WO2022214043A1 - 一种多手势交互带有振动反馈触控方向盘控制系统 - Google Patents

一种多手势交互带有振动反馈触控方向盘控制系统 Download PDF

Info

Publication number
WO2022214043A1
WO2022214043A1 PCT/CN2022/085654 CN2022085654W WO2022214043A1 WO 2022214043 A1 WO2022214043 A1 WO 2022214043A1 CN 2022085654 W CN2022085654 W CN 2022085654W WO 2022214043 A1 WO2022214043 A1 WO 2022214043A1
Authority
WO
WIPO (PCT)
Prior art keywords
steering wheel
vibration
touch
vibration feedback
feedback logic
Prior art date
Application number
PCT/CN2022/085654
Other languages
English (en)
French (fr)
Inventor
彭方强
王平
Original Assignee
浙江吉利控股集团有限公司
宁波吉利汽车研究开发有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 浙江吉利控股集团有限公司, 宁波吉利汽车研究开发有限公司 filed Critical 浙江吉利控股集团有限公司
Priority to EP22784109.5A priority Critical patent/EP4275981A1/en
Publication of WO2022214043A1 publication Critical patent/WO2022214043A1/zh

Links

Images

Classifications

    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B62—LAND VEHICLES FOR TRAVELLING OTHERWISE THAN ON RAILS
    • B62D—MOTOR VEHICLES; TRAILERS
    • B62D1/00—Steering controls, i.e. means for initiating a change of direction of the vehicle
    • B62D1/02—Steering controls, i.e. means for initiating a change of direction of the vehicle vehicle-mounted
    • B62D1/04—Hand wheels
    • B62D1/046—Adaptations on rotatable parts of the steering wheel for accommodation of switches
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B60—VEHICLES IN GENERAL
    • B60K—ARRANGEMENT OR MOUNTING OF PROPULSION UNITS OR OF TRANSMISSIONS IN VEHICLES; ARRANGEMENT OR MOUNTING OF PLURAL DIVERSE PRIME-MOVERS IN VEHICLES; AUXILIARY DRIVES FOR VEHICLES; INSTRUMENTATION OR DASHBOARDS FOR VEHICLES; ARRANGEMENTS IN CONNECTION WITH COOLING, AIR INTAKE, GAS EXHAUST OR FUEL SUPPLY OF PROPULSION UNITS IN VEHICLES
    • B60K37/00—Dashboards
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B60—VEHICLES IN GENERAL
    • B60K—ARRANGEMENT OR MOUNTING OF PROPULSION UNITS OR OF TRANSMISSIONS IN VEHICLES; ARRANGEMENT OR MOUNTING OF PLURAL DIVERSE PRIME-MOVERS IN VEHICLES; AUXILIARY DRIVES FOR VEHICLES; INSTRUMENTATION OR DASHBOARDS FOR VEHICLES; ARRANGEMENTS IN CONNECTION WITH COOLING, AIR INTAKE, GAS EXHAUST OR FUEL SUPPLY OF PROPULSION UNITS IN VEHICLES
    • B60K35/00—Instruments specially adapted for vehicles; Arrangement of instruments in or on vehicles
    • B60K35/10—Input arrangements, i.e. from user to vehicle, associated with vehicle functions or specially adapted therefor
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B60—VEHICLES IN GENERAL
    • B60K—ARRANGEMENT OR MOUNTING OF PROPULSION UNITS OR OF TRANSMISSIONS IN VEHICLES; ARRANGEMENT OR MOUNTING OF PLURAL DIVERSE PRIME-MOVERS IN VEHICLES; AUXILIARY DRIVES FOR VEHICLES; INSTRUMENTATION OR DASHBOARDS FOR VEHICLES; ARRANGEMENTS IN CONNECTION WITH COOLING, AIR INTAKE, GAS EXHAUST OR FUEL SUPPLY OF PROPULSION UNITS IN VEHICLES
    • B60K35/00—Instruments specially adapted for vehicles; Arrangement of instruments in or on vehicles
    • B60K35/20—Output arrangements, i.e. from vehicle to user, associated with vehicle functions or specially adapted therefor
    • B60K35/25—Output arrangements, i.e. from vehicle to user, associated with vehicle functions or specially adapted therefor using haptic output
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B62—LAND VEHICLES FOR TRAVELLING OTHERWISE THAN ON RAILS
    • B62D—MOTOR VEHICLES; TRAILERS
    • B62D1/00—Steering controls, i.e. means for initiating a change of direction of the vehicle
    • B62D1/02—Steering controls, i.e. means for initiating a change of direction of the vehicle vehicle-mounted
    • B62D1/04—Hand wheels
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/016—Input arrangements with force or tactile feedback as computer generated output to the user
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/03—Arrangements for converting the position or the displacement of a member into a coded form
    • G06F3/041—Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0487—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser
    • G06F3/0488—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0487—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser
    • G06F3/0488—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures
    • G06F3/04883—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures for inputting data by handwriting, e.g. gesture or text
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B60—VEHICLES IN GENERAL
    • B60K—ARRANGEMENT OR MOUNTING OF PROPULSION UNITS OR OF TRANSMISSIONS IN VEHICLES; ARRANGEMENT OR MOUNTING OF PLURAL DIVERSE PRIME-MOVERS IN VEHICLES; AUXILIARY DRIVES FOR VEHICLES; INSTRUMENTATION OR DASHBOARDS FOR VEHICLES; ARRANGEMENTS IN CONNECTION WITH COOLING, AIR INTAKE, GAS EXHAUST OR FUEL SUPPLY OF PROPULSION UNITS IN VEHICLES
    • B60K2360/00—Indexing scheme associated with groups B60K35/00 or B60K37/00 relating to details of instruments or dashboards
    • B60K2360/143—Touch sensitive instrument input devices
    • B60K2360/1434—Touch panels
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B60—VEHICLES IN GENERAL
    • B60K—ARRANGEMENT OR MOUNTING OF PROPULSION UNITS OR OF TRANSMISSIONS IN VEHICLES; ARRANGEMENT OR MOUNTING OF PLURAL DIVERSE PRIME-MOVERS IN VEHICLES; AUXILIARY DRIVES FOR VEHICLES; INSTRUMENTATION OR DASHBOARDS FOR VEHICLES; ARRANGEMENTS IN CONNECTION WITH COOLING, AIR INTAKE, GAS EXHAUST OR FUEL SUPPLY OF PROPULSION UNITS IN VEHICLES
    • B60K2360/00—Indexing scheme associated with groups B60K35/00 or B60K37/00 relating to details of instruments or dashboards
    • B60K2360/143—Touch sensitive instrument input devices
    • B60K2360/1446—Touch switches
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B60—VEHICLES IN GENERAL
    • B60K—ARRANGEMENT OR MOUNTING OF PROPULSION UNITS OR OF TRANSMISSIONS IN VEHICLES; ARRANGEMENT OR MOUNTING OF PLURAL DIVERSE PRIME-MOVERS IN VEHICLES; AUXILIARY DRIVES FOR VEHICLES; INSTRUMENTATION OR DASHBOARDS FOR VEHICLES; ARRANGEMENTS IN CONNECTION WITH COOLING, AIR INTAKE, GAS EXHAUST OR FUEL SUPPLY OF PROPULSION UNITS IN VEHICLES
    • B60K2360/00—Indexing scheme associated with groups B60K35/00 or B60K37/00 relating to details of instruments or dashboards
    • B60K2360/146—Instrument input by gesture
    • B60K2360/1468—Touch gesture
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B60—VEHICLES IN GENERAL
    • B60K—ARRANGEMENT OR MOUNTING OF PROPULSION UNITS OR OF TRANSMISSIONS IN VEHICLES; ARRANGEMENT OR MOUNTING OF PLURAL DIVERSE PRIME-MOVERS IN VEHICLES; AUXILIARY DRIVES FOR VEHICLES; INSTRUMENTATION OR DASHBOARDS FOR VEHICLES; ARRANGEMENTS IN CONNECTION WITH COOLING, AIR INTAKE, GAS EXHAUST OR FUEL SUPPLY OF PROPULSION UNITS IN VEHICLES
    • B60K2360/00—Indexing scheme associated with groups B60K35/00 or B60K37/00 relating to details of instruments or dashboards
    • B60K2360/16—Type of output information
    • B60K2360/164—Infotainment
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B60—VEHICLES IN GENERAL
    • B60K—ARRANGEMENT OR MOUNTING OF PROPULSION UNITS OR OF TRANSMISSIONS IN VEHICLES; ARRANGEMENT OR MOUNTING OF PLURAL DIVERSE PRIME-MOVERS IN VEHICLES; AUXILIARY DRIVES FOR VEHICLES; INSTRUMENTATION OR DASHBOARDS FOR VEHICLES; ARRANGEMENTS IN CONNECTION WITH COOLING, AIR INTAKE, GAS EXHAUST OR FUEL SUPPLY OF PROPULSION UNITS IN VEHICLES
    • B60K2360/00—Indexing scheme associated with groups B60K35/00 or B60K37/00 relating to details of instruments or dashboards
    • B60K2360/77—Instrument locations other than the dashboard
    • B60K2360/782—Instrument locations other than the dashboard on the steering wheel
    • Y—GENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
    • Y02—TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
    • Y02P—CLIMATE CHANGE MITIGATION TECHNOLOGIES IN THE PRODUCTION OR PROCESSING OF GOODS
    • Y02P90/00—Enabling technologies with a potential contribution to greenhouse gas [GHG] emissions mitigation
    • Y02P90/02—Total factory control, e.g. smart factories, flexible manufacturing systems [FMS] or integrated manufacturing systems [IMS]

Definitions

  • the invention relates to the technical field of automobile steering wheels, in particular to a multi-gesture interactive touch steering wheel control system with vibration feedback.
  • the multi-function steering wheel key switch is an important human-computer interaction control center of the vehicle, integrating multimedia control and combination instrument information center control, as well as the opening and adjustment of intelligent driving related functions.
  • the key switch is basically a physical key, which is output from the early analog quantity. , developed into a digital switch with LIN communication.
  • the present invention is introduced to support pressing, sliding, special gestures, handwriting, etc. It adopts CAN communication and has a digital touch switch with vibration feedback. Through the deep integration of hardware and software, it can effectively solve the problem. There is no mechanical travel touch feedback, which significantly improves the touch experience, especially for driving scenarios, providing users with an efficient, safe and comfortable car experience;
  • the interaction method is single, only pressing, does not support sliding, special gestures, by pressing the physical switch, leaving a travel space under the switch for pressing;
  • the purpose of the present invention is to provide a multi-gesture interactive touch steering wheel control system with vibration feedback in order to overcome the above-mentioned defects of the prior art.
  • a multi-gesture interactive touch steering wheel control system with vibration feedback includes an integrated entertainment host, the integrated entertainment host is respectively connected with an interface interaction module and a touch steering wheel switch module, wherein:
  • the touch steering wheel switch module is used to collect and send the touch coordinates of pressing or sliding to the integrated entertainment host;
  • the integrated entertainment host is used to analyze the received touch coordinates in combination with the HMI interface interaction scene displayed by the interface interaction module, generate an interface interaction change instruction, and send the interface interaction change instruction to the corresponding interface interaction change instruction.
  • an interface interaction module which presents a corresponding interface recognition rendering result through the interface interaction module, and simultaneously sends a vibration feedback command to the touch steering wheel switch module, so that the touch steering wheel switch module generates corresponding vibration feedback logic;
  • the interface interaction module is used to present the corresponding interface identification rendering result.
  • the interface interaction module includes a head-up display screen, a combined instrument screen and a large central control screen, and the head-up display screen, the combined instrument screen and the large central control screen respectively adopt different communication protocols to communicate with the integrated entertainment host. communication connection.
  • the described communication protocol includes the transmission of coordinates and control signals for the square control and the integrated entertainment host, and the CAN HS-500kb/s communication protocol of the serial communication protocol bus is transmitted at 500kb/s; Transmission of video, audio and control signals of entertainment host and instrument, head-up display, GMSL-2.5Gbit/s communication protocol of serial communication protocol bus at 2.5Gbit/s; and for integrated entertainment host and central control large screen
  • the transmission of video and control signals, the GMSL2-6Gbit/s communication protocol of the serial communication protocol bus is transmitted at 6Gbit/s.
  • the touch control steering wheel switch module includes a steering wheel touch panel, a pressure sensor and a vibration motor built into the steering wheel touch panel, wherein:
  • the steering wheel touchpad is used to receive and collect touch coordinates corresponding to different interactive operation actions
  • the pressure sensor is used to trigger vibration feedback when a set threshold is reached according to the pressure change on the steering wheel touchpad in different scenarios;
  • the vibration motor is used to vibrate according to the corresponding vibration feedback logic.
  • the vibration feedback logic includes short press tactile vibration feedback logic, long press tactile vibration feedback logic, invalid press tactile vibration feedback logic, sliding and special gesture tactile vibration feedback logic and handwriting tactile vibration feedback logic, wherein:
  • the short-pressing tactile vibration feedback logic specifically includes: first, when the pressure value received by the pressure sensor changes from 0 to a set threshold X, triggering the vibration motor to vibrate once, and then, when the pressure When the pressure value received by the sensor drops to X-2, the vibration motor is triggered to vibrate once again;
  • the long-press tactile vibration feedback logic specifically includes: first, when the pressure value received by the pressure sensor changes from 0 to a set threshold X, triggering the vibration motor to vibrate, and then triggering the integrated entertainment When the host determines that it is a single or multiple activation event, the vibration motor is triggered to vibrate once or continuously. Finally, when the pressure value received by the pressure sensor drops to X-2, the vibration motor is triggered again. vibration;
  • the invalid pressing tactile vibration feedback logic specifically includes: when the integrated entertainment host determines that the user is operating an invalid vibration scene, that is, the song list has been slid to the bottom, and when sliding down is determined to be invalid sliding, the vibration is activated.
  • the instruction causes the vibration motor in the steering wheel touchpad to vibrate;
  • the sliding and special gesture tactile vibration feedback logic specifically includes: based on the relative coordinates between the finger sliding start point position and the release point position on the steering wheel touch panel, the integrated entertainment host determines and recognizes the sliding operation as a sliding operation. Then trigger the vibration motor to vibrate, or when a special gesture trajectory operation is performed with a finger on the steering wheel touch panel, the integrated entertainment host determines and recognizes the special gesture and triggers the vibration motor to vibrate;
  • the handwriting tactile vibration feedback logic specifically includes: based on the relative coordinates between the handwriting start point position and the release point position of the finger on the steering wheel touch panel, the integrated entertainment host determines and recognizes that it is a handwriting operation.
  • the vibration motor vibrates.
  • the present invention also provides a touch steering wheel control method based on the multi-gesture interaction with vibration feedback touch steering wheel control system, the method comprising:
  • the touch coordinates combined with the HMI interface interaction scene displayed by the interface interaction module, it is analyzed in the integrated entertainment host, an interface interaction change instruction is generated, and an interface interaction change instruction is sent to the corresponding interface interaction module, which presents the corresponding interface recognition and rendering result through the interface interaction module, and at the same time sends a vibration feedback command to the touch steering wheel switch module, so that the touch steering wheel switch module generates corresponding vibration feedback logic.
  • the touch-control steering wheel switch module includes a steering wheel touch panel, a pressure sensor and a vibration motor built into the steering wheel touch panel, wherein:
  • the steering wheel touchpad is used to receive and collect touch coordinates corresponding to different interactive operation actions
  • the pressure sensor is used to trigger vibration feedback when a set threshold is reached according to the pressure change on the steering wheel touchpad in different scenarios;
  • the vibration motor is used to vibrate according to the corresponding vibration feedback logic.
  • the interface interaction module includes a head-up display screen, a combination instrument screen and a large central control screen, and the head-up display screen, the combination instrument screen and the central control large screen respectively adopt different
  • the communication protocol is communicatively connected with the integrated entertainment host, and the communication protocol includes the transmission of coordinates and control signals for the square control and the integrated entertainment host, and the CAN HS-500kb serial communication protocol bus is transmitted at 500kb/s.
  • GMSL-2.5Gbit/s communication protocol for the transmission of video, audio and control signals of the integrated entertainment host and instrument, head-up display, and serial communication protocol bus at 2.5Gbit/s; and for The transmission of video and control signals between the integrated entertainment host and the central control large screen transmits the GMSL2-6Gbit/s communication protocol of the serial communication protocol bus at 6Gbit/s.
  • the vibration feedback logic includes short press haptic vibration feedback logic, long press haptic vibration feedback logic, invalid press haptic vibration feedback logic, sliding and special gesture haptic vibration feedback logic, and handwriting haptic feedback logic.
  • Vibration feedback logic where:
  • the short-pressing tactile vibration feedback logic specifically includes: first, when the pressure value received by the pressure sensor changes from 0 to a set threshold X, triggering the vibration motor to vibrate once, and then, when the pressure When the pressure value received by the sensor drops to X-2, the vibration motor is triggered to vibrate once again;
  • the long-press tactile vibration feedback logic specifically includes: first, when the pressure value received by the pressure sensor changes from 0 to a set threshold X, triggering the vibration motor to vibrate, and then triggering the integrated entertainment When the host determines that it is a single or multiple activation event, the vibration motor is triggered to vibrate once or continuously. Finally, when the pressure value received by the pressure sensor drops to X-2, the vibration motor is triggered again. vibration;
  • the invalid pressing tactile vibration feedback logic specifically includes: when the integrated entertainment host determines that the user is operating an invalid vibration scene, that is, the song list has been slid to the bottom, and when sliding down is determined to be invalid sliding, the vibration is activated.
  • the instruction causes the vibration motor in the steering wheel touchpad to vibrate;
  • the sliding and special gesture tactile vibration feedback logic specifically includes: based on the relative coordinates between the finger sliding start point position and the release point position on the steering wheel touch panel, the integrated entertainment host determines and recognizes the sliding operation as a sliding operation. Then trigger the vibration motor to vibrate, or when a special gesture trajectory operation is performed with a finger on the steering wheel touch panel, the integrated entertainment host determines and recognizes the special gesture and triggers the vibration motor to vibrate;
  • the handwriting tactile vibration feedback logic specifically includes: based on the relative coordinates between the handwriting start point position and the release point position of the finger on the steering wheel touch panel, the integrated entertainment host determines and recognizes that it is a handwriting operation.
  • the vibration motor vibrates.
  • the present invention also provides an automobile, which includes the multi-gesture interactive touch steering wheel control system with vibration feedback.
  • the present invention has the following advantages:
  • This intelligent touch steering wheel control system can instruct the vehicle to perform the operation you want through pressing and multi-gestures.
  • various operations can be performed in different interaction scenarios.
  • the methods include short press, long press, left and right sliding, up and down sliding, special gestures and handwriting functions of the left and right steering wheel key switches.
  • the integrated related functions include not only the steering wheel height, the adjustment of the exterior mirrors, the head-up display and other driving-related functions, but also multimedia, Air conditioning, voice, telephone, navigation, intelligent driving adjustment, feedback methods include tactile vibration feedback, visual feedback, sound feedback, supporting the iterative increase of functions throughout the life cycle;
  • the present invention enhances the splash-proof, water-proof and dust-proof performance of the steering wheel control switch because there is no physical gap;
  • the tactile vibration feedback of the present invention is to strengthen and supplement the visual and auditory effects, and can improve the user's sensory experience;
  • the steering wheel touchpad of the present invention supports the iterative increase of full life cycle functions, including single finger, such as VW O Z S LJ U n swipe gesture, two-finger inward/outward/left/right swipe, three-finger inward, It also includes left and right interactions, such as drawing circles with the left hand and drawing circles with the right hand, etc. These gestures support different functions.
  • FIG. 1 is a system network topology diagram in an embodiment of the present invention
  • FIG. 3 is a schematic diagram of a short-press tactile vibration feedback logic in an embodiment of the present invention, wherein FIG. 3(a) is a schematic diagram of a short-press event, and FIG. 3(b) is an exploded schematic diagram of a short-press tactile feedback;
  • FIG. 4 is a schematic diagram of a long-press haptic vibration feedback logic in an embodiment of the present invention, wherein FIG. 4(a) is a schematic diagram of a long-press event, and FIG. 4(b) is a schematic diagram of an exploded long-press haptic feedback;
  • FIG. 5 is a logical schematic diagram of invalid pressing tactile vibration feedback in an embodiment of the present invention, wherein FIG. 5( a ) is a schematic diagram of an invalid event, FIG. 5( b ) is a schematic diagram of a song list, and FIG. 5( c ) is a schematic diagram of the decomposition of invalid haptic feedback ;
  • FIG. 6 is a logical schematic diagram of sliding and special gesture haptic vibration feedback in an embodiment of the present invention, wherein FIG. 6(a) is a schematic diagram of sliding and special gesture events, and FIG. 6(b) is a schematic diagram of sliding and special gesture confirmation decomposition haptic feedback decomposition .
  • horizontal does not imply that a component is required to be absolutely horizontal or overhang, but rather may be slightly inclined.
  • horizontal only means that its direction is more horizontal than “vertical”, it does not mean that the structure must be completely horizontal, but can be slightly inclined.
  • the terms “arranged”, “installed”, “connected” and “connected” should be understood in a broad sense, for example, it may be a fixed connection, It can also be a detachable connection, or an integral connection; it can be a mechanical connection or an electrical connection; it can be a direct connection, or an indirect connection through an intermediate medium, or the internal communication between the two components.
  • the specific meanings of the above terms in the present invention can be understood in specific situations.
  • the present invention provides a steering wheel touch panel (liquid crystal screen/glass, composite material/in-mold insert injection molding, the same below), which supports the ability to execute various functions in different interactive scenarios. Different operations, not only support pressing and sliding, but also have handwriting function;
  • the existing steering wheel buttons have a single interaction mode, and only press the physical switch hard.
  • the present invention provides a steering wheel touchpad that can solve the problem of no mechanical travel space, rich interaction modes, and supports click, long press, left and right sliding, up and down sliding, inertial sliding, and has interesting and technological sense; at the same time, the present invention has tactile vibration feedback, which can provide real tactile feedback to fingertips;
  • pressure sensors under the touchpad of the steering wheel there are pressure sensors under the touchpad of the steering wheel, and one, two or more pressure sensors can be set under one panel.
  • the number of pressure sensors is not limited here to distinguish between pressing and sliding.
  • the touchpad of the steering wheel detects the touch point or sliding area, and transmits its coordinate value to the integrated entertainment host.
  • the entertainment host analyzes the received coordinate value in combination with the current HMI scene, controls the corresponding operation, and sends out
  • the vibration feedback command makes the vibration motor in the steering wheel touchpad vibrate;
  • the linear motor in the touchpad of the steering wheel of the present invention can provide three different intensities of vibration options, such as light vibration, moderate vibration, and severe vibration, which can be set by the user through the central control large screen; It is selected whether to use, that is, a: press vibration only, b: press vibration + release vibration, the user can set it through the central control large screen; the steering wheel touchpad of the present invention supports the iterative increase of full life cycle functions.
  • the left and right touch steering wheel switch modules send pressing or sliding touch coordinates to the integrated entertainment host through the CAN bus, and the integrated entertainment host will The received coordinate values are analyzed in combination with the current head-up display and the interactive scene in the combination instrument screen, and the corresponding operations are controlled, and a vibration feedback command is issued at the same time to make the vibration motor in the steering wheel touchpad vibrate;
  • Integrated entertainment host control the large central control screen, head-up display screen and combination instrument screen in the car, and adjust through the left and right touch steering wheel switch modules;
  • CAN HS-500kb/s A serial communication protocol bus that transmits at 500kb/s, mainly used in the transmission of control signals;
  • GMSL-2.5Gbit/s a serial communication protocol bus that transmits at 2.5Gbit/s, mainly used for the transmission of video, audio and control signals;
  • GMSL2-6Gbit/s a 6Gbit/s serial communication protocol bus, mainly used for the transmission of video, audio and control signals;
  • UART A universal serial data bus used for asynchronous communication.
  • IPCL protocol Generally, the IPCL protocol is used to convert CAN signals to string signals. After the above string signals are parsed by Carservice or App, they are converted into text or image interfaces for users to choose and use. In this way, the original CAN signals are converted into Text or images that users can understand.
  • QNX a microkernel real-time operating system
  • Android A free and open source operating system based on the Linux kernel (excluding GNU components).
  • Software Buffer software cache
  • Click, slide up and down, slide left and right recognition is done in the underlying system of the integrated entertainment console.
  • the idea of the algorithm is to identify the coordinates of the "pressed” and “raised” positions of the steering wheel touchpad, and calculate the relative coordinates of the two positions to judge. Click or slide, and the direction of the slide, mainly through the dotted box on the left in Figure 2,
  • Input HMI receives the coordinates of the click or slide, and transmits the identified information to the System HMI and System HMI in the QNX system through the IPCL protocol
  • the data is processed and sent to the HMI module of the instrument or head-up display, and finally the recognition result is rendered on the corresponding display screen;
  • the Input HMI does not recognize the original touch points sent by the square control, and sends it to the Android's System HMI through UART.
  • the customized interface obtains and recognizes the handwritten information.
  • the recognized text information is sent back to the QNX side through the System HMI, and the trajectory information is directly rendered on the software Buffer.
  • the track information on the software buffer will be displayed and superimposed as the software channel and the instrument or head-up display channel through shared storage, and presented on the instrument or head-up display together;
  • Mainly used to enable/cancel, confirm or short-press adjustment of a function such as voice activation/cancellation, music multimedia playback, pause, folding/opening adjustment of the exterior rearview mirror, short-press haptic feedback: press to vibrate once, release the vibration 1 time.
  • the short press event is judged by the steering wheel touchpad according to the change of its own pressure value.
  • the specific implementation process is as follows:
  • the touchpad When the user presses, the touchpad will vibrate once when the pressure is from 0N (N) to the set threshold (X)N;
  • the pressure sensor in the touchpad receives the pressure value from small to large.
  • the pressure value changes from 0N to the set threshold (X)N
  • the touchpad The vibration motor of the touchpad starts to vibrate. After T1, the user begins to release it.
  • the pressure value drops to the set threshold (X-2)N
  • the time elapsed at this time is T2
  • the vibration motor in the touchpad starts to vibrate again.
  • the vibration duration is T3, as shown in Fig. 3(b).
  • the long-press haptic feedback is mainly divided into two categories: single-event and multiple-event activation during the long-press process.
  • Single-event activation is mainly used for intelligent driving function activation, head-up display adjustment and reset and other functions, and there are filling blocks/progress on the interactive interface. After the user presses, press and hold until the filling block/progress bar is filled, the function is activated at this time, and the vibration feedback;
  • multiple event activation is mainly used for the position adjustment of the exterior rearview mirror, the position adjustment of the head-up display, and the position of the steering column. adjustment, as shown in Figure 4(a);
  • the long-press event pressing down and releasing the touch is consistent with the short-press event, which is judged by the steering wheel touchpad according to the change of its own pressure value, but in the long-press event, press and hold, single and multiple activation events are all determined by the integrated entertainment
  • the host determines and sends a vibration command to the touchpad. As shown in Figure 4(b), the vibration duration T3 is triggered by the integrated entertainment host sending a vibration command;
  • Its trigger invalid event is identified by the integrated entertainment host based on the current HMI interface, triggered, and vibrated by the touchpad.
  • the process is roughly the same as the long-press haptic feedback process. The difference is that the long-press trigger event has a longer activation period.
  • the function can be activated at this time, and then the vibration feedback can be performed once, and the invalid vibration event is pressed by the user.
  • the integrated entertainment host recognizes invalid vibrations, it will continue to send feedback commands to the touchpad to keep the touchpad vibrating until the user releases it, as shown in Figure 5(c).
  • the bottom system of the integrated entertainment host will receive the continuous coordinates of the square control, that is, after it is judged as a valid command in the figure below, the integrated entertainment host sends a vibration command to the touchpad, and the vibration duration is T2, such as As shown in Figure 6(b);
  • Handwritten haptic feedback is the same as swiping.

Landscapes

  • Engineering & Computer Science (AREA)
  • General Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Chemical & Material Sciences (AREA)
  • Combustion & Propulsion (AREA)
  • Transportation (AREA)
  • Mechanical Engineering (AREA)
  • Human Computer Interaction (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • User Interface Of Digital Computer (AREA)
  • Steering Controls (AREA)

Abstract

一种多手势交互带有振动反馈触控方向盘控制系统，该系统包括集成式娱乐主机，集成式娱乐主机分别与界面交互模块、触控方向盘开关模组相连接，其中：触控方向盘开关模组，用于将按压或滑动的触控坐标采集并发送至集成式娱乐主机；集成式娱乐主机，用于将接收的触控坐标，结合界面交互模块展示的HMI界面交互场景进行解析，产生界面交互变化指令，并发送界面交互变化指令至对应的界面交互模块，通过界面交互模块呈现对应界面识别渲染结果，同时向触控方向盘开关模组发出振动反馈指令，使得触控方向盘开关模组产生对应振动反馈逻辑；界面交互模块，用于呈现对应界面识别渲染结果。还公开了一种用于上述方向盘控制系统的控制方法以及一种汽车。本申请有交互方式多样，功能多等优点。

Description

一种多手势交互带有振动反馈触控方向盘控制系统 技术领域
本发明涉及汽车方向盘技术领域，尤其是涉及一种多手势交互带有振动反馈触控方向盘控制系统。
背景技术
目前，多功能方向盘按键开关作为车辆重要的人机交互控制中心，集成多媒体控制和组合仪表信息中心控制，以及智能驾驶相关功能开启与调节，按键开关基本为物理按键，其从早期的模拟量输出，发展成以LIN通讯的数字开关，今天本发明介绍以支持按压，滑动，特殊手势，手写等，采用CAN通讯的、并具有振动反馈数字式触摸开关，通过硬件和软件深度融合，能有效解决没有机械行程触控反馈，显著改善触控体验，尤其针对驾驶场景，为用户提供高效、安全、舒适的用车体验；
针对多功能方向盘按键开关，功能越来越多，交互体验，科技时尚，安全性提升，需要考虑：
1.现有的上市车型方向盘按键开关数量有限，功能单一，不能复用；
2.交互方式单一，只能按压，不支持滑动，特殊手势，通过按压实体开关，开关下方为按压留出行程空间；
3.对于追求品质，科技时尚，没有机械行程的方向盘触摸板开关或是液晶屏触摸板开关，视觉反馈和声音反馈是否足够？是否安全？
4.是否有一种反馈方式可以和动画，声音完美结合，从而增强用户感知？
发明内容
本发明的目的就是为了克服上述现有技术存在的缺陷而提供一种多手势交互带有振动反馈触控方向盘控制系统。
本发明的目的可以通过以下技术方案来实现：
一种多手势交互带有振动反馈触控方向盘控制系统，该系统包括集成式娱乐主机，所述集成式娱乐主机分别与界面交互模块、触控方向盘开关模组相连接，其中：
所述触控方向盘开关模组，用于将按压或滑动的触控坐标采集并发送至所述集成式娱乐主机；
所述集成式娱乐主机，用于将接收的所述触控坐标，结合所述界面交互模块展示的HMI界面交互场景进行解析，产生界面交互变化指令，并发送界面交互变化指令至对应的所述界面交互模块，通过所述界面交互模块呈现对应界面识别渲染结果，同时向所述触控方向盘开关模组发出振动反馈指令，使得所述触控方向盘开关模组产生对应振动反馈逻辑；
所述界面交互模块，用于呈现对应界面识别渲染结果。
进一步地，所述的界面交互模块包括抬头显示器屏、组合仪表屏和中控大屏，所述抬头显示器屏、组合仪表屏和中控大屏分别采用不同的通信协议与所述集成式娱乐主机通信连接。
进一步地，所述的通信协议包括用于方控与集成式娱乐主机的坐标及控制信号的传输，以500kb/s传输串行通讯协议总线的CAN HS-500kb/s通信协议；用于集成式娱乐主机与仪表、抬头显示器的视频、音频及控制信号的传输，以2.5Gbit/s传输串行通讯协议总线的GMSL-2.5Gbit/s通信协议；以及用于集成式娱乐主机与中控大屏的视频、控制信号的传输，以6Gbit/s传输串行通讯协议总线的GMSL2-6Gbit/s通信协议。
进一步地，所述触控方向盘开关模组包括方向盘触摸板以及内置于所述方向盘触摸板中的压力传感器和振动电机，其中：
所述方向盘触摸板，用于接收采集不同交互操作动作所对应的触控坐标；
所述压力传感器，用于在不同情景下根据所述方向盘触摸板上的压力变化，当达到设定阈值时触发振动反馈；
所述振动电机，用于按照对应振动反馈逻辑进行振动。
进一步地，所述振动反馈逻辑包括短按触觉振动反馈逻辑、长按触觉振动反馈逻辑、无效按压触觉振动反馈逻辑、滑动及特殊手势触觉振动反馈逻辑以及手写触觉振动反馈逻辑，其中：
所述短按触觉振动反馈逻辑，具体包括：首先，当所述压力传感器所接收的压力值从0变化至设定阈值X时，触发所述振动电机进行振动1次，然后，当所述 压力传感器所接收的压力值下降至X-2时，触发所述振动电机再次振动1次；
所述长按触觉振动反馈逻辑，具体包括：首先，当所述压力传感器所接收的压力值从0变化至设定阈值X时，触发所述振动电机进行振动，然后，由所述集成式娱乐主机判定为单次或多次激活事件时，对应触发所述振动电机单次振动或持续振动，最终，当所述压力传感器所接收的压力值下降至X-2时，触发所述振动电机再次振动；
所述无效按压触觉振动反馈逻辑，具体包括：由所述集成式娱乐主机判定为用户正在操作无效振动场景，即歌曲列表已滑动至最底端，再向下滑动判定为无效滑动时，发动振动指令使得所述方向盘触摸板内的振动电机振动；
所述滑动及特殊手势触觉振动反馈逻辑，具体包括：针对于所述方向盘触摸板上基于手指滑动开始点位置和释放点位置之间的相对坐标，由所述集成式娱乐主机判断识别为滑动操作后触发所述振动电机进行振动，或当于所述方向盘触摸板上通过手指进行特殊手势轨迹操作时，由所述集成式娱乐主机判断识别为特殊手势后触发所述振动电机进行振动；
所述手写触觉振动反馈逻辑，具体包括：针对于所述方向盘触摸板上基于手指手写开始点位置和释放点位置之间的相对坐标，由所述集成式娱乐主机判断识别为手写操作后触发所述振动电机进行振动。
本发明还提供一种基于所述的多手势交互带有振动反馈触控方向盘控制系统的触控方向盘控制方法，该方法包括：
获取所述触控方向盘开关模组被触发的按压或滑动的触控坐标；
根据所述触控坐标，结合所述界面交互模块展示的HMI界面交互场景，于所述集成式娱乐主机中进行解析，产生界面交互变化指令，并发送界面交互变化指令至对应的所述界面交互模块，通过所述界面交互模块呈现对应界面识别渲染结果，同时向所述触控方向盘开关模组发出振动反馈指令，使得所述触控方向盘开关模组产生对应振动反馈逻辑。
进一步地，于该触控方向盘控制方法中，所述触控方向盘开关模组包括方向盘触摸板以及内置于所述方向盘触摸板中的压力传感器和振动电机，其中：
所述方向盘触摸板，用于接收采集不同交互操作动作所对应的触控坐标；
所述压力传感器，用于在不同情景下根据所述方向盘触摸板上的压力变化，当达到设定阈值时触发振动反馈；
所述振动电机，用于按照对应振动反馈逻辑进行振动。
进一步地，于该触控方向盘控制方法中，所述的界面交互模块包括抬头显示器屏、组合仪表屏和中控大屏，所述抬头显示器屏、组合仪表屏和中控大屏分别采用不同的通信协议与所述集成式娱乐主机通信连接，所述的通信协议包括用于方控与集成式娱乐主机的坐标及控制信号的传输，以500kb/s传输串行通讯协议总线的CAN HS-500kb/s通信协议；用于集成式娱乐主机与仪表、抬头显示器的视频、音频及控制信号的传输，以2.5Gbit/s传输串行通讯协议总线的GMSL-2.5Gbit/s通信协议；以及用于集成式娱乐主机与中控大屏的视频、控制信号的传输，以6Gbit/s传输串行通讯协议总线的GMSL2-6Gbit/s通信协议。
进一步地，于该触控方向盘控制方法中，所述振动反馈逻辑包括短按触觉振动反馈逻辑、长按触觉振动反馈逻辑、无效按压触觉振动反馈逻辑、滑动及特殊手势触觉振动反馈逻辑以及手写触觉振动反馈逻辑，其中：
所述短按触觉振动反馈逻辑，具体包括：首先，当所述压力传感器所接收的压力值从0变化至设定阈值X时，触发所述振动电机进行振动1次，然后，当所述压力传感器所接收的压力值下降至X-2时，触发所述振动电机再次振动1次；
所述长按触觉振动反馈逻辑，具体包括：首先，当所述压力传感器所接收的压力值从0变化至设定阈值X时，触发所述振动电机进行振动，然后，由所述集成式娱乐主机判定为单次或多次激活事件时，对应触发所述振动电机单次振动或持续振动，最终，当所述压力传感器所接收的压力值下降至X-2时，触发所述振动电机再次振动；
所述无效按压触觉振动反馈逻辑，具体包括：由所述集成式娱乐主机判定为用户正在操作无效振动场景，即歌曲列表已滑动至最底端，再向下滑动判定为无效滑动时，发动振动指令使得所述方向盘触摸板内的振动电机振动；
所述滑动及特殊手势触觉振动反馈逻辑，具体包括：针对于所述方向盘触摸板上基于手指滑动开始点位置和释放点位置之间的相对坐标，由所述集成式娱乐主机判断识别为滑动操作后触发所述振动电机进行振动，或当于所述方向盘触摸板上通过手指进行特殊手势轨迹操作时，由所述集成式娱乐主机判断识别为特殊手势后触发所述振动电机进行振动；
所述手写触觉振动反馈逻辑，具体包括：针对于所述方向盘触摸板上基于手指手写开始点位置和释放点位置之间的相对坐标，由所述集成式娱乐主机判断识别为 手写操作后触发所述振动电机进行振动。
本发明还提供一种汽车，该汽车包括所述的多手势交互带有振动反馈触控方向盘控制系统。
与现有技术相比，本发明具有以下优点：
(1)本智能触控方向盘控制系统可以通过按压和多手势，指示车辆执行你想要的操作，通过此触控方向盘控制面板，就能在不同的交互场景中执行各种不同的操作，交互方式包括左右方向盘按键开关短按，长按，左右滑动，上下滑动，特殊手势和手写功能，集成相关功能不仅包括方向盘高度，外后视镜，抬头显示器的调节等驾驶相关功能，还包括多媒体，空调，语音，电话，导航，智能驾驶调节，反馈方式包括触觉振动反馈，视觉反馈，声音反馈，支持全生命周期功能迭代增加；
(2)本发明扩展了物理按键开关的功能；
(3)交互方式丰富，支持点按，长按，左右滑动，上下滑动，惯性滑动，特殊手势，操作时有趣味性和科技感；
(4)支持手写，更方便快捷的搜素到歌曲名和通讯录人名，导航地名；
(5)同现有的物理按键开关相比，本发明因为没有物理间隙，增强了方向盘控制开关防溅抗水防尘性能；
(6)使用不同的振动强度代替了之前的按压，让体验变得更加微妙；
(7)对于不同的界面元素(填充块/进度条，开关/滑块)，会在用户与其交互成功的一瞬间，会随着音效产生与之完全同步的振动，瞬间给用户一种心灵上的迷之爽快；
(8)本发明触觉振动反馈是对视觉、听觉效果的强化和补充，能提升用户感官体验；
(9)本发明方向盘触摸板支持全生命周期功能迭代增加，包括单指，如V W O Z S LJ U n★滑动手势，双指向内/向外/左滑/右滑，三指向内，还包括左右互动，如左手画圈、右手画圆等，这些手势支持不同功能。
附图说明
为了更清楚地说明本发明实施例的技术方案，下面将对实施例中所需要使用的附图作简单地介绍，应当理解，以下附图仅示出了本发明的某些实施例，因此不应被看作是对范围的限定，对于本领域普通技术人员来讲，在不付出创造性劳动的 前提下，还可以根据这些附图获得其他相关的附图。
图1为本发明实施例中的系统网络拓补图；
图2为本发明实施例中的系统逻辑框图；
图3为本发明实施例中的短按触觉振动反馈逻辑示意图，其中，图3(a)为短按事件示意图，图3(b)为短按触觉反馈分解示意图；
图4为本发明实施例中的长按触觉振动反馈逻辑示意图，其中，图4(a)为长按事件示意图，图4(b)为长按触觉反馈分解示意图；
图5为本发明实施例中的无效按压触觉振动反馈逻辑示意图，其中，图5(a)为无效事件示意图，图5(b)为歌曲列表示意图，图5(c)为无效触觉反馈分解示意图；
图6为本发明实施例中的滑动及特殊手势触觉振动反馈逻辑示意图，其中，图6(a)为滑动和特殊手势事件示意图，图6(b)为滑动和特殊手势确认分解触觉反馈分解示意图。
具体实施方式
下面将结合本发明实施例中的附图，对本发明实施例中的技术方案进行清楚、完整地描述，显然，所描述的实施例是本发明的一部分实施例，而不是全部实施例。基于本发明中的实施例，本领域普通技术人员在没有做出创造性劳动的前提下所获得的所有其他实施例，都应属于本发明保护的范围。
因此，以下对在附图中提供的本发明的实施例的详细描述并非旨在限制要求保护的本发明的范围，而是仅仅表示本发明的选定实施例。基于本发明中的实施例，本领域普通技术人员在没有作出创造性劳动前提下所获得的所有其他实施例，都属于本发明保护的范围。
应注意到：相似的标号和字母在下面的附图中表示类似项，因此，一旦某一项在一个附图中被定义，则在随后的附图中不需要对其进行进一步定义和解释。
在本发明的描述中，需要说明的是，术语“中心”、“上”、“下”、“左”、“右”、“竖直”、“水平”、“内”、“外”等指示的方位或位置关系为基于附图所示的方位或位置关系，或者是该发明产品使用时惯常摆放的方位或位置关系，仅是为了便于描述本发明和简化描述，而不是指示或暗示所指的装置或元件必须具有特定的方位、以特定的方位构造和操作，因此不能理解为对本发明的限制。此外，术语“第一”、 “第二”、“第三”等仅用于区分描述，而不能理解为指示或暗示相对重要性。
此外，术语“水平”、“竖直”等术语并不表示要求部件绝对水平或悬垂，而是可以稍微倾斜。如“水平”仅仅是指其方向相对“竖直”而言更加水平，并不是表示该结构一定要完全水平，而是可以稍微倾斜。
在本发明的描述中，还需要说明的是，除非另有明确的规定和限定，术语“设置”、“安装”、“相连”、“连接”应做广义理解，例如，可以是固定连接，也可以是可拆卸连接，或一体地连接；可以是机械连接，也可以是电连接；可以是直接相连，也可以通过中间媒介间接相连，可以是两个元件内部的连通。对于本领域的普通技术人员而言，可以具体情况理解上述术语在本发明中的具体含义。
本发明针对现有上市车型方向盘按键开关按键数量有限，功能单一等特点，提供方向盘触摸板(液晶屏/玻璃，复合材料/模内镶件注塑下同)，支持在不同交互场景中能执行各种不同的操作，不仅支持按压和滑动，还具备手写功能；
现有方向盘按键交互方式单一，仅用力按压实体开关，本发明提供方向盘触摸板能解决没有机械行程空间，交互方式丰富，支持点按，长按，左右滑动，上下滑动，惯性滑动，操作时有趣味性和科技感；同时本发明具有触觉振动反馈，能给指尖提供真实的触觉反馈；
本发明中方向盘触摸板下有压力传感器，一个面板下可设置1个，2个或多个压力传感器，此处不限压力传感器的数量，用以区分按压还是滑动，当用户按压触控板时，按压力从小到大到达设定阈值时触发振动反馈，释放时检测到压力从大到小到达设定阈值时触发振动反馈；
本发明由方向盘触摸板是通过检测触摸点或滑动区域，将其坐标值传给集成式娱乐主机，娱乐主机将收到的坐标值结合当前的HMI场景进行解析，并控制相应的操作，同时发出振动反馈指令，让方向盘触摸板内振动电机振动；
本发明方向盘触摸板内的线性电机能提供较轻的振动，中度振动，重度振动等三种不同强度的振动选择，用户可以通过中控大屏设置；同时本发明方向盘触摸板释放振动反馈可以被选择是否使用，即a：仅按压振动，b：按压振动+释放振动，用户可以通过中控大屏设置；本发明方向盘触摸板支持全生命周期功能迭代增加。
具体实施例
1)系统网络拓扑图：
基于场景振动反馈原理：如图1所述的系统网络拓扑图，左、右侧触控方向盘 开关模组通过CAN总线，将按压或滑动触控坐标发送给集成式娱乐主机，集成式娱乐主机将收到的坐标值结合当前抬头显示器，组合仪表屏内交互场景进行解析，并控制相应的操作，同时发出振动反馈指令，让方向盘触摸板内振动电机振动；
系统网络具体技术细节如下：
集成式娱乐主机：控制车内中控大屏，抬头显示器屏和组合仪表屏，通过左右侧触控方向盘开关模组进行调节；
CAN HS-500kb/s：一种以500kb/s传输串行通讯协议总线，主要应用于控制信号的传输；
GMSL-2.5Gbit/s：一种以2.5Gbit/s传输串行通讯协议总线，主要用于视频，音频和控制信号的传输；
GMSL2-6Gbit/s：一种以6Gbit/s传输串行通讯协议总线，主要用于视频，音频和控制信号的传输；
APP：第三方应用程序
UART：一种通用串行数据总线，用于异步通信。
IPCL协议：一般用IPCL协议进行CAN信号到字符串信号的转换，以上字符串信号经过Carservice或App的解析后，转成文字或者图像的界面供用户选择和使用，这样就把原始CAN信号转成用户能够看得懂的文字或图像。
QNX：一种微内核实时操作系统；
Android：一种基于Linux内核(不包含GNU组件)的自由及开放源代码的操作系统。
软件Buffer：软件缓存；
2)系统逻辑框图：
点按，上下滑动，左右滑动识别是在集成式娱乐主机底层系统完成，算法的思路是：识别出方向盘触摸板“按下”，“抬起”位置坐标，计算两个位置的相对坐标来判断点按还是滑动，以及滑动的方向，主要通过图2中左侧虚线框，Input HMI接收到点按或滑动坐标，并把识别后的信息通过IPCL协议传到QNX系统中的System HMI，System HMI将数据处理后发到仪表或抬头显示器的HMI模块，最后将识别结果渲染在对应的显示屏上；
对于手写及特殊手势，轨迹及识别，使用图2中右侧Android端的APP提供的输入法，Input HMI将方控发过来的原始触摸点不做识别，通过UART发送给 Android的System HMI，APP通过定制化的接口获取手写的信息并识别，识别的文字信息通过System HMI传回QNX端，轨迹信息直接渲染在软件Buffer上，QNX端获取识别后的文字信息，做相应处理渲染在仪表和抬头显示器的通道上，软件Buffer上的轨迹信息会通过共享存储的方式作为软件通道和仪表或抬头显示器通道做显示叠加，一起呈现在仪表或抬头显示器上；
3)触觉反馈实现方案
1、短按触觉反馈
主要用在某项功能开启/取消，确认或短按调节，如语音激活/取消，音乐多媒体播放，暂停，外后视镜的折叠/打开调节，短按触觉反馈：按压振动1次，释放振动1次。
短按事件由方向盘触控板根据自身压力值变化判断，具体实现过程如下：
用户按压时，触控板压力从0N(牛)到设定阈值(X)N时，振动1次；
用户释放时，触控板压力降到设定阈值(X-2)N时，振动1次，如图3(a)所示；
短按触觉反馈，当用户在T0时刻按压时，触控板内的压力传感器接受到压力值由小到大的变化，当压力值从0N到设定阈值(X)N时，触控板内的振动电机开始振动，持续T1时刻后，用户开始释放，当压力值降到设定阈值(X-2)N时，此时经历的时长为T2，触控板内的振动电机再次开始振动，振动时长为T3，如图3(b)所示。
2、长按触觉反馈
长按触觉反馈主要分为二类：长按过程中单次事件和多次事件激活，单次事件激活主要用在智能驾驶功能激活，抬头显示器调节复位等功能，交互界面上有填充块/进度条，用户按压后，按住保持，待填充块/进度条填充完，此时功能激活，振动反馈；多次事件激活主要用于外后视镜位置调节，抬头显示器位置调节，方向盘管柱位置调节，如图4(a)所示；
长按单次事件激活触觉反馈：按压振动1次，事件激活振动1次，释放振动1次。
长按多次事件激活触觉反馈：按压振动1次，事件激活持续振动直至释放，释放振动1次。
长按事件压下触觉和释放触觉与短按事件一致，均由方向盘触控板根据自身压 力值变化判断，但长按事件中，按住保持，单次和多次激活事件均由集成式娱乐主机判断，并发振动指令给触控板，如图4(b)所示，振动时长T3是由集成式娱乐主机发振动指令触发的；
3、无效按压触觉反馈
区分正常按压，用户操作触控板时，如图5(a)所示，遇到无效事件后，触发振动反馈，并传达用户操作了“错误”的信息，如图5(b)所示，歌曲列表已经到最底端，再按向下键，就会触发“无效”操作振动反馈；
其触发无效事件由集成式娱乐主机基于当前HMI界面进行识别，触发，由触控板振动。其过程与长按触觉反馈过程大致相同，不同在于长按触发事件激活周期较长，待填充块/进度条填充完，此时功能激活，才能振动反馈1次，而无效振动事件由用户按压，集成式娱乐主机识别到无效振动，则会持续给触控板发反馈指令，让触控板持续振动，直到用户释放为止，如图5(c)所示。
4、滑动及特殊手势触觉反馈
滑动和特殊手势分解如图6(a)所示，如上文所述，滑动识别通过计算滑动开始点和释放点两个位置的相对坐标来判断，当此命令有效时进行振动反馈；当用户操作特殊手势时，如通过手指进行“○”，“√”，“Z”，“N”等，当此手势完成时，触发相应操作，触摸板进行振动反馈；
滑动事件和特殊手势事件，集成式娱乐主机底层系统会收到方控的连续坐标，即下图中判断为有效命令后，集成式娱乐主机发振动指令给触控板，振动时长为T2，如图6(b)所示；
5、手写触觉反馈
手写触觉反馈同滑动。
以上所述，仅为本发明的具体实施方式，但本发明的保护范围并不局限于此，任何熟悉本技术领域的技术人员在本发明揭露的技术范围内，可轻易想到各种等效的修改或替换，这些修改或替换都应涵盖在本发明的保护范围之内。因此，本发明的保护范围应以权利要求的保护范围为准。

Claims (10)

  1. 一种多手势交互带有振动反馈触控方向盘控制系统，其特征在于，该系统包括集成式娱乐主机，所述集成式娱乐主机分别与界面交互模块、触控方向盘开关模组相连接，其中：
    所述触控方向盘开关模组，用于将按压或滑动的触控坐标采集并发送至所述集成式娱乐主机；
    所述集成式娱乐主机，用于将接收的所述触控坐标，结合所述界面交互模块展示的HMI界面交互场景进行解析，产生界面交互变化指令，并发送界面交互变化指令至对应的所述界面交互模块，通过所述界面交互模块呈现对应界面识别渲染结果，同时向所述触控方向盘开关模组发出振动反馈指令，使得所述触控方向盘开关模组产生对应振动反馈逻辑；
    所述界面交互模块，用于呈现对应界面识别渲染结果。
  2. 根据权利要求1所述的一种多手势交互带有振动反馈触控方向盘控制系统，其特征在于，所述的界面交互模块包括抬头显示器屏、组合仪表屏和中控大屏，所述抬头显示器屏、组合仪表屏和中控大屏分别采用不同的通信协议与所述集成式娱乐主机通信连接。
  3. 根据权利要求2所述的一种多手势交互带有振动反馈触控方向盘控制系统，其特征在于，所述的通信协议包括用于方控与集成式娱乐主机的坐标及控制信号的传输，以500kb/s传输串行通讯协议总线的CAN HS-500kb/s通信协议；用于集成式娱乐主机与仪表、抬头显示器的视频、音频及控制信号的传输，以2.5Gbit/s传输串行通讯协议总线的GMSL-2.5Gbit/s通信协议；以及用于集成式娱乐主机与中控大屏的视频、控制信号的传输，以6Gbit/s传输串行通讯协议总线的GMSL2-6Gbit/s通信协议。
  4. 根据权利要求1所述的一种多手势交互带有振动反馈触控方向盘控制系统，其特征在于，所述触控方向盘开关模组包括方向盘触摸板以及内置于所述方向盘触摸板中的压力传感器和振动电机，其中：
    所述方向盘触摸板，用于接收采集不同交互操作动作所对应的触控坐标；
    所述压力传感器，用于在不同情景下根据所述方向盘触摸板上的压力变化，当 达到设定阈值时触发振动反馈；
    所述振动电机，用于按照对应振动反馈逻辑进行振动。
  5. 根据权利要求4所述的一种多手势交互带有振动反馈触控方向盘控制系统，其特征在于，所述振动反馈逻辑包括短按触觉振动反馈逻辑、长按触觉振动反馈逻辑、无效按压触觉振动反馈逻辑、滑动及特殊手势触觉振动反馈逻辑以及手写触觉振动反馈逻辑，其中：
    所述短按触觉振动反馈逻辑，具体包括：首先，当所述压力传感器所接收的压力值从0变化至设定阈值X时，触发所述振动电机进行振动1次，然后，当所述压力传感器所接收的压力值下降至X-2时，触发所述振动电机再次振动1次；
    所述长按触觉振动反馈逻辑，具体包括：首先，当所述压力传感器所接收的压力值从0变化至设定阈值X时，触发所述振动电机进行振动，然后，由所述集成式娱乐主机判定为单次或多次激活事件时，对应触发所述振动电机单次振动或持续振动，最终，当所述压力传感器所接收的压力值下降至X-2时，触发所述振动电机再次振动；
    所述无效按压触觉振动反馈逻辑，具体包括：由所述集成式娱乐主机判定为用户正在操作无效振动场景，即歌曲列表已滑动至最底端，再向下滑动判定为无效滑动时，发动振动指令使得所述方向盘触摸板内的振动电机振动；
    所述滑动及特殊手势触觉振动反馈逻辑，具体包括：针对于所述方向盘触摸板上基于手指滑动开始点位置和释放点位置之间的相对坐标，由所述集成式娱乐主机判断识别为滑动操作后触发所述振动电机进行振动，或当于所述方向盘触摸板上通过手指进行特殊手势轨迹操作时，由所述集成式娱乐主机判断识别为特殊手势后触发所述振动电机进行振动；
    所述手写触觉振动反馈逻辑，具体包括：针对于所述方向盘触摸板上基于手指手写开始点位置和释放点位置之间的相对坐标，由所述集成式娱乐主机判断识别为手写操作后触发所述振动电机进行振动。
  6. 一种基于如权利要求1至5中任一项所述的多手势交互带有振动反馈触控方向盘控制系统的触控方向盘控制方法，其特征在于，该方法包括：
    获取所述触控方向盘开关模组被触发的按压或滑动的触控坐标；
    根据所述触控坐标，结合所述界面交互模块展示的HMI界面交互场景，于所述集成式娱乐主机中进行解析，产生界面交互变化指令，并发送界面交互变化指令 至对应的所述界面交互模块，通过所述界面交互模块呈现对应界面识别渲染结果，同时向所述触控方向盘开关模组发出振动反馈指令，使得所述触控方向盘开关模组产生对应振动反馈逻辑。
  7. 根据如权利要求6所述的一种基于所述的多手势交互带有振动反馈触控方向盘控制系统的触控方向盘控制方法，其特征在于，所述触控方向盘开关模组包括方向盘触摸板以及内置于所述方向盘触摸板中的压力传感器和振动电机，其中：
    所述方向盘触摸板，用于接收采集不同交互操作动作所对应的触控坐标；
    所述压力传感器，用于在不同情景下根据所述方向盘触摸板上的压力变化，当达到设定阈值时触发振动反馈；
    所述振动电机，用于按照对应振动反馈逻辑进行振动。
  8. 根据如权利要求6所述的一种基于所述的多手势交互带有振动反馈触控方向盘控制系统的触控方向盘控制方法，其特征在于，所述的界面交互模块包括抬头显示器屏、组合仪表屏和中控大屏，所述抬头显示器屏、组合仪表屏和中控大屏分别采用不同的通信协议与所述集成式娱乐主机通信连接，所述的通信协议包括用于方控与集成式娱乐主机的坐标及控制信号的传输，以500kb/s传输串行通讯协议总线的CAN HS-500kb/s通信协议；用于集成式娱乐主机与仪表、抬头显示器的视频、音频及控制信号的传输，以2.5Gbit/s传输串行通讯协议总线的GMSL-2.5Gbit/s通信协议；以及用于集成式娱乐主机与中控大屏的视频、控制信号的传输，以6Gbit/s传输串行通讯协议总线的GMSL2-6Gbit/s通信协议。
  9. 根据如权利要求7所述的一种基于所述的多手势交互带有振动反馈触控方向盘控制系统的触控方向盘控制方法，其特征在于，所述振动反馈逻辑包括短按触觉振动反馈逻辑、长按触觉振动反馈逻辑、无效按压触觉振动反馈逻辑、滑动及特殊手势触觉振动反馈逻辑以及手写触觉振动反馈逻辑，其中：
    所述短按触觉振动反馈逻辑，具体包括：首先，当所述压力传感器所接收的压力值从0变化至设定阈值X时，触发所述振动电机进行振动1次，然后，当所述压力传感器所接收的压力值下降至X-2时，触发所述振动电机再次振动1次；
    所述长按触觉振动反馈逻辑，具体包括：首先，当所述压力传感器所接收的压力值从0变化至设定阈值X时，触发所述振动电机进行振动，然后，由所述集成式娱乐主机判定为单次或多次激活事件时，对应触发所述振动电机单次振动或持续振动，最终，当所述压力传感器所接收的压力值下降至X-2时，触发所述振动电 机再次振动；
    所述无效按压触觉振动反馈逻辑，具体包括：由所述集成式娱乐主机判定为用户正在操作无效振动场景，即歌曲列表已滑动至最底端，再向下滑动判定为无效滑动时，发动振动指令使得所述方向盘触摸板内的振动电机振动；
    所述滑动及特殊手势触觉振动反馈逻辑，具体包括：针对于所述方向盘触摸板上基于手指滑动开始点位置和释放点位置之间的相对坐标，由所述集成式娱乐主机判断识别为滑动操作后触发所述振动电机进行振动，或当于所述方向盘触摸板上通过手指进行特殊手势轨迹操作时，由所述集成式娱乐主机判断识别为特殊手势后触发所述振动电机进行振动；
    所述手写触觉振动反馈逻辑，具体包括：针对于所述方向盘触摸板上基于手指手写开始点位置和释放点位置之间的相对坐标，由所述集成式娱乐主机判断识别为手写操作后触发所述振动电机进行振动。
  10. 一种汽车，其特征在于，该汽车包括如权利要求1至5中任一项所述的多手势交互带有振动反馈触控方向盘控制系统。
PCT/CN2022/085654 2021-04-08 2022-04-07 一种多手势交互带有振动反馈触控方向盘控制系统 WO2022214043A1 (zh)

Priority Applications (1)

Application Number Priority Date Filing Date Title
EP22784109.5A EP4275981A1 (en) 2021-04-08 2022-04-07 Multi-gesture interaction touch steering wheel control system having vibration feedback

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN202110378461.2A CN113085550B (zh) 2021-04-08 2021-04-08 一种多手势交互带有振动反馈触控方向盘控制系统
CN202110378461.2 2021-04-08

Publications (1)

Publication Number Publication Date
WO2022214043A1 true WO2022214043A1 (zh) 2022-10-13

Family

ID=76675284

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2022/085654 WO2022214043A1 (zh) 2021-04-08 2022-04-07 一种多手势交互带有振动反馈触控方向盘控制系统

Country Status (3)

Country Link
EP (1) EP4275981A1 (zh)
CN (1) CN113085550B (zh)
WO (1) WO2022214043A1 (zh)

Families Citing this family (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN113085550B (zh) * 2021-04-08 2022-08-16 浙江吉利控股集团有限公司 一种多手势交互带有振动反馈触控方向盘控制系统
CN113849114A (zh) * 2021-07-30 2021-12-28 的卢技术有限公司 一种方向盘上基于触控板和线性马达的控制方法及系统
CN114407781B (zh) * 2022-01-28 2024-05-14 中国第一汽车股份有限公司 一种基于压力传感器的后视镜调节方法、装置及车辆
CN116176432B (zh) * 2023-05-04 2023-09-12 长城汽车股份有限公司 车载设备控制方法、装置、车辆和存储介质

Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101989139A (zh) * 2009-08-07 2011-03-23 介面光电股份有限公司 阵列式触觉回馈的触控面板
JP2016199081A (ja) * 2015-04-07 2016-12-01 株式会社日本自動車部品総合研究所 情報提供装置
CN106467065A (zh) * 2015-08-18 2017-03-01 上海汽车集团股份有限公司 方向盘触控装置及方向盘
KR20180074872A (ko) * 2016-12-23 2018-07-04 삼성디스플레이 주식회사 조향 핸들 및 이를 포함하는 차량 제어 시스템
US20180273050A1 (en) * 2014-06-25 2018-09-27 Tomtom International B.V. Vehicular human machine interfaces
CN113085550A (zh) * 2021-04-08 2021-07-09 浙江吉利控股集团有限公司 一种多手势交互带有振动反馈触控方向盘控制系统

Family Cites Families (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN107031697A (zh) * 2016-02-03 2017-08-11 北京汽车股份有限公司 车辆的控制系统
CN107357425A (zh) * 2017-06-29 2017-11-17 珠海市魅族科技有限公司 一种触控反馈装置、电子设备及触控反馈方法
US10817063B2 (en) * 2019-02-11 2020-10-27 Volvo Car Corporation Facilitating interaction with a vehicle touchscreen using haptic feedback
CN112558803A (zh) * 2019-09-26 2021-03-26 北京钛方科技有限责任公司 一种车载触控装置及控制方法、汽车
CN111469908B (zh) * 2020-03-23 2022-10-18 浙江吉利汽车研究院有限公司 一种触控方向盘、控制方法及汽车
CN111625088A (zh) * 2020-04-28 2020-09-04 思特沃克软件技术(北京)有限公司 车载系统控制方法及方向盘
CN111890932A (zh) * 2020-06-29 2020-11-06 武汉海微科技有限公司 基于3d touch的智能车载控制系统
CN112162688A (zh) * 2020-08-20 2021-01-01 江苏大学 一种基于手势识别的车载虚拟屏交互信息系统

Patent Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101989139A (zh) * 2009-08-07 2011-03-23 介面光电股份有限公司 阵列式触觉回馈的触控面板
US20180273050A1 (en) * 2014-06-25 2018-09-27 Tomtom International B.V. Vehicular human machine interfaces
JP2016199081A (ja) * 2015-04-07 2016-12-01 株式会社日本自動車部品総合研究所 情報提供装置
CN106467065A (zh) * 2015-08-18 2017-03-01 上海汽车集团股份有限公司 方向盘触控装置及方向盘
KR20180074872A (ko) * 2016-12-23 2018-07-04 삼성디스플레이 주식회사 조향 핸들 및 이를 포함하는 차량 제어 시스템
CN113085550A (zh) * 2021-04-08 2021-07-09 浙江吉利控股集团有限公司 一种多手势交互带有振动反馈触控方向盘控制系统

Also Published As

Publication number Publication date
CN113085550A (zh) 2021-07-09
EP4275981A1 (en) 2023-11-15
CN113085550B (zh) 2022-08-16

Similar Documents

Publication Publication Date Title
WO2022214043A1 (zh) 一种多手势交互带有振动反馈触控方向盘控制系统
US9103691B2 (en) Multimode user interface of a driver assistance system for inputting and presentation of information
US10936108B2 (en) Method and apparatus for inputting data with two types of input and haptic feedback
US10466800B2 (en) Vehicle information processing device
US7295904B2 (en) Touch gesture based interface for motor vehicle
KR102188757B1 (ko) 오프-스크린 가시 객체들의 표면화
US9261908B2 (en) System and method for transitioning between operational modes of an in-vehicle device using gestures
US20110169750A1 (en) Multi-touchpad multi-touch user interface
JP5409657B2 (ja) 画像表示装置
US20140362014A1 (en) Systems and Methods for Pressure-Based Haptic Effects
CN110740896B (zh) 用于运输工具的用户界面以及具有用户界面的运输工具
JP2005190290A (ja) 入力制御装置及び入力応答方法
US20220244789A1 (en) Method for operating a mobile terminal using a gesture recognition and control device, gesture recognition and control device, motor vehicle, and an output apparatus that can be worn on the head
WO2016051440A1 (ja) 車両及びステアリングユニット
TW201145146A (en) Handling tactile inputs
WO2014200874A1 (en) Generation of text by way of a touchless interface
JP2011054025A (ja) 触感付与装置及びプログラム
JP2017030746A (ja) 車両及びステアリングユニット
CN110072148A (zh) 一种基于主从模式的车载信息系统的实现方法
CN111638786B (zh) 车载后排投影显示系统的显示控制方法、装置、设备及存储介质
US10052955B2 (en) Method for providing an operating device in a vehicle and operating device
JP2016038607A (ja) 入力システムおよび入力方法
KR20160061389A (ko) 사용자 인터페이스 및 조작 유닛의 조작 시 사용자를 지원하는 방법
WO2015083264A1 (ja) 表示制御装置及び表示制御方法
CN101520670B (zh) 车载电子装置的控制系统

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 22784109

Country of ref document: EP

Kind code of ref document: A1

ENP Entry into the national phase

Ref document number: 2022784109

Country of ref document: EP

Effective date: 20230808

NENP Non-entry into the national phase

Ref country code: DE