CN111497611A

CN111497611A - Vehicle interaction method and device

Info

Publication number: CN111497611A
Application number: CN202010261034.1A
Authority: CN
Inventors: 朱高祺; 简驾; 刘毅林
Original assignee: Guangzhou Xiaopeng Motors Technology Co Ltd
Current assignee: Guangzhou Xiaopeng Motors Technology Co Ltd
Priority date: 2020-04-03
Filing date: 2020-04-03
Publication date: 2020-08-07

Abstract

The embodiment of the invention provides a vehicle interaction method and a vehicle interaction device, which are applied to a steering wheel of a vehicle, when the vehicle is in a driving state, the vehicle can respond to user operation acting on an interaction area arranged on the steering wheel of the vehicle, and vehicle interaction corresponding to the user operation is executed, so that on one hand, the vehicle is operated on the steering wheel in the driving process of the vehicle, the user can control and interact with the vehicle without distracting, transferring sight and leaving the steering wheel, and the driving safety of the vehicle is ensured, on the other hand, human-vehicle interaction modes are enriched in a limited interaction space of the steering wheel, the user can realize vehicle interaction through different operations according to own requirements, and the vehicle using experience is improved.

Description

Vehicle interaction method and device

Technical Field

The invention relates to the technical field of vehicles, in particular to a vehicle interaction method and a vehicle interaction device.

Background

The intelligent vehicle is a new generation vehicle which is more humanized than a common vehicle, and the intelligent vehicle intensively applies the technologies of computer, vehicle-mounted sensing, information fusion, communication, artificial intelligence, automatic control and the like, and is a typical high and new technology complex. The intelligent vehicle not only relates to the organic combination of the internet of vehicles and vehicles, but also generally combines new energy and intelligentization factors, aims to realize safe, comfortable, energy-saving and efficient driving, and becomes a new generation vehicle which can be finally operated by replacing people. The intelligent vehicle has two characteristics of driving automation and interactive touch control, wherein the former is based on artificial intelligence, and the latter is based on hybrid intelligence.

Along with the development of automatic driving and artificial intelligence, man-car interaction in the vehicle is gradually upgraded from a traditional 'button type' operation interface to operation through a vehicle central control screen, and more intelligent and convenient man-car interaction is completed. For example, a typical design example of a center control screen is that a center control screen is arranged between a main driver and a secondary driver of a vehicle body, and a user can operate the vehicle through the center control screen, such as face recognition, gesture operation, and some other human-computer interaction through the center control screen. However, when a user needs to touch the vehicle-mounted central control screen during the driving of the vehicle, on one hand, the user needs to transfer the sight line to the vehicle-mounted central control screen, which causes a great deviation of the driving route and is easy to cause a vehicle accident, and on the other hand, the vehicle control mode which can be provided by the steering wheel is very limited, which cannot meet the requirements of the user.

Disclosure of Invention

The embodiment of the invention provides a vehicle interaction method, which aims to solve the problem that the interaction function and the operation mode of a vehicle steering wheel are single in the prior art.

Correspondingly, the embodiment of the invention also provides a vehicle interaction device, which is used for ensuring the realization and the application of the method.

In order to solve the above problem, an embodiment of the present invention discloses a vehicle interaction method, including:

when the vehicle is in a driving state, responding to user operation acting on an interaction area arranged on a vehicle steering wheel, and executing vehicle interaction corresponding to the user operation.

Optionally, the interaction area is provided with a control key, and when the vehicle is in a driving state, in response to a user operation acting on the interaction area set on a steering wheel of the vehicle, the vehicle interaction corresponding to the user operation is performed, including:

and when the vehicle is in a running state, responding to the user operation acting on the control key, and executing vehicle interaction corresponding to the user operation in the display area of the vehicle.

Optionally, the display area includes an instrument screen, the content displayed on the instrument screen includes at least a first UI element, the control key includes a first control key corresponding to the instrument screen, and when the vehicle is in a driving state, in response to a user operation acting on the control key, an operation corresponding to the user operation is performed on the display area of the vehicle, including:

and when the vehicle is in a running state, responding to the user operation of the first control key, and executing the switching operation of the first UI element in the instrument screen.

Optionally, when the vehicle is in a driving state, in response to a user operation acting on the control key, performing an operation corresponding to the user operation in a display area of the vehicle, including:

and when the vehicle is in a running state, responding to the user operation acting on the first control key, acquiring the content information of the first UI element, and displaying the content information in the instrument screen.

Optionally, the display area includes an in-vehicle center screen including a second UI element, the control key includes a second control key corresponding to the in-vehicle center screen, and the performing, in response to a user operation acting on the control key while the vehicle is in a driving state, an operation corresponding to the user operation in the display area includes:

and changing the second UI element to a selected state in the in-vehicle center control screen in response to a user operation acting on the second control key while the vehicle is in a traveling state.

Optionally, the changing the second UI element to a selected state in the in-vehicle center control screen in response to a user operation acting on the second control key while the vehicle is in the driving state includes:

and hiding a current UI element in the vehicle-mounted center control screen and changing a target UI element opposite to the current UI element into a selected state in response to a user operation acting on the second control key when the vehicle is in a driving state.

Optionally, the user operation includes a first user operation and a second user operation, and the changing the second UI element to a selected state in the in-vehicle center control screen in response to the user operation applied to the second control key while the vehicle is in the traveling state includes:

when the vehicle is in a running state, responding to a first user operation acting on the second control key, and selecting a current UI element in the vehicle-mounted center control screen;

and if a second user operation acting on the second control key is detected within a preset time period, canceling the selection of the current UI element, and selecting a target UI element corresponding to the current UI element.

Optionally, the changing the second UI element to a selected state in the in-vehicle center control screen in response to a user operation acting on the second control key while the vehicle is in the traveling state, further includes:

and resetting the current UI element when a second user operation acting on the second control key is not detected within a preset time period.

Optionally, the interaction area is provided with a plurality of independent keys, each independent key includes a user-defined key, and when the vehicle is in a driving state, in response to a user operation acting on the interaction area set on the vehicle steering wheel, a vehicle interaction corresponding to the user operation is performed, including:

when the vehicle is in a running state, responding to the user operation acting on the user-defined key, and displaying a function selection window in the vehicle-mounted central control screen, wherein the function selection window comprises function information;

determining target function information from the function information in response to the end of the user operation acting on the second control key;

and replacing the current function information of the self-defining key with the target function information in response to the user operation acting on the second control key.

Optionally, when the vehicle is in a driving state, in response to a user operation acting on an interaction area set on a steering wheel of the vehicle, performing a vehicle interaction corresponding to the user operation, further includes:

when the vehicle is in a running state, responding to the user operation acting on the user-defined key, and acquiring the current function information of the user-defined key;

and controlling the vehicle to execute vehicle interaction corresponding to the current function information.

The embodiment of the invention also discloses a vehicle interaction device, which comprises:

and the user operation response module is used for responding to the user operation acting on the interaction area arranged on the vehicle steering wheel when the vehicle is in a driving state, and executing vehicle interaction corresponding to the user operation.

Optionally, the interaction area is provided with a control key, and the user operation response module includes:

and the first vehicle interaction submodule is used for responding to the user operation acted on the control key when the vehicle is in a running state, and controlling the vehicle to execute vehicle interaction corresponding to the user operation in the display area.

Optionally, the display area includes a meter screen, content displayed by the meter screen at least includes a first UI element, the control key includes a first control key corresponding to the meter screen, and the first vehicle interaction sub-module is specifically configured to:

and when the vehicle is in a running state, controlling the vehicle to execute a switching operation aiming at the first UI element in the instrument screen in response to a user operation acting on the first control key.

Optionally, the first vehicle interaction sub-module is specifically configured to:

Optionally, the display area includes an in-vehicle center control screen, the in-vehicle center control screen includes a second UI element, the control key includes a second control key corresponding to the in-vehicle center control screen, and the first vehicle interaction sub-module is specifically configured to:

Optionally, the user operation includes a first user operation and a second user operation, and the first vehicle interaction sub-module is specifically configured to:

when the vehicle is in a running state, responding to a first user operation acting on the second control key, and displaying an operation of selecting a current UI element on the vehicle-mounted center control screen;

Optionally, the interaction area is provided with a plurality of independent keys, the independent keys include a user-defined key, and the user operation response module includes:

the function window display submodule is used for responding to the user operation acted on the user-defined key when the vehicle is in a running state, and displaying a function selection window in the vehicle-mounted central control screen, wherein the function selection window comprises function information;

a function information determination submodule for determining target function information from the function information in response to an end of a user operation applied to the second control key;

and the function information replacing submodule is used for responding to the user operation acted on the second control key and replacing the current function information of the user-defined key with the target function information.

Optionally, the user operation response module further includes:

the function information acquisition submodule is used for responding to the user operation acting on the user-defined key when the vehicle is in a running state and acquiring the current function information of the user-defined key;

and the function execution submodule is used for controlling the vehicle to execute vehicle interaction corresponding to the current function information.

The embodiment of the invention also discloses a vehicle, which comprises:

one or more processors; and

one or more machine readable media having instructions stored thereon that, when executed by the one or more processors, cause the vehicle to perform one or more methods as described above.

Embodiments of the invention also disclose one or more machine-readable media having instructions stored thereon, which when executed by one or more processors, cause the processors to perform one or more of the methods described above.

The embodiment of the invention has the following advantages:

in the embodiment of the invention, the steering wheel applied to the vehicle can respond to the user operation acting on the interaction area arranged on the steering wheel of the vehicle when the vehicle is in a running state, and the vehicle interaction corresponding to the user operation is executed, so that on one hand, the vehicle is operated on the steering wheel in the running process of the vehicle, the user does not need to be distracted, the sight line is shifted, and the hands leave the steering wheel to carry out control interaction with the vehicle, the driving safety of the vehicle is ensured, on the other hand, in the limited interaction space of the steering wheel, the human-vehicle interaction mode is enriched, the user can realize the vehicle interaction through different operations according to the self requirement, and the vehicle using experience is improved.

Drawings

FIG. 1 is a flow chart of the steps of a vehicle interaction method embodiment of the present invention;

FIG. 2 is a diagram illustrating an example of an interaction area in an embodiment of the invention;

FIG. 3 is a schematic view of an example of a curved sliding operation in an embodiment of the present invention;

FIG. 4 is a schematic view showing an example of a linear sliding operation in the embodiment of the present invention;

FIG. 5 is a schematic diagram of an example of a control key in an embodiment of the present invention;

FIG. 6 is a diagram illustrating an example of a card object switch in an embodiment of the present invention;

FIG. 7 is a diagram illustrating an example of a hint window in an embodiment of the present invention;

FIG. 8 is a diagram illustrating an example of a card object switch in an embodiment of the present invention;

FIG. 9 is a diagram illustrating an example of a custom key in an embodiment of the invention;

FIG. 10 is a diagram illustrating an example of a voice-activated key according to an embodiment of the present invention;

fig. 11 is a diagram illustrating an example of a mute key in an embodiment of the present invention;

FIG. 12 is a diagram illustrating an example of a function customization in an embodiment of the present invention;

FIG. 13 is a diagram illustrating an example of a return key in an embodiment of the present invention;

FIG. 14 is a schematic view of an example of the closing of a pop-up window in an embodiment of the invention;

FIG. 15 is a schematic diagram of an example of a control key in an embodiment of the present invention;

FIG. 16 is a diagram illustrating an example of switching UI elements in an embodiment of the invention;

FIG. 17 is a diagram illustrating an example of a card object switch in an embodiment of the present invention;

FIG. 18 is a block diagram of an embodiment of a vehicle interface device of the present invention.

Detailed Description

In order to make the aforementioned objects, features and advantages of the present invention comprehensible, embodiments accompanied with figures are described in further detail below.

The intelligent automobile is a new generation automobile which is more humanized than a common automobile, and the intelligent automobile intensively applies the technologies of computer, vehicle-mounted sensing, information fusion, communication, artificial intelligence, automatic control and the like, and is a typical high and new technology complex. The intelligent automobile not only relates to the organic combination of the internet of vehicles and the automobiles, but also generally combines the factors of new energy and intellectualization, aims to realize safe, comfortable, energy-saving and efficient driving, and becomes a new generation automobile which can finally replace people to operate. The intelligent automobile is a new power for the future automobile industry reformation and growth.

Along with the development of automatic driving and artificial intelligence, the man-machine interaction in the vehicle is gradually upgraded from a traditional 'button type' operation interface to a central touch screen (central control screen) to replace a traditional button, so that more intelligent and convenient man-machine interaction is completed.

For example, a typical design example of a center control screen is that a center control screen is arranged between a main driver and a secondary driver of a vehicle body, and a driver can operate the vehicle through the center control screen, such as face recognition, gesture operation and some other human-computer interaction through the center control screen.

The screen is changed or will bring convenience to the driver, but at the same time, whether the large screen will cause trouble to the driver becomes the key point of debate of the people in the industry. The screen development replaces the traditional key and is intelligently docked, so that the convenience and flexibility of the operation of a driver are improved, and the pleasure is brought to the driving. But more needs to be considered, and the safety of intelligent control of the vehicle is ensured while the vehicle enjoys convenience.

However, is the design of the in-vehicle center control screen equivalent to that of the mobile phone and tablet device? The answer is different! When the user control screen is used for replacing buttons in the vehicle, the user control screen can be replaced by hardware equipment simply. The use of touch devices in vehicles is fundamentally different from the use of mobile phones, tablets and other related devices in life.

It is known that a user can only touch the screen when looking at the screen, since the center control screen has no physical tactile feedback. When people walk, people can not feel too much trouble when lowering the head to play the mobile phone, but the driving is completely different, and a large number of traffic accidents are caused by the fact that drivers do not pay attention to driving every year around the world.

If all physical keys in the car are replaced by the touch screen, an embarrassing phenomenon can be caused: for example, even if the frequency modulation of a radio is changed or the temperature of an air conditioner is adjusted, the screen operation needs to be stared, which actually buries a great potential safety hazard.

In particular, during driving, the driver's normative driving behavior at least includes: the inability to look away from the road surface, the inability to move both hands away from the steering wheel, whether staring at the screen for even a few seconds or controlling the steering wheel with one hand, can cause irreparable loss.

Even if the driver can control the relevant functions in the vehicle based on the voice, if the central control screen responds too slowly, the normal reaction of the driver is to go to the central control screen again to check what happens to the end, and the operation safety hazard is large and is not allowed at all. When slow response or no response occurs on related devices such as a mobile phone and a tablet, a user can accept longer waiting time, and the user operation is less limited by the outside, so that in practice, the user can do no matter whether to submit an operation request again or quit the application and then re-enter the application. The design of the vehicle-mounted central control screen can be seen, and the design cannot be equivalent to that of related equipment such as a mobile phone and a tablet computer.

Therefore, the vehicle interaction screen replaces the traditional key interaction mode, convenience and flexibility of user operation are improved, fun is brought to driving, and meanwhile safety problems are brought to vehicle driving. In the interaction process with the vehicle-mounted central control screen, the vehicle-mounted central control screen does not have physical tactile feedback, so that a user is required to stay the sight on the vehicle-mounted central control screen all the time in the interaction process, and if the vehicle is in a high-speed driving state, the sight is shifted from a driving road, so that great vehicle accidents are easily caused, and irretrievable loss is caused.

Even if the user can control the relevant vehicle functions based on voice, if the vehicle center screen responds slowly, or the voice recognition delays, the physiological reaction of the user is usually to shift the line of sight to the vehicle center screen to see what happens, and the operation is not allowed during the running of the vehicle. Different from the interaction of electronic equipment such as a mobile terminal, when the mobile terminal has a slow response or no response, on one hand, the waiting time of the user can be longer, on the other hand, the limitation on the user operation is less, and in practice, the user can re-enter no matter whether the user re-executes an operation request or quits the current operation. Due to the particularity of the vehicle, the user is required to be unable to leave the driving road and unable to leave the steering wheel by both hands in the driving process of the vehicle, and the vision is not allowed to be transferred to the vehicle-mounted central control screen for a few seconds or the steering wheel is controlled by one hand. It can be seen that there is a substantial difference in the interaction between a person and a vehicle, and the interaction between a person and an electronic device.

For a long time, on the basis of safety, those skilled in the art continuously improve the interaction mode of the vehicle central control screen, so that vehicle interaction is concentrated on the vehicle central control screen for a long time, that is, only the interaction of the user on the vehicle central control screen is considered, and the possibility of other aspects is not considered. In view of the above, one of the core concepts of the embodiments of the present invention is to expand a vehicle interaction scenario of an intelligent vehicle in a limited operation space of a steering wheel of the vehicle, where a user may input different user operations, such as a sliding operation, a pressing operation, a touching operation, and a gesture action, in an interaction area of the steering wheel to implement vehicle interaction, such as controlling a vehicle-mounted center control screen of the vehicle, controlling opening of a trunk, controlling vehicle entertainment, and the like, on one hand, in a vehicle driving process, the user may operate on the steering wheel without distracting, transferring a line of sight, and leaving hands from the steering wheel to operate the vehicle center control screen, thereby ensuring safety of vehicle driving, on the other hand, in the limited interaction space of the steering wheel, a human-vehicle interaction manner is enriched, so that the user may implement vehicle interaction through different operations according to his own needs, the vehicle experience is improved.

The invention overcomes the technical bias that vehicle interaction can only be carried out on a vehicle-mounted central control screen, adopts the technical means abandoned by people due to the technical bias, creatively provides a scheme of adding a user interaction area (covering the touch function of the vehicle central control screen) on a steering wheel, and enables a user to standardly hold the steering wheel by two hands and observe the road condition in front by two eyes in the driving process; when some functions need to be operated, a user only needs to carry out interaction operation such as pressing or touch or sliding on the steering wheel in a handy manner, and then feedback of corresponding operation results can be obtained, so that the safety problem of man-machine interaction on the intelligent automobile is fundamentally solved.

At the same time, since the steering wheel itself has limited physical space and numerous imparted functions, such as the usual presence of an airbag in the steering wheel, it will be appreciated that this results in a very limited user interaction control area on the steering wheel. Under the condition, the inventor of the application also provides different interaction modes of the user interaction control area on the steering wheel, and besides pressing, sliding, touching and the like, control combination operation or key combination operation can be set so as to realize response and operation of infinite and expandable functions in the limited control area.

Furthermore, for The functions corresponding to The steering wheel interaction control area, The functions can be actively defined by a vehicle manufacturer, can also be customized by a user, and can be continuously upgraded along with The technological development and The continuous change of The user requirements, such as upgrading more functions of steering wheel user interaction control through Over The Air (OTA).

Referring to fig. 1, a flowchart illustrating steps of an embodiment of a vehicle interaction method of the present invention is shown, which may specifically include the following steps:

and 101, responding to a user operation acting on an interaction area arranged on a vehicle steering wheel when the vehicle is in a driving state, and executing vehicle interaction corresponding to the user operation.

In the embodiment of the invention, an interaction area can be arranged on the steering wheel of the vehicle, a control key can be arranged in the interaction area, and the control key can comprise a physical key only supporting pressing, a touch key only supporting touch operation, and a composite key supporting both physical pressing and user touch. Taking a touch key as an example, the touch key can detect a touch operation of a user finger touching the key, and one or more touch points can be preset on the control key, so that when the finger touches the touch points, a touch signal can be generated, and the vehicle can correspondingly respond to the touch signal to complete the corresponding operation.

Referring to the schematic diagram of an example of a control key shown in fig. 2, interaction areas are respectively disposed on the left and right sides of the center of the steering wheel, control keys with different control functions may be disposed in different interaction areas, and a control key may be a single independent control key or a control key group set composed of multiple control keys.

In a specific implementation, the user operation may be a pressing operation, a touching operation, or a combination of the pressing operation and the touching operation, different control keys or control key group sets may correspond to different user operation instructions, and different user operation instructions correspond to different vehicle interaction functions, that is, the vehicle may perform vehicle interaction corresponding to the user operation according to the user operation in an interaction area on the steering wheel.

Specifically, the touch points through which the sliding operation of the user passes include touch point ① -touch point ② -touch point ③ -touch point ④ -touch point ⑤, and the sliding track of the touch points forms a semicircular curve, so that the vehicle can determine the sliding direction and the sliding distance of the sliding operation according to the position relationship among the touch points.

Referring to fig. 4, a schematic diagram of a linear sliding operation in an embodiment of the present invention, a user may perform a sliding operation on a control key in a horizontal or vertical direction. Specifically, the touch points through which the user operates include a touch point a-a touch point B-a touch point C, and the sliding trajectory of the touch points forms a horizontal straight line, so that the vehicle can determine the sliding direction and the sliding distance of the sliding operation according to the position relationship between the touch points.

In an optional embodiment of the present invention, one or more touch points may be set on the control key, and when the vehicle is in a driving state, the touch signal triggered by the sliding operation may be obtained in response to the sliding operation performed on the touch point of the control key, a detection time difference between any two adjacent touch signals may be determined, and the touch signal with the detection time difference smaller than a preset time threshold may be determined as an effective sliding motion, and then a sliding direction and a sliding distance corresponding to the effective sliding operation may be determined. And controlling the vehicle to execute vehicle interaction corresponding to the effective sliding action according to the sliding direction and the sliding distance.

Referring to fig. 5, which is a schematic diagram illustrating an example of a control key according to an embodiment of the present invention, the control key may include a control key having an explicit touch point, or a set of control keys formed by combining an explicit touch point and a hidden touch point. The dominant touch point is visible on the surface of the control key and the hidden touch point is not visible on the surface of the control key. If the control key comprises the explicit touch point and the hidden touch point, the precision of sliding touch can be increased while the original appearance design of the control key is not changed, and therefore the function of touch control on the control key is enriched.

In a specific implementation, when the finger of the user touches the control key, the touch operation performed by the user may include: a single touch point is touched separately and at least two adjacent touch points are touched by sliding.

Wherein separately touching a single touch point may include a short touch and a long touch. The short-time touch may be a touch operation in which the duration of touching the single touch point is lower than a time threshold T1, and the long-time touch may be a touch operation in which the duration of touching the single touch point is higher than a time threshold T2. In practice, the time threshold may be generated by a person skilled in the art according to empirical values or test data, such as 1 second, but the invention is not limited thereto.

The sliding touch may be a touch operation that moves from one touch point to another while maintaining plane contact, and the sliding touch passes through adjacent at least two touch points. If the touch operation of the user is a sliding touch operation, the touch operation passes through at least two adjacent touch points. Each time a touch signal is triggered by passing through a touch point, the touch operation of the sliding touch can trigger at least two touch signals. Optionally, the touch signal corresponding to each touch point may have a unique signal identifier to distinguish different touch signals. In this case, the vehicle may obtain a touch signal generated by a touch point triggered by a touch operation of the user, and further calculate a detection time difference between two adjacent touch signals. If the time difference between the currently detected touch signal and the last detected touch signal is less than or equal to a preset time threshold, determining that the touch operation triggering the currently detected touch signal is an effective sliding operation; if the time difference between the currently detected touch signal and the last detected touch signal is greater than the preset time threshold, the touch operation triggering the currently detected touch signal is determined to be a single-point touch operation, so that the single-point touch and the sliding touch can be effectively distinguished by detecting the detection time difference between the two touch signals, and the accuracy of touch operation detection is ensured.

In a specific implementation, the position information corresponding to each touch point may have a unique position identifier, and after it is determined that the touch operation of the user is an effective sliding operation, the position information of the touch point generating the touch signal may be acquired, the touch points are connected, the direction of the connection line is used as the sliding direction of the sliding operation, and the distance between the two touch points is used as the sliding distance of the sliding operation, so that the vehicle is controlled to perform vehicle interaction corresponding to the effective sliding operation according to the sliding direction and the sliding distance.

In another alternative embodiment of the present invention, when the user operation is a pressing operation, the pressing may include a short pressing and a long pressing. Wherein, the short press is a press operation of pressing the single control key for a duration lower than a time threshold T3, and the long press is a press operation of pressing the single control key for a duration higher than a time threshold T4. In practice, the time threshold may be generated by a person skilled in the art according to empirical values or test data, such as 1 second, but the invention is not limited thereto.

As an example of specific implementation of the embodiment of the present invention, different control keys in a steering wheel interaction area may correspond to different functions, as shown in fig. 2, the control key arranged in the left interaction area of the steering wheel may include 4 direction keys, a first confirmation key, a voice key, and a User-defined key, and when a User presses different direction keys, different functions may be executed, such as controlling selection of a UI (User Interface) element in a vehicle-mounted center control screen, and after the selection, confirming the UI element by pressing the first confirmation key; the voice key can be pressed to open the vehicle-mounted voice function of the vehicle, so that voice interaction between people and the vehicle is realized; a custom key may also be pressed, a vehicle interaction associated with the custom key performed, and so on. The control keys arranged in the interaction area on the right side of the steering wheel may include a volume up-down key, a multimedia switching key, a second confirmation key, a return key and a mute key, and the user may also perform corresponding vehicle interaction by pressing the control keys.

In the embodiment of the invention, the vehicle interaction may include a first type of vehicle control and a second type of vehicle control, wherein the first type of vehicle control may be a control unrelated to vehicle running, such as an in-vehicle entertainment control, a vehicle body control and the like, and the second type of vehicle control may be a control related to vehicle running, such as an automatic driving control, a power control and the like. When the vehicle is in a driving state, the vehicle can respond to the sliding operation acting on the interaction area arranged on the steering wheel of the vehicle, and the vehicle interaction corresponding to the sliding operation is executed, such as vehicle-mounted entertainment, vehicle body control and the like, or an automatic driving mode is entered, or an energy recovery mode is entered, and the like.

For the first type of vehicle control of the vehicle, a user can input a corresponding self-defined instruction through a mobile terminal or a vehicle-mounted central control screen, and a vehicle-mounted system sets the function realization of the interaction area of the steering wheel according to the self-defined instruction, for example, the current control is to realize the switching of cards in the display area by clockwise sliding a half circle in the interaction area, and the current control is changed to switch multimedia by clockwise sliding the half circle in the interaction area according to the self-defined instruction of the user. And for the second type of vehicle control of the vehicle, the vehicle manufacturer updates the vehicle control in an OTA upgrading mode.

In the embodiment of the invention, when the vehicle is in a driving state, the vehicle can respond to the user operation acting on the interaction area arranged on the vehicle steering wheel, the vehicle interaction corresponding to the user operation is executed, and the operation feedback aiming at the user operation is executed, so that on one hand, the user can quickly perform feedback (such as vibration feedback, voice feedback and the like) and execute corresponding vehicle interaction by operating on the steering wheel during the driving process of the vehicle, the irregular operations of user distraction, sight line transfer, hand leaving from the steering wheel and the like are avoided, the driving safety of the vehicle is ensured, and on the other hand, the human-vehicle interaction mode is enriched in the limited interaction space of the steering wheel, so that the user can realize the vehicle interaction through different operations according to the self requirement, and the vehicle using experience is improved.

In an optional embodiment of the invention, the interaction area is provided with control keys corresponding to different display areas of the vehicle, so that when the vehicle is in a driving state, the vehicle can respond to user operations acting on different control keys to control the vehicle to perform vehicle interaction corresponding to the user operations in the display areas corresponding to the control keys. The Display area may include an instrument screen, an in-vehicle center control screen, a HUD (Head Up Display), and the like.

In a specific implementation, the display area may include UI elements, and different display areas may show different UI elements or the same UI element. UI elements may include, among other things, card objects, application icons or interfaces, folder icons, multimedia file icons, and interactive controls.

In one example, the first control key arranged on the left side of the steering wheel may be a control key corresponding to the instrument panel, and interaction with the instrument panel may be achieved by operating the first control key. Specifically, the content displayed by the instrument panel may include at least a first UI element, such as a card object, a driving mode icon, an automobile gear icon, and the like, where the card object may include card objects such as vehicle energy consumption, mileage, weather, vehicle condition, vehicle duration, in-vehicle temperature, vehicle-mounted air conditioning air volume, instrument panel brightness, and vehicle radar, and the driving mode icon may include icons corresponding to different vehicle driving modes such as an economy mode, a normal mode, and a sport mode, that is, when the driving mode icon is controlled to switch, the vehicle may be controlled to correspondingly switch different driving modes; the automobile gear icons can comprise icons of different automobile gears such as a D gear, a P gear, an R gear and the like, namely when the automobile gear icons are controlled to be switched, the automobile can be controlled to correspondingly switch different gears.

When the vehicle is in a running state, the vehicle displays a switching operation for the first UI element, such as switching a card, switching a running mode, or the like, in the instrument panel in response to a user operation acting on the first control key. In addition, it is also possible to acquire content information on the first UI element in response to a user operation acting on the first control key and then present the content information in the meter screen. The user operation may include a slide touch operation, a short press operation, and a long press operation, among others.

For the switching process of the UI elements, the user operation may correspond to a single operation and multiple operations, the single operation may be to switch the UI elements by a single independent user operation for the user, the multiple operations may be to switch the current UI element to a target UI element that the user wants to select by the user through a first user operation first, and then view content information of the currently selected UI element through a second user operation, or perform continuous operation for a certain UI element, of course, a specific user operation mode may be arbitrarily set by a person skilled in the art according to an actual situation, which is not limited by the present invention.

Referring to fig. 6, which is a schematic diagram illustrating an example of switching a card object according to an embodiment of the present invention, the card object may be displayed in a dashboard of a vehicle, and the first control key may include four direction keys and one enter key. When the direction key is pressed, switching of a target object (such as a card object) can be realized. The user can input a slide operation on the direction key, so that the vehicle can display a switching operation for the card object in the instrument screen, realize slide switching of the card, and display the card object after the slide. When the user presses the confirmation key, the card can be accessed, and the information corresponding to the card is displayed, such as displaying the vehicle mileage, energy consumption, vehicle condition, weather, shortcut control and the like. Further, when the card object contains a plurality of levels of sub-cards, the user can perform card browsing by the above-described user operation, and when the vehicle does not detect the user operation within a certain time (e.g., within 4 seconds), it is possible to return to the card object at the upper level and maintain the long display of the card object.

In the control process of the card object in the instrument screen, the vehicle can respond to a first sliding operation acted on the touch key to determine a first sliding direction of the first sliding operation, then determine a first switching instruction aiming at the current card object according to the first sliding direction, and then switch the current card object into the target card object according to the first switching instruction. In an example of specific application of the embodiment of the present invention, when the sliding direction is a clockwise direction, a positive order switching instruction for the current card object is generated; and when the sliding direction is the anticlockwise direction, generating a sequence switching instruction aiming at the current card object.

For another example, the card object may be an energy consumption card, an energy center card, a mileage card, a vehicle condition card, a weather card, a shortcut control card, and the like, which may be a first-level card object, and may also be a multi-level card object, where the multi-level card object, that is, the card object, may include at least one first-level daughter card object, and the first-level daughter card object may also include a second-level daughter card object, and the like.

The user can select the card object in the instrument screen by performing clockwise or anticlockwise sliding operation on the direction key, for example, the energy consumption card, the energy center card, the mileage card, the vehicle condition card, the weather card, the quick control card and the like are selected, and after the user selects the energy consumption card and presses the first confirmation key for a short time, the energy consumption card can be opened, and energy consumption information in the energy consumption card, for example, sub-cards of the energy consumption in the current day, the energy consumption in the current week and the like are displayed. The user may then continue to slide clockwise or counterclockwise on the arrow keys to select the target sub-card, for example, to select the energy consumption of the day to query the energy consumption information of the day of the vehicle. In the selection process of the card object, the vehicle can select the card object according to the sliding operation of the user; in the selection process of the sub-card object, if the vehicle does not receive the confirmation operation of the user within a certain time (such as within 4 seconds), the vehicle returns to the upper-level interface, namely, the selection interface of the card object is returned, so that the user can realize the interaction with the instrument screen by operating the interaction area of the steering wheel, and the interaction mode between the user and the vehicle is enriched.

In another example of the embodiment of the present invention, the content displayed in the meter screen may further include a prompt window in which a display processing operation for the prompt window is displayed in response to a user operation applied to the first control key while the vehicle is in a driving state. The display processing operation may include operations of minimizing the hint window, closing the hint window, setting to delay processing, and the like.

Referring to fig. 7, which is a schematic diagram illustrating an example of a prompt window in an embodiment of the present invention, when a text reminder window appears on a meter screen, a user may close the text reminder window in the meter screen by pressing a first confirmation key (e.g., a "close" key shown in the figure).

In another example, the second control key arranged on the right side of the steering wheel may be a control key corresponding to the in-vehicle center control screen, and interaction with the in-vehicle center control screen may be achieved by operating the second control key. Specifically, the in-vehicle center control screen may include a second UI element, and the second UI element may include a card object, an application icon, an application interface, a folder icon, a multimedia file icon, and the like, and the second UI element is changed to a selected state in the in-vehicle center control screen in response to a user operation applied to the second control key while the vehicle is in the driving state.

Specifically, while the vehicle is in the running state, the vehicle hides the current UI element in the in-vehicle center control screen and changes the target UI element opposite to the current UI element to the selected state in response to the first user operation applied to the second control key. Or responding to the first user operation acting on the second control key, and displaying the operation of selecting the current UI element on the vehicle-mounted center control screen; and if a second user operation acting on the second control key is detected within a preset time period, canceling the selection of the current UI element, and selecting a target UI element corresponding to the current UI element. It should be noted that the first user operation and the second user operation may be continuous sliding operations, for example, the first user operation triggers the first touch signal, and the second user operation triggers the second touch signal, so that the two touch signals may form a control signal corresponding to one sliding operation, and the touch signal generated by one sliding operation is split, so that the stability of signal transmission can be ensured.

In addition, when a second user operation acting on the second control key is not detected within a preset time period, the current UI element is reset.

Referring to fig. 8, which is a schematic diagram illustrating an example of switching a card object in an embodiment of the present invention, a second control key on the right side of a steering wheel may include 4 multimedia keys and a confirmation key, and when a user presses the keys, the user may control multimedia playing of a vehicle. After the user inputs the sliding operation, the operation of selecting the card object at the top of the card list can be displayed in the card list displayed on the vehicle-mounted central control screen, the selected card object is highlighted, then the card switching is performed according to the sliding direction and the sliding distance of the sliding operation, and the position of the selected card object is fixed. And if no further operation of the user is received within the preset time, the selection and the highlight are cancelled.

It should be noted that, different from another scheme for switching UI elements, the difference between the two schemes is a display manner, where the first UI element display manner is to display only a current UI element in a vehicle-mounted center control screen, hide a previous UI element and a next UI element of the current UI element, and switch after detecting a user operation. The second UI element display mode is to display a UI element list in the vehicle-mounted center control screen, and a user can switch UI elements in the UI element list according to the needs of the user. The switching processes of the two are similar or identical, and are not described in detail herein.

In another optional embodiment of the invention, the interaction area is further provided with a plurality of independent keys, and when the vehicle is in a driving state, the vehicle can respond to user operations acting on the independent keys to execute vehicle interaction corresponding to the user operations. As shown in fig. 2, the independent keys may include a voice call key and a custom key disposed in the left interactive region, and a return key and a mute key disposed in the right interactive region.

Referring to fig. 9, which is a schematic diagram illustrating an example of a custom key in an embodiment of the present invention, a vehicle may respond to a user operation applied to the custom key, obtain current function information of the custom key, and control the vehicle to perform vehicle interaction corresponding to the current function information. Specifically, at the beginning of vehicle leaving factory, the function information of the custom key may be none, the user can perform function customization according to the self-requirement, and after the definition is completed, the user can trigger the corresponding function, such as switching a multimedia sound source, indicating a pedestrian, opening a driving recorder, automatically parking, motorcade communication, and the like, by pressing the custom key for a short time.

Referring to fig. 10, which is a schematic diagram illustrating an example of a voice call-out key in an embodiment of the present invention, when a vehicle is in a driving state, the vehicle may collect voice information of a vehicle user in response to a user operation applied to the voice call-out key, determine a voice instruction corresponding to the voice information, and then control the vehicle to perform vehicle interaction corresponding to the voice instruction. The user operation can be a long-press operation, when the user presses the voice call-up key for a long time, the vehicle can acquire voice information of the user in the vehicle through the sound pickup equipment, perform semantic recognition and determine a voice instruction, so that vehicle interaction corresponding to the voice instruction is executed.

Referring to fig. 11, a schematic diagram of an example of a mute key in the embodiment of the present invention, when a vehicle is in a driving state, a speaker of the vehicle is muted in response to a user operation applied to the mute key.

In another optional embodiment of the invention, the user can perform combined operation on the control keys in the interaction area, so that the interaction with the vehicle is performed through various operation modes, the human-vehicle interaction mode is enriched in the limited interaction space of the steering wheel, the user can realize vehicle interaction through different operations according to the self requirement, and the vehicle using experience is improved. Specifically, when the vehicle is in a running state, vehicle interaction corresponding to the user operation is performed in response to the user operation applied to the control key and the independent key.

In an example of the embodiment of the present invention, when the vehicle is in a driving state, the vehicle may present a function selection window in the in-vehicle center control screen in response to a user operation applied to the custom key, the function selection window including function information, then determine target function information from the presented function information in response to an end of the user operation applied to the second control key, and then replace the current function information of the custom key with the target function information in response to the user operation applied to the second control key. The function selection window may also be closed in response to a user operation on the return key. It should be noted that, for the function setting of the custom key, the setting may also be performed when the vehicle is in a stationary state, and the present invention is not limited to this.

Referring to fig. 12, which is a schematic diagram illustrating an example of function customization in an embodiment of the present invention, in a process of customizing a function of a customization key, a user may select function information of the customization key by sliding and touching a multimedia key of a right control key and pressing a confirmation key. Specifically, the vehicle can respond to the long press operation acting on the user-defined key, and display a function selection window in the vehicle-mounted central control large screen, the function selection window can comprise a plurality of function information, then can respond to the end of the sliding operation acting on the multimedia key, determine the target function information selected by the user from the function information, and respond to the short press operation acting on the second confirmation key to replace the current function information of the user-defined key with the target function information, for example, the current function information is 'replace multimedia sound source', the target function information is 'motorcade conversation', the 'replace multimedia sound source' is replaced with 'motorcade conversation', after the replacement is finished, the user short presses the user-defined key again, the motorcade conversation is triggered, so that the user can perform function setting on the user-defined key according to the requirement of the user, and the individual requirement of the user is met, the experience of using cars is promoted.

Referring to fig. 13, which is a schematic diagram illustrating an example of a return key in an embodiment of the present invention, in a process of customizing a function of a custom key, when a user wants to cancel the function customization, the user may close a function selection window in an on-vehicle center control large screen by pressing the return key for a short time.

In another example, when a dialog window, such as a pop-up window, appears on the vehicle-mounted center control large screen, the vehicle may acquire window information of the dialog window in response to a user operation acting on the second control key and display the window information; or closing the dialogue window in response to a user operation acting on the return key; and returning to the main interface of the vehicle-mounted central control screen in response to the user operation on the return key.

Referring to fig. 14, which is a schematic diagram of an example of closing a pop-up window in the embodiment of the present invention, when a pop-up window appears on a vehicle-mounted center control screen, a user may obtain window information corresponding to the pop-up window by pressing a confirmation key for a short time, and display the window information in a full-screen display manner; the popup can also be closed by pressing a return key for a short time; the user can also press a return key for a long time to return to the main interface of the vehicle-mounted central control screen while closing the pop-up window, so that the user can realize the interaction with the vehicle-mounted central control large screen by operating the interaction area of the steering wheel (in the example, the control key group set is an expression form of the interaction area), and the interaction mode between the user and the vehicle is enriched.

In addition, when the conversation window is the incoming call window, the vehicle can respond to the short-press operation acted on the confirmation key and answer the incoming call of the incoming call window; or, responding to the short press operation acted on the return key, ignoring the incoming call of the incoming call window, and closing the incoming call ring; or, when the user presses the return key again, the user can reject the incoming call in the incoming call window and close the incoming call window.

In another optional embodiment of the invention, when the user operation is a sliding touch operation, the vehicle may control the vehicle to perform a vehicle interaction corresponding to the sliding operation in response to the sliding operation applied to the interaction area. Specifically, the user may control the vehicle to perform corresponding vehicle interaction by performing a sliding operation on a control key of the steering wheel, such as controlling a temperature of the vehicle air conditioner, controlling a volume of a speaker, controlling a brightness of a large screen of the vehicle center control, controlling a UI (user interface) element in the large screen of the vehicle center control, and controlling a brightness of an instrument screen.

It should be noted that the control keys on the left and right sides have similar sliding touch functions, and one side of the control keys can implement the function, and the other side of the control keys can also implement the function. In addition, for the implementation of different functions, including but not limited to the above-mentioned sliding operation, short-press operation, long-press operation, and the like, the user may customize the functions according to the actual needs, which is not limited by the present invention.

In an optional embodiment of the invention, the vehicle may collect a touch signal triggered by the sliding operation in response to the sliding operation acting on the interaction area, and present the selection operation for the UI element in the display area according to the signal number of the touch signal.

In a specific implementation, if the touch operation of the user is a sliding touch operation, the touch operation passes through at least two adjacent touch points. For a sliding touch operation behavior, one sliding operation signal may correspond to one feedback output. However, when the signal is processed as one signal, an unnecessary noise signal is likely to occur between signal transmissions, and the display feedback result may be jumbled in the display area.

Therefore, in this embodiment, the touch signals generated by the operation behavior of the user are split into signals, and each time one touch signal is triggered by passing through one touch point, the touch operation of the sliding touch can trigger at least two touch signals. Optionally, the touch signal corresponding to each touch point may have a unique signal identifier to distinguish different touch signals, so that the vehicle may display a selection operation for the UI element in the display area according to the number of signals of the touch signal.

In an optional embodiment of the present invention, when 1 touch signal is received, first feedback information for a current UI element is presented in a display area; after the first feedback information is displayed, if the 2 nd touch signal is not received within the preset time, resetting the current UI element.

In another optional embodiment of the present invention, when 1 touch signal is received, first feedback information for a current UI element is presented in a display area; after the first feedback information is displayed, if a 2 nd touch signal is received within a preset time, displaying second feedback information for a current UI element in the display area, and after the second feedback information, displaying a selection operation for the UI element in the display area.

In a specific implementation, a signal quantity threshold value can be set, the signal quantity generated by one touch operation is monitored, when the number of the touch signals is monitored to be not more than the threshold value, first feedback information aiming at the current UI element is displayed in a display area, the current UI element is reset after the display is finished, no switching operation is executed, and then the touch signals are detected again; and when the number of the touch signals is gradually increased to be larger than or equal to the threshold value, the user is considered to input one complete sliding operation, corresponding second feedback information is displayed in the display area, and the selection operation aiming at the UI element is executed.

Specifically, when the signal quantity of the touch signal meets a preset threshold, the vehicle may acquire position information of a touch point generating the touch signal, then determine a sliding direction of the sliding operation by using the position information corresponding to different touch points, simultaneously display second feedback information for the current UI element in the display area, hide the current UI element in the display area according to the sliding direction, and display a target UI element corresponding to the current UI element; or, if the sliding operation of the user is an operation for the UI element list in the display area, after the second feedback information is displayed, according to the sliding direction, deselecting the current UI element, and selecting the target UI element corresponding to the current UI element.

The sliding information corresponding to the sliding operation may include a sliding distance and a sliding direction, and the vehicle may determine the number of UI elements to be switched according to the sliding distance and determine the direction in which the UI elements are switched according to the sliding direction. For example, if the sliding direction is clockwise, a first switching instruction for the current UI element is generated; if the sliding direction is the anticlockwise direction, generating a second switching instruction aiming at the current UI element, so that the current UI element can be deselected after the second feedback information is displayed, and the same type of UI elements adjacent to the current UI element are selected as target UI elements according to the first switching instruction or the second switching instruction; or after the second feedback information is displayed, hiding the current UI element, and displaying the same type of UI elements adjacent to the current UI element according to the first switching instruction or the second switching instruction.

It should be noted that, for the switching of UI elements, switching may be performed between UI elements of the same type, for example, switching a card object in a card list; in a main interface of the system, switching folder icons or switching application program icons; in the multimedia management interface, multimedia is switched, and the like.

Referring to fig. 15, in an exemplary schematic diagram of a control key in an embodiment of the present invention, assuming that the control key is equally divided into 8 regions, each region corresponds to one touch point, each time one touch signal is triggered by passing through one touch point, two touch signals trigger one switching operation, a signal number threshold may be set to be a multiple of 2, and when the signal number triggered by a user operation is greater than 2 or is a multiple of 2, the signal number is regarded as a complete sliding operation.

Whether the user is inputting the sliding operation or not can be judged firstly, and when the user continuously triggers the contact signals according to the topological sequence, the vehicle can be judged that the user is inputting the sliding operation. When the user slides the finger, the system can automatically shield the first two signals, and when the sliding is triggered by the third signal, the selection operation aiming at the UI element is displayed in the display area.

As shown in fig. 16, which illustrates a schematic flow chart of UI element switching in the embodiment of the present invention, where the first feedback information may be a preliminary action, and the second feedback information may include a preliminary action and a switching action, a single sliding operation may be split into two signals and three action triggers, where the first signal is triggered to complete the first preliminary action, and if the second signal occurs, the preliminary action is continuously triggered, otherwise, the first action is reset immediately; when the second signal is generated, the second preliminary action effect is played immediately, and the switching action effect is automatically linked, so that one complete signal input is completed when the second signal is completely input, and one complete feedback output is completed when the switching action is completed. The touch signal splitting device has the advantages that the two signals correspond to two dynamic effects (the second preparatory dynamic effect and the switching dynamic effect are connected into one), in order to guarantee the stability of signal transmission, the dynamic effect corresponding to the second signal is decoupled into the second preparatory dynamic effect and the switching dynamic effect, so that the touch signal generated by sliding operation is split, the stability of signal transmission can be effectively guaranteed, the false touch is avoided, and the operation experience of a user is improved.

As shown in fig. 17, which illustrates a schematic diagram of switching a card object in the embodiment of the present invention, assuming that a UI element is a card, in a switching process of the card, when a first touch signal is detected, a first segment of action is invoked, and if a second touch signal is not detected, after the action is played, the original state is maintained; if the second touch signal is detected, after the second segment of action is played, switching to the next or previous card according to the sliding direction, so that the UI elements in the display area can be switched through the sliding operation of the control key of the steering wheel, such as switching the card, switching the application program icon and the like, after the switching is finished, the confirmation instruction input by the user within a certain time (such as within 3 seconds) can be received, the UI elements are opened, such as opening the card and opening the application program, if the user does not input the confirmation instruction within the certain time, the selection of the UI elements is cancelled, the current state is reset or kept, on one hand, vehicle interaction is carried out through the steering wheel, so that the user is not restricted by the touch control mode of the display area any more, particularly, the driving safety of the user is ensured in the driving process, on the other hand, the interaction modes between the user and the vehicle are enriched, different requirements of users can be met, and vehicle experience is improved.

Further, in addition to the control of the switching direction of the UI elements by the sliding direction, the number of UI element switches may be controlled by the sliding distance. Specifically, the sliding distance may be mapped to position information of the touch points, a displacement between two touch points constitutes a unit sliding distance, the unit sliding distance may be switched to one UI element, and if the user's sliding operation triggers 2 touch signals, the unit sliding distance corresponds to one unit sliding distance, that is, one sliding operation is completed, and one UI element may be switched; when the sliding operation triggers 3 touch signals, corresponding to a sliding distance of 1.5 units, it can be understood that, as described above, when the number of signals of the touch signals is greater than 2, or is a multiple of 2, the sliding operation is regarded as a complete sliding operation, i.e., the sliding operation is a complete sliding operation, but does not satisfy the sliding distance of 2 units, and therefore only one UI element can be switched; when the sliding operation triggers 4 touch signals, two UI elements can be switched corresponding to two units of sliding distance, and so on.

In addition, in order to prevent the driver from mistakenly touching the interaction area in the vehicle driving process, the driving information of the vehicle and the steering information of the steering wheel can be acquired, and then the input signal of the interaction area is shielded according to the driving information and the steering information, so that the mistaken touching prevention of the interaction area of the steering wheel is realized, and especially in the driving process, unnecessary troubles caused by the mistaken touching can be avoided when the driver is in a special driving situation, and the driving experience and the safety are improved.

In a specific implementation, the interaction area may be provided with keys, where the keys may include physical keys, touch keys, and multifunctional keys, and respectively support operations such as hard pressing, soft touching, and hard pressing and soft touching, for example, a user may implement part of vehicle or entertainment control by pressing the keys or touching the keys.

When the vehicle starts, the input signal of the interaction area can be shielded firstly. Specifically, the signal response of the control key on the steering wheel is in a continuously-opened state, and the user operation of the user is detected and received all the time, so that the instant response is ensured. In some scenarios, the user may touch or press the control key all the time, however, these operations are not operations of the user's subjective input, and the input signals need to be masked. For example, after the vehicle is started, when the driver holds the steering wheel with both hands (or shoots on the control keys of the steering wheel), the control keys are easy to touch or press, so that the control keys always receive touch signals or press signals, and further, the vehicle responds to the non-subjective touch operation of the user, thereby bringing trouble to the user.

Specifically, when the vehicle starts, the vehicle-mounted system can start a false touch prevention mechanism of the steering wheel control key, generate a signal shielding instruction for the control key in the interaction area, execute the signal shielding instruction, and shield input signals which can be obtained by the shielding part but are not subject to user operation, so that the vehicle is prevented from responding to the input signals, unnecessary troubles are brought to the user, the driving of the user is influenced, and the driving experience of the user is guaranteed. In specific implementation, the steering information of the steering wheel can comprise a steering angle and a steering angular speed, when the vehicle speed information is greater than or equal to a preset speed threshold value, the input signal of an interaction area can be shielded according to the steering angle or the steering angular speed, so that in the driving process of the vehicle, the non-subjective user operation of a driver is shielded, the situation that the driver touches a control key by mistake under the condition of attentive driving is avoided, unnecessary troubles are brought, and the driving experience and the safety are improved. The vehicle may partially or completely shield the input signal of the interaction area according to the steering information, such as signal shielding of control keys in the interaction area on the left or right side of the steering wheel, or signal shielding of control keys in all interaction areas of the steering wheel.

In an optional embodiment of the present invention, when the steering angle is greater than or equal to the preset angle threshold, the input signal of the interaction region is masked; and when the steering angular speed is greater than or equal to the preset angular speed threshold value, shielding the input signal of the interaction area.

In one example, assume that the speed threshold is 7 km/h, the angle threshold is 60 degrees, and the angular speed threshold is 45 degrees/sec. When the speed of the vehicle is greater than or equal to 7 km/h, the input signal of the interaction area on the steering wheel can be shielded according to the steering angle or the steering angular velocity of the steering wheel rotated by the user. Specifically, when the steering angle is greater than or equal to 60 degrees, it is determined that the driver is concentrating on driving at the moment, and the input signal of the interaction area is shielded; when the steering angular speed is greater than or equal to 45 degrees/second, the driver is judged to be focusing on driving at the moment, the input signal of the interaction area is shielded, the situation that the driver touches the control key by mistake under the condition of focusing on driving is avoided, unnecessary troubles are avoided, and the driving experience and the safety are improved.

In addition, under the condition that the vehicle speed of the vehicle is greater than or equal to the speed threshold, if the condition that the steering information of the current steering wheel does not meet the signal shielding is detected, the shielding of the pressing signal can be cancelled, namely when the speed information is greater than or equal to the preset speed threshold and the steering angle is smaller than the preset steering angle, the shielding of the input signal is cancelled; and when the speed information is greater than or equal to the preset speed threshold value and the steering angular speed is less than the preset angular speed threshold value, the shielding of the input signal is cancelled.

For example, when the vehicle speed is greater than or equal to 7 km/h, it is detected that the steering angle is less than 60 degrees, and/or when the steering angular speed is less than 45 degrees/s, the shielding of the pressing signal may be cancelled (or the pressing signal is not shielded), and the normal interaction of the steering wheel interaction area is recovered (or the normal interaction of the steering wheel interaction area is maintained), so that on one hand, the driver is prevented from mistakenly touching the steering wheel interaction area during driving, and on the other hand, the interaction of the steering wheel interaction area is recovered under the condition that the vehicle meets the vehicle interaction, so as to ensure the control of the driver on the vehicle.

For example, if the interaction area of the steering wheel is provided with a display screen, the touch signal of the display screen may be shielded according to the steering angle and/or the steering angular velocity of the steering wheel when the vehicle speed information is greater than or equal to the preset speed threshold. Specifically, when the steering angle is larger than a preset angle threshold, shielding a touch signal of a display screen; and/or shielding the touch signal of the display screen when the steering angular speed is greater than a preset angular speed threshold value.

In the embodiment of the invention, the vehicle adopts the corresponding shielding condition to shield the input signal of the steering wheel interaction area by setting the speed threshold. When the vehicle speed information of the vehicle is less than the speed threshold, the input signal of the interaction area can be shielded according to the steering angle of the steering wheel.

In one example, assume that the speed threshold is 7 km/h and the angle threshold is 60 degrees. When the speed of the vehicle is less than 7 km/h, the pressing signal of the physical control key can be shielded according to the steering angle of the steering wheel rotated by the user. Specifically, when the steering angle is larger than 60 degrees, the driver is judged to be focusing on driving at the moment, the input signal of the interaction area is shielded, the situation that the driver touches the control key by mistake under the condition of focusing on driving is avoided, unnecessary troubles are brought, and the driving experience and the safety are improved. It is understood that, in the case of low speed, the vehicle may also shield the input signal from the steering wheel interaction area according to the driving information of the vehicle.

In addition, under the condition that the vehicle speed of the vehicle is smaller than the speed threshold, if it is detected that the steering information of the current steering wheel does not meet the signal shielding condition, the shielding of the pressing signal can be cancelled, that is, when the speed information is smaller than the preset speed threshold and the steering angle is smaller than the preset steering angle, the shielding of the input signal is cancelled.

For example, when the vehicle speed is greater than or equal to 7 km/h and the steering angle is detected to be less than 60 degrees, the shielding of the input signal can be cancelled and the normal interaction of the steering wheel interaction area can be recovered, so that on one hand, the mistaken touch of the driver on the steering wheel interaction area in the driving process is avoided, and on the other hand, the interaction of the steering wheel interaction area is recovered under the condition that the vehicle meets the vehicle interaction condition, so as to ensure the control of the driver on the vehicle.

It should be noted that the embodiment of the present invention includes, but is not limited to, the above examples, and it is understood that, under the guidance of the idea of the embodiment of the present invention, a person skilled in the art may set the angular threshold and the angular velocity threshold according to the actual situation, and the present invention is not limited to this.

It should be noted that driving is a continuous process, and may include vehicle starting, initial low speed starting, middle speed increasing to high speed, end speed decreasing, and the like, and the shielding of the steering wheel input signal is also a dynamic alternating process of shielding and shielding release.

Specifically, when the vehicle is started and does not start to run, the input signals in the interaction area can be shielded, and signals triggered by non-subjective operation when the driver places hands in the interaction area are avoided. It can be understood that, in the process, the vehicle actively shields the input signal of the interaction area, but the driver can cancel the shielding according to the requirement of the driver so as to input the corresponding operation in the interaction area; or canceling the shielding of the input signal when the vehicle monitors that the shielding condition is not met.

When the vehicle is in a low-speed state at a starting initial stage, if the vehicle speed is less than a preset threshold value, whether an input signal of an interaction area is shielded or not can be judged according to the steering angle of the steering wheel, and it can be understood that in the low-speed state, along with the large-scale rotation of the steering wheel by a driver, the hand of the driver mistakenly touches the interaction area, so that the vehicle responds to a corresponding instruction, and further the driving condition of the driver is influenced, therefore, in the starting initial stage of the vehicle, when the rotation angle of the steering wheel is monitored to be greater than or equal to the preset angle threshold value, the input signal of the interaction area is shielded; otherwise, the input signal is not shielded, or under the condition of being in a shielding state, the condition that the shielding condition is not met is monitored, and the shielding of the input signal is cancelled.

When the vehicle is in a state of accelerating to high-speed running in the middle section, the vehicle speed is greater than or equal to a preset threshold value at the moment, whether the input signal of the interaction area is shielded or not can be judged according to the steering angle or the steering angular speed of the steering wheel, and it can be understood that less external interference needs to be ensured under the conditions of accelerating and high-speed running of the vehicle so that a driver can drive with great concentration, therefore, when the vehicle is in a higher vehicle speed, if the steering angle of the steering wheel is greater than or equal to the preset angular speed threshold value or the steering angular speed of the steering wheel is greater than or equal to the preset angular speed threshold value, the input signal of the interaction area is shielded; otherwise, the input signal is not shielded, or under the condition of being in a shielding state, the condition that the shielding condition is not met is monitored, and the shielding of the input signal is cancelled.

When the vehicle is in a terminal deceleration state, if the monitored vehicle speed is greater than or equal to a preset threshold value, whether the input signal of the interaction area is shielded or not can be judged according to the steering angle or the steering angular speed of the steering wheel; when the vehicle speed is reduced below a preset threshold value, whether the input signal of the interaction area is shielded or not can be judged according to the steering angle of the steering wheel. When the condition that the shielding condition is not met (including that the vehicle stops running) is monitored, the input signal is not shielded, or the shielding condition is not met under the condition that the vehicle is in the shielding state, the shielding of the input signal is cancelled, and the dynamic alternation process between the shielding and the shielding removal of the input signal of the steering wheel of the vehicle is realized, so that on one hand, the mistaken touch of a driver on the interaction area of the steering wheel is avoided, and on the other hand, the interaction of the interaction area of the steering wheel is recovered under the condition that the vehicle meets the vehicle interaction, so that the control of the driver on the vehicle is ensured.

In the embodiment of the invention, the steering wheel applied to the vehicle can respond to the user operation acting on the interaction area arranged on the steering wheel of the vehicle when the vehicle is in a running state, and the vehicle interaction corresponding to the user operation is executed, so that on one hand, the vehicle is operated on the steering wheel in the running process of the vehicle, the user does not need to be distracted, the sight line is shifted, and the hands leave the steering wheel to carry out control interaction with the vehicle, the driving safety of the vehicle is ensured, on the other hand, the human-vehicle interaction mode is enriched in the limited interaction space of the steering wheel, the user can realize the vehicle interaction through different operations according to the self requirement, and the vehicle using experience is improved.

It should be noted that, for simplicity of description, the method embodiments are described as a series of acts or combination of acts, but those skilled in the art will recognize that the present invention is not limited by the illustrated order of acts, as some steps may occur in other orders or concurrently in accordance with the embodiments of the present invention. Further, those skilled in the art will appreciate that the embodiments described in the specification are presently preferred and that no particular act is required to implement the invention.

Referring to fig. 18, a block diagram of a vehicle interaction device according to an embodiment of the present invention is shown, which may specifically include the following modules:

the user operation response module 1801 is configured to, when the vehicle is in a driving state, respond to a user operation acting on an interaction area set on a steering wheel of the vehicle, and perform vehicle interaction corresponding to the user operation.

In an optional embodiment of the present invention, the interaction area is provided with a control key, and the user operation response module 1801 includes:

In an optional embodiment of the present invention, the display area includes a meter screen, content displayed by the meter screen at least includes a first UI element, the control key includes a first control key corresponding to the meter screen, and the first vehicle interaction sub-module is specifically configured to:

In an optional embodiment of the invention, the first vehicle interaction submodule is specifically configured to:

In an optional embodiment of the present invention, the display area includes an in-vehicle center control screen, the in-vehicle center control screen includes a second UI element, the control keys include second control keys corresponding to the in-vehicle center control screen, and the first vehicle interaction sub-module is specifically configured to:

In an optional embodiment of the present invention, the user operation includes a first user operation and a second user operation, and the first vehicle interaction submodule is specifically configured to:

when the vehicle is in a running state, responding to the user operation acting on the second control key, and displaying the operation of selecting the current UI element on the vehicle-mounted center control screen;

In an optional embodiment of the present invention, the interaction area is provided with a plurality of independent keys, the independent keys include a user-defined key, and the user operation response module 1801 includes:

In an optional embodiment of the present invention, the user operation response module 1801 further includes:

For the device embodiment, since it is basically similar to the method embodiment, the description is simple, and for the relevant points, refer to the partial description of the method embodiment.

An embodiment of the present invention further provides a vehicle, including:

one or more processors; and

one or more machine readable media having instructions stored thereon that, when executed by the one or more processors, cause the vehicle to perform a method as described in embodiments of the invention.

Embodiments of the invention also provide one or more machine-readable media having instructions stored thereon, which when executed by one or more processors, cause the processors to perform the methods described in embodiments of the invention.

The embodiments in the present specification are described in a progressive manner, each embodiment focuses on differences from other embodiments, and the same and similar parts among the embodiments are referred to each other.

As will be appreciated by one skilled in the art, embodiments of the present invention may be provided as a method, apparatus, or computer program product. Accordingly, embodiments of the present invention may take the form of an entirely hardware embodiment, an entirely software embodiment or an embodiment combining software and hardware aspects. Furthermore, embodiments of the present invention may take the form of a computer program product embodied on one or more computer-usable storage media (including, but not limited to, disk storage, CD-ROM, optical storage, EEPROM, Flash, eMMC, and the like) having computer-usable program code embodied therein.

Embodiments of the present invention are described with reference to flowchart illustrations and/or block diagrams of methods, terminal devices (systems), and computer program products according to embodiments of the invention. It will be understood that each flow and/or block of the flow diagrams and/or block diagrams, and combinations of flows and/or blocks in the flow diagrams and/or block diagrams, can be implemented by computer program instructions. These computer program instructions may be provided to a processor of a general purpose computer, special purpose computer, embedded processor, or other programmable data processing terminal to produce a machine, such that the instructions, which execute via the processor of the computer or other programmable data processing terminal, create means for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks.

These computer program instructions may also be stored in a computer-readable memory that can direct a computer or other programmable data processing terminal to function in a particular manner, such that the instructions stored in the computer-readable memory produce an article of manufacture including instruction means which implement the function specified in the flowchart flow or flows and/or block diagram block or blocks.

These computer program instructions may also be loaded onto a computer or other programmable data processing terminal to cause a series of operational steps to be performed on the computer or other programmable terminal to produce a computer implemented process such that the instructions which execute on the computer or other programmable terminal provide steps for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks.

While preferred embodiments of the present invention have been described, additional variations and modifications of these embodiments may occur to those skilled in the art once they learn of the basic inventive concepts. Therefore, it is intended that the appended claims be interpreted as including preferred embodiments and all such alterations and modifications as fall within the scope of the embodiments of the invention.

Finally, it should also be noted that, herein, relational terms such as first and second, and the like may be used solely to distinguish one entity or action from another entity or action without necessarily requiring or implying any actual such relationship or order between such entities or actions. Also, the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or terminal that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or terminal. Without further limitation, an element defined by the phrase "comprising an … …" does not exclude the presence of other like elements in a process, method, article, or terminal that comprises the element.

The vehicle interaction method and the vehicle interaction device provided by the invention are described in detail above, and the principle and the implementation mode of the invention are explained in the text by applying specific examples, and the description of the above embodiments is only used for helping to understand the method and the core idea of the invention; meanwhile, for a person skilled in the art, according to the idea of the present invention, there may be variations in the specific embodiments and the application scope, and in summary, the content of the present specification should not be construed as a limitation to the present invention.

Claims

1. A vehicle interaction method, characterized in that the method comprises:

2. The method according to claim 1, wherein the interaction area is provided with a control key, and the performing of the vehicle interaction corresponding to the user operation in response to the user operation acting on the interaction area provided on the steering wheel of the vehicle while the vehicle is in the driving state comprises:

3. The method according to claim 2, wherein the display area includes an instrument screen, the content presented by the instrument screen includes at least a first UI element, the control key includes a first control key corresponding to the instrument screen, and the performing, in response to a user operation applied to the control key while the vehicle is in the driving state, an operation corresponding to the user operation on the display area of the vehicle includes:

4. The method according to claim 3, wherein the performing, in response to a user operation acting on the control key while a vehicle is in a running state, an operation corresponding to the user operation in a display area of the vehicle includes:

5. The method according to claim 2, wherein the display area includes an in-vehicle center screen including a second UI element, the control key includes a second control key corresponding to the in-vehicle center screen, and the performing, in response to a user operation applied to the control key while the vehicle is in the traveling state, an operation corresponding to the user operation in the display area includes:

6. The method according to claim 5, wherein changing the second UI element to a selected state in the in-vehicle center screen in response to a user operation on the second control key while the vehicle is in the traveling state comprises:

7. The method according to claim 5, wherein the user operation includes a first user operation and a second user operation, and the changing the second UI element to a selected state in the in-vehicle center control screen in response to the user operation applied to the second control key while the vehicle is in the traveling state includes:

8. The method according to claim 7, wherein the changing the second UI element to a selected state in the in-vehicle center screen in response to a user operation acting on the second control key while the vehicle is in the running state, further comprises:

9. The method of claim 7, wherein the interaction area is provided with a plurality of independent keys, the independent keys comprise custom keys, and the performing of the vehicle interaction corresponding to the user operation in response to the user operation acting on the interaction area provided on the steering wheel of the vehicle while the vehicle is in the driving state comprises:

10. The method according to claim 9, wherein the performing of the vehicle interaction corresponding to the user operation in response to the user operation acting on the interaction region provided on the steering wheel of the vehicle while the vehicle is in the traveling state further comprises:

11. A vehicle interaction device, the device comprising:

12. A vehicle, characterized by comprising:

one or more processors; and

one or more machine readable media having instructions stored thereon that, when executed by the one or more processors, cause the vehicle to perform the method of one or more of claims 1-10.

13. One or more machine-readable media having instructions stored thereon, which when executed by one or more processors, cause the processors to perform the method of one or more of claims 1-10.