CN111409459B - Vehicle-mounted function control method, control device, vehicle and storage medium - Google Patents

Vehicle-mounted function control method, control device, vehicle and storage medium Download PDF

Info

Publication number
CN111409459B
CN111409459B CN202010183016.6A CN202010183016A CN111409459B CN 111409459 B CN111409459 B CN 111409459B CN 202010183016 A CN202010183016 A CN 202010183016A CN 111409459 B CN111409459 B CN 111409459B
Authority
CN
China
Prior art keywords
key
vehicle
touched
touch sensing
driver
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN202010183016.6A
Other languages
Chinese (zh)
Other versions
CN111409459A (en
Inventor
高子强
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Guangzhou Xiaopeng Motors Technology Co Ltd
Original Assignee
Guangzhou Xiaopeng Motors Technology Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Guangzhou Xiaopeng Motors Technology Co Ltd filed Critical Guangzhou Xiaopeng Motors Technology Co Ltd
Priority to CN202010183016.6A priority Critical patent/CN111409459B/en
Publication of CN111409459A publication Critical patent/CN111409459A/en
Application granted granted Critical
Publication of CN111409459B publication Critical patent/CN111409459B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • BPERFORMING OPERATIONS; TRANSPORTING
    • B60VEHICLES IN GENERAL
    • B60KARRANGEMENT OR MOUNTING OF PROPULSION UNITS OR OF TRANSMISSIONS IN VEHICLES; ARRANGEMENT OR MOUNTING OF PLURAL DIVERSE PRIME-MOVERS IN VEHICLES; AUXILIARY DRIVES FOR VEHICLES; INSTRUMENTATION OR DASHBOARDS FOR VEHICLES; ARRANGEMENTS IN CONNECTION WITH COOLING, AIR INTAKE, GAS EXHAUST OR FUEL SUPPLY OF PROPULSION UNITS IN VEHICLES
    • B60K35/00Instruments specially adapted for vehicles; Arrangement of instruments in or on vehicles
    • B60K35/10Input arrangements, i.e. from user to vehicle, associated with vehicle functions or specially adapted therefor
    • BPERFORMING OPERATIONS; TRANSPORTING
    • B60VEHICLES IN GENERAL
    • B60RVEHICLES, VEHICLE FITTINGS, OR VEHICLE PARTS, NOT OTHERWISE PROVIDED FOR
    • B60R16/00Electric or fluid circuits specially adapted for vehicles and not otherwise provided for; Arrangement of elements of electric or fluid circuits specially adapted for vehicles and not otherwise provided for
    • B60R16/005Electro-mechanical devices, e.g. switched
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/011Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
    • G06F3/013Eye tracking input arrangements
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/03Arrangements for converting the position or the displacement of a member into a coded form
    • G06F3/041Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means

Landscapes

  • Engineering & Computer Science (AREA)
  • General Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Human Computer Interaction (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Mechanical Engineering (AREA)
  • Chemical & Material Sciences (AREA)
  • Combustion & Propulsion (AREA)
  • Transportation (AREA)
  • User Interface Of Digital Computer (AREA)
  • Steering Controls (AREA)

Abstract

A vehicle-mounted function control method, a control device, a vehicle and a storage medium, the method is applied to the vehicle comprising a steering wheel and a vehicle-mounted camera device; the steering wheel includes at least one key the method comprising: detecting the sight line direction of a driver through the vehicle-mounted camera device; judging whether the sight line direction of the driver faces the key; and if the sight line direction is judged to face the key, responding to a control signal output when the key is touched, and executing the vehicle-mounted function corresponding to the key. By implementing the embodiment of the invention, the sight line direction of the driver can be detected through the vehicle-mounted camera device, and the key pressing requirement of the driver is verified by using the key and the sight line direction, so that the situation that the vehicle-mounted function is started by mistake due to mistaken touch is reduced, and the control precision of the vehicle-mounted function is improved.

Description

Vehicle-mounted function control method, control device, vehicle and storage medium
Technical Field
The invention relates to the technical field of vehicle control, in particular to a vehicle-mounted function control method, a vehicle-mounted function control device, a vehicle and a storage medium.
Background
Currently, most vehicles are provided with one or more function keys on a steering wheel, and each function key can control associated vehicle-mounted functions (such as a multimedia playing function and a vehicle-mounted call function). When a function key on the steering wheel is touched, the touched function key may output a corresponding control signal, so that a functional component inside the vehicle may perform a corresponding vehicle-mounted function in response to the control signal. Thus, the driver can control the in-vehicle function through the function key when holding the steering wheel.
However, in practice it has been found that the driver can hold the steering wheel in a number of different positions, while the function keys of most vehicles are arranged on the spokes of the steering wheel. This makes it easy for the driver to miss-touch the function keys when holding the steering wheel in certain postures, resulting in the corresponding vehicle-mounted functions being erroneously activated. Referring to fig. 1, fig. 1 is an exemplary view of a driver holding a steering wheel. When the driver holds the steering wheel in the posture shown in fig. 1, the palm of the hand is likely to touch the key by mistake.
Disclosure of Invention
The embodiment of the invention discloses a vehicle-mounted function control method, a control device, a vehicle and a storage medium, which can reduce the occurrence of the situation that the vehicle-mounted function is started by mistake due to mistaken touch.
The embodiment of the invention discloses a vehicle-mounted function control method on the first aspect,
the method is applied to a vehicle comprising a steering wheel and a vehicle-mounted camera device; the steering wheel comprises at least one key; the method comprises the following steps:
detecting the sight line direction of a driver through the vehicle-mounted camera device;
judging whether the sight line direction of the driver faces the key;
and if the sight line direction is judged to face the key, responding to a control signal output when the key is touched, and executing the vehicle-mounted function corresponding to the key.
As an optional implementation manner, in the first aspect of this embodiment of the present invention, the method further includes:
and if the sight line direction is judged not to face the key, shielding the control signal output when the key is touched.
As an alternative implementation, in a first aspect of an embodiment of the present invention,
the at least one key is arranged on a spoke of the steering wheel; the steering wheel further comprises a touch sensing device, wherein the touch sensing device is used for detecting human body touch and is arranged at the rim of the steering wheel; the method further comprises the following steps:
detecting whether a touch sensing area corresponding to the touch sensing device is touched by a human body through the touch sensing device;
and if the sight line direction does not face the key and the touch sensing area is detected to be touched by a human body, responding to a control signal output when the key is touched, and executing a vehicle-mounted function corresponding to the key. As an optional implementation manner, in the first aspect of this embodiment of the present invention, the method further includes:
detecting whether a touch sensing area corresponding to the touch sensing device is touched by a human body through the touch sensing device;
and after judging that the sight line direction is not towards the key and before shielding the control signal output when the key is touched, the method further comprises the following steps:
and if the touch control induction area is not touched by a human body, executing the control signal output when the shielding key is touched.
As an alternative implementation, in a first aspect of an embodiment of the present invention,
after the sight line direction is judged not to face the key and the touch sensing area is detected to be touched by a human body, and before the vehicle-mounted function corresponding to the key is executed in response to the control signal output when the key is touched, the method further comprises the following steps:
and if the fact that the pressed pressure value of the touch sensing area when touched by a human body is smaller than a first preset pressure threshold value is detected, executing the step of responding to the control signal output when the key is touched and executing the vehicle-mounted function corresponding to the key.
As an optional implementation manner, in the first aspect of the embodiment of the present invention, after determining that the line of sight direction is not facing to the key and detecting that the touch sensing area is touched by a human body, and before executing an in-vehicle function corresponding to the key in response to a control signal output when the key is touched, the method further includes:
and if the fact that the contact area of the touch sensing area and the human body is larger than a first preset area threshold value is detected, executing the step of responding to the control signal output when the key is touched and executing the vehicle-mounted function corresponding to the key.
As an alternative implementation, in a first aspect of an embodiment of the present invention,
the method further comprises the following steps:
if the touch sensing area is detected to be touched by a human body, and the contact area of the touch sensing area and the human body is smaller than a second preset area threshold value, shielding a control signal output when the key is touched;
the second preset area threshold is less than or equal to the first preset area threshold.
A second aspect of the embodiments of the present invention discloses a control device, which is characterized in that the control device is provided in a vehicle including a steering wheel and a vehicle-mounted camera device; the steering wheel comprises at least one key;
the control device includes:
the detection unit is used for detecting the sight direction of a driver through the vehicle-mounted camera device and judging whether the sight direction of the driver faces the key;
and the control unit is used for responding to a control signal output when the key is touched and executing the vehicle-mounted function corresponding to the key when the detection unit judges that the sight line direction faces to the key.
A third aspect of the embodiment of the invention discloses a vehicle including the control device disclosed in the first aspect of the embodiment of the invention.
A fourth aspect of the present invention discloses a computer-readable storage medium storing a computer program, wherein the computer program causes a computer to execute any one of the methods disclosed in the first aspect of the embodiments of the present invention.
A fifth aspect of the embodiments of the present invention discloses a computer program product, which, when running on a computer, causes the computer to execute any one of the methods disclosed in the first aspect of the embodiments of the present invention.
Compared with the prior art, the embodiment of the invention has the following beneficial effects:
in the embodiment of the invention, the sight direction of a driver is detected by a vehicle-mounted camera device; when the sight line direction is judged to face the keys arranged on the steering wheel, the control signals output by the keys are responded, double verification of the key requirements of a driver can be carried out by utilizing the keys and the sight line direction, the situation that the vehicle-mounted function is started mistakenly due to mistaken touch is reduced, and the control precision of the vehicle-mounted function is improved.
Drawings
In order to more clearly illustrate the technical solutions in the embodiments of the present invention, the drawings needed to be used in the embodiments will be briefly described below, and it is obvious that the drawings in the following description are only some embodiments of the present invention, and it is obvious for those skilled in the art that other drawings can be obtained according to these drawings without creative efforts.
FIG. 1 is an exemplary diagram of a driver's holding posture of a steering wheel according to an embodiment of the present disclosure;
FIG. 2 is a diagram illustrating an exemplary configuration of a vehicle interior according to an embodiment of the present invention;
FIG. 3 is a flow chart illustrating a method for controlling vehicle functions according to an embodiment of the present invention;
FIG. 4 is a flow chart illustrating another exemplary method for controlling vehicle functions according to an embodiment of the present disclosure;
FIG. 5A is an exemplary diagram of a position of a steering wheel held by a driver touching a button according to an embodiment of the present invention;
FIG. 5B is a diagram illustrating another example of the steering wheel held by the driver while touching the keys, according to an embodiment of the present invention;
FIG. 5C is an exemplary diagram of a position of a steering wheel held by a driver touching keys according to another embodiment of the disclosure;
FIG. 6A is a diagram illustrating another example of a driver's grip on a steering wheel according to an embodiment of the present disclosure;
FIG. 6B is a diagram illustrating another example of a driver's grip on a steering wheel, according to an embodiment of the present disclosure;
FIG. 6C is a diagram illustrating another example of a driver's grip on a steering wheel, according to an embodiment of the present disclosure;
FIG. 6D is an exemplary illustration of another driver's grip on the steering wheel, in accordance with an embodiment of the present invention;
FIG. 7 is a diagram illustrating an exemplary structure of a control device according to an embodiment of the present invention;
fig. 8 is a structural example diagram of another control device disclosed in the embodiment of the present invention.
Detailed Description
The technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the drawings in the embodiments of the present invention, and it is obvious that the described embodiments are only a part of the embodiments of the present invention, and not all of the embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention.
It is to be noted that the terms "comprises" and "comprising" and any variations thereof in the embodiments and drawings of the present invention are intended to cover non-exclusive inclusions. For example, a process, method, system, article, or apparatus that comprises a list of steps or elements is not limited to only those steps or elements listed, but may alternatively include other steps or elements not listed, or inherent to such process, method, article, or apparatus.
The embodiment of the invention discloses a vehicle-mounted function control method, a control device, a vehicle and a storage medium, which can reduce false touch and improve the control precision of controlling vehicle-mounted functions. The following are detailed below.
To better describe the in-vehicle function control method, the control apparatus, the vehicle, and the storage medium disclosed in the embodiments of the present invention,
a vehicle interior hardware configuration to which the embodiment of the present invention is applicable will be first described below. Referring to fig. 2, fig. 2 is a diagram illustrating an exemplary structure of a vehicle interior according to an embodiment of the present invention. As shown in fig. 2, the vehicle interior may be provided with an in-vehicle image pickup device 1 and a steering wheel 2.
The vehicle-mounted camera 1 may be used for capturing a face image of a driver, and may include, but is not limited to, a visible light camera, an infrared camera, or the like. As shown in fig. 2, the in-vehicle image pickup device may be provided in the a-pillar of the vehicle with the shooting direction directed toward the inside of the vehicle. In other possible examples, the vehicle-mounted imaging device 1 may also be disposed at a front windshield, a rear view mirror, or the like, with the imaging direction facing the inside of the vehicle; alternatively, the in-vehicle imaging device 1 may be provided on a steering wheel with the imaging direction facing the driver seat.
The steering wheel 2 may comprise a rim 20, spokes 21 and at least one key 22, wherein different keys 22 may control different vehicle functions respectively. The key 22 may be a mechanical press type key, or may be a touch type key, which is not limited in detail. For example, as shown in fig. 2, the keys 22 may be disposed on spokes of the steering wheel, and in other possible examples, the keys 22 may be disposed at the rim of the steering wheel. Optionally, the steering wheel 2 may further include a touch sensing device 23.
The touch sensing device 23 may be disposed at a rim of the steering wheel. For example, as shown in fig. 2, the touch sensing device 23 may be disposed at the connection between the spoke 21 and the rim 20 of the steering wheel and on the back of the steering wheel. Alternatively, if the keys 22 are disposed at two ends of the spoke 21 as shown in fig. 2, touch sensing devices 23A and 23B as shown in fig. 2 may be disposed at the connection points of the two ends of the spoke 21 and the rim 20, respectively; alternatively, if the key 22 is only disposed at any one end of the spoke 21, the touch sensing device 23 may be disposed only at the connection between the end of the spoke 21 where the key 22 is disposed and the rim 20, and is not particularly limited. In the embodiment of the present invention, the touch sensing device 23 may be used for detecting human touch, and may include, but is not limited to, a resistive touch sensor or a capacitive touch sensor. Optionally, the touch sensing device 23 may further include a pressure sensor for detecting the pressing pressure.
It is understood that the touch sensing device 23 may correspond to a certain effective detection area, which is a touch sensing area on the steering wheel (as shown by oblique lines in fig. 2), and the area size of the effective detection area may be determined by the coverage area of each sensor included in the touch sensing device 23. When a human body touches the portion of the steering wheel located in the touch sensing area, the touch sensing device 23 can detect the human body touch. Furthermore, it is understood that the location where the touch sensing device 23 is disposed may include a partial area of the back surface of the spoke 21, such that the touch sensing area may include a partial area of the back surface of the spoke (as shown in fig. 2); alternatively, the touch sensing device 23 may be disposed at a position not including the spoke 21, so that the touch sensing area includes a partial area on the back of the rim 20 but not a partial area on the back of the spoke. Optionally, the touch sensing device 23 is disposed at a position such that a difference between a distance between the upper boundary and the lower boundary of the touch sensing area and the width of the spoke 20 is smaller than a preset distance threshold. That is, the upper and lower boundaries of the touch sensing area should be close to the spoke 20.
Based on the above-mentioned vehicle internal hardware configuration, the following describes a vehicle-mounted function control method, a control device, a vehicle, and a storage medium disclosed in the embodiments of the present invention in detail.
Example one
Referring to fig. 3, fig. 3 is a schematic flow chart of a vehicle-mounted function control method according to an embodiment of the invention. As shown in fig. 3, the in-vehicle function control method may include the steps of:
301. detecting the sight direction of a driver through a vehicle-mounted camera device, and judging whether the sight direction of the driver faces to a key; if yes, go to step 302; if not, step 303 is performed.
In the embodiment of the invention, the vehicle-mounted camera device can shoot the face image of the driver and identify the eyes of the driver in the face image, so that the sight line direction of the driver can be identified. Furthermore, in the embodiment of the present invention, the driver's sight line direction facing key may include, but is not limited to, any one of the following cases: the driver's sight line is directed towards the steering wheel, the driver's sight line is directed towards the spoke, and the driver's sight line is directed towards a certain key. That is, when it is determined that the driver's sight line direction falls within the key and its peripheral area, it may be determined that the driver's sight line direction is directed toward the key.
For example, assuming that the vehicle-mounted camera device is arranged at the position of the a pillar, when it is recognized that the sight line direction of the driver is towards the front windshield, the driver may be observing the road ahead, and it may be determined that the sight line direction of the driver is not towards the key; when it is recognized that the driver's sight line direction is directed downward, it can be determined that the driver's sight line direction is directed toward the key.
It can be understood that not all drivers are quite familiar with the specific distribution of each key on the steering wheel, and most drivers generally view the setting position of the key on the steering wheel corresponding to the vehicle-mounted function to be started before touching the key when starting some vehicle-mounted functions. Therefore, in the embodiment of the present invention, if it is determined that the sight line direction of the driver is toward the key, it can be determined that the driver really has a key request, and step 303 is directly executed; otherwise, the operation of touching the key at this time can be determined as a false determination, and step 302 is executed.
302. And responding to the control signal output by the touched key to execute the vehicle-mounted function corresponding to the key.
303. And shielding the control signal output when the key is touched.
It can be seen that in the method described in fig. 3, by determining whether the line of sight direction of the driver is towards the key, it can be further verified whether the driver really has a key demand. When the sight line direction is judged to face the key, the control signal output by the key is responded, the situation that the vehicle-mounted function is started mistakenly due to mistaken touch can be reduced, and the control precision of the vehicle-mounted function is improved.
Example two
Referring to fig. 4, fig. 4 is a schematic flow chart of another vehicle-mounted function control method according to an embodiment of the present invention. As shown in fig. 4, the in-vehicle function control method may include the steps of:
401. detecting the sight direction of a driver through a vehicle-mounted camera device, and judging whether the sight direction of the driver faces to a key arranged on a spoke or not; if yes, go to step 403; if not, go to step 402.
In the embodiment of the present invention, if it is determined that the sight line of the driver faces the key, it can be determined that the driver really has a key demand, and step 403 is directly executed; otherwise, step 402 is executed to further verify whether the driver mistakenly touches the key through the touch sensing device.
402. Detecting whether a touch sensing area corresponding to the touch sensing device is touched by a human body through the touch sensing device; if yes, go to step 403; if not, go to step 404.
In the embodiment of the present invention, please refer to fig. 5A-5C. Fig. 5A-5C are exemplary diagrams of a posture of holding a steering wheel when a driver touches keys according to an embodiment of the present invention. It should be noted that fig. 5A to 5C show the upper and lower boundaries of the touch sensing area on the back of the steering wheel in dotted lines for easy understanding. When the driver needs to touch the keys, the driver generally holds the steering wheel in the posture shown in fig. 5A to 5C, and the palm of the driver surrounds the rim of the wheel and is located a short distance from the keys. The palm of the driver naturally touches the touch sensing area, and the touch sensing device can detect that the sensing area is touched by a human body. Therefore, when it is detected that the touch sensing area is touched by a human body, it can be determined that the driver does have a key demand at this time, and step 403 described below is executed, so that the in-vehicle function corresponding to the key can be executed in response to the control signal output when the key is touched.
Referring to fig. 6A-6D together, fig. 6A-6D are schematic diagrams illustrating another type of posture of a driver holding a steering wheel according to an embodiment of the present invention. Dotted lines in fig. 6A-6D show the upper and lower boundaries of the touch sensing area on the back of the steering wheel. When the driver holds the steering wheel in any one of the postures shown in fig. 6A to 6D, the driver generally has no need of pressing keys, and the palm of the driver generally does not touch the touch sensing area on the steering wheel. Therefore, even if the control signal outputted when the key is touched is detected, if it is detected that the touch sensing area is not touched by the human body, it can be determined that the key is touched by mistake, and the following step 404 is executed.
403. And responding to the control signal output by the touched key to execute the vehicle-mounted function corresponding to the key.
In the embodiment of the invention, the control signal is output when the key is touched.
404. And shielding the control signal output when the key is touched.
In the embodiment of the present invention, when it is determined that the sight line of the driver is not oriented to the key and it is not detected that the touch sensing area is touched by a human body, it may be determined that the driver mistakenly touches the key, and step 404 is executed to avoid mistakenly starting the corresponding vehicle-mounted function.
Optionally, after the step 402 is executed to detect that the touch sensing area is touched by the human body, it may be further determined whether to execute the step 403 or the step 404 according to a magnitude of a pressure applied to the touch sensing area or a contact area between the touch sensing area and the human body. As described separately below.
As an alternative implementation manner, if it is detected that the touch sensing area is touched by a human body, and the pressure value of the touch sensing area pressed when the touch sensing area is touched by the human body is smaller than the first preset pressure threshold, step 403 is performed;
if it is detected that the touch sensing area is touched by a human body and the pressed pressure value of the touch sensing area when touched by the human body is greater than the second preset pressure threshold, step 404 is executed.
Wherein the second preset pressure threshold may be greater than or equal to the first preset pressure threshold. Optionally, the first preset pressure threshold may be set with reference to a pressure value pressed by the touch sensing area when the driver holds the steering wheel in a virtual manner; the second preset pressure threshold value can be set by referring to a pressure value when the driver rotates the steering wheel, and the touch sensing area is pressed.
By implementing the embodiment, whether the driver is performing the turning operation can be judged according to the magnitude of the pressure value pressed when the touch sensing area is touched by the human body. When the vehicle runs in a straight line, a driver does not need to rotate the steering wheel, so that the steering wheel is generally held in a virtual manner with small force, and the pressure value of the touch sensing area is small. At this time, the probability that the driver erroneously touches the key is low, and if the control signal output when the key is touched is acquired, it can be determined that the driver really has a key request, and step 403 is executed. When the vehicle turns, the driver needs to rotate the steering wheel, the steering wheel is often held by large force, and the pressure value of the touch sensing area pressed is large. If the control signal output by the key is acquired at this time, the control signal is likely to be triggered due to the false touch, so step 404 is executed.
For example, please refer to fig. 5A. When the driver holds the steering wheel in the posture shown in fig. 5A, if the vehicle is controlled to run straight, the driver holds the steering wheel with a small force; if the vehicle is controlled to turn, the driver needs to hold the steering wheel with great force to rotate the steering wheel. As can be seen, with the above-described embodiment, even if the driver holds the steering wheel in the posture shown in fig. 5A, it is possible to reduce the occurrence of erroneous activation of the in-vehicle function due to erroneous touch of the key.
As another optional implementation manner, if it is detected that the touch sensing area is touched by a human body, and the contact area between the touch sensing area and the human body is greater than the first preset area threshold, step 403 is executed;
if it is detected that the touch sensing area is touched by a human body and the contact area between the touch sensing area and the human body is smaller than the second predetermined area threshold, step 404 is executed.
The second preset area threshold may be less than or equal to the first preset area threshold.
By implementing the embodiment, whether the touched operation of the key is mistaken touch can be judged through the contact area between the touch sensing area and the human body. For example, if the driver touches the keys while holding the steering wheel, the gestures shown in fig. 5A-5C are generally adopted. As can be seen from fig. 5A to 5C, the palm of the driver surrounds the edge of the steering wheel, and the contact area between the touch sensing area and the human body is larger. If the driver holds the steering wheel in the postures shown in fig. 6A to 6D, the driver may not have a key demand. When the driver holds the steering wheel in the posture shown in fig. 6D, fingers may erroneously touch the control sensing area. However, as can be seen from fig. 6D, the contact area between the finger and the touch sensing area is smaller. Therefore, when it is detected that the contact area between the touch sensing area and the human body is large, it can be determined that the driver really has a key demand, and step 403 is executed; when it is detected that the contact area between the touch sensing area and the human body is small, it can be determined that the driver mistakenly touches the key and the touch sensing area, and step 404 is executed.
In summary, in the embodiment of the present invention, when at least one of the following conditions is satisfied, step 403 is executed to respond to the control signal output by the key: 1. the sight direction of the driver faces the key; 2. the sight direction of the driver does not face the keys, and the touch sensing area is touched by a human body; 3. the sight direction of the driver does not face the key, and the pressure value of the touch sensing area pressed is smaller than a first preset pressure threshold value; 4. the sight line direction of the driver does not face the key, and the contact area of the touch sensing area and the human body is larger than a first preset area threshold value.
When at least one of the following conditions is satisfied, step 404 is executed to mask the control signal output by the key: the sight line direction of the driver does not face the keys, and the touch sensing area is not touched by a human body; the sight direction of the driver does not face the key, and the pressure value of the touch sensing area pressed is larger than a second preset pressure threshold value; the sight line direction of the driver does not face the key, and the contact area of the touch sensing area and the human body is smaller than a second preset area threshold value.
It can be seen that in the method depicted in fig. 4, when the driver's attention is placed on the key (i.e., the direction of the line of sight is toward the key), the control signal output by the key can be responded directly; otherwise, whether the touch sensing area is touched by a human body can be detected so as to further verify whether the driver mistakenly touches the key. In addition, when the touch sensing area is detected to be touched by a human body, whether a control signal output by a key is responded or not can be further judged according to the pressure of the touch sensing area, so that the condition that the vehicle-mounted function is started mistakenly due to mistaken touch of the key when a driver rotates a steering wheel can be reduced; and whether the control signal output by the key is responded can be further judged according to the contact area between the touch sensing area and the human body, so that the control signal output by the key can be shielded when the driver mistakenly touches the key due to improper posture of holding the steering wheel, and the corresponding vehicle-mounted function is prevented from being started mistakenly.
EXAMPLE III
Referring to fig. 7, fig. 7 is a schematic structural diagram of a control device according to an embodiment of the present invention. The control device shown in fig. 7 may be provided in a vehicle including the steering wheel and the vehicle-mounted camera shown in fig. 2, and the control device may perform data transmission with the keys provided on the steering wheel and the vehicle-mounted camera. The control device shown in fig. 7 may include:
a detection unit 701, configured to detect a line of sight direction of a driver through a vehicle-mounted camera, and determine whether the line of sight direction of the driver faces a key;
a control unit 702 configured to execute an in-vehicle function corresponding to the key in response to a control signal output when the key is touched when the detection unit 701 determines that the line of sight direction of the driver is toward the key; alternatively, the detection unit 701 may be configured to shield a control signal output when the key is touched when the driver's sight line direction is determined not to be directed to the key.
Optionally, the control device shown in fig. 7 may also perform data transmission with a touch sensing device on the steering wheel. The detection unit 701 may further be configured to detect whether a touch sensing area corresponding to the touch sensing device is touched by a human body through the touch sensing device; (ii) a
Accordingly, the control unit 702 may be specifically configured to, when the detection unit 701 determines that the line-of-sight direction of the driver is toward the key, respond to the control signal and execute the vehicle-mounted function corresponding to the key; or,
the touch control unit 701 may be configured to, when the detection unit 701 determines that the line of sight of the driver is not oriented to the key but detects that the touch control sensing area is touched by a human body, respond to a control signal output when the key is touched, and execute a vehicle-mounted function corresponding to the key; or,
the shielding unit can be used for shielding the control signal output when the key is touched when the detection unit 701 determines that the sight line direction of the driver is not towards the key and the touch sensing area is not detected to be touched by a human body.
Further optionally, the control unit 702 is configured to, when the detection unit 701 determines that the line of sight of the driver is not oriented to the key but detects that the touch sensing area is touched by a human body, respond to a control signal output when the key is touched, and execute a vehicle-mounted function corresponding to the key; the implementation mode of (1) may specifically include:
the control unit 702 is configured to, when the detection unit 701 determines that the line of sight of the driver is not oriented to the key, but detects that the touch sensing area is touched by a human body, and a pressed pressure value during the touch is smaller than a first preset pressure threshold value, respond to a control signal output when the key is touched, and execute a vehicle-mounted function corresponding to the key.
In addition, the control unit 702 may be further configured to shield the control signal output when the key is touched when the detection unit 701 determines that the line of sight of the driver is not oriented to the key, but detects that the touch sensing area is touched by a human body, and a pressure value pressed during the touch is greater than a second preset pressure threshold value.
Further optionally, when the detection unit 701 detects that the line of sight of the driver is off and the touch-sensitive area is touched by a human body, the implementation manner of the control unit 702 for executing the vehicle-mounted function corresponding to the key in response to the control signal output when the key is touched may further include:
the control unit 702 is configured to, when the detection unit 701 detects that the driver's sight line is cut off, the driver's sight line direction is not facing the key, but the touch sensing area is detected to be touched by a human body, and a contact area between the touch sensing area and the human body is greater than a first preset area threshold, respond to a control signal output when the key is touched, and execute a vehicle-mounted function corresponding to the key.
The control unit 702 may be further configured to shield the control signal output when the key is touched when the detection unit 701 detects that the driver's sight line direction is cut off and the key is not facing the touch sensing area, but the touch sensing area is detected to be touched by a human body, and a contact area between the touch sensing area and the human body is greater than a second preset area threshold.
It can be seen that, with the control device shown in fig. 7, it is possible to further verify whether the driver really has a key demand through the touch sensing device disposed on the back of the steering wheel. When the touch sensing area is detected to be touched by a human body, the control signal output by the key is responded, and therefore the control precision of the vehicle-mounted function is improved. Further, the control device shown in fig. 7 directly responds to the control signal output from the key when recognizing that the driver is paying attention to the key; otherwise, whether the touch sensing area is touched by a human body is further detected, so that double verification can be selectively performed by using the touch sensing device under the scene with higher risk of mistaken touch, and user experience can be improved. Furthermore, the control device shown in fig. 7 can determine whether to respond to the control signal output by the key according to the magnitude of the pressure applied to the touch sensing area or the contact area between the touch sensing area and the human body, so that the control signal output by the key can be shielded when the driver rotates the steering wheel and mistakenly touches the key, or when the driver mistakenly touches the key due to an improper posture of holding the steering wheel, so as to prevent the corresponding vehicle-mounted function from being started mistakenly.
Example four
Referring to fig. 8, fig. 8 is a schematic structural diagram of another control device according to an embodiment of the disclosure. As shown in fig. 8, the control device may include:
a processor 810, a memory 820, a key 830, a touch sensing device 840 and an on-vehicle camera device 850; the touch sensing device 840 may include a touch sensor 840A and a pressure sensor 840B.
It is to be understood that the illustrated structure of the embodiment of the present invention does not constitute a specific limitation to the control device shown in fig. 8. In other embodiments of the present application, the control device shown in FIG. 8 may include more or fewer components than shown, or some components may be combined, some components may be separated, or a different arrangement of components. The illustrated components may be implemented in hardware, software, or a combination of software and hardware. Processor 810 may include one or more processing units, where the various processing units may be stand-alone devices or may be integrated within one or more processors. A memory 820 may also be provided in the processor 810, the memory 820 being for storing instructions and data. In some embodiments, the memory 820 in the processor 810 may be a cache memory. The memory 820 may hold instructions or data that have just been used or recycled by the processor 810. If the processor 810 needs to reuse the instructions or data, it may call directly from the memory 820. Avoiding repeated accesses reduces the latency of the processor 810, thereby increasing the efficiency of the system.
The key 830 may be a mechanical press type key or a touch type key.
The touch sensing device 840 for detecting human touch may be disposed on a surface of a steering wheel of a vehicle. Here, the touch sensor 840A is also referred to as a "touch device". The touch sensor 840A may be disposed on a surface of a rim of the steering wheel for detecting a touch operation applied to the surface of the steering wheel. In some embodiments, the touch sensing device 840A may include a plurality of touch sensors 840A, and each touch sensor 840A may detect a human touch applied within a valid detection range corresponding to the touch sensor. The pressure sensor 840B is used for sensing a pressure signal, and can convert the pressure signal into an electrical signal. Pressure sensor 840B may comprise, for example, a resistive pressure sensor, an inductive pressure sensor, a capacitive pressure sensor, or the like. Each pressure sensor 840B can detect the amount of pressure applied within the valid detection range for that pressure sensor. The effective detection ranges respectively corresponding to the touch sensors 840A and the effective detection ranges respectively corresponding to the pressure sensors 840B may form a touch sensing area.
The in-vehicle image pickup device 850 is used to pick up still images or videos, and may include a visible light image pickup device, an infrared image pickup device, and the like.
In the embodiment of the present invention, the in-vehicle camera 850 may transmit the captured facial image of the driver to the processor 810, and the processor 810 recognizes the line-of-sight direction of the driver from the facial image; the keys 830 may detect a key input of the driver and generate and transmit a control signal to the processor 810 when the key input of the driver is detected. The processor 810, upon receiving the control signal transmitted by the key 830, may determine whether the driver's gaze direction is towards the key 830; if yes, the processor 810 responds to the control signal transmitted by the key 830 and executes the vehicle-mounted function corresponding to the key 830; if not, the processor 810 masks the control signal.
Optionally, after receiving the control signal transmitted by the key 830 and determining that the driver's sight line direction is not facing the key 830, the processor 810 may further determine whether a touch operation transmitted by the touch sensor 840A is received; if yes, the processor 810 responds to the control signal transmitted by the key 830 and executes the vehicle-mounted function corresponding to the key 830; if not, the processor 810 masks the control signal.
Further optionally, the processor 810 may further receive a pressure value, which is transmitted by the pressure sensor 840B and is pressed when the touch sensing area on the steering wheel is touched; after receiving the control signal transmitted by the key 830 and determining that the driver's sight line direction is not facing the key 830, the processor 810 may further determine whether the pressure value is smaller than a first preset pressure threshold; if yes, responding to the control signal transmitted by the key 830, and executing the vehicle-mounted function corresponding to the key 830; or judging whether the pressure value is greater than a second preset pressure threshold value; if so, the processor 810 masks the control signal.
Still further alternatively, the processor 810 may count the number of touch sensors 840A that transmit touch operations to the processor 810 at the same time, so as to determine the contact area with the human body when the sensing region is touched according to the number; and after receiving the control signal transmitted by the key 830 and determining that the driver's sight line direction is not oriented to the key 830, determining whether the contact area is larger than a first preset area threshold, if so, responding to the control signal transmitted by the key 830 to execute the vehicle-mounted function corresponding to the key 830, or, determining whether the contact area is smaller than a second preset area threshold, and if so, shielding the control signal by the processor 810.
The embodiment of the invention discloses a vehicle which comprises a control device shown in figure 7 or figure 8.
The embodiment of the invention discloses a computer-readable storage medium which stores a computer program, wherein the computer program enables a computer to execute any one of the vehicle-mounted function control methods shown in fig. 3 or fig. 4.
An embodiment of the present invention discloses a computer program product, which includes a non-transitory computer-readable storage medium storing a computer program, and the computer program is operable to cause a computer to execute any one of the in-vehicle function control methods shown in fig. 3 or fig. 4.
It should be appreciated that reference throughout this specification to "one embodiment" or "an embodiment" means that a particular feature, structure or characteristic described in connection with the embodiment is included in at least one embodiment of the present invention. Thus, the appearances of the phrases "in one embodiment" or "in an embodiment" in various places throughout this specification are not necessarily all referring to the same embodiment. Furthermore, the particular features, structures, or characteristics may be combined in any suitable manner in one or more embodiments. Those skilled in the art should also appreciate that the embodiments described in this specification are exemplary and alternative embodiments, and that the acts and modules illustrated are not required in order to practice the invention.
In various embodiments of the present invention, it should be understood that the sequence numbers of the above-mentioned processes do not imply an inevitable order of execution, and the execution order of the processes should be determined by their functions and inherent logic, and should not constitute any limitation on the implementation process of the embodiments of the present invention.
The units described as separate parts may or may not be physically separate, and parts displayed as units may or may not be physical units, may be located in one place, or may be distributed on a plurality of network units. Some or all of the units can be selected according to actual needs to achieve the purpose of the solution of the embodiment.
In addition, functional units in the embodiments of the present invention may be integrated into one processing unit, or each unit may exist alone physically, or two or more units are integrated into one unit. The integrated unit can be realized in a form of hardware, and can also be realized in a form of a software functional unit.
The integrated units, if implemented as software functional units and sold or used as a stand-alone product, may be stored in a computer accessible memory. Based on such understanding, the technical solution of the present invention, which is a part of or contributes to the prior art in essence, or all or part of the technical solution, can be embodied in the form of a software product, which is stored in a memory and includes several requests for causing a computer device (which may be a personal computer, a server, a network device, or the like, and may specifically be a processor in the computer device) to execute part or all of the steps of the above-described method of each embodiment of the present invention.
It will be understood by those skilled in the art that all or part of the steps in the methods of the embodiments described above may be implemented by hardware instructions of a program, and the program may be stored in a computer-readable storage medium, where the storage medium includes Read-Only Memory (ROM), Random Access Memory (RAM), Programmable Read-Only Memory (PROM), Erasable Programmable Read-Only Memory (EPROM), One-time Programmable Read-Only Memory (OTPROM), Electrically Erasable Programmable Read-Only Memory (EEPROM), Compact Disc Read-Only Memory (CD-ROM), or other Memory, such as a magnetic disk, or a combination thereof, A tape memory, or any other medium readable by a computer that can be used to carry or store data.
The vehicle-mounted function control method, the vehicle-mounted function control device, the vehicle and the storage medium disclosed in the embodiments of the present invention are described in detail, and the principle and the implementation of the present invention are explained in the present document by applying specific examples, and the description of the above embodiments is only used to help understanding the method and the core idea of the present invention. Meanwhile, for a person skilled in the art, according to the idea of the present invention, there may be variations in the specific embodiments and the application scope, and in summary, the content of the present specification should not be construed as a limitation to the present invention.

Claims (9)

1. A vehicle-mounted function control method is characterized in that the method is applied to a vehicle comprising a steering wheel and a vehicle-mounted camera device; the steering wheel comprises at least one key; the at least one key is arranged on a spoke of the steering wheel; the steering wheel further comprises a touch sensing device, wherein the touch sensing device is used for detecting human body touch and is arranged at the rim of the steering wheel; the method comprises the following steps:
detecting the sight line direction of a driver through the vehicle-mounted camera device;
judging whether the sight line direction of the driver faces the key;
if the sight line direction is judged to face the key, responding to a control signal output when the key is touched, and executing a vehicle-mounted function corresponding to the key, wherein the sight line direction facing key comprises any one of the following: the sight line direction of the driver faces to a steering wheel, the sight line direction of the driver faces to spokes, and the sight line direction of the driver faces to one key;
detecting whether a touch sensing area corresponding to the touch sensing device is touched by a human body through the touch sensing device;
and if the sight line direction does not face the key and the touch sensing area is detected to be touched by a human body, responding to a control signal output when the key is touched, and executing a vehicle-mounted function corresponding to the key.
2. The method of claim 1, further comprising:
and if the sight line direction is judged not to face the key, shielding the control signal output when the key is touched.
3. The method of claim 2, further comprising:
detecting whether a touch sensing area corresponding to the touch sensing device is touched by a human body through the touch sensing device;
and after judging that the sight line direction is not towards the key and before shielding the control signal output when the key is touched, the method further comprises the following steps:
and if the touch control induction area is not touched by a human body, executing the control signal output when the shielding key is touched.
4. The method according to claim 1, wherein after determining that the line of sight is not oriented toward the key and detecting that the touch sensing area is touched by a human body, and before executing the vehicle-mounted function corresponding to the key in response to the control signal output when the key is touched, the method further comprises:
and if the fact that the pressed pressure value of the touch sensing area when touched by a human body is smaller than a first preset pressure threshold value is detected, executing the step of responding to the control signal output when the key is touched and executing the vehicle-mounted function corresponding to the key.
5. The method according to claim 1, wherein after determining that the line of sight is not oriented toward the key and detecting that the touch sensing area is touched by a human body, and before executing the vehicle-mounted function corresponding to the key in response to the control signal output when the key is touched, the method further comprises:
and if the fact that the contact area of the touch sensing area and the human body is larger than a first preset area threshold value is detected, executing the step of responding to the control signal output when the key is touched and executing the vehicle-mounted function corresponding to the key.
6. The method of claim 5, further comprising:
if the touch sensing area is detected to be touched by a human body, and the contact area of the touch sensing area and the human body is smaller than a second preset area threshold value, shielding a control signal output when the key is touched;
the second preset area threshold is less than or equal to the first preset area threshold.
7. A control device is characterized in that the control device is arranged on a vehicle comprising a steering wheel and a vehicle-mounted camera device; the steering wheel comprises at least one key; the at least one key is arranged on a spoke of the steering wheel; the steering wheel further comprises a touch sensing device, wherein the touch sensing device is used for detecting human body touch and is arranged at the rim of the steering wheel; the control device includes:
the detection unit is used for detecting the sight direction of a driver through the vehicle-mounted camera device and judging whether the sight direction of the driver faces the key;
the control unit is used for responding to a control signal output when the key is touched and executing the vehicle-mounted function corresponding to the key when the detection unit judges that the sight line direction faces to the key, wherein the sight line direction faces to the key and comprises any one of the following components: the sight line direction of the driver faces to a steering wheel, the sight line direction of the driver faces to spokes, and the sight line direction of the driver faces to one key;
the detection unit is also used for detecting whether a touch sensing area corresponding to the touch sensing device is touched by a human body through the touch sensing device;
and the control unit is also used for responding to a control signal output when the key is touched and executing a vehicle-mounted function corresponding to the key if the sight line direction is judged not to face the key and the touch induction area is detected to be touched by a human body.
8. A vehicle characterized by comprising the control device according to claim 7.
9. A computer-readable storage medium storing a computer program, characterized in that: the computer program causes a computer to execute the in-vehicle function control method according to any one of claims 1 to 6.
CN202010183016.6A 2020-03-16 2020-03-16 Vehicle-mounted function control method, control device, vehicle and storage medium Active CN111409459B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202010183016.6A CN111409459B (en) 2020-03-16 2020-03-16 Vehicle-mounted function control method, control device, vehicle and storage medium

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202010183016.6A CN111409459B (en) 2020-03-16 2020-03-16 Vehicle-mounted function control method, control device, vehicle and storage medium

Publications (2)

Publication Number Publication Date
CN111409459A CN111409459A (en) 2020-07-14
CN111409459B true CN111409459B (en) 2021-12-07

Family

ID=71487616

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202010183016.6A Active CN111409459B (en) 2020-03-16 2020-03-16 Vehicle-mounted function control method, control device, vehicle and storage medium

Country Status (1)

Country Link
CN (1) CN111409459B (en)

Families Citing this family (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN116198435B (en) * 2023-05-04 2023-09-05 长城汽车股份有限公司 Vehicle control method and device, vehicle and storage medium

Citations (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6418362B1 (en) * 2000-10-27 2002-07-09 Sun Microsystems, Inc. Steering wheel interface for vehicles
CN1424968A (en) * 2000-02-18 2003-06-18 齐亚德·贝达尼 Arrangement for switch-equipped steering wheel
CN103010125A (en) * 2012-12-12 2013-04-03 深圳市凌启电子有限公司 Vehicle electronic device control method and system
CN107121944A (en) * 2016-02-25 2017-09-01 腾讯科技(深圳)有限公司 Vehicle-mounted function control method and steering wheel controller
CN107632711A (en) * 2017-09-28 2018-01-26 上海与德科技有限公司 The control method and control system of terminal
CN110562168A (en) * 2019-08-26 2019-12-13 武汉格罗夫氢能汽车有限公司 Anti-mistaken-collision system for switch keys of hydrogen energy automobile steering wheel
CN110723194A (en) * 2019-10-17 2020-01-24 宝能(广州)汽车研究院有限公司 Steering wheel with touch function and signal control method
CN110834641A (en) * 2019-11-26 2020-02-25 奇瑞汽车股份有限公司 Driving behavior monitoring and alarming system and method

Family Cites Families (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR101500130B1 (en) * 2013-09-02 2015-03-06 현대자동차주식회사 Apparatus for Controlling Vehicle installation on Steering wheel

Patent Citations (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN1424968A (en) * 2000-02-18 2003-06-18 齐亚德·贝达尼 Arrangement for switch-equipped steering wheel
US6418362B1 (en) * 2000-10-27 2002-07-09 Sun Microsystems, Inc. Steering wheel interface for vehicles
CN103010125A (en) * 2012-12-12 2013-04-03 深圳市凌启电子有限公司 Vehicle electronic device control method and system
CN107121944A (en) * 2016-02-25 2017-09-01 腾讯科技(深圳)有限公司 Vehicle-mounted function control method and steering wheel controller
CN107632711A (en) * 2017-09-28 2018-01-26 上海与德科技有限公司 The control method and control system of terminal
CN110562168A (en) * 2019-08-26 2019-12-13 武汉格罗夫氢能汽车有限公司 Anti-mistaken-collision system for switch keys of hydrogen energy automobile steering wheel
CN110723194A (en) * 2019-10-17 2020-01-24 宝能(广州)汽车研究院有限公司 Steering wheel with touch function and signal control method
CN110834641A (en) * 2019-11-26 2020-02-25 奇瑞汽车股份有限公司 Driving behavior monitoring and alarming system and method

Also Published As

Publication number Publication date
CN111409459A (en) 2020-07-14

Similar Documents

Publication Publication Date Title
JP2018150043A (en) System for information transmission in motor vehicle
US10486531B2 (en) Vehicle display system
JP2018150043A5 (en)
JP2016119032A (en) Touch display contact detection apparatus and touch display contact detection method
US20200201320A1 (en) Mobile terminal and remote operation method
US20170003853A1 (en) Vehicle and Method of Controlling the Same
CN111552368A (en) Vehicle-mounted human-computer interaction method and vehicle-mounted equipment
CN112776600A (en) Vehicle input device, vehicle input method, and non-transitory storage medium
US20140168068A1 (en) System and method for manipulating user interface using wrist angle in vehicle
EP3570140B1 (en) Control method and device for vehicle-mounted system
CN111409459B (en) Vehicle-mounted function control method, control device, vehicle and storage medium
US9475443B2 (en) Airbag adjustment based on driver position
CN114429624A (en) Sight line input device
CN107291219B (en) User interface, vehicle and method for identifying a hand of a user
CN110588759B (en) Vehicle steering control method and device
JP6581482B2 (en) Image recognition device
US20140320430A1 (en) Input device
US20210001914A1 (en) Vehicle input device
US20140098998A1 (en) Method and system for controlling operation of a vehicle in response to an image
CN113799791B (en) Steering wheel key false touch prevention method and device based on camera and vehicle
KR101339833B1 (en) Method and apparatus for providing active user manual by using touch sensor
CN116501167A (en) In-vehicle interaction system based on gesture operation and vehicle
JP2020185861A (en) Signal processing device of touch sensor, operation device including touch sensor and signal processing device, and signal processing method of touch sensor
CN115756204A (en) Key function triggering method and steering wheel control panel assembly
JP6188468B2 (en) Image recognition device, gesture input device, and computer program

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant