CN111301311A - Steering wheel button based on camera - Google Patents
Steering wheel button based on camera Download PDFInfo
- Publication number
- CN111301311A CN111301311A CN202010124189.0A CN202010124189A CN111301311A CN 111301311 A CN111301311 A CN 111301311A CN 202010124189 A CN202010124189 A CN 202010124189A CN 111301311 A CN111301311 A CN 111301311A
- Authority
- CN
- China
- Prior art keywords
- camera
- steering wheel
- vehicle body
- user
- image recognition
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Images
Classifications
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60R—VEHICLES, VEHICLE FITTINGS, OR VEHICLE PARTS, NOT OTHERWISE PROVIDED FOR
- B60R16/00—Electric or fluid circuits specially adapted for vehicles and not otherwise provided for; Arrangement of elements of electric or fluid circuits specially adapted for vehicles and not otherwise provided for
- B60R16/005—Electro-mechanical devices, e.g. switched
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B62—LAND VEHICLES FOR TRAVELLING OTHERWISE THAN ON RAILS
- B62D—MOTOR VEHICLES; TRAILERS
- B62D1/00—Steering controls, i.e. means for initiating a change of direction of the vehicle
- B62D1/02—Steering controls, i.e. means for initiating a change of direction of the vehicle vehicle-mounted
- B62D1/04—Hand wheels
- B62D1/046—Adaptations on rotatable parts of the steering wheel for accommodation of switches
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60R—VEHICLES, VEHICLE FITTINGS, OR VEHICLE PARTS, NOT OTHERWISE PROVIDED FOR
- B60R2300/00—Details of viewing arrangements using cameras and displays, specially adapted for use in a vehicle
- B60R2300/10—Details of viewing arrangements using cameras and displays, specially adapted for use in a vehicle characterised by the type of camera system used
- B60R2300/105—Details of viewing arrangements using cameras and displays, specially adapted for use in a vehicle characterised by the type of camera system used using multiple cameras
Abstract
The application discloses steering wheel button based on camera, including setting up at least one camera on the vehicle body, at least include the virtual key region on the steering wheel of vehicle in the visual field of camera, the camera is connected to image recognition and judges the unit, the image recognition judges the unit other end and is connected to the control unit on the vehicle body through the interface unit on the vehicle body, the camera is used for acquireing the user's thumb action in the virtual key region, image recognition judges the unit and is used for discerning user's thumb action and judging the control command who corresponds rather than, the interface unit is used for transmitting control command to the control unit, the control unit is used for carrying out control command. Above-mentioned steering wheel button based on camera can effectively reduce the entity button quantity on the steering wheel, reduces the circuit complexity on the steering wheel, need not capacitive switch, reduction in production cost, and simple easy operation promotes user's use and experiences.
Description
Technical Field
The invention belongs to the technical field of vehicle intelligent equipment, and particularly relates to a steering wheel key based on a camera.
Background
In current vehicle, for convenient operation, set up a lot of function button usually on the steering wheel to make things convenient for driver's operation, shorten the time that the driver looked for the button, effectively promote the security of driving. Common integrated functions on a steering wheel are: the system comprises the following components of Bluetooth telephone answering and hanging up, multimedia control, constant speed cruise, voice navigation, voice control, instrument control, driving computer control, lane keeping, yaw early warning, sound control and the like. Such a large number of functions requires many keys, and the easy operation area on the steering wheel is limited, and if there are too many function keys on the steering wheel, the keys are too dense, the appearance is complicated, and misoperation is more easily caused. For the situation, some automobile manufacturers accept or reject the function of the steering wheel keys, and therefore the accepting or rejecting of the function is inevitable, and some automobile manufacturers also adopt touch sensing materials on the steering wheel to execute different functions by sensing gestures of users on touch areas, but the method needs new materials and occupies positions of other function keys, so that the defect is obvious. In addition, some proposals adopt gesture recognition based on a camera to replace some function keys, but the gestures are recognized by the methods and are all gestures or actions of the whole hand, and the gesture of part of the gestures is easy to cause error recognition, and in this case, the hand of the driver needs to be suspended when the driver operates the driver, which causes inconvenience in operation and easily causes fatigue to the arm of the operator.
Disclosure of Invention
In order to solve the problems, the invention provides a steering wheel key based on a camera, which can effectively reduce the number of physical keys on a steering wheel, reduce the complexity of a circuit on the steering wheel, avoid a capacitance switch, reduce the production cost, is simple and easy to operate, and improve the use experience of a user.
The invention provides a steering wheel key based on a camera, which comprises at least one camera arranged on a vehicle body, wherein the view field of the camera at least comprises a virtual key area on a steering wheel of the vehicle, the camera is connected to an image recognition judging unit, the other end of the image recognition judging unit is connected to a control unit on the vehicle body through an interface unit on the vehicle body, the camera is used for acquiring the action of a user thumb in the virtual key area, the image recognition judging unit is used for recognizing the action of the user thumb and judging a control instruction corresponding to the action of the user thumb, the interface unit is used for transmitting the control instruction to the control unit, and the control unit is used for executing the control instruction.
Preferably, in the steering wheel key based on the camera, the number of the cameras is two.
Preferably, in the steering wheel key based on the camera, the camera is disposed in a driving seat a-pillar area and/or an interior mirror area of the vehicle body.
Preferably, in the above-mentioned steering wheel key based on a camera, the camera is configured to acquire a single click/double click/left sliding/right sliding motion of a left and/or right thumb of a user in the virtual key area.
Preferably, in the above steering wheel key based on camera, the control unit includes a volume control part, a central control menu part, a bluetooth telephone part and a telephone answering/hanging-up part.
Preferably, in the steering wheel key based on the camera, the camera is an infrared camera with an infrared light supplement component.
As can be seen from the above description, the steering wheel key based on the camera provided by the present invention includes at least one camera disposed on the vehicle body, the field of view of the camera at least includes the virtual key area on the steering wheel of the vehicle, the camera is connected to the image recognition and judgment unit, the other end of the image recognition and judgment unit is connected to the control unit on the vehicle body through the interface unit on the vehicle body, the camera is configured to obtain the thumb action of the user in the virtual key area, the image recognition and judgment unit is configured to recognize the thumb action of the user and judge the control instruction corresponding thereto, the interface unit is configured to transmit the control instruction to the control unit, the control unit is configured to execute the control instruction, it is seen that the corresponding instruction can be executed as long as the camera receives the thumb action of the user, need not to set up the button on the steering wheel again and just can realize some instructions to can effectively reduce the entity button quantity on the steering wheel, reduce the circuit complexity on the steering wheel, need not capacitive switch moreover, reduction in production cost, simple easy operation promotes user's use and experiences.
Drawings
In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the drawings used in the description of the embodiments or the prior art will be briefly described below, it is obvious that the drawings in the following description are only embodiments of the present invention, and for those skilled in the art, other drawings can be obtained according to the provided drawings without creative efforts.
Fig. 1 is a schematic view of a camera of a steering wheel key based on a camera according to the present disclosure installed in a vehicle;
fig. 2 is a schematic diagram illustrating connection of units of a steering wheel key based on a camera provided in the present application.
Detailed Description
The key of the steering wheel based on the camera is provided, the number of the entity keys on the steering wheel can be effectively reduced, the circuit complexity on the steering wheel is reduced, a capacitance switch is not needed, the production cost is reduced, the operation is simple and easy, and the use experience of a user is improved.
The technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the drawings in the embodiments of the present invention, and it is obvious that the described embodiments are only a part of the embodiments of the present invention, and not all of the embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention.
An embodiment of a camera-based steering wheel key provided by the present application is shown in fig. 1 and fig. 2, where fig. 1 is a schematic view of a camera-based steering wheel key provided by the present application installed in a vehicle, and fig. 2 is a schematic view of connection of each unit of a camera-based steering wheel key provided by the present application, and specifically, the camera-based steering wheel key includes at least one camera 1 disposed on a vehicle body, a field of view of the camera 1 at least includes a virtual key area 3 on a steering wheel 2 of the vehicle, it should be noted that such a virtual key area 3 may be defined according to driving or characteristics of a user, rather than a fixed area, so as to facilitate users with different driving habits to improve convenience of control keys according to their specific situations, and of course, may also be disposed at a position of an existing steering wheel key, in short, the number of physical switches and circuits can be reduced, the virtual key area 3 shown in fig. 1 can more easily detect whether the thumb of the driver touches the steering wheel by using a computer vision method, which greatly helps to judge clicking, double-clicking and sliding, reduces the difficulty of gesture recognition, improves the reliability of the system, furthermore, the camera 1 is connected to the image recognition judging unit 4, the image recognition judging unit 4 can recognize the action of the thumb of the user on the steering wheel by using the existing image recognition technology, which is not repeated here, when the driver holds the steering wheel, the thumb can conveniently make various gestures, because the hand on the steering wheel does not have the occurrence of arm fatigue like other gesture recognition, the other end of the image recognition judging unit 4 is connected to the control unit 6 on the vehicle body through the interface unit 5 on the vehicle body, it should be noted that, this interface unit 5 and the control unit 6 are units that are originally present on the vehicle, and are not described herein again, in this embodiment, the camera 1 is used to acquire the motion of the thumb of the user in the virtual key area 3, that is, only needs to recognize the operation of the thumb on the steering wheel, and may be double-clicking the steering wheel, single-clicking the steering wheel, or sliding on the steering wheel, without suspending the hand like in the prior art, it should be further noted that the image recognition and determination unit 4 is used to recognize the motion of the thumb of the user and determine a control instruction corresponding to the motion, the interface unit 5 is used to transmit the control instruction to the control unit 6, and the control unit 6 is used to execute the control instruction, so that it can be seen that the scheme can implement control of multiple functions without arranging an entity function key on the steering wheel, thereby saving much space for other function keys, simplifying the circuitry within the steering wheel.
As can be seen from the above description, in the embodiment of the steering wheel key based on the camera provided in the present application, since the steering wheel key comprises at least one camera disposed on the vehicle body, the field of view of the camera at least includes the virtual key area on the steering wheel of the vehicle, the camera is connected to the image recognition and judgment unit, the other end of the image recognition and judgment unit is connected to the control unit on the vehicle body through the interface unit on the vehicle body, the camera is used to obtain the thumb action of the user in the virtual key area, the image recognition and judgment unit is used to recognize the thumb action of the user and judge the control instruction corresponding to the thumb action, the interface unit is used to transmit the control instruction to the control unit, the control unit is used to execute the control instruction, it is seen that the corresponding instruction can be executed as long as the camera receives the thumb action of the user, and some instructions can be realized without setting, thereby can effectively reduce the entity button quantity on the steering wheel, reduce the circuit complexity on the steering wheel, need not capacitive switch moreover, reduction in production cost, simple easy operation promotes user's use and experiences.
In a specific embodiment of the above steering wheel key based on the cameras, the number of the cameras 1 may be specifically two, in this case, two cameras are installed to form a binocular system, a thumb action in a designated area can be identified more accurately, or two cameras identify one result respectively, reliability is improved by fusion of a plurality of results, of course, three or more cameras may be further provided, the number of the cameras is freely selected according to actual needs, and the number is not limited here.
In a further scheme, the camera can be arranged in a driving seat A column area of the vehicle body and/or an interior rear view mirror area, the driving seat A column area is not far away from the hands of a driver, the sight line of the driver is not affected, the area corresponding to the hands of the driver and the steering wheel can be conveniently shot, the interior rear view mirror area also meets the requirements mentioned above, and therefore the camera is suitable for being placed, and of course, the camera can be placed in other positions without limitation.
In yet another embodiment of the above-described camera-based steering wheel key, the camera 1 is used to capture single/double click/left slide/right slide motions of the user's left and/or right thumbs within the virtual key area. Specifically, in the left area, the left-hand clicking action of the user is to click the left area on the steering wheel, the left-hand double-clicking action of the user is to click the left area on the steering wheel twice continuously, the left sliding action of the thumb of the user is to slide the thumb from right to left in the left area of the steering wheel, and the right sliding action of the thumb of the user is to slide the thumb from left to right in the left area of the steering wheel; in the right area, the right hand single-click action of the user is to click the right area on the steering wheel, the right hand double-click action of the user is to continuously click the two sides in the right area on the steering wheel, the left sliding action of the thumb of the user is to slide the thumb from right to left in the right area of the steering wheel, and the right sliding action of the thumb of the user is to slide the thumb from left to right in the right area of the steering wheel.
In another specific embodiment of the above steering wheel key based on a camera, the control unit may specifically include a volume control component, a central control menu component, a bluetooth phone component, and a phone answering/hanging-up component, and specifically, but not limited to, the following actions and functions may be adopted:
in a preferred embodiment of the above steering wheel button based on a camera, the camera may be an infrared camera having an infrared light supplement component, that is, a camera supplemented with infrared LED light may be used, where the infrared refers to a common grayscale CMOS imaging sensor, and a lens of a band-pass filter film of a specific waveband is added, and a frequency band of a band-pass is consistent with a wavelength used by the LED, so that light captured by the camera is mainly infrared light emitted by the LED as much as possible, thereby reducing influence of external light on imaging, improving imaging quality, reducing influence of light in an external environment by using the infrared camera, and more reliably detecting gestures, and being detectable at night and daytime, without influencing a sight line of a driver or a person in a vehicle. The infrared light supplement sub-module can be composed of 3 near-infrared LED light supplement lamps, the wavelength is unified at 850nm or 940nm, the effective distance is 1m when the infrared LED light supplement sub-module operates, the infrared LED light supplement sub-module is triggered by an output pin of a camera for reducing power consumption, namely, the LED light supplement is performed once when the infrared LED light supplement sub-module is used for shooting one frame, the power consumption can be reduced through the mode, the heating of the LED is reduced, and the stability of the system is enhanced. The camera sensor is provided with a pin (FLASH pin), when the sensor is exposed (photographed), the pin can output a high level and is connected to a power supply control module of the LED to control whether the LED is lightened or not, and the exposure of the sensor and the LED light supplement can be synchronized. In practice, the LED and the camera are integrated in one device, and the optical axis of the camera lens is preferably not completely parallel to the plane of the steering wheel, but slightly has an included angle of 5-10 degrees, so that whether the thumb touches the steering wheel or not can be well shot, and the stability is further improved.
The previous description of the disclosed embodiments is provided to enable any person skilled in the art to make or use the present invention. Various modifications to these embodiments will be readily apparent to those skilled in the art, and the generic principles defined herein may be applied to other embodiments without departing from the spirit or scope of the invention. Thus, the present invention is not intended to be limited to the embodiments shown herein but is to be accorded the widest scope consistent with the principles and novel features disclosed herein.
Claims (6)
1. The utility model provides a steering wheel button based on camera, its characterized in that, is including setting up at least one camera on the vehicle body, include at least in the visual field of camera the virtual button region on the steering wheel of vehicle, the camera is connected to image recognition judging element, the image recognition judging element other end passes through interface unit on the vehicle body is connected to control unit on the vehicle body, the camera is used for acquireing user's thumb action in the virtual button region, image recognition judging element is used for discerning user's thumb action and judging rather than the control command who corresponds, interface unit be used for with control command transmission extremely control unit, control unit is used for carrying out control command.
2. The camera-based steering wheel key of claim 1, wherein the number of cameras is two.
3. The camera-based steering wheel key of claim 1, wherein the camera is disposed in a driver's seat a-pillar area and/or an interior mirror area of the vehicle body.
4. The camera-based steering wheel key of claim 1, wherein the camera is configured to capture single/double click/left slide/right slide motions of a user's left and/or right thumb within the virtual key area.
5. The camera-based steering wheel key of claim 1, wherein the control unit comprises a volume control component, a central control menu component, a bluetooth phone component, and a phone answer/hang up component.
6. The camera-based steering wheel key of any one of claims 1-5, wherein the camera is an infrared camera with an infrared fill-in component.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010124189.0A CN111301311A (en) | 2020-02-27 | 2020-02-27 | Steering wheel button based on camera |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010124189.0A CN111301311A (en) | 2020-02-27 | 2020-02-27 | Steering wheel button based on camera |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN111301311A true CN111301311A (en) | 2020-06-19 |
Family
ID=71159464
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202010124189.0A Pending CN111301311A (en) | 2020-02-27 | 2020-02-27 | Steering wheel button based on camera |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN111301311A (en) |
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN113822795A (en) * | 2021-09-17 | 2021-12-21 | 惠州视维新技术有限公司 | Virtual key projection method and device based on millimeter wave radar and electronic equipment |
| WO2022116656A1 (en) * | 2020-12-02 | 2022-06-09 | Huawei Technologies Co.,Ltd. | Methods and devices for hand-on-wheel gesture interaction for controls |
Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN108175428A (en) * | 2018-01-30 | 2018-06-19 | 成都四海万联科技有限公司 | A kind of intelligent steering wheel for detecting human health status |
| CN108803426A (en) * | 2018-06-27 | 2018-11-13 | 常州星宇车灯股份有限公司 | A kind of vehicle device control system based on TOF gesture identifications |
| JP2018190275A (en) * | 2017-05-10 | 2018-11-29 | 矢崎総業株式会社 | Vehicle operation device |
-
2020
- 2020-02-27 CN CN202010124189.0A patent/CN111301311A/en active Pending
Patent Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP2018190275A (en) * | 2017-05-10 | 2018-11-29 | 矢崎総業株式会社 | Vehicle operation device |
| CN108175428A (en) * | 2018-01-30 | 2018-06-19 | 成都四海万联科技有限公司 | A kind of intelligent steering wheel for detecting human health status |
| CN108803426A (en) * | 2018-06-27 | 2018-11-13 | 常州星宇车灯股份有限公司 | A kind of vehicle device control system based on TOF gesture identifications |
Cited By (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2022116656A1 (en) * | 2020-12-02 | 2022-06-09 | Huawei Technologies Co.,Ltd. | Methods and devices for hand-on-wheel gesture interaction for controls |
| US11507194B2 (en) | 2020-12-02 | 2022-11-22 | Huawei Technologies Co., Ltd. | Methods and devices for hand-on-wheel gesture interaction for controls |
| CN113822795A (en) * | 2021-09-17 | 2021-12-21 | 惠州视维新技术有限公司 | Virtual key projection method and device based on millimeter wave radar and electronic equipment |
| CN113822795B (en) * | 2021-09-17 | 2024-02-09 | 惠州视维新技术有限公司 | Virtual key projection method and device based on millimeter wave radar and electronic equipment |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| TWI498771B (en) | Gesture recognition system and glasses with gesture recognition function | |
| US11917126B2 (en) | Systems and methods for eye tracking in virtual reality and augmented reality applications | |
| CN108205374B (en) | Eyeball tracking module and method of video glasses and video glasses | |
| TWI450159B (en) | Optical touch device, passive touch system and its input detection method | |
| US20180173300A1 (en) | Interactive virtual objects in mixed reality environments | |
| KR20140079162A (en) | System and method for providing a user interface using finger start points shape recognition in a vehicle | |
| JP2016503741A (en) | Input device for automobile | |
| CN111301311A (en) | Steering wheel button based on camera | |
| CN101644976A (en) | Surface multipoint touching device and positioning method thereof | |
| CN104875680A (en) | HUD (head up display) device combining voice and video recognition | |
| CN105404396A (en) | Vehicle device based on infrared sensing gesture recognition | |
| WO2021035646A1 (en) | Wearable device and control method therefor, gesture recognition method, and control system | |
| CN106325493A (en) | Vehicle and method of controlling the same | |
| KR20140072734A (en) | System and method for providing a user interface using hand shape trace recognition in a vehicle | |
| US11966155B2 (en) | Imaging apparatus that, under certain conditions, displays one or both of an autofocus frame and a line-of-sight pointer, and method for controlling the same | |
| KR20140079160A (en) | System and method for providing a user interface using 2 dimension camera in a vehicle | |
| CN111461059A (en) | Multi-zone multi-classification extensible gesture recognition control device and control method | |
| CN109947243B (en) | Intelligent electronic equipment gesture capturing and recognizing technology based on touch hand detection | |
| CN108732969B (en) | A kind of SCM Based automobile gesture control device and its control method | |
| US20200272398A1 (en) | Double-screen display device and switch method for controlling the same | |
| CN116198435B (en) | Vehicle control method and device, vehicle and storage medium | |
| CN109960406B (en) | Intelligent electronic equipment gesture capturing and recognizing technology based on action between fingers of two hands | |
| CN113799791B (en) | Steering wheel key false touch prevention method and device based on camera and vehicle | |
| KR20120054739A (en) | User interface providing system using user identification | |
| CN106453932A (en) | Method and apparatus of awakening mobile terminal, and mobile terminal |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20200619 |