CN104881117B - A kind of apparatus and method that speech control module is activated by gesture identification - Google Patents
A kind of apparatus and method that speech control module is activated by gesture identification Download PDFInfo
- Publication number
- CN104881117B CN104881117B CN201510264952.9A CN201510264952A CN104881117B CN 104881117 B CN104881117 B CN 104881117B CN 201510264952 A CN201510264952 A CN 201510264952A CN 104881117 B CN104881117 B CN 104881117B
- Authority
- CN
- China
- Prior art keywords
- gesture
- information
- module
- control module
- driver
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Landscapes
- User Interface Of Digital Computer (AREA)
Abstract
The invention discloses a kind of apparatus and method that speech control module is activated by gesture identification, including shell, display and activation structure on shell are fixed on, activation structure includes being placed in the gesture identification sensor of housing exterior, being placed in the data processing module and memory module of enclosure；Gesture identification sensor catches driver's real-time gesture information and by the real-time gesture information transfer to data processing module, the customized control gesture information of memory module memory of driving person, data processing module by real-time gesture information compared with controlling gesture information after according to comparative result control voice control module be opened and closed.The present invention completes the opening and closing to speech control module by gesture identification, without touching button manually, reduces the limb action amplitude of driver, improves the security of driving；The gesture identification method of the present invention is influenceed small, completely not affected by noise, good reliability by environment.
Description
Technical field
The present invention relates to vehicle electronic device field, more particularly to it is a kind of for being swashed by gesture identification on automobile
The apparatus and method of speech control module living.
Background technology
As automobile is increasingly popularized, there is also various electronic product on automobile, these electronics on the market
Product, which is mostly auxiliary driver or improves traffic safety, to be set, such as the speech control system on automobile, is driven
Person can be controlled by voice to some electronic products on automobile, without manually operated, allow driver more special
The driving of the heart.
The Activiation method of traditional speech control system typically has two kinds, and first method is set on vehicle console
Entity or virtual push button, by clicking on startup speech control system, this method needs driver manually operated, not only
The notice of driver is displaced, while the limb action for needing driver to carry out by a relatively large margin clicks on button, exists larger
Potential safety hazard.Second method is that this method is not only using startup of the specific phonetic order realization to speech control system
The cost of voice system chip is greatly improved, and is extremely easily influenceed by ambient noise, reliability is low, opens simultaneously
Dynamic phonetic order does not possess directive property, is easily disturbed by the voice of non-driver.
Therefore, prior art has yet to be improved and developed.
The content of the invention
It is an object of the invention to provide a kind of apparatus and method that speech control module is activated by gesture identification, the party
Method need not shift the notice of driver, while need not touch button, safe, not done by environmental noise and ambient light
Disturb, reliability is high.
Technical scheme is as follows：A kind of device that speech control module is activated by gesture identification, wherein, including
Shell, display and activation structure on shell are fixed on, the activation structure includes being placed in the gesture identification sensing of housing exterior
Device, the data processing module and memory module for being placed in enclosure；
Gesture identification sensor, memory module and the display are connected with data processing module respectively, at the data
Reason module is connected with speech control module；
The gesture identification sensor catches driver's real-time gesture information and by the real-time gesture information transfer to data
Processing module, the customized control gesture information of memory module memory of driving person, the data processing module is by real time hand
Gesture information compared with controlling gesture information after be opened and closed according to comparative result control voice control module, the display shows
The status information of speech control module.
The described device that speech control module is activated by gesture identification, wherein, it is provided with the frame of the shell
Fixed shrinkage pool, the gesture identification sensor are placed in fixed shrinkage pool fixed.
The described device that speech control module is activated by gesture identification, wherein, it is provided with the outside of the fixed shrinkage pool
Protection cap.
The described method that speech control module device is activated by gesture identification, wherein, comprise the following steps：
A, the control gesture of the self-defined control voice control module opening and closing of driver, and control gesture information is stored in
Store up in module；
B, gesture identification sensor persistently catches driver's real-time gesture information and by the real-time gesture information transfer to number
According to processing module；
C, data processing module by real-time gesture information compared with controlling gesture information after controlled according to comparative result
Speech control module；
D, the speech control module after starting keeps standby, and the stand-by time is set by driver, gesture identification sensor
It is lasting to keep obtaining the hand signal of driver, without the effective hand signal of acquisition or voice in stand-by time
Control module does not obtain effective audio controls, then speech control module waits next time automatically into closed mode
Start.
The described method that speech control module device is activated by gesture identification, wherein, in the step A, including with
Lower step：
A1, pass through the operation interface selection control gesture information memory module on display；
A2, driver make a gesture in front of gesture identification sensor, and the gesture is identified simultaneously gesture identification sensor
By the presentation of information of the gesture in the display, driver determines gesture information, forms prearranged gesture information；
A3, driver beat identical gesture in front of gesture identification sensor again, and gesture identification sensor is to the gesture
It is identified and by the information of the gesture compared with prearranged gesture information, prearranged gesture information is unanimously then stored in by both
Control gesture information is formed in memory module；
A4, the control gesture information that store of selection, and by each instruction one for controlling gesture information and speech control module
One is correspondingly arranged.
The described method that speech control module device is activated by gesture identification, wherein, it is described aobvious in the step A2
Showing the information for the gesture that device is shown includes the shape image information of gesture and the direction of action information of gesture.
The described method that speech control module device is activated by gesture identification, wherein, in the step C, at data
Reason module is by the shape image information of real-time gesture information and direction of action information compared with controlling gesture information；
The direction of action information uses Fuzzy comparisons, the action side of the direction of action and control gesture of the real-time gesture
To angle be less than 30 °, then it is assumed that both direction of action information are identical.
Beneficial effects of the present invention：The present invention completes the opening and closing to speech control module by gesture identification, without manual
Button is touched, driver's sight ensures driver without shifting when reducing the limb action amplitude of driver, while operating
It can concentrate on driving, improve the security of driving；The present invention gesture identification method influenceed by environment it is small, completely not
It is affected by noise, good reliability；The display of the present invention can share same display with vehicle-mounted central control system, therefore need not
The space on automobile center console is taken, it is practical and convenient.
Brief description of the drawings
Fig. 1 is the structure diagram for the device for activating speech control module in the present invention by gesture identification.
Fig. 2 is the module frame chart for the device for activating speech control module in the present invention by gesture identification.
Embodiment
To make the objects, technical solutions and advantages of the present invention clearer, clear and definite, develop simultaneously embodiment pair referring to the drawings
The present invention is further described.
The invention discloses a kind of device that speech control module is activated by gesture identification, as shown in figure 1, including shell
100th, display 200 and activation structure on shell are fixed on（Do not drawn in figure）, specifically, the activation structure includes being placed in shell
The gesture identification sensor of outside, the data processing module and memory module for being placed in enclosure.Gesture identification sensor, storage
Module and display are connected with data processing module respectively, and data processing module is connected with speech control module（Referring to Fig. 2）；It is real
In the application of border, gesture identification sensor catches driver's real-time gesture information and by the real-time gesture information transfer to data processing
Module, the customized control gesture information of memory module memory of driving person, data processing module is by real-time gesture information with controlling
Gesture information is opened and closed after being compared according to comparative result control voice control module, and display shows the shape of speech control module
State information.The present invention realizes the opening and closing to speech control system by using gesture identification, and larger limb is carried out without driver
Body acts, and more will not greatly improve the security of driving due to needing to touch button and the notice of scattered driver.This
The gesture of driver is identified using gesture identification sensor for invention, and this mode is small by the interference of environment, completely not
By noise jamming, simultaneously because gesture identification sensor can identify left side or the rear side of steering wheel（Or driver neighboring area
It is interior）Gesture, only driver quickly can be controlled by gesture to speech control system, and directive property is high, passenger's
Limb action is difficult to disturb it.
For the ease of installation settings, fixed shrinkage pool 110 is provided with the frame of shell 100, gesture identification sensor 300 is put
In fixed in fixed shrinkage pool 110.In practical application, gesture identification sensor 300 can be set according to the driving habit of driver
In different places, do not limit and be only integrally fixed on shell 100, conventional setting orientation is the left and right sides or the car of steering wheel
On the downside of inside rear-view mirror, while the direction of gesture identification sensor 300 is slightly set upward, in use, driver only needs slightly
Lift hand, you can caught by gesture identification sensor 300, it is easy to operate.Further, the fixed outside of shrinkage pool 110 is provided with protection
Lid（Do not drawn in figure）, the effect of the protection cap is protection gesture identification sensor 300, while can be set in protection cap appearance
Certain decorative cover, to improve its aesthetic property.
In practical application, in order to reduce the position occupancy to Vehicle Control Panel, the present invention can be with automobile central control system
Share same display.
The method for activating speech control module device by gesture identification the invention also discloses this, comprises the following steps：
A, the control gesture of the self-defined control voice control module of driver, and control gesture information is stored in storage mould
In block.
B, gesture identification sensor persistently catches driver's real-time gesture information and by the real-time gesture information transfer to number
According to processing module.
C, data processing module by real-time gesture information compared with controlling gesture information after controlled according to comparative result
Speech control module.Such as when recognizing initiation gesture signal, data processing module sends control signal and starts Voice command mould
Block, while the status information of voice module is shown on a display screen, while can be sent out voice message.
D, the speech control module after starting keeps standby, and the stand-by time is set by driver, gesture identification sensor
It is lasting to keep obtaining the hand signal of driver, without the effective hand signal of acquisition or voice in stand-by time
Control module does not obtain effective audio controls, then speech control module waits next time automatically into closed mode
Start.This set method, can reduce the opening and closing frequency of speech control module, while reduce the unnecessary control of driver
Action, makes the control mode of whole system more succinctly facilitate, while speech control module can be more quick when standby
The voice command of driver is reacted.
More specifically, in step A, comprise the following steps：
A1, pass through the operation interface selection control gesture information memory module on display；, can be with Initialize installation
By the initialization memory module of the operation interface selection control gesture information on display, the pattern is used for driver according to certainly
The gesture information of the self-defined control voice control module of custom of body.
A2, driver make a gesture in front of gesture identification sensor, and the gesture is identified simultaneously gesture identification sensor
By the presentation of information of the gesture in the display, driver determines gesture information, forms prearranged gesture information.
A3, driver beat identical gesture in front of gesture identification sensor again, and gesture identification sensor is to the gesture
It is identified and by the information of the gesture compared with prearranged gesture information, prearranged gesture information is unanimously then stored in by both
Control gesture information is formed in memory module；Certainly, in actual applications, multiple determination pattern can be set, i.e., by multiple
What is repeated beats same gesture, and identification of the gesture identification sensor to multiple gesture is consistent, just is defined as controlling by the gesture
Gesture, and by the information storage of the gesture in a storage module, this way can ensure to control the accuracy of gesture information, together
When driver can also be made the custom quickly grasped to the gesture, to ensure driver during repeatedly gesture is determined
The stability and accuracy acted by gesture control speech control module.
A4, the control gesture information that store of selection, and by each instruction one for controlling gesture information and speech control module
One is correspondingly arranged；Each control gesture information is carried out with the control information of speech control module it is corresponding, such as by a certain control
Gesture information processed is corresponding with the startup control information of speech control module, when recognizing the control gesture information, data processing
Module then sends startup information to speech control module.
More specifically, in step A2, the gesture information of gesture identification sensor identification and the gesture that shows of display
The direction of action information of shape image information and gesture of the information including gesture.Different gesture shapes and the motion side of gesture
To collocation, a variety of different control gesture informations can be formed, are controlled for the different running method of speech control module.
Meanwhile the direction of motion of gesture shape and gesture is arranged in pairs or groups, real-time gesture further can be quickly and accurately determined, at data
Manage module by the shape image information of real-time gesture information and direction of action information compared with controlling gesture information, only in fact
When gesture gesture shape and gesture the direction of motion simultaneously with control gesture match, data processing module ability to Voice command mould
Block is controlled accordingly, the very big accuracy for improving system.
More specifically, direction of action information uses Fuzzy comparisons, as long as the direction of action of real-time gesture and control gesture
Direction of action angle be less than 30 °, then it is assumed that both direction of action information are identical.This is due in driver's practical operation
In, implementing the shape of gesture can preferably keep, but the direction of its motion is difficult to keep entirely accurate, therefore in order that drive
The operation for the person of sailing is more convenient, while also makes more hommization of the invention, in the direction of action information of relatively gesture, can adopt
With relatively reasonable fuzzy processing method.
It should be appreciated that the application of the present invention is not limited to above-mentioned citing, for those of ordinary skills, can
To be improved or converted according to the above description, all these modifications and variations should all belong to the guarantor of appended claims of the present invention
Protect scope.
Claims (6)
1. a kind of device that speech control module is activated by gesture identification, it is characterised in that including shell, be fixed on shell
Display and activation structure, the activation structure include being placed in the gesture identification sensor of housing exterior, are placed in enclosure
Data processing module and memory module；
Gesture identification sensor, memory module and the display are connected with data processing module respectively, the data processing mould
Block is connected with speech control module；
The gesture identification sensor catches driver's real-time gesture information and by the real-time gesture information transfer to data processing
Module, the customized control gesture information of memory module memory of driving person, the data processing module believe real-time gesture
It is opened and closed after ceasing compared with controlling gesture information according to comparative result control voice control module, the display shows voice
The status information of control module；
The real-time gesture information includes the shape image information and direction of action information of gesture；
Fixed shrinkage pool is provided with the frame of the shell, the gesture identification sensor is placed in fixed shrinkage pool fixed.
2. the device according to claim 1 that speech control module is activated by gesture identification, it is characterised in that described solid
Determine to be provided with protection cap on the outside of shrinkage pool.
3. a kind of method that speech control module device is activated by gesture identification as described in claim 1 ~ 2 any one,
It is characterised in that it includes following steps：
A, the control gesture of the self-defined control voice control module opening and closing of driver, and control gesture information is stored in storage mould
In block；
B, gesture identification sensor persistently catch driver's real-time gesture information and by the real-time gesture information transfer to data at
Manage module；
C, data processing module by real-time gesture information compared with controlling gesture information after according to comparative result control voice
Control module；
D, the speech control module after starting keeps standby, and the stand-by time is set by driver, and gesture identification sensor continues
Keep obtaining the hand signal of driver, without the effective hand signal of acquisition or Voice command in stand-by time
Module does not obtain effective audio controls, then speech control module starts next time automatically into closed mode, wait.
4. the method according to claim 3 that speech control module device is activated by gesture identification, it is characterised in that institute
State in step A, comprise the following steps：
A1, pass through the operation interface selection control gesture information memory module on display；
A2, driver make a gesture in front of gesture identification sensor, and gesture identification sensor is identified to the gesture and should
In the display, driver determines gesture information to the presentation of information of gesture, forms prearranged gesture information；
A3, driver beat identical gesture in front of gesture identification sensor again, and gesture identification sensor is carried out to the gesture
Identify and by the information of the gesture compared with prearranged gesture information, prearranged gesture information is unanimously then stored in storage by both
Control gesture information is formed in module；
A4, the control gesture information that store of selection, and by a pair of each instruction 1 for controlling gesture information and speech control module
It should set.
5. the method according to claim 4 that speech control module device is activated by gesture identification, it is characterised in that institute
State in step A2, the information for the gesture that the display is shown includes the shape image information of gesture and the direction of action letter of gesture
Breath.
6. the method according to claim 3 that speech control module device is activated by gesture identification, it is characterised in that institute
State in step C, data processing module believes the shape image information of real-time gesture information and direction of action information with control gesture
Breath is compared；
The direction of action information uses Fuzzy comparisons, direction of action and the direction of action of control gesture of the real-time gesture
Angle is less than 30 °, then it is assumed that both direction of action information are identical.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201510264952.9A CN104881117B (en) | 2015-05-22 | 2015-05-22 | A kind of apparatus and method that speech control module is activated by gesture identification |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201510264952.9A CN104881117B (en) | 2015-05-22 | 2015-05-22 | A kind of apparatus and method that speech control module is activated by gesture identification |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN104881117A CN104881117A (en) | 2015-09-02 |
| CN104881117B true CN104881117B (en) | 2018-03-27 |
Family
ID=53948640
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201510264952.9A Active CN104881117B (en) | 2015-05-22 | 2015-05-22 | A kind of apparatus and method that speech control module is activated by gesture identification |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN104881117B (en) |
Families Citing this family (10)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN109102801A (en) | 2017-06-20 | 2018-12-28 | 京东方科技集团股份有限公司 | Audio recognition method and speech recognition equipment |
| CN109979442A (en) * | 2017-12-27 | 2019-07-05 | 珠海市君天电子科技有限公司 | A kind of sound control method, device and electronic equipment |
| CN109990334A (en) * | 2017-12-29 | 2019-07-09 | 青岛有屋科技有限公司 | A kind of intelligence smoke machine control system |
| CN108804010B (en) * | 2018-05-31 | 2021-07-30 | 北京小米移动软件有限公司 | Terminal control method, device and computer readable storage medium |
| CN113544769A (en) * | 2019-04-10 | 2021-10-22 | 深圳迈瑞生物医疗电子股份有限公司 | Recording method of clinical events, medical device and storage medium |
| CN112199033B (en) * | 2020-09-30 | 2023-06-20 | 北京搜狗科技发展有限公司 | Voice input method and device and electronic equipment |
| CN113086025B (en) * | 2021-04-26 | 2022-04-15 | 长春捷翼汽车零部件有限公司 | Charging cover control method and device for electric automobile and electric automobile |
| CN113257251B (en) * | 2021-05-11 | 2024-05-24 | 深圳优地科技有限公司 | Robot user identification method, apparatus and storage medium |
| WO2023014393A1 (en) * | 2021-08-03 | 2023-02-09 | Hewlett-Packard Development Company, L.P. | Laminate bond strength |
| CN114482833A (en) * | 2022-01-24 | 2022-05-13 | 西安建筑科技大学 | Intelligent sun-shading shutter control system and method based on gesture recognition |
Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101055193A (en) * | 2006-04-12 | 2007-10-17 | 株式会社日立制作所 | Noncontact input operation device for in-vehicle apparatus |
| CN102646016A (en) * | 2012-02-13 | 2012-08-22 | 北京百纳信息技术有限公司 | User terminal for displaying gesture-speech interaction unified interface and display method thereof |
| CN102667708A (en) * | 2009-12-21 | 2012-09-12 | 大陆汽车有限责任公司 | Method and device for operating technical equipment, in particular a motor vehicle |
| CN103631157A (en) * | 2012-08-29 | 2014-03-12 | 杨尧任 | Device of employing hand gesture recognition technology to control vehicle electric appliance and application method thereof |
-
2015
- 2015-05-22 CN CN201510264952.9A patent/CN104881117B/en active Active
Patent Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101055193A (en) * | 2006-04-12 | 2007-10-17 | 株式会社日立制作所 | Noncontact input operation device for in-vehicle apparatus |
| CN102667708A (en) * | 2009-12-21 | 2012-09-12 | 大陆汽车有限责任公司 | Method and device for operating technical equipment, in particular a motor vehicle |
| CN102646016A (en) * | 2012-02-13 | 2012-08-22 | 北京百纳信息技术有限公司 | User terminal for displaying gesture-speech interaction unified interface and display method thereof |
| CN103631157A (en) * | 2012-08-29 | 2014-03-12 | 杨尧任 | Device of employing hand gesture recognition technology to control vehicle electric appliance and application method thereof |
Also Published As
| Publication number | Publication date |
|---|---|
| CN104881117A (en) | 2015-09-02 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN104881117B (en) | A kind of apparatus and method that speech control module is activated by gesture identification | |
| CN106502570B (en) | Gesture recognition method and device and vehicle-mounted system | |
| KR101537936B1 (en) | Vehicle and control method for the same | |
| US9720498B2 (en) | Controlling a vehicle | |
| EP2969697B1 (en) | System and method for identifying handwriting gestures in an in-vehicle infromation system | |
| US9235269B2 (en) | System and method for manipulating user interface in vehicle using finger valleys | |
| CN104691449A (en) | Vehicle control apparatus and method thereof | |
| JP2018107759A (en) | Image processing device, image processing method, and image processing system | |
| WO2022048118A1 (en) | Method and apparatus for controlling in-vehicle robot, vehicle, electronic device, and medium | |
| JP2007106353A (en) | Vehicular information display device, and vehicular information display system | |
| CN108349389A (en) | Commanding apparatus and method for receiving the character string inputted by user in a motor vehicle | |
| US9349044B2 (en) | Gesture recognition apparatus and method | |
| CN109795410A (en) | Method and apparatus for promoting the suggestion to the feature underused | |
| WO2022062491A1 (en) | Vehicle-mounted smart hardware control method based on smart cockpit, and smart cockpit | |
| CN112905004B (en) | Gesture control method and device for vehicle-mounted display screen and storage medium | |
| CN113782020A (en) | In-vehicle voice interaction method and system | |
| US20210199980A1 (en) | Method for operating a head-mounted electronic display device, and display system for displaying a virtual content | |
| CN116529125A (en) | Method and apparatus for controlled hand-held steering wheel gesture interaction | |
| WO2022267354A1 (en) | Human-computer interaction method and apparatus, and electronic device and storage medium | |
| CN110554766A (en) | Interaction method and vehicle-mounted interaction device | |
| WO2022142331A1 (en) | Control method and apparatus for vehicle-mounted display screen, and electronic device and storage medium | |
| CN108216087B (en) | Method and apparatus for identifying a user using identification of grip style of a door handle | |
| CN204679955U (en) | A kind of device by the voice activated control module of gesture identification | |
| EP4328765A1 (en) | Method and apparatus for recommending vehicle driving strategy | |
| CN107107756B (en) | Human/machine interface and method for controlling vehicle functions by detecting driver's movements and/or expressions |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| EXSB | Decision made by sipo to initiate substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant | ||
| TR01 | Transfer of patent right | ||
| TR01 | Transfer of patent right |
Effective date of registration: 20180802 Address after: 528100 Guangdong, Foshan Sanshui center, science and Technology Industrial Park, Southwest Park, C area 25-8 (F1) 310-315 Patentee after: Guangdong card Star Electronics Technology Co., Ltd. Address before: 528133 C District, Southwest Industrial Park, Sanshui District, Foshan, Guangdong Patentee before: Coagent Electronic S & T Co., Ltd. |