CN102866803B - A kind ofly support the virtual console gesture control method of the automobile of blind operation and device - Google Patents
A kind ofly support the virtual console gesture control method of the automobile of blind operation and device Download PDFInfo
- Publication number
- CN102866803B CN102866803B CN201210312798.4A CN201210312798A CN102866803B CN 102866803 B CN102866803 B CN 102866803B CN 201210312798 A CN201210312798 A CN 201210312798A CN 102866803 B CN102866803 B CN 102866803B
- Authority
- CN
- China
- Prior art keywords
- gesture
- sign language
- module
- console
- touch
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Landscapes
- User Interface Of Digital Computer (AREA)
Abstract
The invention discloses and a kind ofly support the virtual console gesture control method of the automobile of blind operation and device, can facilitate user in driving procedure, driving path sight line need not be shifted, by oarsman's gesture on console touch-screen, corresponding manipulation is carried out to automobile, this blind operating function to automobile, well compensate for and search complicated and diversified mechanical key in traditional pilothouse and carry out the deficiency controlled, simultaneously, the virtual console of the present invention is integrated with sign language library module, gesture analysis processing module, sign language identification module, sign language database management module, gesture manipulation execution module, and gesture manipulation security mechanism management module, the associated treatment work of modules, its sign language is manipulated there is simple ease for use, gesture manipulation window independence, the semantic uniqueness of gesture, sign language alterability, the features such as manipulation made safe, can according to real needs, for user provides convenience, fast, friendly, the automobile center console manipulation of safety is experienced.
Description
Technical field
The present invention relates to auto electronic control technology, especially a kind of gesture control method and device being applied to the virtual console of automobile.
Background technology
Along with developing rapidly and popularization and application of automotive electronics, in automobile, there is increasing controlling functions.In pilothouse, around central control board and bearing circle, be all covered with function control knob miscellaneous.In car, these diversified control knobs really provide the user more manipulation and select right, but bring impact also to the operation ease of driver and complexity simultaneously, make driver in the driving driving procedure carrying out high security, also to decontrol bearing circle go to stretch out one's hand even to turn one's head want sight line leave driving road go to see or the longer time go to search the position wanting the function button place performed, such behavior will inevitably disperse the notice of driver, causes larger hidden danger undoubtedly to traffic safety.Driver when driving, leave driving road and go to search and press, rotate or stir these a feast for the eyes function buttons by sight line, really have impact on the security of driving, to operation during driving to control also to make troubles.
Now, along with the development of auto industry and the raising of computer level, more requirements are proposed for automobile man-machine interaction integration.By touch-screen, the new trend becoming era development is controlled to automobile.Touch screen technology is a kind of novel man-machine interaction input mode, and compared with traditional key-press input mode, touch-screen inputs intuitive and convenient more.Touch-screen is made up of the detection part be arranged on before lcd screen and touch screen controller.When pointing or other object touches the graphic button be arranged on the touch-screen of display front end, the position touched is detected by touch-screen detection part, when after detection user touch location, send its contact coordinate information to touch screen controller, touch screen controller analyzes the order of rear execution corresponding operating to touch information.Therefore, traditional mechanical button control panel in automobile cab can be replaced with touch-screen, and produce vivid figure manipulation effect by the liquid crystal display picture of touch-screen.
But, although existing automobile touch screen improves the aesthetic property at the key controlled interface of automobile cab console and mutual friendly, but still rest on operations such as using the simple touch-control click of tradition to manipulate automobile, driver is in driving driving procedure, if will be operated by touch-screen, still need allow sight line leave driving road and transfer to the figure button checked above touch-screen, carry out click keys and perform the feature operation wanted.Therefore, allow driver's sight line in driving driving procedure leave driving road go to click executable operations, still there is larger potential safety hazard, inherently not changing traditional mechanical button control panel needs pilot's line of vision to leave driving road, and goes to check that the deficiency operated just can be carried out in button position.
Summary of the invention
Object of the present invention will solve the deficiency that current above-mentioned automobile center console touch screen technology exists just, and a kind of virtual console gesture control method of the automobile of blind operation and device supported is provided, driver can be diverted sb.'s attention check the console touch-screen of pilothouse, and only can perform corresponding function with carrying out gesture operation to touch-screen, realize the blind operating function to automobile virtual console touch-screen.
In order to solve the problems of the technologies described above, technical scheme of the present invention is as follows:
Support the automobile of a blind operation virtual console gesture actuation means, comprise console touch-screen, sign language library module, sign language database management module, gesture analysis processing module, sign language identification module, gesture manipulation execution module and gesture manipulation security mechanism management module;
Described console touch-screen adopts capacitive touch screen, adopts the touch screen controller of programmable system on chip framework, can carry out communicating and collaborative work with other peripheral hardwares, and customized demand can obtain gesture information;
The sign language that described sign language library module stores through definition mentions and sign language automobile center console manipulation function one to one;
Described sign language database management module is for managing the sign language in sign language library module;
Described gesture analysis processing module is used for carrying out analyzing and processing to the gesture that described console touch-screen detects, then calls sign language identification module after obtaining complete sign language;
Described sign language identification module carries out analysis to the gesture information obtained and identifies, judges the matching similarity of sign language in its gesture path and sign language library module, if reach certain threshold value, then can think this gesture; The gesture information that described gesture manipulation execution module identifies according to described sign language identification module, inquire about the Automobile operation of its correspondence, transmitted control signal to electrical control unit system or vehicle mounted electrical apparatus control system by CAN, LIN bus, corresponding automobile component is controlled, performs corresponding operating;
Described gesture manipulation security mechanism management module is used for carrying out safety verification to the gesture bookkeeping in described sign language database management module.
Further, when sign language database management module carries out bookkeeping to the sign language in gesture language library, gesture is needed to manipulate security mechanism management module to carry out safety verification, after only having safety verification to pass through, bookkeeping could be carried out to gesture language library, after through safety certification, when wanting to add new gesture operation, first the gesture operation of typing is got, and can identify carrying out analysis, judge that whether this sign language has higher duplication similarity degree with the sign language that stores in existing sign language library module, if prepare some similarity in the new sign language that adds and existing sign language to reach more than the threshold value of setting, then can think that sign language conflict repeats, add unsuccessful, need to input again in addition, until the requirement meeting similarity collision detection, after similarity collision detection, select current alternative again and not by automobile center console manipulation function that other sign languages use, finally new gesture and its corresponding manipulation function are added in sign language library module.
Support the virtual console gesture control method of the automobile of blind operation, comprise the steps
31) console touch-screen detects and obtains gesture information;
32) gesture analysis processing module is used for carrying out analyzing and processing to the gesture that described console touch-screen detects, then calls sign language identification module after obtaining complete sign language;
33) described sign language identification module carries out analysis identification to the gesture information obtained, and judges the matching similarity of sign language in its gesture path and sign language library module, if reach certain threshold value, then can think this gesture; The gesture information that described gesture manipulation execution module identifies according to described sign language identification module, inquire about the Automobile operation of its correspondence, transmitted control signal to electrical control unit system or vehicle mounted electrical apparatus control system by CAN, LIN bus, corresponding automobile component is controlled, performs corresponding operating;
The sign language that described sign language library module stores through definition mentions and sign language automobile center console manipulation function one to one;
34) sign language database management module is for managing the sign language in sign language library module, after the checking of gesture manipulation security mechanism management module safety, and can to the gesture bookkeeping in described sign language database management module.
Further, the gesture analysis disposal route of gesture analysis processing module comprises the steps:
41) console touch-screen detects touch in one's hands, waits for that gesture input is complete, obtains complete gesture information;
42) sign language identification module is called;
43) gesture analysis processing module judges whether the gesture operation detected is conventional touch screen operation;
44) if conventional touch screen operation, then allocating conventional gesture processing module, according to the concrete window in current place, performs corresponding conventional gesture operation to it;
Does 45) if not conventional touch screen operation, then sign language identification module determine whether sign language in sign language library module?
46) if not sign language in sign language library module, then any manipulation instruction is not performed;
47) if sign language in sign language library module, then call gesture manipulation execution module, perform the feature operation that the sign language that defines in sign language library module is corresponding.
Further, in described step 41) in this console touch-screen when having detected that hand touches, according to arrange stand-by period, wait for that complete gesture has inputted.
Further, in step 43) in gesture analysis processing module the sign language storehouse gesture operation difference of conventional touch screen gesture operation and definition is treated, it is the operation that the graphical window of the current display of console touch-screen is carried out for conventional touch screen gesture operation, this gesture is the gesture operation of window correlativity, sign language operation in sign language library module is had nothing to do with current place window interface, uses these sign languages can perform corresponding automobile manipulation order at any window.
Further, gesture touch-control detected for from console touch-screen, comprised the steps: to the disposal route this gesture being called to sign language identification module
71) when console touch-screen detects finger touch, console touch-screen detection part sends look-at-me with the form of interruption to gesture analysis processing module;
72), after gesture analysis processing module receives look-at-me, corresponding interrupt processing function is called;
73) initiation gesture manipulation language in-put timer;
74) when timer time arrives, then all gesture informations of current console touch-screen are obtained;
75) analyzing and processing is carried out to all gesture informations of current console touch-screen;
76) sign language identification module is called respectively to each gesture information, after it is identified, perform corresponding operating.
Beneficial effect of the present invention is: the present invention can facilitate user in driving procedure, need not shift driving path sight line, carries out corresponding manipulation by oarsman's gesture on console touch-screen to automobile.This blind operating function to automobile, well compensate for and searches complicated and diversified mechanical key in traditional pilothouse and carry out the deficiency controlled.Meanwhile, the virtual console of the present invention is integrated with sign language library module, gesture analysis processing module, sign language identification module, sign language database management module, gesture manipulation execution module, and gesture manipulation security mechanism management module.The associated treatment work of modules, makes its sign language manipulate and has the features such as simple ease for use, gesture manipulation window independence, the semantic uniqueness of gesture, sign language alterability, manipulation made safe.Can according to real needs, for user provide convenience, fast, friendly, safe automobile center console manipulation experiences.
Accompanying drawing explanation
Fig. 1 is the hierarchical chart of each functional module in apparatus of the present invention system;
Fig. 2 is apparatus of the present invention and the connection layout between electrical control unit system and vehicle mounted electrical apparatus control system;
Fig. 3 be the self-defining sign language storehouse of apparatus of the present invention system and its corresponding perform feature operation;
Fig. 4 is the process flow diagram processing sign language input in apparatus of the present invention system;
Fig. 5 is the process flow diagram of gesture analysis processing module in apparatus of the present invention system;
Fig. 6 is the treatment step process flow diagram of this automobile virtual console sign language base management system;
Fig. 7 is that this automobile virtual console sign language administration module adds gesture manipulation process flow diagram.
Embodiment
Below in conjunction with the drawings and specific embodiments, the present invention is described further.
As shown in Figure 1, a kind ofly support the automobile of blind operation virtual console gesture actuation means, this console (center controlling platform) device comprises console touch-screen, sign language library module, sign language database management module, gesture analysis processing module, sign language identification module, gesture manipulation execution module, gesture manipulation security mechanism management module.
Console touch-screen adopts capacitive touch screen, and this touch-screen support identifies the two or more points on surface in contact simultaneously, also namely supports Multi-contact location recognition.The core of multi-touch system is the capacitive sensing of a pair adjacent electrode composition.When a conductor is as pointed close to these electrodes, the electric capacity between two electrodes will increase, and is then detected by microcontroller, thus identifies touching position information.
This console touch-screen adopts the touch screen controller of programmable system on chip framework, conveniently can induce the touch situation of the single finger of user and multiple finger, and can carry out communicating and collaborative work with other peripheral hardwares, there is good design flexibility and configurability, thus convenient according to customized demand acquisition gesture information.
Sign language library module defines a set of sign language towards the operation of automobile cab console, can pre-define the feature operation of a set of sign language storehouse and its corresponding virtual console of automobile performed in this virtual console internal system.
This sign language library module has following features:
A manipulation function that the sign language defined in () this sign language library module is corresponding is generally the feature operation that driver relatively commonly uses, and sign language is not cover all feature operations of automobile cab console.
B the common function operation of the sign language in () this sign language library module and the virtual console of automobile is one-to-one relationship.
C the sign language defined in () this sign language library module commonly uses the one expansion of gesture operation (such as click, length is pressed, and slides page up and down, Scalable etc.) to existing conventional touch screen and supplements.The gesture operation that the sign language of definition in this sign language library module is conventional with existing touch-screen does not conflict mutually.
D the gesture operation defined in () this sign language library module can perform on any graphic interface window of virtual console touch-screen, do not need to turn back to corresponding function window interface and could perform corresponding function operation.
E () this sign language has the feature of the semantic uniqueness of gesture and gesture manipulation window independence.Wherein the semantic the Uniqueness of gesture is processed by gesture manipulation security mechanism management module, and gesture manipulation window independence problem is processed by gesture analysis processing module.
Sign language database management module supports that user carries out bookkeeping to the sign language in gesture language library module, such as increases the operation of self-defined gesture and its correspondence, deletes gesture, the operation etc. of amendment sign language and its correspondence.Meanwhile, when modifying to sign language, gesture is needed to manipulate security mechanism management module to carry out safety verification.After only having safety verification to pass through, could modify to gesture language library.
When user through safety certification after, when wanting to add new gesture operation, first the gesture operation of user's typing is got, and can identify carrying out analysis, judge whether this gesture has higher duplication similarity degree with the gesture in existing sign language library module, if user prepares some similarity in the new gesture of adding and existing gesture and reaches more than the threshold value of setting (calculating of gesture curve similarity has method and the algorithm of a lot of comparative maturity, calculating for gesture similarity can utilize conventional method), then can think that gesture conflict repeats, add unsuccessful, user is needed to input in addition again, until the requirement meeting the collision detection of gesture similarity, after the collision detection of gesture similarity, select current alternative again and not by automobile center console manipulation function that other sign languages use, finally new gesture and its corresponding manipulation function are added in sign language library module.
Gesture analysis processing module primary responsibility carries out analyzing and processing to the gesture that console touch-screen detects, the gesture analysis process method step of this module is as follows:
(1) touch-screen detects touch in one's hands, waits for that the input of user's gesture is complete, obtains complete gesture information;
(2) sign language identification module is called;
Does (3) gesture analysis processing module judge that the gesture operation detected is conventional touch screen operation?
(4) if so, then allocating conventional gesture processing module, according to the concrete window in current place, performs corresponding conventional gesture operation to it.
(5) if not, then determine whether language in sign language storehouse?
(6) if not, then do not perform any manipulation instruction.
(7) gesture manipulation execution module is if so, then called, the feature operation that the sign language defined in execution sign language storehouse is corresponding.
In described step (1): this virtual console touch-screen is not just call sign language identification module having detected that hand touches at once, because user is carrying out the gesture operations such as some multi-point touch, therefore, after will waiting for that the complete input of user completes, just analysis is carried out to obtained complete gesture information and identify.Otherwise the parsing identification error of gesture semanteme may be caused.Wait for that the time of user's gesture input can according to circumstances be arranged.
In described step (3): the sign language storehouse gesture operation difference of conventional touch screen gesture operation and definition is treated by this gesture analysis processing module.Be the operation carried out the graphical window of the current display of console touch-screen for conventional touch screen gesture operation (such as click, long to press, slide page up and down, Scalable etc.), therefore these gestures are gesture operations of window correlativity.And gesture operation in sign language library module and current place window interface have nothing to do, use these gestures can perform corresponding automobile manipulation order at any window, the gesture operation therefore in sign language storehouse is window independence.
Gesture touch-control has been detected for from console touch-screen, as follows to the process method step this gesture being called to sign language identification module:
(11) when console touch-screen detects finger touch, touch-screen detection part sends look-at-me with the form of interruption to gesture analysis processing module;
(12), after gesture analysis processing module receives look-at-me, corresponding interrupt processing function is called;
(13) initiation gesture manipulation language in-put timer;
(14) when timer time arrives, then all gesture informations of current touch screen are obtained;
(15) analyzing and processing is carried out to all gesture informations of current touch screen;
(16) sign language identification module is called respectively to each gesture information, after it is identified, perform corresponding operating.
Sign language identification module carries out analysis to the complete gesture information of touch-screen obtained and identifies, judges the matching similarity of sign language in its gesture path and sign language storehouse, if reach certain threshold value, then can think this gesture.Search the Automobile operation that in sign language storehouse, this gesture correspondence performs.
The gesture information that gesture manipulation execution module identifies according to sign language identification module, inquire about the Automobile operation of its correspondence, this virtual console is transmitted control signal to electrical control unit system (BCM) or vehicle mounted electrical apparatus control system by CAN, LIN bus, corresponding automobile component is controlled, performs corresponding operating.
Gesture manipulation security mechanism management module primary responsibility carries out safety verification to the gesture retouching operation in gesture language library administration module.The feature of this module is as follows:
A () is when using this virtual console touch-screen gesture control system first, need first its finger print information of typing of car owner, can typing one point or multiple finger, after typing completes, when needing to modify to gesture language library, just need first by finger print identification verification later.If after need to add the new finger print information of management, also need first by the finger print identification verification that arranges before.
B () only has car owner user by after finger print identifying identity, just can self-defined interpolation gesture and its correspondence operation or sign language deleted, revise.Ensure the security in this console touch-screen sign language storehouse.
C () gesture manipulation security mechanism management module has gesture similarity collision detection function.For the newly-increased gesture of user's input, system accounting calculates all similarities that there is gesture in current input gesture and system, only have all gesture similarities all lower than setting threshold value, just can think that this gesture is new gesture, added to existing sign language storehouse, otherwise new gesture is added unsuccessful.This ensure that the uniqueness of sign language.
As shown in Figure 2, the invention provides and a kind ofly support the automobile of blind operation virtual console gesture actuation means, the virtual console touch-screen of this automobile has a touch-screen press-key lock, when pressing this button, console touch-screen can be pinned, now console is in holding state, does not support gesture operation; Click console press-key lock again, then recover gesture and touch manipulation.
This virtual console is connected by the electrical control unit system (BCM) of LIN/CAN bus and automobile or vehicle mounted electrical apparatus control system, controls automobile execution corresponding operating by sending corresponding manipulation signal.
Simultaneously, this console touch-screen adopts the touch screen controller of programmable system on chip framework, sign language library module is integrated with inside this console, gesture analysis processing module, sign language identification module, sign language database management module, gesture manipulation execution module, and gesture manipulation security mechanism management module.
In this touch screen controller, the hierarchical structure of each functional module as shown in Figure 1.User can carry out two large generic operations by this touch-screen: a class mainly operation carried out the sign language in native system sign language storehouse of user, primarily of sign language library module, sign language database management module and gesture manipulation security mechanism management module etc. are responsible for; The automobile control operation that another kind of mainly user utilizes sign language to perform, primarily of gesture analysis processing module, sign language identification module and gesture manipulation execution module etc. are responsible for.
As a selectivity case study on implementation of the present invention, as shown in Figure 3, this virtual console internal system can pre-define the feature operation of a set of sign language storehouse and its corresponding virtual console of automobile performed.This sign language can be a stroke gesture, two stroke gestures or Multi strokes gesture, and suitably defines related gesture according to the meaning of concrete operations, facilitates user to remember use.
Such as open automotive window (window), use the gesture of its English initial w to manipulate; Open boot (pack), use the gesture of its English initial p to manipulate; Hood is unblanked (suo), uses the gesture of the initial s of its Chinese phonetic alphabet to manipulate; Open glass sunroof, the shape " mouth " according to skylight carries out gesture manipulation etc.These also according to the concrete use habit of user, can be changed by sign language database management module.
One. car owner logs in and uses virtual console touch-screen system process first:
When car owner user uses basic step during this automobile virtual console gesture control system as follows first:
(1) car owner's typing fingerprint, creates car owner's finger print information, enters the virtual console gesture control system of this automobile.
(2) car owner inputs certain gesture operation on console touch-screen, according to process sign language input operation entire flow of the present invention as shown in Figure 4.
(3) according to the gesture control method of this system, call gesture analysis processing module to the gesture of input, its processing procedure as shown in Figure 5.
As a selectivity case study on implementation of the present invention, the concrete case process of user operation one at the gesture controlling equipment using the virtual console of this automobile is below described:
A () car owner inputs gesture of sliding left on console touch-screen, according to the control method of this system, this gesture of system identification is conventional touch screen operating gesture, then carry out correspondingly translating into next page operations.
When () car owner inputs clockwise C on console touch-screen b, this gesture of system identification is unconventional touch-screen gesture operation, in sign language storehouse, there is this sign language simultaneously, therefore call gesture manipulation execution module and perform corresponding operating, namely open air-conditioning.
C () now car owner inputs clockwise triangle on console touch-screen, turn on room light lamp.
D () when now car owner inputs clockwise circle on console touch-screen, turns on radio.
(e) now car owner input on console touch-screen from left to right clockwise on wedge angle time, air-conditioner temperature is heightened.
(f) now car owner input on console touch-screen clockwise square time, then glass sunroof is opened.
In this case operating process, gesture operation does not need could perform corresponding gesture operation in respective window, namely do not need to regulate air-conditioner temperature at console touch-screen airconditioning control interface, as long as systems axiol-ogy is to being the manipulation of corresponding gesture, namely can perform corresponding operating at once, have nothing to do with current place window interface.Therefore, this process embodies the feature that this automobile virtual console system has gesture manipulation window independence and semantic uniqueness.
Two. car owner's management correcting sign language storehouse process:
Car owner can manage the sign language storehouse of this system, supports that user such as increases the operation of self-defined gesture and its correspondence, deletes gesture, the operation etc. of amendment sign language and its correspondence.
The treatment step of this sign language base management system is as follows:
(1) user logs in sign language library management interface, carries out authentication;
(2), after authentication is passed through, user selects the operation managed gesture;
(3) if selecting is " adding new gesture ", then need the new gesture of typing, similarity detection is carried out to new gesture, detect by rear, select the Automobile operation that corresponding new gesture performs, and joined in sign language storehouse.
(4) if selection is " amendment gesture and its respective operations ", then need to select further to be " gesture that retouching operation is corresponding " or selection " operation that amendment gesture is corresponding ";
If a () selects " gesture that retouching operation is corresponding ", then need the new gesture of typing, similarity detection is carried out to new gesture, detect by rear, successfully can revise the new gesture of this operation correspondence.
If b () is selected " operation that amendment gesture is corresponding ", then select the operation of the available execution of current automobile, amendment is saved in sign language storehouse.
(5) if select to be " deleting gesture manipulation ", then select the gesture needing to delete, deleted.
The treatment step process flow diagram of this automobile virtual console sign language base management system as shown in Figure 6.
As a selectivity case study on implementation of the present invention, the concrete steps for the new sign language manipulation of interpolation one are below described:
A () first calls gesture manipulation security mechanism management module, verify user identity;
(b) virtual console touch-screen typing user fingerprints information;
Does c () judge the finger print information of user's typing and user fingerprints information match in database?
(d) if not, then subscriber authentication failure.
E () is if then user is in the newly-increased gesture of console touch-screen input;
F () is carried out analysis to newly-increased gesture information and is identified;
G () calculates the similarity of all gestures in newly-increased gesture and console touch-screen;
Does h () judge whether that gesture similarity reaches the threshold value of setting?
If (i) had, then newly-increased gesture is added unsuccessful.
If j () does not have, then select the Automobile operation that newly-increased gesture is corresponding;
K the Automobile operation of newly-increased gesture and its correspondence adds in sign language storehouse by ().
This automobile virtual console sign language administration module adds gesture manipulation detailed process as shown in Figure 7.
Can be found out by above example, the present invention can facilitate car owner to carry out blind operation in driving procedure, carries out corresponding manipulation by oarsman's gesture on console touch-screen to automobile.The features such as the simple ease for use of its sign language operation, window independence, the management correcting in sign language storehouse and security mechanism wherein, can provide convenience for car owner, fast, the automobile center console manipulation experience of safety.
The virtual console gesture control method of automobile of the blind operation of support provided by the invention, can be widely used in all kinds of automobile middle control bench control system, in its sign language storehouse, sign language, optional Automobile operation and gesture identification method can determine different customizations according to real needs.
The above is only the preferred embodiment of the present invention; it should be pointed out that for those skilled in the art, without departing from the inventive concept of the premise; can also make some improvements and modifications, these improvements and modifications also should be considered as in scope.
Claims (5)
1. support the automobile virtual console gesture actuation means of blind operation for one kind, it is characterized in that, comprise console touch-screen, sign language library module, sign language database management module, gesture analysis processing module, sign language identification module, gesture manipulation execution module and gesture manipulation security mechanism management module;
Described console touch-screen adopts capacitive touch screen, uses the touch screen controller of programmable system on chip framework, can carry out communicating and collaborative work with other peripheral hardwares, and can obtain gesture information according to customized demand;
The sign language that described sign language library module stores through definition mentions and sign language automobile center console manipulation function one to one;
Described sign language database management module is for managing the sign language in sign language library module;
Described gesture analysis processing module is used for carrying out analyzing and processing to the gesture that described console touch-screen detects, then calls sign language identification module after obtaining complete sign language;
Described sign language identification module carries out analysis to the gesture information obtained and identifies, judges the matching similarity of sign language in its gesture path and sign language library module, if reach certain threshold value, then thinks the gesture in sign language library module; The gesture information that described gesture manipulation execution module identifies according to described sign language identification module, inquire about the Automobile operation of its correspondence, transmitted control signal to electrical control unit system or vehicle mounted electrical apparatus control system by CAN, LIN bus, corresponding automobile component is controlled, performs corresponding operating;
Described gesture manipulation security mechanism management module is used for carrying out safety verification to the gesture bookkeeping in described sign language database management module;
When sign language database management module carries out bookkeeping to the sign language in gesture language library, gesture is needed to manipulate security mechanism management module to carry out safety verification, after only having safety verification to pass through, bookkeeping could be carried out to gesture language library, after through safety certification, when wanting to add new gesture operation, first the gesture operation of typing is got, and analysis identification can be carried out to the gesture operation of typing, whether the sign language judging typing has higher duplication similarity degree with the sign language that stores in existing sign language library module, if prepare some similarity in the new sign language that adds and existing sign language to reach more than the threshold value of setting, then can think that sign language conflict repeats, add unsuccessful, need to input again in addition, until the requirement meeting similarity collision detection, after similarity collision detection, select current alternative again and not by automobile center console manipulation function that other sign languages use, finally new gesture and its corresponding manipulation function are added in sign language library module.
2. support the virtual console gesture control method of automobile of blind operation, it is characterized in that, comprise the steps
31) console touch-screen detects and obtains gesture information;
32) gesture analysis processing module is used for carrying out analyzing and processing to the gesture that described console touch-screen detects, then calls sign language identification module after obtaining complete sign language;
33) described sign language identification module carries out analysis identification to the gesture information obtained, and judges the matching similarity of sign language in its gesture path and sign language library module, if reach certain threshold value, then thinks the gesture in language library module; The gesture information that gesture manipulation execution module identifies according to described sign language identification module, inquire about the Automobile operation of its correspondence, transmitted control signal to electrical control unit system or vehicle mounted electrical apparatus control system by CAN, LIN bus, corresponding automobile component is controlled, performs corresponding operating;
The sign language that described sign language library module stores through definition mentions and sign language automobile center console manipulation function one to one;
34) sign language database management module is for managing the sign language in sign language library module, after the checking of gesture manipulation security mechanism management module safety, and can to the gesture bookkeeping in described sign language database management module; The gesture analysis disposal route of gesture analysis processing module comprises the steps:
41) console touch-screen detects touch in one's hands, waits for that gesture input is complete, obtains complete gesture information;
42) sign language identification module is called;
43) gesture analysis processing module judges whether the gesture operation detected is conventional touch screen operation;
44) if conventional touch screen operation, then allocating conventional gesture processing module, according to the concrete window in current place, performs corresponding conventional gesture operation to it;
Does 45) if not conventional touch screen operation, then sign language identification module determine whether sign language in sign language library module?
46) if not sign language in sign language library module, then any manipulation instruction is not performed;
47) if sign language in sign language library module, then call gesture manipulation execution module, perform the feature operation that the sign language that defines in sign language library module is corresponding.
3. according to claim 2ly a kind ofly support the virtual console gesture control method of the automobile of blind operation, it is characterized in that, in described step 41) in this console touch-screen when having detected that hand touches, according to incoming timing device arrange stand-by period, wait for that complete gesture has inputted.
4. according to claim 3ly a kind ofly support the virtual console gesture control method of the automobile of blind operation, it is characterized in that, in step 43) in gesture analysis processing module the sign language storehouse gesture operation difference of conventional touch screen gesture operation and definition is treated, it is the operation that the graphical window of the current display of console touch-screen is carried out for conventional touch screen gesture operation, conventional touch screen gesture is the gesture operation of window correlativity, sign language operation in sign language library module is had nothing to do with current place window interface, use these sign languages can perform corresponding automobile manipulation order at any window.
5. according to claim 3ly a kind ofly support the virtual console gesture control method of the automobile of blind operation, it is characterized in that, gesture touch-control detected for from console touch-screen, comprised the steps: to the disposal route gesture detected being called to sign language identification module
71) when console touch-screen detects finger touch, console touch-screen detection part sends look-at-me with the form of interruption to gesture analysis processing module;
72), after gesture analysis processing module receives look-at-me, corresponding interrupt processing function is called;
73) initiation gesture manipulation language in-put timer;
74) when timer time arrives, then all gesture informations of current console touch-screen are obtained;
75) analyzing and processing is carried out to all gesture informations of current console touch-screen;
76) sign language identification module is called respectively to each gesture information, after it is identified, perform corresponding operating.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201210312798.4A CN102866803B (en) | 2012-08-30 | 2012-08-30 | A kind ofly support the virtual console gesture control method of the automobile of blind operation and device |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201210312798.4A CN102866803B (en) | 2012-08-30 | 2012-08-30 | A kind ofly support the virtual console gesture control method of the automobile of blind operation and device |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN102866803A CN102866803A (en) | 2013-01-09 |
| CN102866803B true CN102866803B (en) | 2016-02-17 |
Family
ID=47445700
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201210312798.4A Active CN102866803B (en) | 2012-08-30 | 2012-08-30 | A kind ofly support the virtual console gesture control method of the automobile of blind operation and device |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN102866803B (en) |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US11873000B2 (en) | 2020-02-18 | 2024-01-16 | Toyota Motor North America, Inc. | Gesture detection for transport control |
Families Citing this family (25)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| TWI511029B (en) | 2014-01-28 | 2015-12-01 | Acer Inc | Touch display apparatus and operating method thereof |
| CN104932808B (en) * | 2014-03-21 | 2018-09-11 | 宏碁股份有限公司 | Touch control display apparatus and its operating method |
| CN104657075A (en) * | 2015-01-29 | 2015-05-27 | 刘波 | Gesture control device and method for automobile electric appliance |
| TW201636233A (en) | 2015-04-14 | 2016-10-16 | 鴻海精密工業股份有限公司 | Control system and control method for vehicle |
| CN105117147A (en) * | 2015-07-24 | 2015-12-02 | 上海修源网络科技有限公司 | Method and apparatus for manipulating vehicle-mounted operating system based on gesture and vehicle-mounted device |
| WO2017035792A1 (en) * | 2015-09-01 | 2017-03-09 | 深圳好视网络科技有限公司 | Gesture-based channel changing method and remote control |
| CN106527674A (en) * | 2015-09-14 | 2017-03-22 | 上海羽视澄蓝信息科技有限公司 | Human-computer interaction method, equipment and system for vehicle-mounted monocular camera |
| CN105760096A (en) * | 2016-01-04 | 2016-07-13 | 钟林 | Automobile center console direction gesture control method and device supporting blind operation |
| WO2017124454A1 (en) * | 2016-01-23 | 2017-07-27 | 曹晟 | Gesture-based method for calling instruction for system, and operating apparatus |
| WO2017124451A1 (en) * | 2016-01-23 | 2017-07-27 | 曹晟 | Gesture-based method for calling instruction for vehicle-mounted system, and operating apparatus |
| DE102016119846A1 (en) * | 2016-10-18 | 2018-04-19 | Preh Gmbh | Man-machine interface comprising a steering wheel and a fingerprint sensor attached thereto |
| CN106891724B (en) * | 2017-01-22 | 2022-05-03 | 斑马信息科技有限公司 | Automobile main control screen system and method |
| CN106598349A (en) * | 2017-02-28 | 2017-04-26 | 上海蔚来汽车有限公司 | Vehicle-mounted touch display device and control method thereof |
| CN109669529A (en) * | 2017-10-16 | 2019-04-23 | 上汽通用汽车有限公司 | Vehicle-mounted man-machine interactive system |
| CN109410691A (en) * | 2018-12-17 | 2019-03-01 | 深圳市中智仿真科技有限公司 | A kind of automobile of gesture control function drives training analog machine |
| CN110928411B (en) * | 2019-11-18 | 2021-03-26 | 珠海格力电器股份有限公司 | AR-based interaction method and device, storage medium and electronic equipment |
| CN111045590B (en) * | 2019-12-04 | 2021-06-04 | 广州小鹏汽车科技有限公司 | Method and system for vehicle-mounted key simulation, storage medium and vehicle |
| US11308800B2 (en) | 2019-12-05 | 2022-04-19 | Toyota Motor North America, Inc. | Transport impact reporting based on sound levels |
| US10832699B1 (en) | 2019-12-05 | 2020-11-10 | Toyota Motor North America, Inc. | Impact media sharing |
| US11107355B2 (en) | 2019-12-05 | 2021-08-31 | Toyota Motor North America, Inc. | Transport dangerous driving reporting |
| CN111309153B (en) * | 2020-03-25 | 2024-04-09 | 北京百度网讯科技有限公司 | Man-machine interaction control method and device, electronic equipment and storage medium |
| CN112363665B (en) * | 2020-10-30 | 2022-05-27 | 东风汽车有限公司 | Automobile touch screen control method, electronic equipment and storage medium |
| CN113548061B (en) * | 2021-06-25 | 2023-04-18 | 北京百度网讯科技有限公司 | Man-machine interaction method and device, electronic equipment and storage medium |
| CN114697448A (en) * | 2022-03-29 | 2022-07-01 | 南京点明软件科技有限公司 | Mobile phone input method applied to blind person operation |
| CN114458123B (en) * | 2022-04-12 | 2022-06-14 | 国汽智控(北京)科技有限公司 | Vehicle window control method, device and equipment |
Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| TW200619982A (en) * | 2004-08-31 | 2006-06-16 | Ibm | Touch gesture based interface for motor vehicle |
| CN101546233A (en) * | 2009-05-05 | 2009-09-30 | 上海华勤通讯技术有限公司 | Identification and operation method of touch screen interface gestures |
| JP2009298285A (en) * | 2008-06-12 | 2009-12-24 | Tokai Rika Co Ltd | Input device |
| JP2009301300A (en) * | 2008-06-12 | 2009-12-24 | Tokai Rika Co Ltd | Input device |
| CN101854496A (en) * | 2010-04-28 | 2010-10-06 | 青岛海信电器股份有限公司 | Television set and control method and remote controller thereof |
| CN102520876A (en) * | 2012-01-04 | 2012-06-27 | 北京飞漫软件技术有限公司 | Method for operating intelligent touch screen equipment |
-
2012
- 2012-08-30 CN CN201210312798.4A patent/CN102866803B/en active Active
Patent Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| TW200619982A (en) * | 2004-08-31 | 2006-06-16 | Ibm | Touch gesture based interface for motor vehicle |
| JP2009298285A (en) * | 2008-06-12 | 2009-12-24 | Tokai Rika Co Ltd | Input device |
| JP2009301300A (en) * | 2008-06-12 | 2009-12-24 | Tokai Rika Co Ltd | Input device |
| CN101546233A (en) * | 2009-05-05 | 2009-09-30 | 上海华勤通讯技术有限公司 | Identification and operation method of touch screen interface gestures |
| CN101854496A (en) * | 2010-04-28 | 2010-10-06 | 青岛海信电器股份有限公司 | Television set and control method and remote controller thereof |
| CN102520876A (en) * | 2012-01-04 | 2012-06-27 | 北京飞漫软件技术有限公司 | Method for operating intelligent touch screen equipment |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US11873000B2 (en) | 2020-02-18 | 2024-01-16 | Toyota Motor North America, Inc. | Gesture detection for transport control |
Also Published As
| Publication number | Publication date |
|---|---|
| CN102866803A (en) | 2013-01-09 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN102866803B (en) | A kind ofly support the virtual console gesture control method of the automobile of blind operation and device | |
| CN103353828B (en) | The method and device of function is write and is wiped in a kind of switching on the touchscreen | |
| US8519960B2 (en) | Method and apparatus for switching of KVM switch ports using gestures on a touch panel | |
| CN103186339B (en) | A kind of input method and be provided with the electronic equipment of dummy keyboard | |
| US10146432B2 (en) | Method for operating an operator control device of a motor vehicle in different operator control modes, operator control device and motor vehicle | |
| CN109542283B (en) | Gesture touch multi-screen operation method | |
| CN102855081A (en) | Apparatus and method for providing web browser interface using gesture in device | |
| CN103425424B (en) | Handwriting input word selection system and method | |
| JP2007072578A (en) | Input device | |
| CN104859561B (en) | Vehicle device information processing method and device on automobile | |
| US9361022B2 (en) | Character input apparatus | |
| CN104657075A (en) | Gesture control device and method for automobile electric appliance | |
| CN103051695B (en) | A kind of mobile phone that utilizes carries out the method and system of information input to vehicular applications software | |
| EP4137380A1 (en) | Human-computer interaction method and apparatus, and electronic device and storage medium | |
| CN114764304A (en) | Screen display method | |
| CN106227438B (en) | Terminal control method and device | |
| CN102841752B (en) | The characters input method of a kind of human-computer interaction device and device | |
| CN104020989A (en) | Control method and system based on remote application | |
| CN114690889A (en) | Processing method of virtual keyboard and related equipment | |
| CN109669529A (en) | Vehicle-mounted man-machine interactive system | |
| CN104866218A (en) | Control method of electronic touch equipment | |
| CN107407976B (en) | Operation equipment, motor vehicle and the method for running operation equipment | |
| CN106293431A (en) | Handwriting input recognition methods, system and electronic installation | |
| EP2187300A1 (en) | Procedure and system of operator interaction with tactile surface computers | |
| JP3747022B2 (en) | Control system using tactile input field |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| C14 | Grant of patent or utility model | ||
| GR01 | Patent grant |