CN106502416A - A kind of driving simulation system of Intelligent Recognition bimanual input and its control method - Google Patents

A kind of driving simulation system of Intelligent Recognition bimanual input and its control method Download PDF

Info

Publication number
CN106502416A
CN106502416A CN201610983286.9A CN201610983286A CN106502416A CN 106502416 A CN106502416 A CN 106502416A CN 201610983286 A CN201610983286 A CN 201610983286A CN 106502416 A CN106502416 A CN 106502416A
Authority
CN
China
Prior art keywords
hand gesture
hand
motion sequence
actual
sequence
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN201610983286.9A
Other languages
Chinese (zh)
Other versions
CN106502416B (en
Inventor
缪文南
叶子城
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Guangzhou College of South China University of Technology
Original Assignee
Guangzhou College of South China University of Technology
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Guangzhou College of South China University of Technology filed Critical Guangzhou College of South China University of Technology
Priority to CN201610983286.9A priority Critical patent/CN106502416B/en
Publication of CN106502416A publication Critical patent/CN106502416A/en
Application granted granted Critical
Publication of CN106502416B publication Critical patent/CN106502416B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/017Gesture based interaction, e.g. based on a set of recognized hand gestures

Landscapes

  • Engineering & Computer Science (AREA)
  • General Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Human Computer Interaction (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Processing Or Creating Images (AREA)

Abstract

The invention discloses a kind of driving simulation system of Intelligent Recognition bimanual input and its control method, including Left-hand gesture identification bracelet, right-hand gesture identification bracelet and terminal, the Left-hand gesture identification bracelet and right-hand gesture identification bracelet are connected with terminal by communication network, and the Left-hand gesture identification bracelet includes:First 3-axis acceleration sensor, for gathering the left hand 3-axis acceleration sequence at each moment in Left-hand gesture change.Only need user's both hands to wear the Left-hand gesture identification bracelet and right-hand gesture identification bracelet for being loaded with 3-axis acceleration sensor respectively, gesture identification is carried out by 3-axis acceleration sensor, recognition speed is faster;Can hand locus be identified tracking, be analyzed using space coordinates sequence is simplified, identification error is less, and activity space is unfettered, more easy and convenient.

Description

A kind of driving simulation system of Intelligent Recognition bimanual input and its control method
Technical field
A kind of the present invention relates to human-computer interaction technique field, more particularly to driving simulation system of Intelligent Recognition bimanual input And its control method.
Background technology
With the high speed development of body feeling interaction technology, and 3D sensors is widely used, and the application of body feeling interaction is more next More popularize, especially Gesture Recognition, be used widely in human-computer interaction intelligent system.In recent years, gesture identification skill Art is also applied in drive simulating learning system or virtual race car system, makes user make various combination gestures by both hands to grasp Control system, allows user to obtain infinite enjoyment between physical sport and intention imagination.But existing gesture identification formula simulation is driven Learning system or virtual race car system is sailed, using video identification bimanual input method, hand is taken pictures by camera, Then carry out normalizing analysis to image, and the image that normalization is obtained carried out space projection, and by the projection coordinate of gained with The projection coordinate of the image for prestoring is compared, so as to identify corresponding bimanual input.This video identification bimanual input Though method comparison is directly perceived, need through complicated mathematical calculation process, recognition speed is slow, and hand locus cannot be entered Row recognition and tracking, identification error are larger;And, user must in the image pickup scope of camera so as to activity space is constrained, or Person's user's head is worn and is loaded with camera but so more burdensome inconvenience.
Content of the invention
It is an object of the invention to proposing a kind of gesture identification rapidly and efficiently, accuracy of identification is high, makes User Activity not by about The driving simulation system of the Intelligent Recognition bimanual input of beam and its control method.
It is that the present invention is employed the following technical solutions up to this purpose:
A kind of driving simulation system of Intelligent Recognition bimanual input, including Left-hand gesture identification bracelet, right-hand gesture identification Bracelet and terminal, the Left-hand gesture identification bracelet and right-hand gesture identification bracelet are connected with terminal by communication network, described Left-hand gesture identification bracelet includes:
First 3-axis acceleration sensor, for gathering the left hand 3-axis acceleration sequence at each moment in Left-hand gesture change Row;
First microprocessor, for generating left hand ring pairing address code, and is used for the left hand 3-axis acceleration sequence, Corresponding actual Left-hand gesture motion sequence is generated by 3-dimensional encoding module;
First data collector, for being packaged into left hand by actual Left-hand gesture motion sequence and left hand ring pairing address code Ring exercise data bag is sent to terminal;
The right-hand gesture identification bracelet includes:
Second 3-axis acceleration sensor, for gathering the right hand 3-axis acceleration sequence at each moment in right-hand gesture change Row;
Second microprocessor, for generating right hand ring pairing address code, and is used for the right hand 3-axis acceleration sequence, Corresponding actual right-hand gesture motion sequence is generated by 3-dimensional encoding module;
Second data collector, for being packaged into the right hand by actual right-hand gesture motion sequence and right hand ring pairing address code Ring exercise data bag is sent to terminal;
The terminal includes:
Standard Left-hand gesture storehouse, for storing standard Left-hand gesture motion sequence corresponding with each Left-hand gesture;
Standard right hand gesture library, for storing standard right hand gesture motion sequence corresponding with each right-hand gesture;
Bracelet communicator, for receiving the left hand ring exercise data bag and right-hand gesture identification hand of Left-hand gesture identification bracelet The right hand ring exercise data bag of ring;
Bracelet data class manager, is carried out for the left hand ring exercise data bag and right hand ring exercise data bag to receiving Classification storage;
Left-hand gesture adaptation, for transferring the actual Left-hand gesture motion sequence of the left hand ring exercise data bag, and Mated with the standard Left-hand gesture motion sequence of storage, corresponding Left-hand gesture is obtained from standard Left-hand gesture storehouse;
Right-hand gesture adaptation, for transferring the actual right-hand gesture motion sequence of the right hand ring exercise data bag, and Mated with the standard right hand gesture motion sequence of storage, corresponding right-hand gesture is obtained from standard right hand gesture library;
Drive simulating manager, selects analogue-key for presetting multiple analog Driving Scene and scene set, by field Scape selects analogue-key to select and switching drive simulating scene.
Preferably, the drive simulating manager, be additionally operable to the default drive simulation comprising multiple drive simulation buttons by Keyset, and be the corresponding drive simulating action of each drive simulation key configurations;
Gesture and analogue-key configurator, for presetting bimanual input combination of sets, the bimanual input combination of sets includes a left side Multiple bimanual input combinations that hand gesture and right-hand gesture are combined, and be each drive simulation button and corresponding both hands Mapping relations are set up in gesture combination, also select analogue-key and the combination of corresponding bimanual input to set up mapping relations for scene;
Analogue-key controller, obtains for the Left-hand gesture that obtains Left-hand gesture adaptation and right hand gesture adaptation Right-hand gesture is combined, and is then mated with bimanual input combination of sets, finds out corresponding bimanual input combination, and is mapped as Scene selects analogue-key, selects analogue-key to select drive simulating scene finally by scene;Analogue-key controller, also uses The right-hand gesture obtained in the Left-hand gesture that obtains Left-hand gesture adaptation and right hand gesture adaptation is combined, then with double Hand gesture combination of sets is mated, and finds out corresponding bimanual input combination, and is mapped as corresponding drive simulation button, finally holds Row drive simulating action corresponding with drive simulation button.
Preferably, the 3-dimensional encoding module includes three axle angle generators and three-axis moving data encoder, described three Axle angle generator includes:
For presetting X-axis threshold value dX, Y-axis threshold value dYWith Z axis threshold value dZ
For in TnWhen inscribe, gather X-axis output voltage variation delta xn, Y-axis output voltage variation delta ynDefeated with Z axis Go out voltage variety Δ zn, n=0,1,2 ..., wherein T0For initial time;
For in TnWhen inscribe, judge | Δ xn| whether it is less than dX, | Δ yn| whether it is less than dY, and | Δ yn| whether it is less than dZ;If then continue down to execute, if not then resurvey data;
For in TnWhen inscribe, according to the angle α that three shaft angle degree formula calculate X-axis and acceleration of gravityn, Y-axis added with gravity The angle β of speedn, and the angle γ of Z axis and acceleration of gravityn;The three shaft angles degree formula is as follows:
αn=ar cos (Δ xn/gkx), βn=arcos (Δ yn/gky), γn=ar cos (Δ zn/gkz);
Wherein, g is acceleration of gravity, kxFor X-axis sensitivity, kyFor Y-axis sensitivity, kzFor Z axis sensitivity, g, kx、kyWith kzIt is constant;
For the α calculated according to Filtering Formulan、βnAnd γnFiltered, if αn、βnAnd γnMeet Filtering Formula, Then export to the three-axis moving data encoder, and renewable time Tn=Tn+1, enter next three shaft angles degree and generated Journey;If αn、βnAnd γnFiltering Formula is not met, then direct renewable time Tn=Tn+1, enter next three shaft angles degree and generated Journey;
The Filtering Formula is as follows:
cos(2αn)+cos(2βn)+cos(2γn)=1.
Preferably, the three-axis moving data encoder includes:
For receiving the α of the three axles angle generator outputn、βnAnd γn, n=0,1,2 ...;
For formula being generated according to three axle amount of deflections generate three axle amount of deflection data combination of sets, the three axles amount of deflection data Combination of sets is in TnWhen the X-axis amount of deflection X that inscribesn, Y-axis amount of deflection YnWith Z axis amount of deflection Zn, the three axles amount of deflection generates public Formula is as follows:
Xn=cos (αn0), Yn=cos (βn0),Zn=cos (γn0);
Segmentation is carried out for the three axle amount of deflection data combination of sets to generating,
If -1≤Xn< -0.5, then update Xn=1;If -0.5≤Xn< 0, then update Xn=2;If 0≤Xn< 0.5, then more New Xn=3;If 0.5≤Xn≤ 1, then update Xn=4;
If -1≤Yn< -0.5, then update Yn=1;If -0.5≤Yn< 0, then update Yn=2;If 0≤Yn< 0.5, then more New Yn=3;If 0.5≤Yn≤ 1, then update Yn=4;
If -1≤Zn< -0.5, then update Zn=1;If -0.5≤Zn< 0, then update Zn=2;If 0≤Zn< 0.5, then more New Zn=3;If 0.5≤Zn≤ 1, then update Zn=4;
For setting up three axle amount of deflection data combination sequence number table, it is that three axle amount of deflection data groups after each segmentation are compiled in collaboration with Sequence number;
For three axle amount of deflection data combination of sets after to segmentation, according to three axle amount of deflection data combine sequence number table obtain right The sequence number row that answers, and three-axis moving data sequence is constituted by sequence number row.
Preferably, the first microprocessor also includes:
First data validity judge module, for the reality to newly-generated actual Left-hand gesture motion sequence and caching Left-hand gesture motion sequence is compared:If newly-generated actual Left-hand gesture motion sequence and the actual Left-hand gesture fortune of caching Dynamic sequence is identical, then do not send data command to first data collector;If newly-generated actual Left-hand gesture fortune The actual Left-hand gesture motion sequence of dynamic sequence and caching is differed, then send the transmission number to first data collector According to instruction.
Preferably, second microprocessor also includes:
Second data validity judge module, for the reality to newly-generated actual right-hand gesture motion sequence and caching Right-hand gesture motion sequence is compared:If newly-generated actual right-hand gesture motion sequence and the actual right-hand gesture fortune of caching Dynamic sequence is identical, then do not send data command to second data collector;If newly-generated actual right-hand gesture fortune The actual right-hand gesture motion sequence of dynamic sequence and caching is differed, then send the transmission number to second data collector According to instruction.
Preferably, the control method of the driving simulation system of the Intelligent Recognition bimanual input, builds storehouse process including terminal Process is manipulated with analogue-key:
Terminal builds storehouse process:
Step E1, the terminal Criterion Left-hand gesture storehouse and standard right hand gesture library, standard Left-hand gesture library storage Standard Left-hand gesture motion sequence corresponding with each Left-hand gesture, standard right hand gesture library storage are corresponding with each right-hand gesture Standard right hand gesture motion sequence;
Step E2, the default multiple analog Driving Scene of the terminal and scene set select analogue-key, are selected by scene Select analogue-key to select and switching drive simulating scene;
Step E3, the default bimanual input combination of sets of the terminal, the bimanual input combination of sets include Left-hand gesture and the right side Multiple bimanual input combinations that hand gesture is combined;And analogue-key and the combination of corresponding bimanual input is selected for scene Set up mapping relations;
Step E4, the Left-hand gesture identification bracelet arrange left hand ring pairing address code, and the right-hand gesture recognizes bracelet Right hand ring pairing address code is set;
Analogue-key manipulates process:
Step G1, the left hand 3-axis acceleration at each moment in the Left-hand gesture identification bracelet collection Left-hand gesture change Sequence, and generate corresponding actual Left-hand gesture motion sequence;Meanwhile, the right-hand gesture identification bracelet collection right-hand gesture becomes The right hand 3-axis acceleration sequence at each moment in change, and generate corresponding actual right-hand gesture motion sequence;
Actual Left-hand gesture motion sequence and left hand ring pairing address code are beaten by step G2, the Left-hand gesture identification bracelet It is bundled into left hand ring exercise data bag to send to terminal;Meanwhile, the right-hand gesture recognizes bracelet by actual right-hand gesture motion sequence Row and right hand ring pairing address code are packaged into right hand ring exercise data bag and send to terminal;
Step G3, the terminal receive the left hand ring exercise data bag of Left-hand gesture identification bracelet and right-hand gesture identification hand The right hand ring exercise data bag of ring, and the left hand ring exercise data bag and right hand ring exercise data bag that receive are carried out by classification and deposited Storage;
Step G4, the terminal transfer the actual Left-hand gesture motion sequence of the left hand ring exercise data bag, and and deposit The standard Left-hand gesture motion sequence of storage is mated, and obtains corresponding Left-hand gesture from standard Left-hand gesture storehouse;
Step G5, the terminal transfer the actual right-hand gesture motion sequence of the right hand ring exercise data bag, and and deposit The standard right hand gesture motion sequence of storage is mated, and obtains corresponding right-hand gesture from standard right hand gesture library;
The Left-hand gesture of acquisition and the right-hand gesture for obtaining are combined by step G6, the terminal, then with both hands hand Gesture combination of sets is mated, and finds out corresponding bimanual input combination, and is mapped as corresponding scene selection analogue-key, finally leads to Crossing scene selects analogue-key to select drive simulating scene.
Preferably, the terminal is built storehouse process and is also included:
Step E5, the terminal preset the drive simulation comprising multiple drive simulation buttons by keyset, and drive for each Sail analogue-key and configure corresponding drive simulating action, and be that each drive simulation button and corresponding bimanual input group are built jointly Vertical mapping relations;
The analogue-key manipulation process also includes:
The Left-hand gesture of acquisition and the right-hand gesture for obtaining are combined by step G7, the terminal, then with both hands hand Gesture combination of sets is mated, and finds out corresponding bimanual input combination, and is mapped as corresponding analogue-key, finally executes and simulation The corresponding drive simulating action of button.
Preferably, step G2 also includes that data validity judges sub-step:
The Left-hand gesture identification bracelet is first to newly-generated actual Left-hand gesture motion sequence and the actual left hand of caching Gesture motion sequence is compared:If newly-generated actual Left-hand gesture motion sequence and the actual Left-hand gesture motion sequence of caching Row are identical, then do not send left hand ring exercise data bag to the terminal;If newly-generated actual Left-hand gesture motion sequence eases up The actual Left-hand gesture motion sequence that deposits is differed, then send left hand ring exercise data bag to the terminal;
Meanwhile, the right-hand gesture identification bracelet is first to newly-generated actual right-hand gesture motion sequence and the reality of caching Right-hand gesture motion sequence is compared:If newly-generated actual right-hand gesture motion sequence and the actual right-hand gesture fortune of caching Dynamic sequence is identical, then do not send right hand ring exercise data bag to the terminal;If newly-generated actual right-hand gesture motion sequence Differ with the actual right-hand gesture motion sequence of caching, then right hand ring exercise data bag is sent to the terminal.
The driving simulation system of the Intelligent Recognition bimanual input gathers user's by the first 3-axis acceleration sensor Left hand 3-axis acceleration sequence and the right hand 3-axis acceleration sequence by the second 3-axis acceleration sensor collection user, then lead to 3-dimensional encoding module converter is crossed for actual Left-hand gesture motion sequence and actual right-hand gesture motion sequence, and sends it to end End is analyzed coupling, so as to identify corresponding Left-hand gesture and right-hand gesture.The simulation of the Intelligent Recognition bimanual input Control loop only needs user's both hands to wear the Left-hand gesture identification bracelet and right-hand gesture for being loaded with 3-axis acceleration sensor respectively Identification bracelet, carries out gesture identification by 3-axis acceleration sensor, compares existing video identification bimanual input method, mathematics Calculating process is more simplified, so as to recognition speed faster;Can hand locus be identified tracking, be sat using space is simplified Mark sequence is analyzed, and identification error is less;And, Left-hand gesture identification bracelet and right-hand gesture identification bracelet need to only be put At user's wrist, activity space is unfettered, more easy and convenient.
Description of the drawings
The present invention will be further described for accompanying drawing, but the content in accompanying drawing does not constitute any limitation of the invention.
Fig. 1 is the communication connection schematic diagram of one of embodiment of the invention;
Fig. 2 is the Left-hand gesture identification bracelet module connection figure of one of embodiment of the invention;
Fig. 3 is the right-hand gesture identification bracelet module connection figure of one of embodiment of the invention;
Fig. 4 is the terminal module connection figure of one of embodiment of the invention;
Fig. 5 is three axle angle generator principle flow charts of one of embodiment of the invention;
Fig. 6 is the three-axis moving data encoder principle flow chart of one of embodiment of the invention;
Fig. 7 is the drive simulating method flow diagram of one of embodiment of the invention;
Fig. 8 is the Left-hand gesture identification bracelet data validity decision flow chart of one of embodiment of the invention;
Fig. 9 is the right-hand gesture identification bracelet data validity decision flow chart of one of embodiment of the invention.
Wherein:Left-hand gesture recognizes bracelet 1;Right-hand gesture recognizes bracelet 2;Terminal 3;Standard Left-hand gesture storehouse 31;Standard Right-hand gesture storehouse 32;First 3-axis acceleration sensor 11;First microprocessor 12;First data collector 13;Two or three axle Acceleration transducer 21;Second microprocessor 22;Second data collector 23;Bracelet communicator 33;Bracelet data Classification Management Device 34;Left-hand gesture adaptation 35;Right-hand gesture adaptation 36;Drive simulating manager 37;Gesture and analogue-key configurator 38;Analogue-key controller 39;First data validity judge module 121;Second data validity judge module 221.
Specific embodiment
Technical scheme is further illustrated below in conjunction with the accompanying drawings and by specific embodiment.
The driving simulation system of the Intelligent Recognition bimanual input of the present embodiment, recognizes bracelet 1, right hand hand including Left-hand gesture Gesture identification bracelet 2 and terminal 3, as shown in figure 1, Left-hand gesture identification bracelet 1 and right-hand gesture identification bracelet 2 are by communication Network is connected with terminal 3, as shown in Fig. 2 Left-hand gesture identification bracelet 1 includes:
First 3-axis acceleration sensor 11, for gathering the left hand 3-axis acceleration at each moment in Left-hand gesture change Sequence;
First microprocessor 12, for generating left hand ring pairing address code, and is used for the left hand 3-axis acceleration sequence Row, generate corresponding actual Left-hand gesture motion sequence by 3-dimensional encoding module;
First data collector 13, for being packaged into a left side by actual Left-hand gesture motion sequence and left hand ring pairing address code Bracelet exercise data bag is sent to terminal 3;
As shown in figure 3, the right-hand gesture identification bracelet 2 includes:
Second 3-axis acceleration sensor 21, for gathering the right hand 3-axis acceleration at each moment in right-hand gesture change Sequence;
Second microprocessor 22, for generating right hand ring pairing address code, and is used for the right hand 3-axis acceleration sequence Row, generate corresponding actual right-hand gesture motion sequence by 3-dimensional encoding module;
Second data collector 23, for being packaged into the right side by actual right-hand gesture motion sequence and right hand ring pairing address code Bracelet exercise data bag is sent to terminal 3;
As shown in figure 4, the terminal 3 includes:
Standard Left-hand gesture storehouse 31, for storing standard Left-hand gesture motion sequence corresponding with each Left-hand gesture;
Standard right hand gesture library 32, for storing standard right hand gesture motion sequence corresponding with each right-hand gesture;
Bracelet communicator 33, knows for receiving the left hand ring exercise data bag and right-hand gesture of Left-hand gesture identification bracelet 1 The right hand ring exercise data bag of other bracelet 2;
Bracelet data class manager 34, enters for the left hand ring exercise data bag and right hand ring exercise data bag to receiving Row classification storage;
Left-hand gesture adaptation 35, for transferring the actual Left-hand gesture motion sequence of the left hand ring exercise data bag, And mated with the standard Left-hand gesture motion sequence of storage, corresponding Left-hand gesture is obtained from standard Left-hand gesture storehouse 31;
Right-hand gesture adaptation 36, for transferring the actual right-hand gesture motion sequence of the right hand ring exercise data bag, And mated with the standard right hand gesture motion sequence of storage, corresponding right-hand gesture is obtained from standard right hand gesture library 32;
Drive simulating manager 37, selects analogue-key for presetting multiple analog Driving Scene and scene set, passes through Scene selects analogue-key to select and switching drive simulating scene.
The driving simulation system of the Intelligent Recognition bimanual input gathers user by the first 3-axis acceleration sensor 11 Left hand 3-axis acceleration sequence and by the second 3-axis acceleration sensor 21 gather user right hand 3-axis acceleration sequence, It is actual Left-hand gesture motion sequence and actual right-hand gesture motion sequence to pass through 3-dimensional encoding module converter again, and is sent to Coupling is analyzed to terminal 3, so as to identify corresponding Left-hand gesture and right-hand gesture.The Left-hand gesture recognizes bracelet 1 Recognize that bracelet 2 is connected with terminal 3 by wireless communication modes such as WIFI, bluetooths with right-hand gesture, left hand ring fortune is sent to terminal 3 Dynamic packet and right hand ring exercise data bag, the terminal 3 are PC, mobile phone, panel computer etc..The Intelligent Recognition both hands hand The driving simulation system of gesture only needs user's both hands to wear Left-hand gesture identification 1 He of bracelet for being loaded with 3-axis acceleration sensor respectively Right-hand gesture recognizes bracelet 2, carries out gesture identification by 3-axis acceleration sensor, compares existing video identification bimanual input Method, mathematical calculation process are more simplified, so as to recognition speed faster;Can hand locus be identified tracking, be adopted Simplify space coordinates sequence to be analyzed, identification error is less;And, Left-hand gesture identification bracelet 1 and right-hand gesture are known 2 need of other bracelet are placed at user's wrist, and activity space is unfettered, more easy and convenient.
The terminal 3 is to match address code with Left-hand gesture identification hand by transferring the left hand ring of left hand ring exercise data bag Ring 1 is matched, and is transferred the right hand ring pairing address code and right-hand gesture identification bracelet 2 of right hand ring exercise data bag and matched, and The left hand ring exercise data bag and right hand ring exercise data bag for arranging the 34 pairs of receptions of bracelet data class manager carries out classification and deposits Storage;So as to realize recognizing that bracelet 1 and right-hand gesture recognize the differentiation of bracelet 2 to Left-hand gesture, it is ensured that to left hand ring exercise data Bag and the shunting independent process of right hand ring exercise data bag, it is to avoid Left-hand gesture is misidentified into right-hand gesture, or by right hand hand Gesture misidentifies into this factor data of Left-hand gesture and exchanges the identification mistake for causing, and improves bimanual input identification certainty.
Preferably, as shown in figure 4, the drive simulating manager 37, is additionally operable to default comprising multiple drive simulation buttons Drive simulation press keyset, and be the corresponding drive simulating action of each drive simulation key configurations;
Gesture and analogue-key configurator 38, for presetting bimanual input combination of sets, the bimanual input combination of sets includes Multiple bimanual input combinations that Left-hand gesture and right-hand gesture are combined, and be each drive simulation button and corresponding pair Mapping relations are set up in the combination of hand gesture, also select analogue-key and the combination of corresponding bimanual input to set up mapping relations for scene;
Analogue-key controller 39, for the Left-hand gesture that obtains Left-hand gesture adaptation 35 and right hand gesture adaptation 36 The right-hand gesture of acquisition is combined, and is then mated with bimanual input combination of sets, finds out corresponding bimanual input combination, and It is mapped as scene and selects analogue-key, selects analogue-key to select drive simulating scene finally by scene;Analogue-key is controlled Device 39, being additionally operable to the right-hand gesture that the Left-hand gesture that obtains Left-hand gesture adaptation 35 and right hand gesture adaptation 36 obtain is carried out Combination, is then mated with bimanual input combination of sets, is found out corresponding bimanual input combination, and is mapped as corresponding driving mould Intend button, finally execute drive simulating action corresponding with drive simulation button.
The driving simulation system of the Intelligent Recognition bimanual input is first by being mapped to scene by the bimanual input of user Analogue-key is selected, and the drive simulating scene for needing is selected so as to user can be combined by bimanual input;Then, user makes again The various bimanual input combinations for being mapped to drive simulation button, so that execute corresponding simulation by the combination of various bimanual inputs Driver behavior.The driving simulation system can arrange corresponding car racing game program or Driving study program, break through existing with true Real handle or the mode of operation of button, but change to be operated by bimanual input, make user simulate direction by both hands Disk controls the operation of virtual car, user can be made to produce cordial feeling and dependence feeling with similar operation is truly driven, be greatly improved User experience.
The drive simulating manager 37 arranges multiple scenes and selects analogue-key and analogue-key, selects mould by scene Intending button and selecting drive simulating scene, and corresponding drive simulating action is configured for each analogue-key, multiple scenes select mould Intend button and analogue-key also sets up mapping relations with the combination of corresponding bimanual input, the mapping relations are as shown in table 1 below:
Table 1
As shown in Table 1, the driving simulation system of the Intelligent Recognition bimanual input makes user simulate steering wheel by both hands The operation of control virtual car, similar with truly driving operate with family more easy to get started manipulation, different from mechanical keyboard, touch Button and other game paddles, make user feel that in hand be exactly to hold one based on the body-sensing technology of bimanual input recognition methods Steering wheel, has very real presence.
Preferably, the 3-dimensional encoding module includes three axle angle generators and three-axis moving data encoder, such as Fig. 5 institutes Show, the three axles angle generator includes:
For presetting X-axis threshold value dX, Y-axis threshold value dYWith Z axis threshold value dZ
For in TnWhen inscribe, gather X-axis output voltage variation delta xn, Y-axis output voltage variation delta ynDefeated with Z axis Go out voltage variety Δ zn, n=0,1,2 ..., wherein T0For initial time;
For in TnWhen inscribe, judge | Δ xn| whether it is less than dX, | Δ yn| whether it is less than dY, and | Δ yn| whether it is less than dZ;If then continue down to execute, if not then resurvey data;
For in TnWhen inscribe, according to the angle α that three shaft angle degree formula calculate X-axis and acceleration of gravityn, Y-axis added with gravity The angle β of speedn, and the angle γ of Z axis and acceleration of gravityn;The three shaft angles degree formula is as follows:
αn=ar cos (Δ xn/gkx), βn=ar cos (Δ yn/gky), γn=ar cos (Δ zn/gkz);
Wherein, g is acceleration of gravity, kxFor X-axis sensitivity, kyFor Y-axis sensitivity, kzFor Z axis sensitivity, g, kx、kyWith kzIt is constant;
For the α calculated according to Filtering Formulan、βnAnd γnFiltered, if αn、βnAnd γnMeet Filtering Formula, Then export to the three-axis moving data encoder, and renewable time Tn=Tn+1, enter next three shaft angles degree and generated Journey;If αn、βnAnd γnFiltering Formula is not met, then direct renewable time Tn=Tn+1, enter next three shaft angles degree and generated Journey;
The Filtering Formula is as follows:
cos(2αn)+cos(2βn)+cos(2γn)=1.
The 3-dimensional encoding module first passes through X, Y and Z axis that three axle angle generators calculate 3-axis acceleration sensor The angle α of the acceleration of gravity at each moment in gesture changen、βnAnd γn;Then pass through three-axis moving data encoder again Calculate the amount of deflection X of X, Y and Z axis in gesture change between each moment and initial positionn、YnAnd Zn, the initial position is In initial time T0Under α0、β0And γ0;Obtain with X, Y and Z axis in hand finally according to three axle amount of deflection data combination sequence number table Each moment amount of deflection X in gesture changen、YnAnd ZnCorresponding sequence number row, and three-axis moving data sequence is constituted by sequence number row Row.The Left-hand gesture identification bracelet 1 and right-hand gesture identification bracelet 2 are entered to detection data using the 3-dimensional encoding module Row is processed:The Left-hand gesture recognizes the left hand 3-axis acceleration sequence of the collection of bracelet 1, and right-hand gesture identification bracelet 2 is gathered Right hand 3-axis acceleration sequence, its essence is X, Y in 3-dimensional encoding module and Z axis each moment in gesture change Δxn、ΔynWith Δ zn;The actual Left-hand gesture motion sequence that Left-hand gesture identification bracelet 1 is generated, right-hand gesture recognize bracelet 2 The actual right-hand gesture motion sequence for generating, and standard Left-hand gesture motion sequence and the standard right hand gesture of the storage of terminal 3 Motion sequence, its essence are the three-axis moving data sequence that the three-axis moving data encoding processor in 3-dimensional encoding module is generated Row.
It is different from the existing process mould by trying to achieve displacement to acceleration continuous integral twice and then obtain bimanual input Block, the 3-dimensional encoding module are entered by calculating each moment each axle and the relative angle of initial position in gesture change And pass through relative angle and can just obtain bimanual input, this avoid initial position punctuate error present in multiple integral and calculating The problems such as amplifying with error accumulation, simplifies operand, improves arithmetic speed.The three axles angle generator presets X-axis threshold Value dX, Y-axis threshold value dYWith Z axis threshold value dZ, can eliminate what the shake of human body was brought to the data that 3-axis acceleration sensor is collected Affect;And the three axles angle generator is also to αn、βnAnd γnFiltered, some are not met the data mistake of Filtering Formula Filter, improve data accuracy, and then improve gesture identification precision.
Preferably, as shown in fig. 6, the three-axis moving data encoder includes:
For receiving the α of the three axles angle generator outputn、βnAnd γn, n=0,1,2 ...;
For formula being generated according to three axle amount of deflections generate three axle amount of deflection data combination of sets, the three axles amount of deflection data Combination of sets is in TnWhen the X-axis amount of deflection X that inscribesn, Y-axis amount of deflection YnWith Z axis amount of deflection Zn, the three axles amount of deflection generates public Formula is as follows:
Xn=cos (αn0), Yn=cos (βn0),Zn=cos (γn0);
Segmentation is carried out for the three axle amount of deflection data combination of sets to generating,
If -1≤Xn< -0.5, then update Xn=1;If -0.5≤Xn< 0, then update Xn=2;If 0≤Xn< 0.5, then more New Xn=3;If 0.5≤Xn≤ 1, then update Xn=4;
If -1≤Yn< -0.5, then update Yn=1;If -0.5≤Yn< 0, then update Yn=2;If 0≤Yn< 0.5, then more New Yn=3;If 0.5≤Yn≤ 1, then update Yn=4;
If -1≤Zn< -0.5, then update Zn=1;If -0.5≤Zn< 0, then update Zn=2;If 0≤Zn< 0.5, then more New Zn=3;If 0.5≤Zn≤ 1, then update Zn=4;
For setting up three axle amount of deflection data combination sequence number table, it is that three axle amount of deflection data groups after each segmentation are compiled in collaboration with Sequence number;
For three axle amount of deflection data combination of sets after to segmentation, according to three axle amount of deflection data combine sequence number table obtain right The sequence number row that answers, and three-axis moving data sequence is constituted by sequence number row.
Coordinate system is set up in three axle amount of deflection data combination of sets segmentations in the three-axis moving data encoder, carries out coordinate Coding, is divided into four sections per axle, so both ensure that the speed of data processing and data transfer, while also obtaining higher essence Degree.And, if directly transmitting the data processing difficulty and easily that three axle amount of deflection data combination of sets after segmentation will improve terminal 3 There is factor data intersection extraction etc. and process the gesture identification mistake for causing by mistake, therefore the three-axis moving data encoder sets up three Axle amount of deflection data combine sequence number table, send sequence number to terminal 3 and arrange composition three-axis moving data sequence, so as to reduce data processing Difficulty, improves the efficiency and precision of gesture identification.The three axles amount of deflection data combination sequence number table is as shown in table 2:
Xn Yn Zn Sequence number
1 1 1 1
1 1 2 2
1 1 3 3
1 1 4 5
1 2 1 6
1 2 2 7
1 2 3 8
1 2 4 9
1 3 1 10
4 2 4 56
4 3 1 57
4 3 2 58
4 3 3 59
4 3 4 60
4 4 1 61
4 4 2 62
4 4 3 63
4 4 4 64
Table 2
According to table 2, the data area of the three-axis moving data sequence is 1~64, the three-axis moving data sequence It is classified as in the data area, any combination that multiple sequence numbers are arranged according to time sequencing, such as described three-axis moving data Sequence can be { Isosorbide-5-Nitrae, 3,23,54, Isosorbide-5-Nitrae 3,6,4,63 }.
Preferably, as shown in Fig. 2 the first microprocessor 12 also includes:
First data validity judge module 121, for newly-generated actual Left-hand gesture motion sequence and caching Actual Left-hand gesture motion sequence is compared:If newly-generated actual Left-hand gesture motion sequence and the actual left hand hand of caching Potential motion sequence is identical, then do not send data command to first data collector 13;If newly-generated actual left hand The actual Left-hand gesture motion sequence of gesture motion sequence and caching is differed, then send institute to first data collector 13 State transmission data command.
Preferably, as shown in figure 3, second microprocessor 22 also includes:
Second data validity judge module 221, for newly-generated actual right-hand gesture motion sequence and caching Actual right-hand gesture motion sequence is compared:If newly-generated actual right-hand gesture motion sequence and the actual right hand hand of caching Potential motion sequence is identical, then do not send data command to second data collector 23;If the newly-generated actual right hand The actual right-hand gesture motion sequence of gesture motion sequence and caching is differed, then send institute to second data collector 23 State transmission data command.
When actual Left-hand gesture motion sequence or actual right-hand gesture motion sequence produce change, the left hand ring fortune of transmission Dynamic packet or right hand ring exercise data Bao Caiwei valid data;And actual Left-hand gesture motion sequence or actual right-hand gesture fortune When dynamic sequence does not produce change, the left hand ring exercise data bag of transmission or right hand ring exercise data bag are invalid data, and this is not only The speed of processing data is affected, and substantially increases power consumption.Therefore, the Left-hand gesture identification bracelet 1 arranges first Data validity judge module 121, the right-hand gesture identification bracelet 2 arrange the second data validity judge module 221, work as reality When border Left-hand gesture motion sequence or actual right-hand gesture motion sequence do not produce change, left hand ring is not sent to terminal 3 and moved Packet or right hand ring exercise data bag, so as to effectively reduce useless data transfer, greatly reduce Left-hand gesture identification hand Ring 1 and right-hand gesture recognize the power consumption of bracelet 2.
Preferably, the control method of the driving simulation system of the Intelligent Recognition bimanual input, as shown in fig. 7, comprises eventually Build storehouse process and analogue-key manipulation process in end:
Terminal builds storehouse process:
Step E1,3 Criterion Left-hand gesture storehouse 31 of the terminal and standard right hand gesture library 32, standard Left-hand gesture storehouse 31 storages standard Left-hand gesture motion sequence corresponding with each Left-hand gesture, the storage of standard right hand gesture library 32 and each right hand The corresponding standard right hand gesture motion sequence of gesture;
Step E2, the terminal 3 presets multiple analog Driving Scene and scene set selects analogue-key, is selected by scene Select analogue-key to select and switching drive simulating scene;
Step E3, the terminal 3 preset bimanual input combination of sets, and the bimanual input combination of sets includes Left-hand gesture and the right side Multiple bimanual input combinations that hand gesture is combined;And analogue-key and the combination of corresponding bimanual input is selected for scene Set up mapping relations;
Step E4, the Left-hand gesture identification bracelet 1 arrange left hand ring pairing address code, and the right-hand gesture recognizes bracelet 2 arrange right hand ring pairing address code;
Analogue-key manipulates process:
Step G1, in the Left-hand gesture identification bracelet 1 collection Left-hand gesture change, three axle of left hand at each moment accelerates Degree series, and generate corresponding actual Left-hand gesture motion sequence;Meanwhile, the right-hand gesture identification bracelet 2 collection right hand hand The right hand 3-axis acceleration sequence at each moment in gesture change, and generate corresponding actual right-hand gesture motion sequence;
Actual Left-hand gesture motion sequence and left hand ring are matched address code by step G2, the Left-hand gesture identification bracelet 1 It is packaged into left hand ring exercise data bag to send to terminal 3;Meanwhile, actual right-hand gesture is transported by the right-hand gesture identification bracelet 2 Dynamic sequence and right hand ring pairing address code are packaged into right hand ring exercise data bag and send to terminal 3;
Step G3, the terminal 3 receive the left hand ring exercise data bag of Left-hand gesture identification bracelet 1 and right-hand gesture identification The right hand ring exercise data bag of bracelet 2, and the left hand ring exercise data bag and right hand ring exercise data bag that receive are classified Storage;
Step G4, the terminal 3 transfer the actual Left-hand gesture motion sequence of the left hand ring exercise data bag, and and deposit The standard Left-hand gesture motion sequence of storage is mated, and obtains corresponding Left-hand gesture from standard Left-hand gesture storehouse 31;
Step G5, the terminal 3 transfer the actual right-hand gesture motion sequence of the right hand ring exercise data bag, and and deposit The standard right hand gesture motion sequence of storage is mated, and obtains corresponding right-hand gesture from standard right hand gesture library 32;
The Left-hand gesture of acquisition and the right-hand gesture for obtaining are combined by step G6, the terminal 3, then with both hands hand Gesture combination of sets is mated, and finds out corresponding bimanual input combination, and is mapped as corresponding scene selection analogue-key, finally leads to Crossing scene selects analogue-key to select drive simulating scene.
Preferably, the terminal is built storehouse process and is also included:
Step E5, the default drive simulation comprising multiple drive simulation buttons of the terminal 3 press keyset, and drive for each Sail analogue-key and configure corresponding drive simulating action, and be that each drive simulation button and corresponding bimanual input group are built jointly Vertical mapping relations;
The analogue-key manipulation process also includes:
The Left-hand gesture of acquisition and the right-hand gesture for obtaining are combined by step G7, the terminal 3, then with both hands hand Gesture combination of sets is mated, and finds out corresponding bimanual input combination, and is mapped as corresponding analogue-key, finally executes and simulation The corresponding drive simulating action of button.
The control method of the driving simulation system of the Intelligent Recognition bimanual input is added by gathering three axle of left hand of user Velocity series and right hand 3-axis acceleration sequence, then be actual Left-hand gesture motion sequence and reality by 3-dimensional encoding module converter Border right-hand gesture motion sequence, and send it to terminal 3 and be analyzed coupling, so as to identify corresponding Left-hand gesture and the right side Hand gesture.The control method recognition speed of the driving simulation system of the Intelligent Recognition bimanual input is fast, can be to hand space bit Put and be identified tracking, be analyzed using space coordinates sequence is simplified, identification error is less;Also, to the left side for receiving Bracelet exercise data bag and right hand ring exercise data bag carry out classification storage;So as to realize recognizing bracelet 1 and the right side to Left-hand gesture The differentiation of hand gesture identification bracelet 2, it is ensured that to left hand ring exercise data bag and the shunting independent process of right hand ring exercise data bag, Avoid for Left-hand gesture misidentifying into right-hand gesture, or right-hand gesture is misidentified into this factor data exchange of Left-hand gesture and cause Identification mistake, improve bimanual input identification certainty.
The control method of the driving simulation system of the Intelligent Recognition bimanual input passes through first by the bimanual input of user Be mapped to scene and select analogue-key, the drive simulating scene for needing is selected so as to user can be combined by bimanual input;Then, User makes the various bimanual input combinations for being mapped to drive simulation button again, executes so as to pass through various bimanual input combinations Corresponding drive simulating action.The control method can arrange corresponding car racing game program or Driving study program, break through existing There is the mode of operation with true handle or button, but change to be operated by bimanual input, make user pass through both hands mould Draft direction disk controls the operation of virtual car, user can be made to produce cordial feeling and dependence feeling with similar operation is truly driven, greatly Big raising user experience.
Preferably, step G2 also includes that data validity judges sub-step:
As shown in figure 8, the Left-hand gesture identification bracelet 1 is first to newly-generated actual Left-hand gesture motion sequence and caching Actual Left-hand gesture motion sequence be compared:If newly-generated actual Left-hand gesture motion sequence and the actual left hand of caching Gesture motion sequence is identical, then do not send left hand ring exercise data bag to the terminal 3;If newly-generated actual Left-hand gesture fortune The actual Left-hand gesture motion sequence of dynamic sequence and caching is differed, then send left hand ring exercise data bag to the terminal 3;
Meanwhile, as shown in figure 9, the right-hand gesture recognizes bracelet 2 first to newly-generated actual right-hand gesture motion sequence It is compared with the actual right-hand gesture motion sequence of caching:If newly-generated actual right-hand gesture motion sequence and the reality of caching Border right-hand gesture motion sequence is identical, then do not send right hand ring exercise data bag to the terminal 3;If the newly-generated actual right hand The actual right-hand gesture motion sequence of gesture motion sequence and caching is differed, then send right hand ring to the terminal 3 and move number According to bag.
When actual Left-hand gesture motion sequence or actual right-hand gesture motion sequence produce change, the left hand ring fortune of transmission Dynamic packet or right hand ring exercise data Bao Caiwei valid data;And actual Left-hand gesture motion sequence or actual right-hand gesture fortune When dynamic sequence does not produce change, the left hand ring exercise data bag of transmission or right hand ring exercise data bag are invalid data, and this is not only The speed of processing data is affected, and substantially increases power consumption.Therefore, step G2 also includes that data validity judges Sub-step, when actual Left-hand gesture motion sequence or actual right-hand gesture motion sequence do not produce change, does not send to terminal 3 Left hand ring exercise data bag or right hand ring exercise data bag, so as to effectively reduce useless data transfer, greatly reduce left hand Gesture identification bracelet 1 and right-hand gesture recognize the power consumption of bracelet 2.
Above in association with the know-why that specific embodiment describes the present invention.These descriptions are intended merely to explain the present invention's Principle, and limiting the scope of the invention can not be construed to by any way.Based on explanation herein, the technology of this area Personnel associate other specific embodiments of the present invention by need not paying performing creative labour, these modes fall within Within protection scope of the present invention.

Claims (9)

1. a kind of driving simulation system of Intelligent Recognition bimanual input, recognizes hand including Left-hand gesture identification bracelet, right-hand gesture Ring and terminal, the Left-hand gesture identification bracelet and right-hand gesture identification bracelet are connected with terminal by communication network, its feature It is, the Left-hand gesture identification bracelet includes:
First 3-axis acceleration sensor, for gathering the left hand 3-axis acceleration sequence at each moment in Left-hand gesture change;
First microprocessor, for generating left hand ring pairing address code, and is used for the left hand 3-axis acceleration sequence, passes through 3-dimensional encoding module generates corresponding actual Left-hand gesture motion sequence;
First data collector, for being packaged into left hand ring fortune by actual Left-hand gesture motion sequence and left hand ring pairing address code Dynamic packet is sent to terminal;
The right-hand gesture identification bracelet includes:
Second 3-axis acceleration sensor, for gathering the right hand 3-axis acceleration sequence at each moment in right-hand gesture change;
Second microprocessor, for generating right hand ring pairing address code, and is used for the right hand 3-axis acceleration sequence, passes through 3-dimensional encoding module generates corresponding actual right-hand gesture motion sequence;
Second data collector, for being packaged into right hand ring fortune by actual right-hand gesture motion sequence and right hand ring pairing address code Dynamic packet is sent to terminal;
The terminal includes:
Standard Left-hand gesture storehouse, for storing standard Left-hand gesture motion sequence corresponding with each Left-hand gesture;
Standard right hand gesture library, for storing standard right hand gesture motion sequence corresponding with each right-hand gesture;
Bracelet communicator, for receiving the left hand ring exercise data bag and right-hand gesture identification bracelet of Left-hand gesture identification bracelet Right hand ring exercise data bag;
Bracelet data class manager, classifies for the left hand ring exercise data bag and right hand ring exercise data bag to receiving Storage;
Left-hand gesture adaptation, for transferring the actual Left-hand gesture motion sequence of the left hand ring exercise data bag, and and deposits The standard Left-hand gesture motion sequence of storage is mated, and obtains corresponding Left-hand gesture from standard Left-hand gesture storehouse;
Right-hand gesture adaptation, for transferring the actual right-hand gesture motion sequence of the right hand ring exercise data bag, and and deposits The standard right hand gesture motion sequence of storage is mated, and obtains corresponding right-hand gesture from standard right hand gesture library;
Drive simulating manager, is selected analogue-key for presetting multiple analog Driving Scene and scene set, is selected by scene Select analogue-key to select and switching drive simulating scene.
2. the driving simulation system of Intelligent Recognition bimanual input according to claim 1, it is characterised in that:The simulation is driven Manager is sailed, and the default drive simulation comprising multiple drive simulation buttons is additionally operable to by keyset, and is pressed for each drive simulation Key configures corresponding drive simulating action;
Gesture and analogue-key configurator, for presetting bimanual input combination of sets, the bimanual input combination of sets includes left hand hand Multiple bimanual input combinations that gesture and right-hand gesture are combined, and be each drive simulation button and corresponding bimanual input Mapping relations are set up in combination, also select analogue-key and the combination of corresponding bimanual input to set up mapping relations for scene;
Analogue-key controller, for the right hand that the Left-hand gesture that obtains Left-hand gesture adaptation and right hand gesture adaptation are obtained Gesture is combined, and is then mated with bimanual input combination of sets, finds out corresponding bimanual input combination, and is mapped as scene Analogue-key is selected, selects analogue-key to select drive simulating scene finally by scene;Analogue-key controller, be additionally operable to by The right-hand gesture that the Left-hand gesture and right hand gesture adaptation that Left-hand gesture adaptation is obtained is obtained is combined, then with both hands hand Gesture combination of sets is mated, and finds out the combination of corresponding bimanual input, and is mapped as corresponding drive simulation button, finally execute with The corresponding drive simulating action of drive simulation button.
3. the driving simulation system of Intelligent Recognition bimanual input according to claim 1, it is characterised in that described three-dimensional compile Code module includes that three axle angle generators and three-axis moving data encoder, the three axles angle generator include:
For presetting X-axis threshold value dX, Y-axis threshold value dYWith Z axis threshold value dZ
For in TnWhen inscribe, gather X-axis output voltage variation delta xn, Y-axis output voltage variation delta ynWith Z axis output electricity Pressure variation delta zn, n=0,1,2 ..., wherein T0For initial time;
For in TnWhen inscribe, judge | Δ xn| whether it is less than dX, | Δ yn| whether it is less than dY, and | Δ yn| whether it is less than dZ;If Then continue down to execute, if not then resurveying data;
For in TnWhen inscribe, according to the angle α that three shaft angle degree formula calculate X-axis and acceleration of gravityn, Y-axis and acceleration of gravity Angle βn, and the angle γ of Z axis and acceleration of gravityn;The three shaft angles degree formula is as follows:
αn=ar cos (Δ xn/g kx), βn=ar cos (Δ yn/g ky), γn=ar cos (Δ zn/g kz);
Wherein, g is acceleration of gravity, kxFor X-axis sensitivity, kyFor Y-axis sensitivity, kzFor Z axis sensitivity, g, kx、kyAnd kz? For constant;
For the α calculated according to Filtering Formulan、βnAnd γnFiltered, if αn、βnAnd γnMeet Filtering Formula, then defeated Go out to the three-axis moving data encoder, and renewable time Tn=Tn+1, enter next three shaft angles degree generating process;If αn、βnAnd γnFiltering Formula is not met, then direct renewable time Tn=Tn+1, enter next three shaft angles degree generating process;
The Filtering Formula is as follows:
cos(2αn)+cos(2βn)+cos(2γn)=1.
4. the driving simulation system of Intelligent Recognition bimanual input according to claim 3, it is characterised in that the three axles fortune Dynamic data encoder includes:
For receiving the α of the three axles angle generator outputn、βnAnd γn, n=0,1,2 ...;
For formula being generated according to three axle amount of deflections generate three axle amount of deflection data combination of sets, the three axles amount of deflection data combination Collection is in TnWhen the X-axis amount of deflection X that inscribesn, Y-axis amount of deflection YnWith Z axis amount of deflection Zn, the three axles amount of deflection generation formula is such as Under:
Xn=cos (αn0), Yn=cos (βn0),Zn=cos (γn0);
Segmentation is carried out for the three axle amount of deflection data combination of sets to generating,
If -1≤Xn< -0.5, then update Xn=1;If -0.5≤Xn< 0, then update Xn=2;If 0≤Xn< 0.5, then update Xn =3;If 0.5≤Xn≤ 1, then update Xn=4;
If -1≤Yn< -0.5, then update Yn=1;If -0.5≤Yn< 0, then update Yn=2;If 0≤Yn< 0.5, then update Yn =3;If 0.5≤Yn≤ 1, then update Yn=4;
If -1≤Zn< -0.5, then update Zn=1;If -0.5≤Zn< 0, then update Zn=2;If 0≤Zn< 0.5, then update Zn =3;If 0.5≤Zn≤ 1, then update Zn=4;
For setting up three axle amount of deflection data combination sequence number table, it is that three axle amount of deflection data groups after each segmentation compile in collaboration with sequence Number;
For three axle amount of deflection data combination of sets after to segmentation, according to three axle amount of deflection data combine sequence number table obtain corresponding Sequence number is arranged, and constitutes three-axis moving data sequence by sequence number row.
5. the driving simulation system of Intelligent Recognition bimanual input according to claim 1, it is characterised in that described first is micro- Processor also includes:
First data validity judge module, for the actual left hand to newly-generated actual Left-hand gesture motion sequence and caching Gesture motion sequence is compared:If newly-generated actual Left-hand gesture motion sequence and the actual Left-hand gesture motion sequence of caching Row are identical, then do not send data command to first data collector;If newly-generated actual Left-hand gesture motion sequence The actual Left-hand gesture motion sequence of row and caching is differed, then send the transmission data to first data collector and refer to Order.
6. the driving simulation system of Intelligent Recognition bimanual input according to claim 1, it is characterised in that described second is micro- Processor also includes:
Second data validity judge module, for the actual right hand to newly-generated actual right-hand gesture motion sequence and caching Gesture motion sequence is compared:If newly-generated actual right-hand gesture motion sequence and the actual right-hand gesture motion sequence of caching Row are identical, then do not send data command to second data collector;If newly-generated actual right-hand gesture motion sequence The actual right-hand gesture motion sequence of row and caching is differed, then send the transmission data to second data collector and refer to Order.
7. the control method of the driving simulation system of the Intelligent Recognition bimanual input according to claim 1 to 6 any one, Characterized in that, building storehouse process and analogue-key manipulation process including terminal:
Terminal builds storehouse process:
Step E1, the terminal Criterion Left-hand gesture storehouse and standard right hand gesture library, standard Left-hand gesture library storage with each The corresponding standard Left-hand gesture motion sequence of individual Left-hand gesture, standard right hand gesture library storage mark corresponding with each right-hand gesture Quasi- right-hand gesture motion sequence;
Step E2, the default multiple analog Driving Scene of the terminal and scene set select analogue-key, select mould by scene Intend button to select and switching drive simulating scene;
Step E3, the default bimanual input combination of sets of the terminal, the bimanual input combination of sets include Left-hand gesture and right hand hand Multiple bimanual input combinations that gesture is combined;And select analogue-key and the combination of corresponding bimanual input to set up for scene Mapping relations;
Step E4, the Left-hand gesture identification bracelet arrange left hand ring pairing address code, and the right-hand gesture identification bracelet is arranged Right hand ring matches address code;
Analogue-key manipulates process:
Step G1, the left hand 3-axis acceleration sequence at each moment in the Left-hand gesture identification bracelet collection Left-hand gesture change Row, and generate corresponding actual Left-hand gesture motion sequence;Meanwhile, the right-hand gesture identification bracelet collection right-hand gesture change In each moment right hand 3-axis acceleration sequence, and generate corresponding actual right-hand gesture motion sequence;
Actual Left-hand gesture motion sequence and left hand ring pairing address code are packaged into by step G2, the Left-hand gesture identification bracelet Left hand ring exercise data bag is sent to terminal;Meanwhile, right-hand gesture identification bracelet by actual right-hand gesture motion sequence and Right hand ring pairing address code is packaged into right hand ring exercise data bag and sends to terminal;
Step G3, the terminal receive the left hand ring exercise data bag and right-hand gesture of Left-hand gesture identification bracelet and recognize bracelet Right hand ring exercise data bag, and classification storage is carried out to the left hand ring exercise data bag and right hand ring exercise data bag that receive;
Step G4, the terminal transfer the actual Left-hand gesture motion sequence of the left hand ring exercise data bag, and and storage Standard Left-hand gesture motion sequence is mated, and obtains corresponding Left-hand gesture from standard Left-hand gesture storehouse;
Step G5, the terminal transfer the actual right-hand gesture motion sequence of the right hand ring exercise data bag, and and storage Standard right hand gesture motion sequence is mated, and obtains corresponding right-hand gesture from standard right hand gesture library;
The Left-hand gesture of acquisition and the right-hand gesture for obtaining are combined by step G6, the terminal, then with bimanual input group Intersection is mated, and finds out corresponding bimanual input combination, and is mapped as corresponding scene selection analogue-key, finally by field Scape selects analogue-key to select drive simulating scene.
8. control method according to claim 7, it is characterised in that the terminal builds storehouse process also to be included:
Step E5, the terminal preset the drive simulation comprising multiple drive simulation buttons by keyset, and drive mould for each Intend the corresponding drive simulating action of key configurations, and be that each drive simulation button and the combination foundation of corresponding bimanual input are reflected Penetrate relation;
The analogue-key manipulation process also includes:
The Left-hand gesture of acquisition and the right-hand gesture for obtaining are combined by step G7, the terminal, then with bimanual input group Intersection is mated, and finds out corresponding bimanual input combination, and is mapped as corresponding analogue-key, finally executes and analogue-key Corresponding drive simulating action.
9. control method according to claim 7, it is characterised in that step G2 also includes that data validity judges son Step:
The Left-hand gesture identification bracelet is first to newly-generated actual Left-hand gesture motion sequence and the actual Left-hand gesture of caching Motion sequence is compared:If newly-generated actual Left-hand gesture motion sequence and the actual Left-hand gesture motion sequence phase of caching With then not to terminal transmission left hand ring exercise data bag;If newly-generated actual Left-hand gesture motion sequence and caching Actual Left-hand gesture motion sequence is differed, then send left hand ring exercise data bag to the terminal;
Meanwhile, the right-hand gesture identification bracelet is first to newly-generated actual right-hand gesture motion sequence and the actual right hand of caching Gesture motion sequence is compared:If newly-generated actual right-hand gesture motion sequence and the actual right-hand gesture motion sequence of caching Row are identical, then do not send right hand ring exercise data bag to the terminal;If newly-generated actual right-hand gesture motion sequence eases up The actual right-hand gesture motion sequence that deposits is differed, then send right hand ring exercise data bag to the terminal.
CN201610983286.9A 2016-11-09 2016-11-09 A kind of driving simulation system and its control method of intelligent recognition bimanual input Active CN106502416B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201610983286.9A CN106502416B (en) 2016-11-09 2016-11-09 A kind of driving simulation system and its control method of intelligent recognition bimanual input

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201610983286.9A CN106502416B (en) 2016-11-09 2016-11-09 A kind of driving simulation system and its control method of intelligent recognition bimanual input

Publications (2)

Publication Number Publication Date
CN106502416A true CN106502416A (en) 2017-03-15
CN106502416B CN106502416B (en) 2019-04-02

Family

ID=58324127

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201610983286.9A Active CN106502416B (en) 2016-11-09 2016-11-09 A kind of driving simulation system and its control method of intelligent recognition bimanual input

Country Status (1)

Country Link
CN (1) CN106502416B (en)

Cited By (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN107844195A (en) * 2017-10-26 2018-03-27 天津科技大学 The development approach and system of automobile virtual driving application based on Intel RealSense
CN107948570A (en) * 2017-11-29 2018-04-20 长沙安行机电设备有限公司 A kind of rail track real scene video plays synchronous locomotive driving real time information source method
CN108595003A (en) * 2018-04-23 2018-09-28 Oppo广东移动通信有限公司 Function control method and relevant device
CN111580660A (en) * 2020-05-09 2020-08-25 清华大学 Operation triggering method, device, equipment and readable storage medium

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN104571506A (en) * 2014-12-25 2015-04-29 西安电子科技大学 Smart watch based on action recognition and action recognition method
CN104679246A (en) * 2015-02-11 2015-06-03 华南理工大学 Wearable type equipment based on interactive interface human hand roaming control and interactive interface human hand roaming control method
CN105582669A (en) * 2015-12-21 2016-05-18 上海交通大学 Motion sensing game bracelet system based on motion template feature matching

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN104571506A (en) * 2014-12-25 2015-04-29 西安电子科技大学 Smart watch based on action recognition and action recognition method
CN104679246A (en) * 2015-02-11 2015-06-03 华南理工大学 Wearable type equipment based on interactive interface human hand roaming control and interactive interface human hand roaming control method
CN105582669A (en) * 2015-12-21 2016-05-18 上海交通大学 Motion sensing game bracelet system based on motion template feature matching

Non-Patent Citations (2)

* Cited by examiner, † Cited by third party
Title
刘蓉 等: "基于三轴加速度传感器的手势识别", 《计算机工程》 *
陈阳 等: "基于穿戴式加速度传感器的手势识别系统", 《自动化与信息工程》 *

Cited By (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN107844195A (en) * 2017-10-26 2018-03-27 天津科技大学 The development approach and system of automobile virtual driving application based on Intel RealSense
CN107844195B (en) * 2017-10-26 2024-02-06 天津科技大学 Intel RealSense-based development method and system for virtual driving application of automobile
CN107948570A (en) * 2017-11-29 2018-04-20 长沙安行机电设备有限公司 A kind of rail track real scene video plays synchronous locomotive driving real time information source method
CN107948570B (en) * 2017-11-29 2020-09-04 长沙安行机电设备有限公司 Real-time information source method for real-scene video playing and synchronous locomotive running of railway line
CN108595003A (en) * 2018-04-23 2018-09-28 Oppo广东移动通信有限公司 Function control method and relevant device
CN111580660A (en) * 2020-05-09 2020-08-25 清华大学 Operation triggering method, device, equipment and readable storage medium

Also Published As

Publication number Publication date
CN106502416B (en) 2019-04-02

Similar Documents

Publication Publication Date Title
CN106502416B (en) A kind of driving simulation system and its control method of intelligent recognition bimanual input
CN106512391B (en) A kind of bimanual input recognition methods and the driving simulation system based on it, method
CN103093658B (en) Child real object interaction story building method and system
CN109597485B (en) Gesture interaction system based on double-fingered-area features and working method thereof
CN202150897U (en) Body feeling control game television set
CN106997236A (en) Based on the multi-modal method and apparatus for inputting and interacting
WO2013139181A1 (en) User interaction system and method
CN107357428A (en) Man-machine interaction method and device based on gesture identification, system
CN101715581A (en) Volume recognition method and system
CN106389072A (en) Virtual reality interactive system and method of five-degree-of-freedom upper limb rehabilitation robot
CN107139189A (en) A kind of children's joy religion monitoring robot and its human body target tracking algorithm
CN101947152A (en) Electroencephalogram-voice control system and working method of humanoid artificial limb
CN101561708A (en) Method for sensing and judging input mode by utilizing actions and input device thereof
CN107291359A (en) A kind of input method, device and system
CN105148514A (en) Device and method for controlling game view angle
CN104517100B (en) Gesture pre-judging method and system
CN109976338A (en) A kind of multi-modal quadruped robot man-machine interactive system and method
CN101648076A (en) Game controller and motion capture method using gyroscope
CN105676706A (en) Operation system and method of stereo-rotation experience
CN106426206A (en) Wrestling robot, control equipment and game system
CN106406875A (en) Virtual digital sculpture method based on natural gesture
CN109782914A (en) The selection method of target in virtual three-dimensional scene based on pen device axial-rotation
CN106249901B (en) A kind of adaptation method for supporting somatosensory device manipulation with the primary game of Android
US20220129081A1 (en) Controller and method for gesture recognition and a gesture recognition device
CN106502407A (en) A kind of data processing method and its relevant device

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant