CN103530059A - Man-machine interactive system and method - Google Patents
Man-machine interactive system and method Download PDFInfo
- Publication number
- CN103530059A CN103530059A CN201310528633.5A CN201310528633A CN103530059A CN 103530059 A CN103530059 A CN 103530059A CN 201310528633 A CN201310528633 A CN 201310528633A CN 103530059 A CN103530059 A CN 103530059A
- Authority
- CN
- China
- Prior art keywords
- keyboard message
- gesture operation
- unit
- keyboard
- computer interaction
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Images
Landscapes
- User Interface Of Digital Computer (AREA)
Abstract
The invention provides a man-machine interactive system and method. The man-machine interactive method includes that descriptors of a keyboard device are added to a USB (Universal Serial Bus) descriptor of a man-machine interactive device, gesture operations are stored to a mapping table of keyboard information of the man-machine interactive device, the man-machine interactive device obtains the keyboard information which is corresponding to the gesture operations in the mapping table when detects the gesture operations of a user, and then the man-machine interactive device sends the keyboard information to a host computer to perform operations which are corresponding to gestures. The man-machine interactive method which sends the keyboard information which is corresponding to the gestures has the advantages of achieving man-machine interaction, not requiring the user to perform application program exploitation on the man-machine device, being compatible to various operating systems, not requiring exploitation anew, simplifying operation on the man-machine interactive device, reducing user using difficulties and barriers and improving user experience.
Description
Technical field
The present invention relates to human-computer interaction technique field, more particularly, relate to a kind of man-machine interactive system and method.
Background technology
Along with scientific and technological progress, be seen everywhere in many public and non-public places (as: education, meeting, exhibition, commercial production, panel computer, the mobile phone etc.) application of the human-computer interaction device's (as: touch-screen, clipboard, electronic whiteboard etc.) based on gesture identification, this class human-computer interaction device provides more stable, convenient, directly perceived and natural interactive mode for all trades and professions.
At present, the human-computer interaction device based on gesture identification realizes mutual method as shown in Figure 1, mainly comprises:
Step S11: human-computer interaction device is passed through to USB(Universal Serial Bus, USB (universal serial bus)) interface is connected with main frame, for human-computer interaction device powers on, make human-computer interaction device's MCU(Micro Control Unit, micro-control unit) interior touch screen program operation;
Step S12: detect gesture operation;
Step S13: judge whether to detect gesture operation, if so, enter step S14, if not, return to step S12;
Step S14: the USB interface by the gesture operation detecting by human-computer interaction device sends to main frame;
Step S15: main frame receives after the gesture operation of human-computer interaction device's transmission, carries out corresponding processing according to gesture operation.
Human-computer interaction device based on gesture identification usually has the demand of carrying out various gesture operations in use; this just needs user oneself to use human-computer interaction device's developing application (as: exploitation realizes the application program of multiple point touching); and the own developing application of user needs to have certain development ability; can write the program of USB interface; or need to learn the SDK(Software Development Kit that manufacturer provides; SDK (Software Development Kit)) program, is used SDK program to develop.
But above-mentioned two kinds of development approaches itself are all more complicated, and, due to the impact of system compatibility, under different operating system, need to re-start the exploitation of application program, these all cause the Application and Development of equipment complicated, and the threshold that user uses and difficulty strengthen.
Summary of the invention
The invention provides a kind of man-machine interactive system and method, to simplify human-computer interaction device's Application and Development, reduce the difficulty that user uses.
For achieving the above object, the invention provides following technical scheme:
The invention provides a kind of man-machine interactive system, comprising: the main frame that human-computer interaction device is connected with described human-computer interaction device with USB interface by described human-computer interaction device;
Wherein, described human-computer interaction device comprises: mapping table storage unit, initialization administrative unit, mapping table reading unit, temporary storage cell, gesture operation detecting unit and Keyboard Message acquiring unit; Described mapping table cell stores has gesture operation to the mapping table of Keyboard Message, and described gesture operation is to the equal unique corresponding Keyboard Message of each gesture operation in the mapping table of Keyboard Message; Described initialization administrative unit, for human-computer interaction device described in initialization, is described human-computer interaction device's USB interface configuration HID agreement, and in described human-computer interaction device's USB descriptor, adds the descriptor of keyboard equipment; Described mapping table reading unit is for reading described gesture operation to the mapping table of Keyboard Message from described mapping table storage unit, and described gesture operation is sent to described temporary storage cell to the mapping table of Keyboard Message; Described temporary storage cell is used for receiving the gesture operation of described mapping table reading unit transmission to the mapping table of Keyboard Message, and stores described gesture operation to the mapping table of Keyboard Message temporarily; Described gesture operation detecting unit is for detection of user's gesture operation, and the information of the gesture operation detecting is sent to described Keyboard Message acquiring unit; Described Keyboard Message acquiring unit is for receiving the information of the gesture operation of described gesture operation detecting unit transmission, according to the information of described gesture operation, from the gesture operation of the interim storage of described temporary storage cell, to the mapping table of Keyboard Message, obtain the Keyboard Message that described gesture operation is corresponding, and the USB interface by described human-computer interaction device sends to described main frame by described Keyboard Message;
Described main frame comprises: Keyboard Message query unit and gesture operation processing unit; The Keyboard Message that described Keyboard Message query unit sends for inquire about described Keyboard Message acquiring unit in described main frame, and the Keyboard Message inquiring is sent to described gesture operation processing unit; The Keyboard Message that described gesture operation processing unit sends for receiving described Keyboard Message query unit, and according to described Keyboard Message, carry out the processing of corresponding gesture operation.
Preferably, described gesture operation detecting unit comprises: testing result generation unit and testing result judging unit; Described testing result generation unit, for detection of user's gesture operation, generates testing result, and described testing result is sent to described testing result judging unit; The testing result that described testing result judging unit sends for receiving described testing result generation unit, according to described testing result, judge whether to detect gesture operation, if, the information of the gesture operation detecting is sent to described Keyboard Message acquiring unit, if not, trigger the gesture operation that described testing result generation unit continues to detect user.
Preferably, described Keyboard Message query unit comprises: Query Result generation unit, Query Result judging unit and Keyboard Message judging unit; The Keyboard Message that described Query Result generation unit sends for inquire about described Keyboard Message acquiring unit in described main frame, generated query result, and described Query Result is sent to described Query Result judging unit; The Query Result that described Query Result judging unit sends for receiving described Keyboard Message query unit, according to described Query Result, judge whether to inquire the Keyboard Message that described Keyboard Message acquiring unit sends, if, the Keyboard Message inquiring is sent to described Keyboard Message judging unit, if not, trigger described Query Result generation unit and continue to inquire about the Keyboard Message that described Keyboard Message acquiring unit sends in described main frame; The Keyboard Message that described Keyboard Message judging unit sends for receiving described Query Result judging unit, according to described Keyboard Message, judge whether described Keyboard Message is the corresponding Keyboard Message of gesture operation that described gesture operation detecting unit detects, if, described Keyboard Message is sent to described gesture operation processing unit, if not, trigger described Query Result generation unit and continue to inquire about the Keyboard Message that described Keyboard Message acquiring unit sends in described main frame.
Preferably, the flash memory that described mapping table storage unit is described human-computer interaction device or band Electrically Erasable Read Only Memory.
Preferably, the internal storage that described temporary storage cell is described human-computer interaction device.
The present invention also provides a kind of man-machine interaction method, be applied to the man-machine interactive system described in above any one, described man-machine interaction method comprises: utilize human-computer interaction device described in described human-computer interaction device's initialization administrative unit initialization, for described human-computer interaction device's USB interface configuration HID agreement, and in described human-computer interaction device's USB descriptor, add the descriptor of keyboard equipment; Utilize described human-computer interaction device's mapping table reading unit to read the gesture operation of described mapping table cell stores to the mapping table of Keyboard Message from described human-computer interaction device's mapping table storage unit, and described gesture operation is sent to described human-computer interaction device's temporary storage cell to the mapping table of Keyboard Message; Utilize described temporary storage cell to receive the gesture operation of described mapping table reading unit transmission to the mapping table of Keyboard Message, and store described gesture operation to the mapping table of Keyboard Message temporarily; Utilize described human-computer interaction device's gesture operation detecting unit to detect user's gesture operation, and the information of the gesture operation detecting is sent to described human-computer interaction device's Keyboard Message acquiring unit; Utilize described Keyboard Message acquiring unit to receive the information of the gesture operation of described gesture operation detecting unit transmission, according to the information of described gesture operation, from the gesture operation of the interim storage of described temporary storage cell, to the mapping table of Keyboard Message, obtain the Keyboard Message that described gesture operation is corresponding, and the USB interface by described human-computer interaction device sends to described main frame by described Keyboard Message; Utilize the Keyboard Message query unit of described main frame in described main frame, to inquire about the Keyboard Message that described Keyboard Message acquiring unit sends, and the Keyboard Message inquiring is sent to the gesture operation processing unit of described main frame; Utilize described gesture operation processing unit to receive the Keyboard Message that described Keyboard Message query unit sends, and according to described Keyboard Message, carry out the processing of corresponding gesture operation.
Preferably, the described gesture operation that utilizes described human-computer interaction device's gesture operation detecting unit detection user, and send to described human-computer interaction device's Keyboard Message acquiring unit to comprise the information of the gesture operation detecting: the gesture operation that utilizes the testing result generation unit detection user of described gesture operation detecting unit, generate testing result, and described testing result is sent to the testing result judging unit of described gesture operation detecting unit; Utilize described testing result judging unit to receive the testing result that described testing result generation unit sends, according to described testing result, judge whether to detect gesture operation, if, the information of the gesture operation detecting is sent to described Keyboard Message acquiring unit, if not, trigger the gesture operation that described testing result generation unit continues to detect user.
Preferably, the described Keyboard Message query unit of described main frame of utilizing is inquired about the Keyboard Message that described Keyboard Message acquiring unit sends in described main frame, and send to the gesture operation processing unit of described main frame to comprise the Keyboard Message inquiring: to utilize the Query Result generation unit of described Keyboard Message query unit in described main frame, to inquire about the Keyboard Message that described Keyboard Message acquiring unit sends, generated query result, and described Query Result is sent to the Query Result judging unit of described Keyboard Message query unit; Utilize described Query Result judging unit to receive the Query Result that described Keyboard Message query unit sends, according to described Query Result, judge whether to inquire the Keyboard Message that described Keyboard Message acquiring unit sends, if, the Keyboard Message inquiring is sent to the Keyboard Message judging unit of described Keyboard Message query unit, if not, trigger described Query Result generation unit and continue to inquire about the Keyboard Message that described Keyboard Message acquiring unit sends in described main frame; Utilize described Keyboard Message judging unit to receive the Keyboard Message that described Query Result judging unit sends, judge whether described Keyboard Message is the corresponding Keyboard Message of gesture operation that described gesture operation detecting unit detects, if, described Keyboard Message is sent to described gesture operation processing unit, if not, trigger described Query Result generation unit and continue to inquire about the Keyboard Message that described Keyboard Message acquiring unit sends in described main frame.
Compared with prior art, technical scheme provided by the present invention at least has the following advantages:
Man-machine interactive system provided by the present invention and method, in human-computer interaction device's USB descriptor, add the descriptor of keyboard equipment, and in human-computer interaction device, store gesture operation to the mapping table of Keyboard Message, when human-computer interaction device detects user's gesture operation, can from mapping table, obtain the Keyboard Message that gesture operation is corresponding, then Keyboard Message be sent to main frame to carry out operation corresponding to gesture.The present invention is by adopting the method for Keyboard Message corresponding to above-mentioned transmission gesture, realized man-machine interaction, thereby do not need user human-computer interaction device to be carried out to the exploitation of application program, and compatible to various operating system, without exploitation again, simplify the operation to human-computer interaction device, reduced difficulty and threshold that user uses, promoted user's experience.
Accompanying drawing explanation
In order to be illustrated more clearly in the embodiment of the present invention or technical scheme of the prior art, to the accompanying drawing of required use in embodiment or description of the Prior Art be briefly described below, apparently, accompanying drawing in the following describes is only some embodiments of the present invention, for those of ordinary skills, do not paying under the prerequisite of creative work, can also obtain according to these accompanying drawings other accompanying drawing.
Fig. 1 is the process flow diagram that in prior art, the human-computer interaction device based on gesture identification realizes mutual method;
The structural representation of the man-machine interactive system that Fig. 2 provides for the embodiment of the present invention one;
The structural representation of the gesture operation detecting unit of the man-machine interactive system that Fig. 3 provides for the embodiment of the present invention one;
The structural representation of the Keyboard Message query unit of the man-machine interactive system that Fig. 4 provides for the embodiment of the present invention one;
The method flow diagram of the equipment end of the man-machine interaction method that Fig. 5 provides for the embodiment of the present invention two;
The another kind of method flow diagram of the equipment end of the man-machine interaction method that Fig. 6 provides for the embodiment of the present invention two;
The method flow diagram of the host side of the man-machine interaction method that Fig. 7 provides for the embodiment of the present invention two;
The another kind of method flow diagram of the host side of the man-machine interaction method that Fig. 8 provides for the embodiment of the present invention two.
Embodiment
For above-mentioned purpose of the present invention, feature and advantage can be become apparent more, below in conjunction with accompanying drawing, the specific embodiment of the present invention is described in detail.
A lot of details have been set forth in the following description so that fully understand the present invention, but the present invention can also adopt other to be different from alternate manner described here and implement, those skilled in the art can do similar popularization without prejudice to intension of the present invention in the situation that, so the present invention is not subject to the restriction of following public specific embodiment.
Secondly, the present invention is described in detail in conjunction with schematic diagram, when the embodiment of the present invention is described in detail in detail; for ease of explanation; the sectional view of indication device structure can be disobeyed general ratio and be done local amplification, and described schematic diagram is example, and it should not limit the scope of protection of the invention at this.The three-dimensional space that should comprise in addition, length, width and the degree of depth in actual fabrication.
Embodiment mono-
The present embodiment provides a kind of man-machine interactive system, and as shown in Figure 2, this system comprises: the main frame 22 that human-computer interaction device 21 is connected with described human-computer interaction device 21 with USB interface by described human-computer interaction device 21;
Wherein, described human-computer interaction device 21 comprises: mapping table storage unit 216, initialization administrative unit 211, mapping table reading unit 212, temporary storage cell 213, gesture operation detecting unit 214 and Keyboard Message acquiring unit 215;
Described mapping table storage unit 216 stores gesture operation to the mapping table of Keyboard Message, and described gesture operation is to the equal unique corresponding Keyboard Message of each gesture operation in the mapping table of Keyboard Message;
Described initialization administrative unit 211, for human-computer interaction device described in initialization 21, is described human-computer interaction device's 21 USB interface configuration HID agreement, and in described human-computer interaction device's 21 USB descriptor, adds the descriptor of keyboard equipment;
Described mapping table reading unit 212 is for reading described gesture operation to the mapping table of Keyboard Message from described mapping table storage unit 216, and described gesture operation is sent to described temporary storage cell 213 to the mapping table of Keyboard Message;
Described temporary storage cell 213 is the mapping table to Keyboard Message for the gesture operation that receives described mapping table reading unit 212 and send, and stores described gesture operation to the mapping table of Keyboard Message temporarily;
Described gesture operation detecting unit 214 is for detection of user's gesture operation, and the information of the gesture operation detecting is sent to described Keyboard Message acquiring unit 215;
Described Keyboard Message acquiring unit 215 is for receiving the information of the gesture operation of described gesture operation detecting unit 214 transmissions, according to the information of described gesture operation, from the gesture operation of described temporary storage cell 213 interim storages, to the mapping table of Keyboard Message, obtain the Keyboard Message that described gesture operation is corresponding, and the USB interface by described human-computer interaction device 21 sends to described main frame by described Keyboard Message;
Described main frame 22 comprises: Keyboard Message query unit 221 and gesture operation processing unit 222;
The Keyboard Message of described Keyboard Message query unit 221 for sending at the described Keyboard Message acquiring unit 215 of the interior inquiry of described main frame 22, and the Keyboard Message inquiring is sent to described gesture operation processing unit 222;
The Keyboard Message that described gesture operation processing unit 222 sends for receiving described Keyboard Message query unit 221, and according to described Keyboard Message, carry out the processing of corresponding gesture operation.
Wherein, the information that interior the stored gesture operation of mapping table storage unit 216 characterizes to the mapping table of Keyboard Message is user's gesture operation and the corresponding relation of Keyboard Message, as: can make corresponding " Win+ '+' " this Keyboard Message of " amplification " this gesture operation, " dwindle " corresponding " Win+ '-' " this Keyboard Message of this gesture operation etc., and, user can set corresponding which the bar Keyboard Message of which kind of gesture operation according to the operating habit of oneself, and gesture operation can change with user's operating habit to the mapping table of Keyboard Message.In addition, in the present embodiment, described mapping table storage unit 216 preferably can be described human-computer interaction device's 21 flash memory or band Electrically Erasable Read Only Memory.
In the present embodiment, after human-computer interaction device 21 is connected by USB interface with main frame 22, give human-computer interaction device 21 energisings, the work that brings into operation of the program in equipment.Each functional module of human-computer interaction device 21 initialization administrative unit 211 initialization human-computer interaction devices 21, USB interface configuration HID agreement for human-computer interaction device 21, equipment can directly be identified by the main frame based on various operating systems, without user, remove to develop complicated USB human-computer interaction device's driver.Initialization administrative unit 211 also need be added the descriptor of keyboard equipment in human-computer interaction device 21 USB descriptor, so that USB interface can send Keyboard Message, human-computer interaction device 21 reports the various attributes of equipment to main frame 22 by USB descriptor, main frame 22 is by carrying out type identification, configuration to the access of USB descriptor to equipment, and for it provides corresponding client driver, the descriptor of keyboard equipment is code corresponding to the information of each keyboard representative.
From mapping table storage unit 216, by gesture operation, the mapping table to Keyboard Message reads out mapping table reading unit 212, and be stored in temporary storage cell 213, this function is called in internal storage by mapping table from the external storage of equipment, can realize access speed faster.When Keyboard Message acquiring unit 215 receives the information of gesture operation, while obtaining corresponding Keyboard Message in need to the mapping table from gesture operation to Keyboard Message, without mapping table storage unit 216 is conducted interviews, only need to access temporary storage cell 213, due to temporary storage cell 213, to have access speed fast, so Keyboard Message acquiring unit 215 can obtain the Keyboard Message that gesture operation is corresponding rapidly.In the present embodiment, described temporary storage cell 213 is described human-computer interaction device's 21 internal storage preferably.
In order to guarantee the true(-)running of device program, as shown in Figure 3, the detecting unit of gesture operation described in the present embodiment 214 preferably comprises: testing result generation unit 2141 and testing result judging unit 2142;
Described testing result generation unit 2141, for detection of user's gesture operation, generates testing result, and described testing result is sent to described testing result judging unit 2142;
The testing result that described testing result judging unit 2142 sends for receiving described testing result generation unit, according to described testing result, judge whether to detect gesture operation, if, the information of the gesture operation detecting is sent to described Keyboard Message acquiring unit 215, if not, trigger the gesture operation that described testing result generation unit 2141 continues to detect user.
The testing result generation unit 2141 of gesture operation detecting unit 214 constantly scans detection to human-computer interaction device 21 surrounding, obtain certain signal as testing result, but the gesture operation that the signal not necessarily at every turn obtaining is all user produces, may there is no gesture operation, or equipment other signal around detected, therefore preferably can obtain signal to detection judges, whether to comprise the information of gesture operation in clear and definite testing result, if, proceed next step operation, if not, illustrate that current time equipment does not have gesture operation around, need testing result generation unit 2141 to proceed to detect.By said process, can avoid human-computer interaction device to produce maloperation, correct, smooth, the high efficiency work of assurance equipment to wrong signal.
When Keyboard Message acquiring unit 215 is according to the gesture operation receiving, find out after corresponding Keyboard Message, in USB descriptor due to human-computer interaction device 21, added the descriptor of keyboard equipment, so human-computer interaction device 21 can send to main frame 22 by Keyboard Message by the USB interface of self.
In the present embodiment, for the work that guarantees main frame 22 correctly, carry out smoothly, as shown in Figure 4, described Keyboard Message query unit 221 preferably comprises: Query Result generation unit 2211, Query Result judging unit 2212 and Keyboard Message judging unit 2213;
The Keyboard Message of described Query Result generation unit 2211 for sending at the described Keyboard Message acquiring unit 215 of the interior inquiry of described main frame 22, generated query result, and described Query Result is sent to described Query Result judging unit 2212;
The Query Result that described Query Result judging unit 2212 sends for receiving described Keyboard Message query unit 2211, according to described Query Result, judge whether to inquire the Keyboard Message that described Keyboard Message acquiring unit 215 sends, if, the Keyboard Message inquiring is sent to described Keyboard Message judging unit 2213, if not, trigger described Query Result generation unit and continue the Keyboard Message sending at the described Keyboard Message acquiring unit 215 of the interior inquiry of described main frame 22;
The Keyboard Message that described Keyboard Message judging unit 2213 sends for receiving described Query Result judging unit 2212, according to described Keyboard Message, judge whether described Keyboard Message is the corresponding Keyboard Message of gesture operation that described gesture operation detecting unit 214 detects, if, described Keyboard Message is sent to described gesture operation processing unit 222, if not, trigger described Query Result generation unit 2211 and continue the Keyboard Message sending at the described Keyboard Message acquiring unit 215 of the interior inquiry of described main frame 22.
The present embodiment is by being refined as Keyboard Message query unit 221 Query Result generation unit 2211, Query Result judging unit 2212 and Keyboard Message judging unit 2213, make the Keyboard Message query unit 221 incessantly can be in the interior inquiry keyboard message of main frame 22, the Keyboard Message corresponding to gesture operation that can also be whether user to the Keyboard Message that whether inquires Keyboard Message, inquires judge respectively, thereby guaranteed that host side program can process by Keyboard Message more correct, that efficiently human-computer interaction device 21 is sent.
The man-machine interactive system that the present embodiment provides, by adding the descriptor of keyboard equipment in the USB descriptor human-computer interaction device 21, and at the interior storage gesture operation of human-computer interaction device 21 mapping table to Keyboard Message, make human-computer interaction device 21 after gesture operation being detected, can by USB interface, send to main frame 22 to operate accordingly Keyboard Message corresponding to gesture operation, thereby realized without human-computer interaction device 21 being carried out under the prerequisite of exploitation of any application program, just can make equipment realize the functions such as multiple point touching, simplified the development and operation that human-computer interaction device 21 uses, threshold and difficulty that user uses have been reduced, promoted user's experience.
Embodiment bis-
Corresponding with embodiment mono-, the present embodiment provides a kind of man-machine interaction method, is applied to the man-machine interactive system described in embodiment mono-, and described man-machine interaction method can be divided into two of equipment end flow process and host side flow processs.Wherein, as shown in Figure 5, equipment end flow process comprises:
Step S51: utilize human-computer interaction device described in described human-computer interaction device's initialization administrative unit initialization, for described human-computer interaction device's USB interface configuration HID agreement, and in described human-computer interaction device's USB descriptor, add the descriptor of keyboard equipment;
Step S52: utilize described human-computer interaction device's mapping table reading unit to read the gesture operation of described mapping table cell stores to the mapping table of Keyboard Message from described human-computer interaction device's mapping table storage unit, and described gesture operation is sent to described human-computer interaction device's temporary storage cell to the mapping table of Keyboard Message;
It should be noted that, in the present embodiment, gesture operation can be entered in equipment by technician's burning to the mapping table of Keyboard Message before human-computer interaction device is dispatched from the factory, and also can, when human-computer interaction device uses, by user, according to operating habit of self etc., be set.
Step S53: utilize described temporary storage cell to receive the gesture operation of described mapping table reading unit transmission to the mapping table of Keyboard Message, and store described gesture operation to the mapping table of Keyboard Message temporarily;
Step S54: utilize described human-computer interaction device's gesture operation detecting unit to detect user's gesture operation, and the information of the gesture operation detecting is sent to described human-computer interaction device's Keyboard Message acquiring unit;
In the present embodiment, as shown in Figure 6, above-mentioned steps S54 preferably can comprise the following steps:
Step S541: utilize the testing result generation unit detection user's of described gesture operation detecting unit gesture operation, generate testing result, and described testing result is sent to the testing result judging unit of described gesture operation detecting unit;
Step S542: utilize described testing result judging unit to receive the testing result that described testing result generation unit sends, according to described testing result, judge whether to detect gesture operation, if, the information of the gesture operation detecting is sent to described Keyboard Message acquiring unit (entering step S55), if not, trigger the gesture operation (returning to step S541) that described testing result generation unit continues to detect user.
By the carrying out of above-mentioned steps S541 and step S542, can guarantee that human-computer interaction device carries out work correctly, smoothly, efficiently.
Step S55: utilize described Keyboard Message acquiring unit to receive the information of the gesture operation of described gesture operation detecting unit transmission, according to the information of described gesture operation, from the gesture operation of the interim storage of described temporary storage cell, to the mapping table of Keyboard Message, obtain the Keyboard Message that described gesture operation is corresponding, and the USB interface by described human-computer interaction device sends to described main frame by described Keyboard Message;
As shown in Figure 7, host side flow process comprises:
Step S71: utilize the Keyboard Message query unit of described main frame to inquire about the Keyboard Message that described Keyboard Message acquiring unit sends in described main frame, and the Keyboard Message inquiring is sent to the gesture operation processing unit of described main frame;
As shown in Figure 8, above-mentioned steps S71 preferably can comprise the following steps:
Step S711: utilize the Query Result generation unit of described Keyboard Message query unit to inquire about the Keyboard Message that described Keyboard Message acquiring unit sends in described main frame, generated query result, and described Query Result is sent to the Query Result judging unit of described Keyboard Message query unit;
Step S712: utilize described Query Result judging unit to receive the Query Result that described Keyboard Message query unit sends, according to described Query Result, judge whether to inquire the Keyboard Message that described Keyboard Message acquiring unit sends, if, the Keyboard Message inquiring is sent to the Keyboard Message judging unit (entering step S713) of described Keyboard Message query unit, if not, trigger described Query Result generation unit and continue to inquire about the Keyboard Message (returning to step S711) that described Keyboard Message acquiring unit sends in described main frame;
Step S713: utilize described Keyboard Message judging unit to receive the Keyboard Message that described Query Result judging unit sends, judge whether described Keyboard Message is the corresponding Keyboard Message of gesture operation that described gesture operation detecting unit detects, if, described Keyboard Message is sent to described gesture operation processing unit (entering step S72), if not, trigger described Query Result generation unit and continue to inquire about the Keyboard Message (returning to step S711) that described Keyboard Message acquiring unit sends in described main frame.
By the carrying out of above-mentioned steps S711, step S712 and step S713, can guarantee that main frame carries out work correctly, smoothly, efficiently.
Step S72: utilize described gesture operation processing unit to receive the Keyboard Message that described Keyboard Message query unit sends, and carry out the processing of corresponding gesture operation according to described Keyboard Message.
In the method that the present embodiment provides, after human-computer interaction device powers on, first in human-computer interaction device's USB descriptor, add the descriptor of keyboard equipment, make human-computer interaction device to main frame, send Keyboard Message by the USB interface of self.And in human-computer interaction device, store gesture operation to the mapping table of Keyboard Message, human-computer interaction device is had after user's gesture operation around detecting, can inquire about this mapping table, obtain the Keyboard Message that gesture operation is corresponding, and by the USB interface configuring in advance, this Keyboard Message is sent to main frame, thereby the Keyboard Message that makes main frame reflect the information of gesture operation according to this, operates accordingly.
Because equipment is to carry out the execution of gesture operation by sending Keyboard Message, so user is while using equipment, without developing application, has reduced threshold and difficulty that client is used, has promoted user's experience, and has saved the required cost of User Exploitation.
And, said method is applicable in several operation systems, when human-computer interaction device is used for different operating system, user is developing application again, utilize the direct transmit operation system of equipment or the conventional Keyboard Message of related software can realize required operation, thereby simplify the operation of using equipment, saved cost of development, helpful to the compatibility of raising operating system.
Be explained for example below.When human-computer interaction device is applied in Mac OS operating system, because the agreement of the multi-point gestures of Mac OS operating system is not open to common USB human-computer interaction device's, therefore in prior art, the human-computer interaction device based on Mac OS operating system wants to realize the function of multi-point gestures, just need the own developing application of user, complicated operation, difficulty is high.In the present embodiment, by sending Keyboard Message corresponding to gesture operation, can realize the effect of operations of the multi-point gestures of the human-computer interaction device based on Mac OS operating system.
For example: human-computer interaction device recognizes the gesture operation of " amplification ", send the Keyboard Message of " Win+ '+' " by USB interface, operating system is amplified processing to picture; Human-computer interaction device recognizes the gesture operation of " dwindling ", sends the Keyboard Message of " Win+ '-' " by USB interface, and operating system is dwindled processing to picture; Human-computer interaction device recognizes the gesture operation of " to anticlockwise ", sends the Keyboard Message of " Win+ ' L ' " by USB interface, and operating system carries out processing to anticlockwise to picture; Human-computer interaction device recognizes the gesture operation of " to right rotation ", sends the Keyboard Message of " Win+ ' R ' " by USB interface, and operating system carries out processing to right rotation to picture; Other gesture operation by that analogy.
In Windows or (SuSE) Linux OS, when starting to design, some application software do not do the processing of multi-point gestures, but provide the operation of keyboard shortcut, as: " amplification " is " Ctrl+ '+' ", " dwindle " is " Ctrl+ '-' ", " to anticlockwise " is " Ctrl+L ", " to right rotation " is " Ctrl+R " etc., the man-machine interaction method that adopts this enforcement to provide, human-computer interaction device detects amplification, dwindle, to anticlockwise, after the gesture operations such as right rotation, directly send corresponding Keyboard Message, application software based on Windows or (SuSE) Linux OS just can directly be supported multi-point gestures like this, do not need to revise software.
The man-machine interaction method that the present embodiment provides is applied in some human-computer interaction device in the fields such as education, meeting, during the function of development equipment, can simplify performance history according to actual needs, makes to write the operations such as code than being easier to.
For example: generally in the edge of the electronic whiteboard with touch-screen part, can reserve a part and do shortcut and use, when user clicks wherein a part of region, touch-screen just needs to send clicks the message in this region to the application software of electronic whiteboard.In the present embodiment, user can arrange area size and the Keyboard Message corresponding to shortcut of these edge parts that reserve according to actual needs at any time, process gesture operation and be sent as Keyboard Message, electronic whiteboard software can get the Keyboard Message that gesture operation is corresponding very easily, to corresponding program code, also than being easier to, writes.
Although the present invention discloses as above with preferred embodiment, yet not in order to limit the present invention.Any those of ordinary skill in the art, do not departing from technical solution of the present invention scope situation, all can utilize method and the technology contents of above-mentioned announcement to make many possible changes and modification to technical solution of the present invention, or be revised as the equivalent embodiment of equivalent variations.Therefore, every content that does not depart from technical solution of the present invention,, all still belongs in the scope of technical solution of the present invention protection any simple modification made for any of the above embodiments, equivalent variations and modification according to technical spirit of the present invention.
Claims (8)
1. a man-machine interactive system, is characterized in that, comprising: the main frame that human-computer interaction device is connected with described human-computer interaction device with USB interface by described human-computer interaction device;
Wherein, described human-computer interaction device comprises: mapping table storage unit, initialization administrative unit, mapping table reading unit, temporary storage cell, gesture operation detecting unit and Keyboard Message acquiring unit;
Described mapping table cell stores has gesture operation to the mapping table of Keyboard Message, and described gesture operation is to the equal unique corresponding Keyboard Message of each gesture operation in the mapping table of Keyboard Message;
Described initialization administrative unit, for human-computer interaction device described in initialization, is described human-computer interaction device's USB interface configuration HID agreement, and in described human-computer interaction device's USB descriptor, adds the descriptor of keyboard equipment;
Described mapping table reading unit is for reading described gesture operation to the mapping table of Keyboard Message from described mapping table storage unit, and described gesture operation is sent to described temporary storage cell to the mapping table of Keyboard Message;
Described temporary storage cell is used for receiving the gesture operation of described mapping table reading unit transmission to the mapping table of Keyboard Message, and stores described gesture operation to the mapping table of Keyboard Message temporarily;
Described gesture operation detecting unit is for detection of user's gesture operation, and the information of the gesture operation detecting is sent to described Keyboard Message acquiring unit;
Described Keyboard Message acquiring unit is for receiving the information of the gesture operation of described gesture operation detecting unit transmission, according to the information of described gesture operation, from the gesture operation of the interim storage of described temporary storage cell, to the mapping table of Keyboard Message, obtain the Keyboard Message that described gesture operation is corresponding, and the USB interface by described human-computer interaction device sends to described main frame by described Keyboard Message;
Described main frame comprises: Keyboard Message query unit and gesture operation processing unit;
The Keyboard Message that described Keyboard Message query unit sends for inquire about described Keyboard Message acquiring unit in described main frame, and the Keyboard Message inquiring is sent to described gesture operation processing unit;
The Keyboard Message that described gesture operation processing unit sends for receiving described Keyboard Message query unit, and according to described Keyboard Message, carry out the processing of corresponding gesture operation.
2. man-machine interactive system according to claim 1, is characterized in that, described gesture operation detecting unit comprises: testing result generation unit and testing result judging unit;
Described testing result generation unit, for detection of user's gesture operation, generates testing result, and described testing result is sent to described testing result judging unit;
The testing result that described testing result judging unit sends for receiving described testing result generation unit, according to described testing result, judge whether to detect gesture operation, if, the information of the gesture operation detecting is sent to described Keyboard Message acquiring unit, if not, trigger the gesture operation that described testing result generation unit continues to detect user.
3. man-machine interactive system according to claim 1, is characterized in that, described Keyboard Message query unit comprises: Query Result generation unit, Query Result judging unit and Keyboard Message judging unit;
The Keyboard Message that described Query Result generation unit sends for inquire about described Keyboard Message acquiring unit in described main frame, generated query result, and described Query Result is sent to described Query Result judging unit;
The Query Result that described Query Result judging unit sends for receiving described Keyboard Message query unit, according to described Query Result, judge whether to inquire the Keyboard Message that described Keyboard Message acquiring unit sends, if, the Keyboard Message inquiring is sent to described Keyboard Message judging unit, if not, trigger described Query Result generation unit and continue to inquire about the Keyboard Message that described Keyboard Message acquiring unit sends in described main frame;
The Keyboard Message that described Keyboard Message judging unit sends for receiving described Query Result judging unit, according to described Keyboard Message, judge whether described Keyboard Message is the corresponding Keyboard Message of gesture operation that described gesture operation detecting unit detects, if, described Keyboard Message is sent to described gesture operation processing unit, if not, trigger described Query Result generation unit and continue to inquire about the Keyboard Message that described Keyboard Message acquiring unit sends in described main frame.
4. man-machine interactive system according to claim 1, is characterized in that, the flash memory that described mapping table storage unit is described human-computer interaction device or band Electrically Erasable Read Only Memory.
5. man-machine interactive system according to claim 1, is characterized in that, the internal storage that described temporary storage cell is described human-computer interaction device.
6. a man-machine interaction method, is applied to the man-machine interactive system described in claim 1～5 any one, it is characterized in that, described man-machine interaction method comprises:
Utilize human-computer interaction device described in described human-computer interaction device's initialization administrative unit initialization, be described human-computer interaction device's USB interface configuration HID agreement, and in described human-computer interaction device's USB descriptor, add the descriptor of keyboard equipment;
Utilize described human-computer interaction device's mapping table reading unit to read the gesture operation of described mapping table cell stores to the mapping table of Keyboard Message from described human-computer interaction device's mapping table storage unit, and described gesture operation is sent to described human-computer interaction device's temporary storage cell to the mapping table of Keyboard Message;
Utilize described temporary storage cell to receive the gesture operation of described mapping table reading unit transmission to the mapping table of Keyboard Message, and store described gesture operation to the mapping table of Keyboard Message temporarily;
Utilize described human-computer interaction device's gesture operation detecting unit to detect user's gesture operation, and the information of the gesture operation detecting is sent to described human-computer interaction device's Keyboard Message acquiring unit;
Utilize described Keyboard Message acquiring unit to receive the information of the gesture operation of described gesture operation detecting unit transmission, according to the information of described gesture operation, from the gesture operation of the interim storage of described temporary storage cell, to the mapping table of Keyboard Message, obtain the Keyboard Message that described gesture operation is corresponding, and the USB interface by described human-computer interaction device sends to described main frame by described Keyboard Message;
Utilize the Keyboard Message query unit of described main frame in described main frame, to inquire about the Keyboard Message that described Keyboard Message acquiring unit sends, and the Keyboard Message inquiring is sent to the gesture operation processing unit of described main frame;
Utilize described gesture operation processing unit to receive the Keyboard Message that described Keyboard Message query unit sends, and according to described Keyboard Message, carry out the processing of corresponding gesture operation.
7. man-machine interaction method according to claim 6, it is characterized in that, described described human-computer interaction device's the gesture operation detecting unit that utilizes detects user's gesture operation, and sends to described human-computer interaction device's Keyboard Message acquiring unit to comprise the information of the gesture operation detecting:
The gesture operation that utilizes the testing result generation unit detection user of described gesture operation detecting unit, generates testing result, and described testing result is sent to the testing result judging unit of described gesture operation detecting unit;
Utilize described testing result judging unit to receive the testing result that described testing result generation unit sends, according to described testing result, judge whether to detect gesture operation, if, the information of the gesture operation detecting is sent to described Keyboard Message acquiring unit, if not, trigger the gesture operation that described testing result generation unit continues to detect user.
8. man-machine interaction method according to claim 6, it is characterized in that, the described Keyboard Message query unit of described main frame of utilizing is inquired about the Keyboard Message that described Keyboard Message acquiring unit sends in described main frame, and sends to the gesture operation processing unit of described main frame to comprise the Keyboard Message inquiring:
Utilize the Query Result generation unit of described Keyboard Message query unit in described main frame, to inquire about the Keyboard Message that described Keyboard Message acquiring unit sends, generated query result, and described Query Result is sent to the Query Result judging unit of described Keyboard Message query unit;
Utilize described Query Result judging unit to receive the Query Result that described Keyboard Message query unit sends, according to described Query Result, judge whether to inquire the Keyboard Message that described Keyboard Message acquiring unit sends, if, the Keyboard Message inquiring is sent to the Keyboard Message judging unit of described Keyboard Message query unit, if not, trigger described Query Result generation unit and continue to inquire about the Keyboard Message that described Keyboard Message acquiring unit sends in described main frame;
Utilize described Keyboard Message judging unit to receive the Keyboard Message that described Query Result judging unit sends, judge whether described Keyboard Message is the corresponding Keyboard Message of gesture operation that described gesture operation detecting unit detects, if, described Keyboard Message is sent to described gesture operation processing unit, if not, trigger described Query Result generation unit and continue to inquire about the Keyboard Message that described Keyboard Message acquiring unit sends in described main frame.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201310528633.5A CN103530059B (en) | 2013-10-30 | 2013-10-30 | man-machine interactive system and method |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201310528633.5A CN103530059B (en) | 2013-10-30 | 2013-10-30 | man-machine interactive system and method |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN103530059A true CN103530059A (en) | 2014-01-22 |
| CN103530059B CN103530059B (en) | 2016-08-17 |
Family
ID=49932114
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201310528633.5A Active CN103530059B (en) | 2013-10-30 | 2013-10-30 | man-machine interactive system and method |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN103530059B (en) |
Cited By (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN108322425A (en) * | 2017-01-18 | 2018-07-24 | 固高科技(深圳)有限公司 | industrial equipment man-machine interaction method and system |
| CN109426498A (en) * | 2017-08-24 | 2019-03-05 | 北京迪文科技有限公司 | A kind of man-machine interactive system backstage development approach and device |
| WO2020000815A1 (en) * | 2018-06-26 | 2020-01-02 | 广州小鸡快跑网络科技有限公司 | Touch screen drive-based input device, operation method and system, and storage medium |
Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20100248688A1 (en) * | 2009-03-30 | 2010-09-30 | Teng Stephanie E | Notifications |
| CN102323875A (en) * | 2011-10-26 | 2012-01-18 | 中国人民解放军国防科学技术大学 | Mouse event-based multi-point touch gesture interaction method and middleware |
| US20130117715A1 (en) * | 2011-11-08 | 2013-05-09 | Microsoft Corporation | User interface indirect interaction |
| CN103257714A (en) * | 2013-05-31 | 2013-08-21 | 深圳职业技术学院 | All-in-one machine supporting gesture recognition |
-
2013
- 2013-10-30 CN CN201310528633.5A patent/CN103530059B/en active Active
Patent Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20100248688A1 (en) * | 2009-03-30 | 2010-09-30 | Teng Stephanie E | Notifications |
| CN102323875A (en) * | 2011-10-26 | 2012-01-18 | 中国人民解放军国防科学技术大学 | Mouse event-based multi-point touch gesture interaction method and middleware |
| US20130117715A1 (en) * | 2011-11-08 | 2013-05-09 | Microsoft Corporation | User interface indirect interaction |
| CN103257714A (en) * | 2013-05-31 | 2013-08-21 | 深圳职业技术学院 | All-in-one machine supporting gesture recognition |
Non-Patent Citations (3)
| Title |
|---|
| 刘森 等: "基于USB HID的电子白板的多点触控技术开发", 《计算机应用与软件》 * |
| 张国华 等: "基于多点触摸的交互手势分析与设计", 《计算机应用研究》 * |
| 燕厚仪 等: "一种独立于应用程序的多点触摸交互中间件", 《计算机应用研究》 * |
Cited By (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN108322425A (en) * | 2017-01-18 | 2018-07-24 | 固高科技(深圳)有限公司 | industrial equipment man-machine interaction method and system |
| CN108322425B (en) * | 2017-01-18 | 2023-08-29 | 固高科技股份有限公司 | Man-machine interaction method and system for industrial equipment |
| CN109426498A (en) * | 2017-08-24 | 2019-03-05 | 北京迪文科技有限公司 | A kind of man-machine interactive system backstage development approach and device |
| CN109426498B (en) * | 2017-08-24 | 2023-11-17 | 北京迪文科技有限公司 | Background development method and device for man-machine interaction system |
| WO2020000815A1 (en) * | 2018-06-26 | 2020-01-02 | 广州小鸡快跑网络科技有限公司 | Touch screen drive-based input device, operation method and system, and storage medium |
Also Published As
| Publication number | Publication date |
|---|---|
| CN103530059B (en) | 2016-08-17 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN110058782B (en) | Touch operation method and system based on interactive electronic whiteboard | |
| EP2843535B1 (en) | Apparatus and method of setting gesture in electronic device | |
| EP3333684A1 (en) | Electronic device having a biometric sensor | |
| US9632693B2 (en) | Translation of touch input into local input based on a translation profile for an application | |
| EP2869181A1 (en) | Method for executing functions in response to touch input and electronic device implementing the same | |
| WO2012075821A1 (en) | Overlapped handwriting input method | |
| CN106681817B (en) | Terminal control method and terminal | |
| KR102327205B1 (en) | Content Share Method and Content Share System | |
| CN104345996B (en) | A kind of other interactive device of radar outlook | |
| CN105094683A (en) | Data display method and device | |
| CN104598308A (en) | Mode switching control method and device | |
| CN103324674A (en) | Method and device for selecting webpage content | |
| WO2020135010A1 (en) | Method and device for processing hosted application, and computer readable storage medium | |
| CN107220377B (en) | Search method, electronic device, and computer storage medium | |
| CN103530059A (en) | Man-machine interactive system and method | |
| US20150002484A1 (en) | Stylus lexicon sharing | |
| CN103677417A (en) | Gesture detection method and device and terminal device | |
| CN104460856A (en) | Tablet computer | |
| US9857910B2 (en) | Method for controlling multiple touchscreens and electronic device | |
| US11460971B2 (en) | Control method and electronic device | |
| US20120013474A1 (en) | Method for informing a user of a possibility to complete the execution of a process in a computing device | |
| JP6801852B2 (en) | Character string display method and terminal device | |
| CN213069764U (en) | Touch control equipment | |
| CN101667111B (en) | Display device and control method thereof | |
| CN104932820A (en) | Touch screen use method and system based on USB mapping |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| C14 | Grant of patent or utility model | ||
| GR01 | Patent grant |