CN105353883A - Man-machine interaction method, man-machine interaction system and calculating apparatus - Google Patents
Man-machine interaction method, man-machine interaction system and calculating apparatus Download PDFInfo
- Publication number
- CN105353883A CN105353883A CN201510895428.1A CN201510895428A CN105353883A CN 105353883 A CN105353883 A CN 105353883A CN 201510895428 A CN201510895428 A CN 201510895428A CN 105353883 A CN105353883 A CN 105353883A
- Authority
- CN
- China
- Prior art keywords
- icon
- option
- picture
- signal
- highlighted
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
- G06F3/0481—Interaction techniques based on graphical user interfaces [GUI] based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance
Abstract
The invention provides a man-machine interaction method, a man-machine interaction system and a calculating apparatus. The calculating apparatus and an input device are in operationable connection; the input device can send discrete evaluation signals; the evaluation number of the signals is not less than 10; the calculating apparatus is equipped with a display screen; the man-machine interaction method can comprise the steps of displaying an initial computer graphical user interface on the display screen, wherein the initial computer graphical user interface comprises icons associated with executable computer programs and a virtual mouse icon; the virtual mouse icon comprises a cursor icon for indicating positions on the screen and a state icon for indicting current operation options that are to be executed possibly; the state icon moves along with the movement of the cursor icon; the operation options on the state mouse are alternatively highlighted; responding to the signal received from the input device; determining that the highlighted operation option indication is taken as the chosen operation options when the signal is received; and executing the chosen operation options and correspondingly upgrading the virtual mouse icon.
Description
Technical field
The present invention relates generally to human-computer interaction technology, is particularly applicable to the man-machine interaction method of special population, man-machine interactive system and calculation element.
Background technology
Along with the continuous progress of electronic technology, computer technology, various computing equipment is that our routine work, exchange and conmmunication provide a lot of means, also for we providing a lot of facilities.The most frequently used and the most important operating equipment of computing equipment is keyboard and mouse, and touch-screen etc., its function is the various softwares etc. in text event detection, operating computer.
Existing man-machine interactive system needs the interactive device such as common keyboard, mouse, and wherein keyboard has tens of and even up to a hundred keys, needs finger sound people could use, and to write etc. in the movement of mouse, touch-screen operates the precise motion then needing hand.
Therefore, the interactive system of these computing equipments and character input method, corresponding software etc., all for normal person designs and produce, for some disabled persons, the elderly, due to the reason such as deformity, hand disease of hand, be difficult to use these equipment.Such as, patient Parkinson, can not use keyboard and mouse due to shaking of hand.Thus make these crowds be difficult to the achievement of shared Information Technology Development.
Summary of the invention
In order to make these special populations to use computer, design one is needed to only have physics or the dummy keyboard of a small amount of key, and corresponding man-machine interactive system.This physics or dummy keyboard receive the very low bandwidth operation signal from user, thus realize the operation of user to computing equipment.
According to an aspect of the present invention, provide the man-machine interaction method that a kind of calculation element realizes, calculation element is operably connected with input equipment, this input equipment can send the signal of discrete value, the value number of this signal is less than 10, this calculation element is configured with display screen, this man-machine interaction method can comprise: show original computer graphic user interface on the display screen, original computer graphic user interface comprises the icon be associated with executable computer program and virtual mouse icon, this virtual mouse icon comprises the cursor icon of position on instruction screen and the Status icons of the current option of operation that may perform of instruction, Status icons is followed the movement of cursor icon and moves, option of operation instruction on state mouse is by alternately highlighted, in response to the signal received from input equipment, the option of operation instruction be highlighted when determining Received signal strength is as the option of operation chosen, and the option of operation selected by performing, and correspondingly upgrade virtual mouse icon.
According to the man-machine interaction method of the embodiment of the present invention, the signal that described input equipment sends can be on-off-type signals, and it inputs by the predetermined motion of the finger of user, toe or the corners of the mouth, eyes, brain wave and triggers.
According to the man-machine interaction method of the embodiment of the present invention, the original state of described cursor icon can be static, and described Status icons can comprise direction icon, to indicate the option of operation to correspondence direction rolling mouse.
According to the man-machine interaction method of the embodiment of the present invention, direction icon can comprise: the arrow indicating four direction up and down; Or indicate the arrow in upper and lower, left and right, upper left, lower-left, upper right, eight directions, bottom right, and the arrow of each direction indication is highlighted in turn.
According to the man-machine interaction method of the embodiment of the present invention, can also comprise: in response to receiving input signal, cursor icon is to the direction motion that the arrow that correspondence is highlighted shows; And Status icons switches to the picture comprising and suspend icon, to indicate the option of operation of time-out.
According to the man-machine interaction method of the embodiment of the present invention, can also comprising: in response to receiving input signal, suspending the motion of cursor icon, and determining whether cursor icon is in executable program picture mark position; If cursor icon is in executable program picture mark position, then Status icons suitching type display between the picture comprising direction icon and the picture comprising clickable icon, the clicking operation of this clickable icon indication mouse; And if cursor icon is not in executable program picture mark position, then Status icons is the picture comprising direction icon, and all directions instruction icon is by alternately highlighted.
According to the man-machine interaction method of the embodiment of the present invention, can also comprise: if input signal when cursor icon is in executable program picture mark position and receives highlighted corresponding to clickable icon, then perform the operation that this executable program is associated.
According to the man-machine interaction method of the embodiment of the present invention, wherein, if this executable program is the program without the need to word, symbol input function, then Status icons switches between the picture be made up of direction icon and the picture be made up of program shortcut icon, the predetermined function option of each program shortcut icon instruction program, if and this executable program is for having word, the program of symbol input function, then cursor icon is in the viewing area that can input, automatically input state is shown as, Status icons is at the picture be made up of direction icon, dummy keyboard picture, switch between the picture be made up of program shortcut icon, and when receiving the signal of input equipment when showing dummy keyboard picture, then display can input characters, symbol and comprise the graphic user interface of return icon and perform can input characters, the executable program of symbol, when receiving the signal from input equipment when return icon is highlighted, graphic user interface switches to the picture of previous Status icons, when receiving the signal from input equipment when the picture that program shortcut icon is formed is shown, Status icons is switched to the picture that program shortcut icon is formed, wherein each program shortcut icon is by highlighted in turn.
According to the man-machine interaction method of the embodiment of the present invention, the signal that described input equipment sends can be the combination of two on-off-type signals; And at given time, two option of operation instructions are by simultaneously highlighted, and two on-off-type signals a period of time that ought now receive from input equipment, determine that the respective items in these two option of operation is the option of operation chosen, and the option of operation selected by performing, and correspondingly upgrade virtual mouse icon.
According to the man-machine interaction method of the embodiment of the present invention, the original state of described cursor icon can be static, described Status icons can comprise direction icon, with the option of operation of instruction to correspondence direction rolling mouse, wherein direction icon is divided into multipair direction icon, each direction icon in a pair direction icon indicates direction respect to one another, and multipair direction icon is by highlighted in turn, wherein arbitrary simultaneously highlighted to direction index map mark quilt.
According to the man-machine interaction method of the embodiment of the present invention, can also comprise: time highlighted when a pair direction icon quilt while, receive two on-off-type signals a period of time from input equipment, determine the moving direction of correspondence one for choosing in both direction, and cursor glyph moves along selected moving direction, and virtual mouse icon is switched to the picture comprising and suspend icon.
According to a further aspect in the invention, provide a kind of man-machine interactive system, calculation element and the input equipment of operability connection can be comprised, this calculation element is configured with display screen, storer and CPU (central processing unit), this input equipment can send the signal of discrete value, the value number of this signal is less than 10, computer instruction set is stored in storer, when this computer instruction set is performed by CPU (central processing unit), make to perform following steps: show original computer graphic user interface on a display screen, original computer graphic user interface comprises the icon be associated with executable computer program and virtual mouse icon, this virtual mouse icon comprises the cursor icon of position on instruction screen and the Status icons of the current option of operation that may perform of instruction, Status icons is followed the movement of cursor icon and moves, option of operation instruction on state mouse is alternately highlighted, in response to the signal received from input equipment, the option of operation instruction be highlighted when determining Received signal strength is as the option of operation chosen, and the option of operation selected by performing, and correspondingly upgrade virtual mouse icon.
According to a further aspect in the invention, provide a kind of calculation element, this calculation element connects input equipment operably, this calculation element is configured with display screen, storer and CPU (central processing unit), this input equipment can send the signal of discrete value, the value number of this signal is less than 10, computer instruction set is stored in storer, when this computer instruction set is performed by CPU (central processing unit), make to perform following steps: show original computer graphic user interface on a display screen, original computer graphic user interface comprises the icon be associated with executable computer program and virtual mouse icon, this virtual mouse icon comprises the cursor icon of position on instruction screen and the Status icons of the current option of operation that may perform of instruction, Status icons is followed the movement of cursor icon and moves, option of operation instruction on state mouse is by alternately highlighted, in response to the signal received from input equipment, the option of operation instruction be highlighted when determining Received signal strength is as the option of operation chosen, and the option of operation selected by performing, and correspondingly upgrade virtual mouse icon.
According to the calculation element of the embodiment of the present invention, the signal that described input equipment sends can be on-off-type signals, and it inputs by the predetermined motion of the finger of user, toe or the corners of the mouth, eyes, brain wave and triggers.
According to the calculation element of the embodiment of the present invention, the original state of described cursor icon can be static, and described Status icons comprises direction icon, to indicate the option of operation to correspondence direction rolling mouse.
According to the calculation element of the embodiment of the present invention, direction icon can comprise: the arrow indicating four direction up and down; Or indicate the arrow in upper and lower, left and right, upper left, lower-left, upper right, eight directions, bottom right, and the arrow of each direction indication is highlighted in turn.
According to the calculation element of the embodiment of the present invention, wherein in response to receiving input signal, cursor icon is to the direction motion that the arrow that correspondence is highlighted shows; And Status icons switches to the picture comprising and suspend icon, to indicate the option of operation of time-out.
According to the calculation element of the embodiment of the present invention, can also comprising in response to receiving input signal, suspending the motion of cursor icon, and determining whether cursor icon is in executable program picture mark position; If cursor icon is in executable program picture mark position, then Status icons suitching type display between the picture comprising direction icon and the picture comprising clickable icon, the clicking operation of this clickable icon indication mouse; And if cursor icon is not in executable program picture mark position, then Status icons is the picture comprising direction icon, and all directions instruction icon is by alternately highlighted.
According to the calculation element of the embodiment of the present invention, if input signal when wherein cursor icon is in executable program picture mark position and receives highlighted corresponding to clickable icon, then perform the operation that this executable program is associated.
According to the calculation element of the embodiment of the present invention, wherein, if this executable program is the program without the need to word, symbol input function, then Status icons switches between the picture be made up of direction icon and the picture be made up of program shortcut icon, the predetermined function option of each program shortcut icon instruction program, if and this executable program is for having word, the program of symbol input function, then cursor icon is in the viewing area that can input, automatically input state is shown as, Status icons is at the picture be made up of direction icon, dummy keyboard picture, switch between the picture be made up of program shortcut icon, and when receiving the signal of input equipment when showing dummy keyboard picture, then display can input characters, symbol and comprise the graphic user interface of return icon and perform can input characters, the executable program of symbol, when receiving the signal from input equipment when return icon is highlighted, graphic user interface switches to the picture of previous Status icons, when receiving the signal from input equipment when the picture that program shortcut icon is formed is shown, Status icons is switched to the picture that program shortcut icon is formed, wherein each program shortcut icon is by highlighted in turn.
According to the calculation element of the embodiment of the present invention, the signal that wherein said input equipment sends can be the combination of two on-off-type signals; And at given time, two option of operation instructions are by simultaneously highlighted, and two on-off-type signals a period of time that ought now receive from input equipment, determine that the respective items in these two option of operation is the option of operation chosen, and the option of operation selected by performing, and correspondingly upgrade virtual mouse icon.
According to the calculation element of the embodiment of the present invention, the original state of described cursor icon can be static, described Status icons can comprise direction icon, with the option of operation of instruction to correspondence direction rolling mouse, wherein direction icon is divided into multipair direction icon, each direction icon in a pair direction icon indicates direction respect to one another, and multipair direction icon is by highlighted in turn, wherein arbitrary simultaneously highlighted to direction index map mark quilt.
According to the calculation element of the embodiment of the present invention, two on-off-type signals a period of time from input equipment is received time highlighted when a pair direction icon quilt while, determine the moving direction of correspondence one for choosing in both direction, and cursor glyph moves along selected moving direction, and virtual mouse icon is switched to the picture comprising and suspend icon.
The man-machine interactive system that the embodiment of the present invention provides and device thereof, little signal is inputted by user, such as press an enter key or two enter keies, can complete that conventional mouse moves and clicks, text event detection and realize the man-machine interactive operation function substantially such as deletions, carriage return.
Here, the input equipment of the present invention that especially requires emphasis can be a bit input equipment.One bit is minimum signal unit, is the limit of input.Be less than a bit, just without any signal, also just have no way of have input.As long as the advantage of a bit input is that people has a paleocinetic organ of energy, just can input characters, thus realize the interchange of person to person.Such as: as long as have one to point or a toe can move, just can be pointed by optoelectronic switch or the motor message of toe, obtain the input of a bit, realize the interchange of person to person; As long as can also blink, or can corners of the mouth motion be carried out, just can obtain these motor messages by video camera, obtain a bit input, thus realize the interchange of person to person; For without any paleocinetic people, by analyzing the eeg signal of its imagination motion, a bit input can be obtained, realize the interchange of person to person.
Accompanying drawing explanation
Below in conjunction with accompanying drawing in the detailed description of the embodiment of the present invention, these and/or other side of the present invention and advantage will become clearly and be easier to understand, wherein:
Fig. 1 shows the hardware composition schematic diagram of man-machine interactive system 1000 according to an embodiment of the invention.
Fig. 2 shows the configuration block diagram of calculation element 1100 according to an embodiment of the invention.
Fig. 3 shows the two bit input equipments comprising two enter keies according to an embodiment of the invention.
The overall procedure of the man-machine interaction method according to an embodiment of the invention 2000 shown in Fig. 4.
Fig. 5 (a)-5g shows the indicative icon of the various patterns of the virtual mouse icon according to the embodiment of the present invention.
Embodiment
In order to make those skilled in the art understand the present invention better, below in conjunction with the drawings and specific embodiments, the present invention is described in further detail.
Fig. 1 shows the hardware composition schematic diagram of man-machine interactive system 1000 according to an embodiment of the invention.
As shown in Figure 1, man-machine interactive system 1000 can comprise calculation element 1100 and the input equipment 1200 of operability connection.
This calculation element 1100 is such as common desk-top computer, notebook computer, server etc., be configured with display screen, storer and CPU (central processing unit), storer can comprise external memory and internal memory, internal memory can be RAM, DRAM, SRAM etc., external memory can be various nonvolatile memory, such as hard disk or solid-state disk etc., storer is provided with operating system and various application programs etc.Do not configure keyboard and mouse shown in Fig. 1, but when normal person uses, can be configured with common keyboard and mouse yet.
Fig. 2 shows the configuration block diagram of the calculation element 1100 according to the embodiment of the present invention.
As shown in Figure 2, calculation element 1100 comprises CPU (central processing unit) 1110, storer 1130, display 1140, network interface 1150, and can be connected to the input equipment 1200 shown in Fig. 1 via wired or wireless mode.Storer 1130, display 1140, network interface 1150 are connected to CPU (central processing unit) 1110 via bus 1120.Storer 1130 comprises internal memory 1131 and external memory storage 1132, and in calculation element 1100 normally runs, resident in internal memory 1131 have operating system and various application program; External memory 1132 can be ROM, hard disk or solid-state disk, can store BIOS, data, program etc. above.
Input equipment 1200 is the external input device for special population designs, and is intended to replace common keyboard and mouse.Input equipment 1200 can send the signal of discrete value in response to the operation of user, the value number of this signal is preferably less than 10.
Input equipment 1200 shown in Fig. 1 only has an enter key, and is switch-type buttons, and signal value is 0 and 1, hereinafter this is called a bit enter key, and corresponding input is called a bit input.Even if user only has a finger active like this, such bit input equipment also can be operated.Such as, for some parkinsonism patient, thumb may be only had active.One bit input equipment is particularly suitable for such patient.
Input equipment 1200 but shown in Fig. 1 is only example, and input equipment can have the form of more enter key, but is preferably less than or equal to 10 keys.Such as Fig. 3 shows the two bit input equipments comprising two enter keies, and each key sends the signal that value is 0 and 1, hereinafter this is called two bit enter keies, and corresponding input is called two bit inputs.As long as even if user two finger is active, two such bit input equipments just can be operated.Such as, for some disability patient, may only have forefinger and middle finger active, two bit input equipments are particularly suitable for such patient.
It should be noted that, above using finger as the human body of trigger switch type signal input device, but this is only example, and other organ that can provide signal of human body can be adopted to carry out trigger switch type signal, the predetermined motion of the finger of such as user, toe or the corners of the mouth, eyes, brain wave.Such as, at corners of the mouth place sensor installation, tearing of the corners of the mouth can be sensed; Sensor installation on eyelid, can sense opening and closing of eyes; Sensor installation on head, can sense the predetermined motion of brain wave.The signal of these sensors sends calculation element 1100 to wired or wireless mode.
In the example depicted in fig. 1, a bit input equipment 1200 connects calculation element 1100 by USB wireline interface 1300.But this is only example, and a bit input equipment 1200 by other wireline interface such as RS232 etc., or can be connected with computer by the wireless mode such as bluetooth, Wifi.
The computer instruction set of the man-machine interaction method can implementing the embodiment of the present invention is stored in storer, when this computer instruction set is performed by CPU (central processing unit), make the flow process of the man-machine interaction method 2000 according to the embodiment of the present invention performed as shown in Figure 4.
In step S2100, show original computer graphic user interface on a display screen, original computer graphic user interface comprises the icon be associated with executable computer program and virtual mouse icon, this virtual mouse icon comprises the cursor icon of position on instruction screen and the Status icons of the current option of operation that may perform of instruction, Status icons is followed the movement of cursor icon and moves, and the option of operation instruction on state mouse is by alternately highlighted.
Here original computer graphic user interface is the concept of broad sense, can be the initial graphics user interface that such as computer presents after off-mode startup; Also can be computer desktop graphic user interface sometime, or certain application window is just at the graphic user interface of top-level windows display, as long as show icon above, by such as selecting and confirming the computer executable program that this icon can perform this icon and is associated.
The icon be associated with executable computer program on original computer graphic user interface is such as the icon be associated with the MicrosoftOfficeWord of Microsoft, the icon that is associated with media player etc., the icon that is associated with micro-letter (WeChat) program of social software such as company of Tengxun, etc.These icons certain on click the mouse and will start corresponding executable program.
Fig. 5 (a) shows the indicative icon of virtual mouse icon according to an embodiment of the invention.This virtual mouse icon comprises cursor icon 5 and Status icons 6.Cursor icon 5 indicates this position of virtual mouse icon on screen, and original state is static; This Status icons 6 indicates the current option of operation that may perform of this virtual mouse, Status icons 6 as shown in Fig. 2 (a) shows the arrow of four direction up and down, the current option of operation that may perform of instruction virtual mouse is mobile along one of direction indicated by four arrows.The arrow of described four direction is highlighted in turn one by one such as to be flashed.
In step S2200, in response to the signal received from input equipment, the option of operation instruction be highlighted when determining Received signal strength is as the option of operation chosen.
Such as, under the state shown in Fig. 5 (a), if when the arrow in a direction flashes wherein, user inputs one bit signal, such as user presses the button of the input equipment 1200 shown in Fig. 1, the bit signal (such as pressing respective signal " 1 ") that then input equipment 1200 button is corresponding is transmitted to calculation element 1100, calculation element 1100 is in response to the signal received from input equipment, in conjunction with the current option of operation be highlighted, determine the option of operation chosen.Such as, if when arrow is left highlighted, receive a bit signal, then calculation element 1100 determines that the option of operation chosen is for being moved to the left virtual mouse.
In step S2300, the option of operation selected by execution, and correspondingly upgrade virtual mouse icon.
Under above-mentioned example, calculation element performs the operation that virtual mouse is moved to the left, such as step-length upgrades position coordinates corresponding to virtual mouse according to predetermined length step-length in time, upgrade virtual mouse icon, user is seemed, and the direction that cursor icon 5 shows to this arrow together with Status icons 6 is moved.And virtual mouse icon is updated to the appearance shown in Fig. 5 (b), namely now, display halt symbol in the Status icons 6 moved along with cursor icon 5, indicates the current option of operation that can perform to be suspend.
Now repeat operation corresponding to selected option of operation and upgrade virtual mouse icon, until receive user's input, now jumping back to step S2200 in response to user's loading routine flow process.
Such as, under the virtual mouse icon shown in Fig. 5 (b), when cursor icon 5 arrives the position of user's needs, user inputs the signal of one bit, and now program process jumps to step S2200.
Then, circulation performs the process of above-mentioned steps S2200-S2300, unless quit a program in being operating as of step S2300.
Above-mentioned steps " option of operation selected by execution; and correspondingly upgrade virtual mouse icon " should be interpreted broadly, comprise the change because performing the computer graphic user interface that selected option of operation is brought, and renewal virtual mouse icon comprises in renewal cursor icon, renewal Status icons and the current option of operation that may perform indicated by Status icons in the updated alternately highlighted.Here Status icons, also should be interpreted broadly, it can be dynamic menu, such as switch between multiple picture, such as, switch between the picture (program shortcut iconic picture) that the picture (direction iconic picture) that the label 6 at Fig. 5 (a) of elucidated hereinafter indicates, the label 6 of Fig. 5 (d) indicate, be also included between the multiple parts in specific picture and switch, also comprise both combinations.
Continuing example above, in step S2200, based on determining that user is under the virtual mouse icon shown in Fig. 5 (b), have input a bit signal, determining that the option of operation chosen is for suspending.
Then in step S2300, calculation element 5 performs and suspends option, such as, comprise: determine the current residing position coordinates of cursor icon 5, stop carrying out position coordinates and change operation, upgrade graphic user interface and make cursor icon 5 stop moving on a graphical user interface, upgrade virtual mouse image, determine whether cursor icon is in executable program picture mark position simultaneously; If cursor icon 5 is in executable program picture mark position, then Status icons 6 suitching type display between the picture comprising direction icon and the picture comprising clickable icon, the clicking operation of this clickable icon indication mouse; And if cursor icon 6 is not in executable program picture mark position, then Status icons 6 is the picture comprising direction icon, and all directions instruction icon is by alternately highlighted.
If cursor icon 5 is in executable program picture mark position, Status icons 6 with cursor icon 5 clicks switching between state (as Suo Shi Fig. 5 (c)) in four arrow states (as Suo Shi Fig. 5 (a)) and mouse, in other words, now Status icons 6 indicates five current option of operation that may perform, namely mouse up and down, left and right movement and clicking the mouse, can select continue operational light mark on a map target motion, or select mouse to click, select mouse motor to cause opening certain operation of software or executive software definition.Such as, Status icons 6 is first highlighted to upward arrow, then highlighted downward arrow, then highlighted arrow left, finally highlighted arrow to the right under the appearance shown in Fig. 5 (a), then the state shown in Fig. 5 (c) is switched to, and circulating under these five patterns, until receive the input signal of user of going round and beginning again.
If input signal when cursor icon 5 is in executable program picture mark position and receives highlighted corresponding to clickable icon, then perform the operation that this executable program is associated.
If this executable program is the program without the need to word, symbol input function, then Status icons 6 can switch between the picture be made up of direction icon (Fig. 5 (a)) and the picture (Fig. 5 (d)) be made up of program shortcut icon, the predetermined function option of each program shortcut icon instruction program.
If this executable program is the program with word, symbol input function, then cursor icon 5 is in the viewing area that can input, automatically input state is shown as, as shown in Fig. 5 (e), cursor icon 5 is no longer arrow form, but capitalization " I ", indication character input state; Status icons switches between the picture be made up of direction icon (Fig. 5 (e)), dummy keyboard picture (Fig. 5 (f)), the picture (Fig. 5 (g)) that is made up of program shortcut icon, again emphasize, now cursor icon 5 is no longer arrow form, but capitalization " I ".
When receiving the signal of input equipment when showing dummy keyboard Status icons picture (Fig. 5 (f)), then display can input characters, symbol and comprise the graphic user interface of return icon and perform can input characters, the executable program of symbol, when receiving the signal from input equipment when return icon is highlighted, graphic user interface switches to the picture of previous Status icons, about the input method of the design and use virtual keypad of virtual keypad can with reference on July 23rd, 2014 to submit in Patent Office of the People's Republic of China, application number is 201410352764.7, denomination of invention is " Chinese character input method, form the method for word and device " patented claim.
When receiving the signal from input equipment when the Status icons picture that program shortcut icon is formed (Status icons that the label 6 in Fig. 5 (d) or Fig. 5 (g) indicates) is shown, Status icons is switched to the picture that program shortcut icon is formed, and wherein each program shortcut icon is by highlighted in turn.
Relevant procedures shortcut icon, such as when software program is media player, can be F.F. shortcut icon, rewind shortcut icon or full frame shortcut icon etc.
Be the man-machine interaction method that a bit input equipment describes according to the embodiment of the present invention for input equipment above, the following describes man-machine interaction method example when input equipment is two bit input equipment.
When two enter key of two bit input equipments such as shown in Fig. 3, in one example, on computer graphic user interface, with the situation of a bit input equipment unlike, any instant has two option of operation (two option of operation indicated by Status icons) to be highlighted simultaneously, and an option of operation is controlled by a corresponding enter key, such as when two option of operation are highlighted side by side in left and right, left button in shown in Fig. 3 two enter key corresponds to the option of operation on the left side, right button corresponds to the option of operation on the right, if then the enter key on the left side is pressed, then represent the option of operation that have chosen the left side.Calculation element receives this signal that two bit input equipments are sent, and the option of operation selected by performing, and upgrade virtual mouse icon, so circulation proceeds down.
Such as, show original computer graphic user interface on the display screen, original computer graphic user interface comprises the icon be associated with executable computer program and virtual mouse icon, virtual mouse comprises cursor icon 5 and Status icons 6, present position is (as hereinafter described on screen for cursor icon 5 indication mouse, instruction program character can also be added as required, be such as can input characters program or can not the program of input characters), Status icons 6 indicates the current option of operation that may perform, Status icons 6 is followed the movement of cursor icon 5 and moves (both such as keep relative static conditions each other), option of operation instruction on state mouse 6 is by alternately highlighted.
The operation of virtual mouse can comprise cursor icon motion, cursor icon stops and mouse clicks three kinds of operations.
The original state of cursor icon 5 is such as static, pattern shown in display Fig. 5 (a), Status icons 6 shows the arrow of four direction up and down, the current possible cursor icon that is operating as is moved, the arrow of four direction flashes in pairs in turn, and such as left and right directions arrow is a pair, simultaneously highlighted, then the arrow of above-below direction is a pair, simultaneously highlighted.
When the arrow in a pair direction flashes, input two bit signals wherein, the cursor icon 5 i.e. direction motion of an arrow display wherein.The arrow of such as left and right directions is to time highlighted, and user presses the left button in two key inputting devices shown in Fig. 3.In response to this signal, calculation element control cursor icon 5 to left movement, and Status icons 6 in display halt symbol, as shown in Fig. 5 (b).
When the icon (such as media player icon) that position such as certain executable computer program that cursor icon 5 arrives user's expectation is associated is upper, user is by next button, then cursor icon 5 i.e. stop motion.Because have two enter keies, can define in this case, input any key effect identical, be all the signal of cursor icon 5 stop motion of giving an order.Or also can define in this case, input left button is the signal of cursor icon 5 stop motion of giving an order, and inputs right button for other and order, such as, for quitting a program or shutdown etc.
Next, the Status icons 6 of following cursor icon 5 switches between four arrow states (as Suo Shi Fig. 5 (a)) and the state of click (as Suo Shi Fig. 5 (c)).Now, such as can first left and right directions arrow simultaneously highlighted, then above-below direction arrow highlighted, then shown in Fig. 5 (c) click state is highlighted simultaneously, if now user inputs left button when left and right directions arrow is highlighted, then cursor icon is to left movement; If input right button in this situation, then cursor icon moves right; If in like manner input left button when above-below direction arrow is highlighted, then cursor icon can move upward, if user inputs right button, cursor icon moves downward; If user have input such as left button when the click state shown in Fig. 5 (c) is highlighted, then open certain operation of software or executive software definition, such as, open media player.
If the user when the position of executable program associated icons have input such as left button in click state in cursor icon, then calculation element is by this executable program of startup, and depending on executable program character and upgrade the form of cursor icon 5 and Status icons 6.
In one example, if this executable program is the program without the need to word, symbol input function, then Status icons 6 can switch between the picture be made up of direction icon (Fig. 5 (a)) and the picture (Fig. 5 (d)) be made up of program shortcut icon, the predetermined function option of each program shortcut icon instruction program.
If this executable program is the program with word, symbol input function, meaning that cursor icon 5 is in can in the viewing area of input characters, then cursor icon 5 is shown as input state by calculation element, as shown in Fig. 5 (e), wherein cursor icon 5 is no longer arrow form, but capitalization " I ", indication character input state; Status icons 6 switches between the picture be made up of direction icon (in Fig. 5 (e)), dummy keyboard picture (Status icons that label 6 in Fig. 5 (f) indicates), the picture (Status icons that the label 6 in Fig. 5 (g) indicates) that is made up of program shortcut icon.Here again emphasize, now cursor icon 5 is no longer arrow form, but capitalization " I ", namely only have Status icons 6 in switching, and cursor icon is capitalization " I " all the time.Here switching such as can: the picture that > dummy keyboard picture and program shortcut icon are formed shows the Status icons that display left and right directions arrow is simultaneously highlighted---> shows the simultaneously highlighted Status icons of above-below direction arrow---simultaneously; Also---> shows the picture that simultaneously highlighted Status icons---> dummy keyboard picture---the > program shortcut icon of above-below direction arrow is formed to Status icons highlighted while of can being display left and right directions arrow.
When receiving indicating user and selecting the input of dummy keyboard picture, calculation element display can input characters, symbol and comprise the graphic user interface of return icon and perform can input characters, the executable program of symbol, when receiving the signal from input equipment when return icon is highlighted, graphic user interface switches to the picture of previous Status icons, about the input method of the design and use virtual keypad of virtual keypad can with reference on July 23rd, 2014 to submit in Patent Office of the People's Republic of China, application number is 201410352764.7, denomination of invention is " Chinese character input method, form the method for word and device " patented claim.
When receiving the input signal of the Status icons picture that indicating user option program shortcut icon is formed, Status icons is switched to the picture that program shortcut icon is formed, and wherein each program shortcut icon is by highlighted in turn.
Relevant procedures shortcut icon, such as when software program is media player, can be F.F. shortcut icon, rewind shortcut icon or full frame shortcut icon etc.
During two bits inputs, faster than one bit, but requiring human body to have two to point etc. can paleocinetic organ.
Man-machine interactive system provided by the invention and device thereof, little signal is inputted by user, such as press an enter key or two enter keies, can complete that conventional mouse moves and clicks, text event detection and realize the man-machine interactive operation function substantially such as deletions, carriage return.
Here, the input equipment of the present invention that especially requires emphasis can be a bit input equipment.One bit is minimum signal unit, is the limit of input.Be less than a bit, just without any signal, also just have no way of have input.As long as the advantage of a bit input is that people has a paleocinetic organ of energy, just can input characters, thus realize the interchange of person to person.Such as: as long as have one to point or a toe can move, just can be pointed by optoelectronic switch or the motor message of toe, obtain the input of a bit, realize the interchange of person to person; As long as can also blink, or can corners of the mouth motion be carried out, just can obtain these motor messages by video camera, obtain a bit input, thus realize the interchange of person to person; For without any paleocinetic people, by analyzing the eeg signal of its imagination motion, a bit input can be obtained, realize the interchange of person to person.
Describe the preferred embodiments of the present invention by reference to the accompanying drawings above, but this being only exemplary, is not exhaustive, and those of ordinary skill in the art can carry out various amendment, replacement, combination as required, add or delete.
Such as, input equipment is above illustrated as has a button or two buttons, but this is only example, and input equipment can have more button, such as three or more.
The cursor icon of previous figures and the form of virtual mouse icon are only example, and those skilled in the art can design and adopt other form as required.
Show the arrow that direction icon indicates four direction up and down above, but this is only example, the arrow in other direction of instruction can be comprised, such as, indicate the arrow in upper and lower, left and right, upper left, lower-left, upper right, eight directions, bottom right.
In example above, calculation element is illustrated as desktop computer, but this is only example, and calculation element can be other form, such as notebook computer, smart mobile phone, personal digital assistant, projector, TV, multimedia player etc.
Be described above various embodiments of the present invention, above-mentioned explanation is exemplary, and non-exclusive, and be also not limited to disclosed each embodiment.When not departing from the scope and spirit of illustrated each embodiment, many modifications and changes are all apparent for those skilled in the art.Therefore, protection scope of the present invention should be as the criterion with the protection domain of claim.
Claims (10)
1. the man-machine interaction method of a calculation element realization, calculation element is operably connected with input equipment, and this input equipment can send the signal of discrete value, and the value number of this signal is less than 10, this calculation element is configured with display screen, and this man-machine interaction method comprises:
Show original computer graphic user interface on the display screen, original computer graphic user interface comprises the icon be associated with executable computer program and virtual mouse icon, this virtual mouse icon comprises the cursor icon of position on instruction screen and the Status icons of the current option of operation that may perform of instruction, Status icons is followed the movement of cursor icon and moves, and the option of operation instruction on state mouse is by alternately highlighted;
In response to the signal received from input equipment, the option of operation instruction be highlighted when determining Received signal strength is as the option of operation chosen; And
Option of operation selected by execution, and correspondingly upgrade virtual mouse icon.
2. man-machine interaction method according to claim 1, the signal that described input equipment sends is on-off-type signals, and its input is triggered by the predetermined motion of the finger of user, toe or the corners of the mouth, eyes, brain wave.
3. man-machine interaction method according to claim 2, the original state of described cursor icon is static, and described Status icons comprises direction icon, to indicate the option of operation to correspondence direction rolling mouse.
4. man-machine interaction method according to claim 3,
Direction icon comprises: the arrow indicating four direction up and down; Or indicate the arrow in upper and lower, left and right, upper left, lower-left, upper right, eight directions, bottom right, and
The arrow of each direction indication is highlighted in turn.
5. man-machine interaction method according to claim 4, wherein in response to receiving input signal, cursor icon is to the direction motion that the arrow that correspondence is highlighted shows; And
Status icons switches to the picture comprising and suspend icon, to indicate the option of operation of time-out.
6. man-machine interaction method according to claim 5, also comprises: in response to receiving input signal, suspends the motion of cursor icon, and determines whether cursor icon is in executable program picture mark position;
If cursor icon is in executable program picture mark position, then Status icons suitching type display between the picture comprising direction icon and the picture comprising clickable icon, the clicking operation of this clickable icon indication mouse; And
If cursor icon is not in executable program picture mark position, then Status icons is the picture comprising direction icon, and all directions instruction icon is by alternately highlighted.
7. man-machine interaction method according to claim 6, if input signal when wherein cursor icon is in executable program picture mark position and receives highlighted corresponding to clickable icon, then performs the operation that this executable program is associated.
8. man-machine interaction method according to claim 7, wherein,
If this executable program is the program without the need to word, symbol input function, then Status icons switches between the picture be made up of direction icon and the picture be made up of program shortcut icon, the predetermined function option of each program shortcut icon instruction program; And
If this executable program is the program with word, symbol input function, then
Cursor icon, in the viewing area that can input, is shown as input state automatically, and Status icons switches between the picture be made up of direction icon, dummy keyboard picture, the picture that is made up of program shortcut icon, and
When receiving the signal of input equipment when showing dummy keyboard picture, then display can input characters, symbol and comprise return icon graphic user interface and perform can input characters, symbol executable program, when receiving the signal from input equipment when return icon is highlighted, graphic user interface switches to the picture of previous Status icons
When receiving the signal from input equipment when the picture that program shortcut icon is formed is shown, Status icons is switched to the picture that program shortcut icon is formed, and wherein each program shortcut icon is by highlighted in turn.
9. a man-machine interactive system, comprise calculation element and the input equipment of operability connection, this calculation element is configured with display screen, storer and CPU (central processing unit), this input equipment can send the signal of discrete value, the value number of this signal is less than 10, store computer instruction set in storer, when this computer instruction set is performed by CPU (central processing unit), make to perform following steps:
Show original computer graphic user interface on a display screen, original computer graphic user interface comprises the icon be associated with executable computer program and virtual mouse icon, this virtual mouse icon comprises the cursor icon of position on instruction screen and the Status icons of the current option of operation that may perform of instruction, Status icons is followed the movement of cursor icon and moves, and the option of operation instruction on state mouse is alternately highlighted;
In response to the signal received from input equipment, the option of operation instruction be highlighted when determining Received signal strength is as the option of operation chosen; And
Option of operation selected by execution, and correspondingly upgrade virtual mouse icon.
10. a calculation element, this calculation element connects input equipment operably, this calculation element is configured with display screen, storer and CPU (central processing unit), this input equipment can send the signal of discrete value, the value number of this signal is less than 10, store computer instruction set in storer, when this computer instruction set is performed by CPU (central processing unit), make to perform following steps:
Show original computer graphic user interface on a display screen, original computer graphic user interface comprises the icon be associated with executable computer program and virtual mouse icon, this virtual mouse icon comprises the cursor icon of position on instruction screen and the Status icons of the current option of operation that may perform of instruction, Status icons is followed the movement of cursor icon and moves, and the option of operation instruction on state mouse is by alternately highlighted;
In response to the signal received from input equipment, the option of operation instruction be highlighted when determining Received signal strength is as the option of operation chosen; And
Option of operation selected by execution, and correspondingly upgrade virtual mouse icon.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201510895428.1A CN105353883A (en) | 2015-12-08 | 2015-12-08 | Man-machine interaction method, man-machine interaction system and calculating apparatus |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201510895428.1A CN105353883A (en) | 2015-12-08 | 2015-12-08 | Man-machine interaction method, man-machine interaction system and calculating apparatus |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN105353883A true CN105353883A (en) | 2016-02-24 |
Family
ID=55329866
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201510895428.1A Pending CN105353883A (en) | 2015-12-08 | 2015-12-08 | Man-machine interaction method, man-machine interaction system and calculating apparatus |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN105353883A (en) |
Cited By (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN106502417A (en) * | 2016-11-08 | 2017-03-15 | 北京暴风魔镜科技有限公司 | Mobile virtual real world devices are adapted to the methods, devices and systems of computer peripheral equipment |
| CN107831920A (en) * | 2017-10-20 | 2018-03-23 | 广州视睿电子科技有限公司 | Cursor movement display methods, device, mobile terminal and storage medium |
| CN109298787A (en) * | 2018-09-14 | 2019-02-01 | 清华大学 | Flexible human-computer interaction device and terminal device |
Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN1499367A (en) * | 2002-11-08 | 2004-05-26 | 英业达股份有限公司 | Method for hot key activation of single key system |
| CN101776981A (en) * | 2010-01-07 | 2010-07-14 | 天津大学 | Method for controlling mouse by jointing brain electricity and myoelectricity |
| CN103699230A (en) * | 2014-01-14 | 2014-04-02 | 东南大学 | Digital interface interaction method on basis of icon electrocerebral control |
| CN104799984A (en) * | 2015-05-14 | 2015-07-29 | 华东理工大学 | Assistance system for disabled people based on brain control mobile eye and control method for assistance system |
-
2015
- 2015-12-08 CN CN201510895428.1A patent/CN105353883A/en active Pending
Patent Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN1499367A (en) * | 2002-11-08 | 2004-05-26 | 英业达股份有限公司 | Method for hot key activation of single key system |
| CN101776981A (en) * | 2010-01-07 | 2010-07-14 | 天津大学 | Method for controlling mouse by jointing brain electricity and myoelectricity |
| CN103699230A (en) * | 2014-01-14 | 2014-04-02 | 东南大学 | Digital interface interaction method on basis of icon electrocerebral control |
| CN104799984A (en) * | 2015-05-14 | 2015-07-29 | 华东理工大学 | Assistance system for disabled people based on brain control mobile eye and control method for assistance system |
Non-Patent Citations (1)
| Title |
|---|
| 程煜等: "《1-Bit人机交互系统》", 《智能系统学报》 * |
Cited By (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN106502417A (en) * | 2016-11-08 | 2017-03-15 | 北京暴风魔镜科技有限公司 | Mobile virtual real world devices are adapted to the methods, devices and systems of computer peripheral equipment |
| CN107831920A (en) * | 2017-10-20 | 2018-03-23 | 广州视睿电子科技有限公司 | Cursor movement display methods, device, mobile terminal and storage medium |
| CN107831920B (en) * | 2017-10-20 | 2022-01-28 | 广州视睿电子科技有限公司 | Cursor movement display method and device, mobile terminal and storage medium |
| CN109298787A (en) * | 2018-09-14 | 2019-02-01 | 清华大学 | Flexible human-computer interaction device and terminal device |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US9176668B2 (en) | User interface for text input and virtual keyboard manipulation | |
| US10228833B2 (en) | Input device user interface enhancements | |
| JP5964429B2 (en) | Semantic zoom | |
| JP6042892B2 (en) | Programming interface for semantic zoom | |
| JP6038925B2 (en) | Semantic zoom animation | |
| US20150058776A1 (en) | Providing keyboard shortcuts mapped to a keyboard | |
| JP2014530395A (en) | Semantic zoom gesture | |
| US9880697B2 (en) | Remote multi-touch control | |
| KR20130127349A (en) | System and control method for character make-up | |
| JP2015026257A (en) | Information processing apparatus, information processing method, and program | |
| CN104281318A (en) | Method and apparatus to reduce display lag of soft keyboard presses | |
| CN105353883A (en) | Man-machine interaction method, man-machine interaction system and calculating apparatus | |
| JP6216862B1 (en) | GAME METHOD AND GAME PROGRAM | |
| US10133346B2 (en) | Gaze based prediction device and method | |
| JP6232694B2 (en) | Information processing apparatus, control method thereof, and program | |
| KR101654710B1 (en) | Character input apparatus based on hand gesture and method thereof | |
| JP2018069040A (en) | Gaming method and gaming program | |
| KR20150057665A (en) | Method of hangul input using electronic device having touch screen and electronic device using the method |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| WD01 | Invention patent application deemed withdrawn after publication |
Application publication date: 20160224 |
|
| WD01 | Invention patent application deemed withdrawn after publication |