CN105988695B - Smart machine and its operation response method - Google Patents
Smart machine and its operation response method Download PDFInfo
- Publication number
- CN105988695B CN105988695B CN201510083694.4A CN201510083694A CN105988695B CN 105988695 B CN105988695 B CN 105988695B CN 201510083694 A CN201510083694 A CN 201510083694A CN 105988695 B CN105988695 B CN 105988695B
- Authority
- CN
- China
- Prior art keywords
- user
- finger
- touch screen
- electric signal
- identified
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Landscapes
- Engineering & Computer Science (AREA)
- General Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Human Computer Interaction (AREA)
- Physics & Mathematics (AREA)
- User Interface Of Digital Computer (AREA)
- Position Input By Displaying (AREA)
- Health & Medical Sciences (AREA)
- Biomedical Technology (AREA)
- Dermatology (AREA)
- General Health & Medical Sciences (AREA)
- Neurology (AREA)
- Neurosurgery (AREA)
Abstract
The invention discloses a kind of smart machine and its operation response methods, the method comprise the steps that receiving the electric signal that the EMG sensor that user wears is sent；The location information of electric signal and combination finger touching touch screen based on the received, responds after determining the operation of user.In the present invention, smart machine can be in conjunction with the identification information and touch position information of user's touching, the operation of user is determined and is responded, simplify it is some such as refer to touching, long-pressing, Macintosh complex operations, more convenient user carries out input control to smart machine, and the user experience is improved.Meanwhile multiple keysets of existing touch screen can be become a key by the present invention, improve the effective display area of touch screen.
Description
Technical field
The present invention relates to human-computer interaction technologies, specifically, the present invention relates to a kind of smart machine and its operation responders
Method.
Background technique
With the continuous development of touch screen technology, such as the smart machine of smart phone, tablet computer, wearable device,
Touch screen technology realization is widely used to respond the operation of user, realizes human-computer interaction.Currently, touch screen has resistance-type touching
Touch screen, capacitive touch screen, surface acoustic wave technique touch screen etc..Compared with traditional keyboard, mouse interactive mode, touch screen is handed over
Mutual mode is simple to operate, and more intuitively, user only needs to touch the icon or text in display screen using finger, can be complete
The operation of pairs of smart machine, brings splendid experience to user.
In general, smart machine can detecte user and touch touch screen after user makes touching operation on the touchscreen
Location information, and then determine user to the input information of smart machine according to the location information of detection.Wherein, user can be with
By a variety of interactive modes, such as virtual key, Macintosh, double-click, long-pressing, multi-point touch, a variety of behaviour are realized on the touchscreen
Make.For example, user can input character by the dummy keyboard editor that touch screen is shown, zoom is realized by multi-point touch
Operation etc..
However, above-mentioned a variety of interactive modes more or less have some shortcoming and defect, these shortcoming and defect are easy
Cause user's operation inconvenient, operating experience is bad.For example, the key in dummy keyboard generally can not be too small, otherwise it is not easy to touch
It touches, thus occupies a large amount of screen space, reduce effective display area；Macintosh, double-click mode at least need user
Click twice could complete to operate；It is long to occupy the additional time as needed and complete to operate；Multi-point touch needs while making
It is operated on the screen with multiple fingers, equipment lesser for screen, especially wearable device will cause serious screening
Gear.
Therefore, it is necessary to provide a kind of smart machine and its operation responder for more carrying out input control convenient for user
Method, to promote user's operation experience.
Summary of the invention
The purpose of the present invention aims to solve at least one of above-mentioned technological deficiency, especially in conjunction with touching touch screen finger and
The location information of touching, so that more convenient user carries out input control to smart machine, is promoted and is used to determine the operation of user
Family operating experience.
The present invention provides a kind of operation response methods of smart machine, comprising:
Receive the electric signal that the EMG sensor that user wears is sent；
Electric signal and the location information of the touch screen is touched in conjunction with the user based on the received, determine the user's
It is responded accordingly after operation.
Further, after the electric signal for receiving the EMG sensor transmission that user wears, further includes:
Electric signal identifies that the finger for the finger and/or user that the user touches on the touchscreen exists based on the received
Pressing dynamics on the touch screen.
Preferably, the electric signal based on the received and touching the location information of the touch screen in conjunction with the user, really
The operation of the fixed user includes:
According to the finger and/or pressing dynamics identified, the location information of the touch screen is touched in conjunction with the user, really
The operation of the fixed user.
Preferably, the electric signal based on the received identifies the finger that the user touches on the touchscreen, it is specific to wrap
It includes:
Using the part classification device trained in advance, electric signal identifies that the user touches on the touchscreen based on the received
The finger touched.
Preferably, training obtains the part classification implement body according to the following method:
For each finger, using the movement of EMG sensor sensing finger touching plane, and the EMG sensing is extracted
After the signal characteristic of the electric signal of device output, the signal characteristic of extraction is demarcated after the information of the finger as training sample；
Classifier is trained using obtained training sample, obtains the part classification device.
Preferably, the operation of the determination user, specifically includes:
When the touch screen shows dummy keyboard, according to the positional information, the letter that user clicks is determined；And
Determine that the letter is upper case or lower case according to the finger identified.
Preferably, the operation of the determination user, specifically includes:
When the touch screen shows dummy keyboard, if determining according to the positional information, user clicks delete key:
Determine that the deletion object that user specifies is a character or a word or a sentence according to the finger identified
Son or a paragraph or full text.
Preferably, the operation of the determination user, specifically includes:
When the touch screen shows contact person interface, the contact person that user clicks is determined according to the positional information；And
Determine that user opens the contact information or the calling contact person or hair message according to the finger identified
To the contact person.
Preferably, the operation of the determination user, specifically includes:
When the touch screen shows browser interface, the link that user clicks is determined according to the positional information；And
Determine that one key of user opens the link or the collection link or in new Shipping Options Page according to the finger identified
Open the link.
Preferably, the operation of the determination user, specifically includes:
When the touch screen shows picture application interface, if determining according to the positional information, user clicks application of drawing
Interface, then
According to the finger identified, determine that user calls paintbrush tool or eraser；And
During user uses paintbrush tool/eraser, according to the pressing dynamics of the finger identified, picture is adjusted
Thickness/rubber size of pen.
Preferably, the operation of the determination user, specifically includes:
When the touch screen shows map application interface, if determining according to the positional information, user clicks map and puts
Greatly/reduce key, then:
According to the pressing dynamics of the finger identified, determine that amplification/diminution shows the multiple of map.
Preferably, the operation of the determination user, specifically includes:
The touch screen show media player interface when, if according to the positional information determine user click F.F./
Fast backspace key, then
According to the pressing dynamics of the finger identified, the speed of skip forward/back is adjusted.
Preferably, the operation of the determination user, specifically includes:
When the touch screen shows media player interface, if determining according to the positional information, user clicks volume
Key, then
It is determined according to the finger identified and increases volume or reduction volume；And
According to the pressing dynamics of the finger identified, determine increase or reduce volume number.
Preferably, the operation of the determination user, specifically includes:
When the touch screen shows media player interface, if determining according to the positional information, user clicks file and cuts
Key is changed, then
It is determined according to the finger identified and plays a upper media file or the next media file of broadcasting.
Preferably, the operation of the determination user, specifically includes:
When the finger identified is specific finger, according to the positional information, the operation of the user is determined；
When the finger identified is not specific finger, according to the finger identified, the operation of user is determined to return
Upper level returns to main screen or opens application menu.
Preferably, the EMG sensor is ring structure, including circumferentially distributed multi-group electrode, and it is integrated with wireless
Mode sends the wireless communication unit of electric signal.
Preferably, the EMG sensor is worn at following at least one: the wrist of the user, forearm, upper arm.
The present invention also provides a kind of smart machines, comprising:
Signal receiving module, the electric signal that the EMG sensor for receiving user's wearing is sent；
Determining module is operated, for touching according to the received electric signal of the signal receiving module, and in conjunction with the finger
The location information of the touch screen determines the operation of the user；
Respond module is responded for the operation to the user determined.
Preferably, the operation determining module specifically includes:
Signal identification unit, for identifying that the user is touching according to the received electric signal of the signal receiving module
Touch pressing dynamics of the finger of the finger and/or user that touch on screen on the touch screen；
Information combining unit, for touching the touching in conjunction with the user according to the finger and/or pressing dynamics identified
The location information for touching screen determines the operation of the user.
Preferably, the signal identification unit is specifically used for according to the received electric signal of the signal receiving module, identification
Pressing dynamics of the finger of user on the touch screen out；And/or using the part classification device trained in advance, according to reception
Electric signal identify the finger that the user touches on the touchscreen.
Further, the smart machine, further includes:
Classifier training module extracts sample electric signal for obtaining the sample electric signal of the EMG sensor acquisition
Signal characteristic；According to the corresponding finger information of sample electric signal, the signal characteristic of extraction is demarcated；According to the signal characteristic of calibration
Classifier is trained, the part classification device is obtained.
Preferably, the information combining unit is specifically used for when the touch screen shows dummy keyboard, according to institute's rheme
Confidence breath determines the letter that user clicks；And determine that the letter is upper case or lower case according to the finger identified.
Preferably, the information combining unit is specifically used for when the touch screen shows dummy keyboard, if according to described
Location information determines that user clicks delete key, then determines that the deletion object that user specifies is a word according to the finger identified
Symbol or a word or a sentence or a paragraph or full text.
Preferably, the information combining unit is specifically used for when the touch screen shows map application interface, if according to
The location information determines that user clicks map and amplifies/reduce key, then according to the pressing dynamics of the finger identified, determination is put
Greatly/reduce the multiple for showing map.
Preferably, the information combining unit is specifically used for when the touch screen shows media player interface, if root
It determines that user clicks volume key according to the location information, is then determined according to the finger identified and increase volume or reduction volume；And
According to the pressing dynamics of the finger identified, determine increase or reduce volume number.
Further, the smart machine, further includes: the EMG sensor；
The EMG sensor is ring structure, including circumferentially distributed multi-group electrode, and is integrated with and is sent wirelessly
The wireless communication unit of electric signal.
In the solution of the present invention, when user touches the touch screen of smart machine, what smart machine can be worn according to user
The electric signal of EMG sensor output, the location information of touch screen is touched in conjunction with user, is carried out accordingly after determining the operation of user
Response.This invention simplifies it is some such as refer to more touching, long-pressing, Macintosh complex operations, it is avoidable that screen is blocked, more
Input control is carried out to smart machine for the convenience of the user, the user experience is improved.Moreover, the present invention can also be achieved finger to touch
The identification of the pressing dynamics of screen, it is many applied to picture, map, media player etc. in application, greatly strengthening user experience.
The additional aspect of the present invention and advantage will be set forth in part in the description, these will become from the following description
Obviously, or practice through the invention is recognized.
Detailed description of the invention
Above-mentioned and/or additional aspect and advantage of the invention will become from the following description of the accompanying drawings of embodiments
Obviously and it is readily appreciated that, in which:
Fig. 1 is the flow diagram of the operation response method of the smart machine of the embodiment of the present invention；
Fig. 2 is the wearing position of EMG sensor and the schematic diagram of structure；
Fig. 3 is the waveform diagram of the original electric signal of EMG sensor acquisition；
Fig. 4 is the waveform diagram of the EMG signal after filtering processing；
Fig. 5 a is the waveform diagram that finger A touches collected EMG signal when touch screen；
Fig. 5 b is the waveform diagram that finger B touches collected EMG signal when touch screen；
Fig. 6 asynchronous waveform diagram of pressing dynamics for same finger touching touch screen；
Fig. 7 is the schematic diagram of the corresponding different operation of same virtual key difference finger；
Fig. 8 is the schematic diagram that different fingers click that contact person corresponds to different operation；.
Fig. 9 is the schematic diagram for the corresponding different operation of link that different fingers are clicked in browser interface；
Figure 10 is the schematic diagram that different tools are called when different fingers click picture application interface；
Figure 11 is the schematic diagram that the thickness of paintbrush tool is adjusted under different pressing dynamics；
Figure 12 is the schematic diagram that map amplification factor is different under different pressing dynamics；
Figure 13 is the schematic diagram that different fingers click that map application interface corresponds to different operation；
Figure 14 is the schematic diagram that fast forward and fast reverse speed is different under different pressing dynamics；
Figure 15 is the schematic diagram that different fingers click that same position corresponds to different operation；
Figure 16 is the schematic diagram that different fingers click that display interface corresponds to different operation；
Figure 17 is the contrast schematic diagram using the effective display area of the forward and backward display screen of the present invention；
Figure 18 is the structural schematic diagram of the smart machine of the embodiment of the present invention；
Figure 19 is the block schematic illustration of the internal structure of the operation determining module of the embodiment of the present invention.
Specific embodiment
The embodiment of the present invention is described below in detail, examples of the embodiments are shown in the accompanying drawings, wherein from beginning to end
Same or similar label indicates same or similar element or element with the same or similar functions.Below with reference to attached
The embodiment of figure description is exemplary, and for explaining only the invention, and is not construed as limiting the claims.
Those skilled in the art of the present technique are appreciated that unless expressly stated, singular " one " used herein, " one
It is a ", " described " and "the" may also comprise plural form.It is to be further understood that being arranged used in specification of the invention
Diction " comprising " refer to that there are the feature, integer, step, operation, element and/or component, but it is not excluded that in the presence of or addition
Other one or more features, integer, step, operation, element, component and/or their group.It should be understood that when we claim member
Part is " connected " or when " coupled " to another element, it can be directly connected or coupled to other elements, or there may also be
Intermediary element.In addition, " connection " used herein or " coupling " may include being wirelessly connected or wirelessly coupling.It is used herein to arrange
Diction "and/or" includes one or more associated wholes for listing item or any cell and all combinations.
Those skilled in the art of the present technique are appreciated that unless otherwise defined, all terms used herein (including technology art
Language and scientific term), there is meaning identical with the general understanding of those of ordinary skill in fields of the present invention.Should also
Understand, those terms such as defined in the general dictionary, it should be understood that have in the context of the prior art
The consistent meaning of meaning, and unless idealization or meaning too formal otherwise will not be used by specific definitions as here
To explain.
Those skilled in the art of the present technique are appreciated that " terminal " used herein above, " terminal device " both include wireless communication
The equipment of number receiver, only has the equipment of the wireless signal receiver of non-emissive ability, and including receiving and emitting hardware
Equipment, have on bidirectional communication link, can carry out two-way communication reception and emit hardware equipment.This equipment
It may include: honeycomb or other communication equipments, shown with single line display or multi-line display or without multi-line
The honeycomb of device or other communication equipments；PCS (Personal Communications Service, PCS Personal Communications System), can
With combine voice, data processing, fax and/or communication ability；PDA (Personal Digital Assistant, it is personal
Digital assistants), it may include radio frequency receiver, pager, the Internet/intranet access, web browser, notepad, day
It goes through and/or GPS (Global Positioning System, global positioning system) receiver；Conventional laptop and/or palm
Type computer or other equipment, have and/or the conventional laptop including radio frequency receiver and/or palmtop computer or its
His equipment." terminal " used herein above, " terminal device " can be it is portable, can transport, be mounted on the vehicles (aviation,
Sea-freight and/or land) in, or be suitable for and/or be configured in local runtime, and/or with distribution form, operate in the earth
And/or any other position operation in space." terminal " used herein above, " terminal device " can also be communication terminal, on
Network termination, music/video playback terminal, such as can be PDA, MID (Mobile Internet Device, mobile Internet
Equipment) and/or mobile phone with music/video playing function, it is also possible to the equipment such as smart television, set-top box.
The present inventor can detecte flesh it is considered that EMG (electromyography, electromyogram) sensor
The action potential waveform of meat motor unit, and it is converted into available electric signal output；When user touches touching using different fingers
When touching screen, the muscular movement unit in arm can generate different action potential waveforms, and the electric signal of EMG sensor output is also
It is different.
Therefore, in the present invention, when the user with EMG sensor touches the touch screen of smart machine, smart machine
The electric signal that can be exported according to the EMG sensor of wearing, the location information of touch screen is touched in conjunction with user, determines the operation of user
After responded.On the one hand, the present invention can be used family when using the same position of different fingers touching touch screen, realize different
Input, save the operation of user, more convenient user carries out input control to smart machine, improves the operating body of user
It tests；On the other hand, multiple keysets of existing touch screen can be become a key by the present invention, improve effective display surface of touch screen
Product.
For example, user inputs capitalization when clicking corresponding virtual key using finger B, clicked using finger A corresponding
Virtual key when input lowercase.To avoid the operation that user clicks Caps Lock, facilitate user to intelligence
The input control of equipment improves user's operation experience, especially in the case where capital and small letter Mixed design is more, promotes user behaviour
Make the effect experienced clearly；And the setting of Caps Lock can be saved, save screen use space.
Below in conjunction with the attached drawing technical solution that the present invention will be described in detail.
The operation response method of smart machine provided in an embodiment of the present invention, detailed process is as shown in Figure 1, include following step
Rapid S101 to S103:
S101: smart machine receives the electric signal that the EMG sensor that user wears is sent.
Specifically, EMG sensor is worn at user's arm；In other words, EMG sensor can be worn on following at least one
Place: the wrist of user, forearm, upper arm position at.To which EMG sensor can detecte when user's finger touches touch screen
To the action potential waveform of the muscular movement unit of user's arm, and the waveform that will test exports in electrical signal form.
Moreover, EMG sensor can be worn at the one of arm, for example, EMG sensor it is wearable at wrist or
Forearm is at ancon；
More preferably, EMG sensor can also be worn on many places of arm.For example, as shown in Fig. 2, EMG sensor can be simultaneously
It is worn at wrist and forearm is at ancon.Wherein, when EMG sensor is worn on many places of arm, intelligence can be improved and set
The accuracy of identification of the standby finger to touching touch screen.
In practical application, for convenience of wearing, EMG sensor can be ring structure.Moreover, to guarantee the accurate of finger identification
Degree, EMG sensor includes circumferentially distributed multi-group electrode.For example, with reference to Fig. 2, the EMG sensor for being worn on fore-arm includes 11
(Ch1 to Ch11), be worn on the EMG sensor at wrist includes 7 groups of electrode (Ch12 to Ch18) to group electrode.
In this step, smart machine can receive user when the finger for detecting user touches the touch screen of this equipment
It is worn on the electric signal that the EMG sensor of arm is sent.More preferably, it can be integrated in EMG sensor and electricity is sent wirelessly
The wireless communication unit of signal, so that electric signal wirelessly can be sent to smart machine by EMG sensor.Wireless communication is single
It is first specifically to can be bluetooth unit.In addition, further include power supply unit in EMG sensor, such as battery power supply unit.
S102: smart machine identifies received electric signal.
Specifically, smart machine, can be according to reception after the electric signal that the EMG sensor for receiving user's wearing is sent
Electric signal identify the pressing dynamics of the finger of finger and/or user that user touches on the touchscreen on the touchscreen.
In this step, smart machine can identify that user touches used hand on the touchscreen according to existing method
Refer to.Specifically, smart machine, which can be filtered received electric signal, (filters industrial frequency AC signal, removes DC component, drop
Make an uproar), feature extraction (time domain, frequency domain), after feature selecting (reduce characteristic dimension), identify that user is touching according to the feature of selection
Touch finger used in touching on screen.For example, Fig. 3 shows the waveform diagram of the raw electrical signal of EMG output；Fig. 4 is shown pair
EMG output raw electrical signal be filtered after waveform diagram.Fig. 5 a shows collected when finger A touching touch screen
The waveform diagram of EMG signal, Figure 5b shows that EMG signals collected when finger B (being different from finger A) touching touch screen
Waveform diagram.In Fig. 5 a, 5b, abscissa indicates the time, and ordinate indicates signal strength；The different three curves difference of amplitude
Represent the collected three-aisled EMG signal waveform of three groups of electrodes in EMG sensor.Wherein, the magnitude relation in different channels,
Signal spectrum different from.
More preferably, to guarantee to identify accuracy, can train a part classification device in advance, smart machine uses instruction in advance
Experienced part classification device, electric signal identifies the finger that user touches on the touchscreen based on the received.Specifically, smart machine
Received electric signal can be filtered, feature extraction, after feature selecting, part classification device trained in advance be used to carry out finger
Identification.
Wherein, a kind of specific method of training component classifier can be such that
For each finger, using the movement of EMG sensor sensing finger touching plane, and the EMG sensing is extracted
After the signal characteristic of the electric signal of device output, the signal characteristic of extraction is demarcated after the information of the finger as training sample；Its
In, the information of the finger of the corresponding signal characteristic calibration extracted can be the title of finger；
Classifier is trained using obtained training sample, obtains the part classification device.
Further, it is contemplated that when same finger touching touch screen, when the pressing dynamics difference of finger, EMG sensor is defeated
The feature of electric signal out is different (referring to Fig. 6)；Therefore, smart machine can also electric signal based on the received, determine finger
Pressing dynamics on the touchscreen.Fig. 6 shows and collects EMG signal when pressing ten times on the touchscreen using same finger
Waveform；Wherein, every group of wave crest indicates primary pressing.As can be seen that when repeatedly being pressed using same finger, EMG signal tool
There are similar features, but there is visibly different intensity (amplitude) therefore finger can be identified in touch screen by EMG signal
On pressing dynamics.
In fact, can touched with training component classifier to finger in the training process of above-mentioned part classification device
The pressing dynamics touched on screen are identified.Intelligent recognition can determine that finger is touching by part classification device trained in advance as a result,
Touch the pressing dynamics on screen.
S103: smart machine combines user to touch the location information of touch screen according to the information identified, determines user
Operation after responded.
Specifically, smart machine is touched according to the finger and/or pressing dynamics identified in above-mentioned steps S102 in conjunction with user
The location information for touching touch screen determines the operation of user.
In practical application, smart machine can detect whether to preset after the finger for identifying touching touch screen
The specific operation for being associated with the finger；If so, the finger then touching the location information of touch screen according to finger and identifying
Associated specific operation determines the operation of user；If being touched and being touched according to finger no, directly as the prior art
The location information of screen determines the operation of user.
The present invention identified by finger, it can be achieved that when different finger touches the same position of touch screen, is realized different defeated
Enter, so as to greatly improve the effective display area of screen.Referring to Figure 17, Figure 17 shows the forward and backward display screens of the application present invention
The contrast schematic diagram of the effective display area of curtain.
Further, smart machine can be combined with the pressing dynamics of finger in the operation for determining user.
Be described in detail below by several specific examples, in the present invention smart machine how according to the finger identified simultaneously
The operation of user is determined in conjunction with the location information of finger touching touch screen, and how the pressing dynamics of finger to be combined to determine user
Operation.
Example 1
Smart machine when touch screen shows dummy keyboard, believe by the position that touch screen can be touched according to the finger of user
Breath determines the letter that user clicks；And determine that letter is upper case or lower case according to the finger identified.
Determine that user inputs capitalization when presetting user using finger A touching letter key for example, with reference to Fig. 7,
When touching letter key using finger B, determine that user inputs lowercase.
In the prior art, when user's input capitalization, need first to click Caps Lock (such as shift key), then point
Hit corresponding letter key；If user inputs lowercase again, also need to click Caps Lock, then click corresponding letter key.
And in the present invention, user is when carrying out the input of upper case or lower case letter, it is no longer necessary to which user clicks capital and small letter switching
Key (such as shift key), reduces user's operation, improves user's operation experience, especially in the case where capital and small letter Mixed design,
The operation of user can be significantly simplified.Moreover, smart machine of the invention can be not provided with Caps Lock, screen is improved
Effective display area.
Example 2
Smart machine is when touch screen shows dummy keyboard, if being determined according to the location information that user's finger touches touch screen
User clicks delete key, then according to the finger that identifies determine deletion object that user specifies be a character or a word,
Or a sentence or a paragraph or full text.
A character is deleted when presetting user using finger A touching delete key for example, with reference to Fig. 7；Use finger B
When touching delete key, a word is deleted；When touching delete key using finger C, a sentence is deleted；It is deleted using finger D touching
When except key, a paragraph is deleted；When touching delete key using finger E, full text is deleted.
In the prior art, it if user deletes for the text of input, can be carried out word for word by clicking delete key
It deletes, can also quickly be deleted by long-pressing delete key, or click delete key after choosing the content of deletion；Regardless of which kind of side
Formula operates all more cumbersome.
And in the present invention, user can touch delete key by using different fingers to carry out a word, a word, one
Sentence, a paragraph, deletion of full text etc., it is simple to operate.
Example 3
Smart machine when touch screen shows contact person interface, believe by the position that touch screen can be touched according to user's finger
Breath determines the contact person that user clicks；And determine that user opens the contact information or calls the connection according to the finger identified
It is people or hair message to the contact person.
Respective contacts information is opened when presetting user using finger A touching contact person for example, with reference to Fig. 8；Make
When touching contact person with finger B, respective contacts are called；When touching contact person using finger C, corresponding connection is sent messages to
People.
In the prior art, when user's call contact or hair message are to contact person, need first to open contact information, then
Select call contact or hair message to contact person.
And in the present invention, different fingers can be used to complete to open contact person, call contact or hair message to connection for user
It is people, it is simple to operate.
Example 4
Smart machine can touch the location information of touch screen when touch screen shows browser interface according to user's finger
Determine the link that user clicks；And according to the finger identified determine one key of user open the link or collect the link or
New Shipping Options Page opens the link.
For example, with reference to Fig. 9, when can preset user using finger A touching link, a key opens respective links；Make
When touching link with finger B, respective links are opened in Shipping Options Page；When touching link using finger C, respective links are collected.
Equally, operation when linking is opened this invention simplifies user's collection or in new Shipping Options Page.
Example 5
Smart machine is when touch screen shows picture application interface, if touching the location information of touch screen according to user's finger
It determines that user clicks picture application interface, then according to the finger identified, determines that user calls paintbrush tool or eraser；
And during user uses paintbrush tool/eraser, according to the pressing dynamics of the finger identified, paintbrush tool is adjusted
Thickness/eraser size.
For example, with reference to Figure 10, when user clicks picture application interface using finger A, determines that user calls paintbrush tool, make
When clicking picture application interface with finger B, determine that user calls eraser.
Referring to Figure 11, during user uses paintbrush tool, can be adjusted according to the pressing dynamics of the finger identified
The thickness of paintbrush tool, paintbrush tool is thinner when touching such as finger, and paintbrush tool is thicker when finger weight.
Example 6
Smart machine is when touch screen shows map application interface, if touching the location information of touch screen according to user's finger
It determines that user clicks map and amplifies/reduce key, then according to the pressing dynamics of the finger identified, determines amplification/diminution explicitly
The multiple of figure.
For example, with reference to Figure 12, user using finger touch map amplify/reduce key when, single times of amplification/diminution is explicitly
Figure, weight map amplifies/when reducing key, more times of amplifications/diminution shows map.
Further, with the application of the invention, also map enlargement key and map can be reduced key merges into a map scaling key, intelligence
Energy equipment is when touch screen shows map application interface, if determining user's point according to the location information that user's finger touches touch screen
Scaling key is hit, then amplification display map is determined according to the finger identified or reduces display map.
Further, it is also possible to when different finger touching touch screens are set, it is corresponding to realize that map is mobile, map amplifies, map
The function of reducing, go to this.That is, smart machine touch screen show map application interface when, can also touch screen explicitly
When figure application interface, if determining that user clicks appointing in map application interface according to the location information that user's finger touches touch screen
One position then determines user's moving map, amplification display map according to the finger that identifies, reduces display map, by the position
It is set as destination.
For example, with reference to Figure 13, for any position at map application interface, moving map when user is touched using finger A,
Amplification display map when being touched using finger B, reduces display map, by the position when touching using finger D when touching using finger C
It installs and (is gone to this) for destination.
In the prior art, usually using referring to that zooming in or out for map is realized in touching, intelligence lesser for screen is set more
It is standby, such as watch, refer to that touching is easy to block screen display content more.
And by the present invention in that touch touch screen with different finger, it can realize and zoom in or out display map, operate
Simply, and not serious screen is easily caused to block.
The prior art realizes pressure sensitive often through time writer (or writing pencil), and time writer is easily lost and interacts not enough
It is natural.And the present invention can be by, in the pressing dynamics of touch screen, determining the multiple that map zooms in or out to finger, interactive mode
Naturally, convenient and simple.
Example 7
Smart machine is when touch screen shows media player interface, if being believed according to the position that user's finger touches touch screen
It ceases and determines that user clicks skip forward/back key, then according to the pressing dynamics of the finger identified, adjust the speed of F.F. or rewind.
For example, with reference to Figure 14, when user touches skip forward/back key using finger, low speed skip forward/back, weight F.F./fast
When backspace key, high speed skip forward/back.
Further, with the application of the invention, skip forward/back key can also be merged into a fast backspace key, smart machine is in touch screen
When showing media player interface, if determining that user clicks fast backspace key according to the location information that user's finger touches touch screen,
F.F. or rewind are determined according to the finger identified.
Example 8
Smart machine is when touch screen shows media player interface, if being believed according to the position that user's finger touches touch screen
It ceases and determines that user clicks volume key, then the finger that basis identifies is determining to be increased volume or reduce volume；And according to identifying
The pressing dynamics of finger, determine increase or reduce volume number.
Smart machine is when touch screen shows media player interface, if being believed according to the position that user's finger touches touch screen
It ceases and determines down key in user's click, then the upper media file of broadcasting is determined according to the finger identified or play next media text
Part.
For example, Figure 15 shows a kind of display interface of wearable smart machine, when user is using finger A touching volume key
Increase volume, reduces volume when touching volume key using finger B；When user is using finger A touching file switch key, upper one is played
A media file plays next media file when touching file switch key using finger B.
Example 9
When the finger that smart machine identifies is specific finger, directly believed according to the position that user's finger touches touch screen
Breath, determines the operation of user；When the finger that smart machine identifies is not specific finger, according to the finger identified, determine
The operation of user is to return to upper level or return to main screen or open application menu out.
For example, with reference to Figure 16, when user is using specific finger A touching touch screen, directly as the prior art, according to
Family finger touches the location information of touch screen, determines the operation of user, i.e. user realizes normal operations using finger A touching；Make
When touching touch screen with finger B, upper level is returned；Main screen is returned when touching touch screen using finger C；It is touched using finger D
Application menu is opened when touching screen.
Application in this example 9 is particularly suitable for smart phone.
It, can be by adding different labels on different keys or using not in order to improve the ease for use of display interface
Same color, to prompt user to realize the required finger of function of the key.
Operation response method based on above-mentioned smart machine, the structural representation of smart machine provided in an embodiment of the present invention
Figure, as shown in figure 18, comprising: signal receiving module 1801, operation acknowledgement module 1802 and respond module 1803.
Signal receiving module 1801 is used to receive the electric signal that the electromyogram EMG sensor of user's wearing is sent.
Operation acknowledgement module 1802 is used for according to the received electric signal of signal receiving module 1801, and user is combined to touch institute
The location information for stating touch screen determines the operation of user.
Respond module 1803 responds the operation of the user determined accordingly.
More preferably, the block schematic illustration for operating the internal structure of determining module 1802 is as shown in figure 19, specifically includes: signal
Recognition unit 1901 and information combining unit 1902.
Signal identification unit 1901 is used to identify that user is touching according to the received electric signal of signal receiving module 1801
The pressing dynamics of the finger of the finger and/or user that are touched on screen on the touchscreen.
Information combining unit 1902 is used to touch touch screen in conjunction with user according to the finger and/or pressing dynamics identified
Location information, determine the operation of user.
More preferably, above-mentioned smart machine may also include classifier training module 1804.
Classifier training module 1804 is used to obtain the sample electric signal of EMG sensor acquisition, extracts sample electric signal
Signal characteristic；According to the corresponding finger information of sample electric signal, the signal characteristic of extraction is demarcated；It is special according to the signal of calibration
Sign is trained classifier, obtains part classification device.
Correspondingly, the signal identification unit 1901 in operation acknowledgement module 1802 specifically can be according to signal receiving module
1801 received electric signals identify the pressing dynamics of the finger of user on the touchscreen；And/or utilize classifier training module
The 1804 part classification devices trained in advance, electric signal identifies the finger that user touches on the touchscreen based on the received.
Further, above-mentioned smart machine may also include that the above-mentioned EMG sensor for being worn on user's arm (in figure not
Mark).In other words, EMG sensor is set in smart machine as a signal transmitting module.
Moreover, more preferably, EMG sensor is ring structure, including circumferentially distributed multi-group electrode, and it is integrated with wireless
Mode sends the wireless communication unit of electric signal.
In practical application, the information combining unit 1902 in smart machine in operation acknowledgement module 1802 is not, it can be achieved that but
It is limited to the multiple functions as described in example 1 to 9.
For example, information combining unit 1902 can be used for being touched and being touched according to user's finger when touch screen shows dummy keyboard
The location information for touching screen determines the letter that user clicks；And it is determined according to the finger identified described alphabetical for capitalization or small
It writes.
Information combining unit 1902 can be used for when touch screen shows dummy keyboard, if touching touch screen according to user's finger
Location information determine that user clicks delete key, then determine that the deletion object that user specifies is a word according to the finger that identifies
Symbol or a word or a sentence or a paragraph or full text.
Information combining unit 1902 can be used for touching touch screen according to user's finger when touch screen shows contact person interface
Location information determine user click contact person；And according to the finger identified determine user open the contact information,
Or the calling contact person or hair message give the contact person.
Information combining unit 1902 can be used for touching touch screen according to user's finger when touch screen shows browser interface
Location information determine user click link；And determine that one key of user opens the link or receipts according to the finger identified
It hides the link or opens the link in new Shipping Options Page.
Information combining unit 1902 can be used for touching when touch screen shows picture application interface if being touched according to user's finger
The location information for touching screen determines that user clicks picture application interface, then according to the finger identified, determines that user calls paintbrush work
Tool or eraser；And during user uses paintbrush tool/eraser, according to the pressing force of the finger identified
Degree, adjusts thickness/rubber size of paintbrush.
Information combining unit 1902 can be used for touching when touch screen shows map application interface if being touched according to user's finger
The location information for touching screen determines that user clicks map and amplifies/reduce key, then according to the pressing dynamics of the finger identified, determination is put
Greatly/reduce the multiple for showing map.
Information combining unit 1902 can be used for when touch screen shows media player interface, if being touched according to user's finger
The location information of touch screen determines that user clicks skip forward/back key, then according to the pressing dynamics of the finger identified, adjustment is fast
Into the speed of/rewind.
Information combining unit 1902 can be used for when touch screen shows media player interface, if being determined according to location information
User clicks volume key, then is determined according to the finger identified and increase volume or reduction volume；And according to the finger identified
Pressing dynamics, determine increase or reduce volume number.
Information combining unit 1902 can be used for when touch screen shows media player interface, if being touched according to user's finger
The location information of touch screen determines that user clicks file switch key, then is determined according to the finger identified and play upper media text
Part plays next media file.
Information combining unit 1902 can be used for being touched when determining the finger identified is specific finger according to user's finger
The location information of touch screen determines the operation of user；When determining the finger identified is not specific finger, according to what is identified
Finger determines the operation of user to return to upper level or returning to main screen or opening application menu.
The function of each module in smart machine of the invention or the implementation of function, can refer to above-mentioned smart machine
Content described in each step of response method is operated, details are not described herein again.
In technical solution of the present invention, when user touches the touch screen of smart machine, smart machine can wear according to user
The electric signal for the EMG sensor output worn, the location information of touch screen is touched in conjunction with user, carries out phase after determining the operation of user
The response answered.Therefore, with the application of the invention, user can realize not when using the same position of different fingers touching touch screen
With input, simplify it is some such as mostly finger touching, long-pressing, Macintosh complex operations, it is avoidable that screen is blocked, more
User is facilitated to carry out input control to smart machine, the user experience is improved.Moreover, the present invention can also be achieved finger to touch screen
Pressing dynamics identification, it is many applied to picture, map, media player etc. in application, greatly strengthening user experience.
Those skilled in the art of the present technique are appreciated that the present invention includes being related to for executing in operation described herein
One or more equipment.These equipment can specially design and manufacture for required purpose, or also may include general
Known device in computer.These equipment have the computer program being stored in it, these computer programs are selectively
Activation or reconstruct.Such computer program can be stored in equipment (for example, computer) readable medium or be stored in
It e-command and is coupled in any kind of medium of bus respectively suitable for storage, the computer-readable medium includes but not
Be limited to any kind of disk (including floppy disk, hard disk, CD, CD-ROM and magneto-optic disk), ROM (Read-Only Memory, only
Read memory), RAM (Random Access Memory, immediately memory), EPROM (Erasable Programmable
Read-Only Memory, Erarable Programmable Read only Memory), EEPROM (Electrically Erasable
Programmable Read-Only Memory, Electrically Erasable Programmable Read-Only Memory), flash memory, magnetic card or light card
Piece.It is, readable medium includes by equipment (for example, computer) with any Jie for the form storage or transmission information that can be read
Matter.
Those skilled in the art of the present technique be appreciated that can be realized with computer program instructions these structure charts and/or
The combination of each frame and these structure charts and/or the frame in block diagram and/or flow graph in block diagram and/or flow graph.This technology neck
Field technique personnel be appreciated that these computer program instructions can be supplied to general purpose computer, special purpose computer or other
The processor of programmable data processing method is realized, to pass through the processing of computer or other programmable data processing methods
The scheme specified in frame or multiple frames of the device to execute structure chart and/or block diagram and/or flow graph disclosed by the invention.
Those skilled in the art of the present technique have been appreciated that in the present invention the various operations crossed by discussion, method, in process
Steps, measures, and schemes can be replaced, changed, combined or be deleted.Further, each with having been crossed by discussion in the present invention
Kind of operation, method, other steps, measures, and schemes in process may also be alternated, changed, rearranged, decomposed, combined or deleted.
Further, in the prior art to have and the step in various operations, method disclosed in the present invention, process, measure, scheme
It may also be alternated, changed, rearranged, decomposed, combined or deleted.
The above is only some embodiments of the invention, it is noted that for the ordinary skill people of the art
For member, various improvements and modifications may be made without departing from the principle of the present invention, these improvements and modifications are also answered
It is considered as protection scope of the present invention.
Claims (29)
1. a kind of operation response method of smart machine characterized by comprising
Receive the electric signal that the electromyogram EMG sensor that user wears is sent；
Based on the received electric signal and in conjunction with the user touch touch screen location information, determine that the operation of the user is laggard
Row response；
The electric signal based on the received and the location information that the touch screen is touched in conjunction with the user, determine the user's
Operation includes:
The finger of finger and/or user that the user that electric signal identifies based on the received touches on the touchscreen is in the touch
Pressing dynamics on screen touch the location information of the touch screen in conjunction with the user, determine the operation of the user.
2. the method as described in claim 1, which is characterized in that the telecommunications for receiving the EMG sensor that user wears and sending
After number, further includes:
Electric signal identifies the finger for the finger and/or user that the user touches on the touchscreen described based on the received
Pressing dynamics on touch screen.
3. method according to claim 1 or 2, which is characterized in that the electric signal based on the received identifies the user
The finger touched on the touchscreen, specifically includes:
Using the part classification device trained in advance, electric signal identifies what the user touched on the touchscreen based on the received
Finger.
4. method as claimed in claim 3, which is characterized in that the part classification implement body is trained according to the following method
It arrives:
For each finger, using the movement of EMG sensor sensing finger touching plane, and it is defeated to extract the EMG sensor
After the signal characteristic of electric signal out, the signal characteristic of extraction is demarcated after the information of the finger as training sample；
Classifier is trained using obtained training sample, obtains the part classification device.
5. method according to claim 1 or 2, which is characterized in that the operation of the determination user specifically includes:
When the touch screen shows dummy keyboard, according to the positional information, the letter that user clicks is determined；And
Determine that the letter is upper case or lower case according to the finger identified.
6. method according to claim 1 or 2, which is characterized in that the operation of the determination user specifically includes:
When the touch screen shows dummy keyboard, if determining according to the positional information, user clicks delete key:
According to the finger identified determine deletion object that user specifies be a character or a word or a sentence or
One paragraph or full text.
7. method according to claim 1 or 2, which is characterized in that the operation of the determination user specifically includes:
When the touch screen shows contact person interface, the contact person that user clicks is determined according to the positional information；And
Determine that user opens the contact information or the calling contact person or hair message to institute according to the finger identified
State contact person.
8. method according to claim 1 or 2, which is characterized in that the operation of the determination user specifically includes:
When the touch screen shows browser interface, the link that user clicks is determined according to the positional information；And
Determine that one key of user opens the link or the collection link or in new Shipping Options Page opening according to the finger identified
The link.
9. method according to claim 1 or 2, which is characterized in that the operation of the determination user specifically includes:
When the touch screen shows picture application interface, if determining that user clicks to draw according to the positional information applies boundary
Face, then
According to the finger identified, determine that user calls paintbrush tool or eraser；And
During user uses paintbrush tool/eraser, according to the pressing dynamics of the finger identified, paintbrush is adjusted
Thickness/rubber size.
10. method according to claim 1 or 2, which is characterized in that the operation of the determination user specifically includes:
When the touch screen shows map application interface, if determining according to the positional information, user clicks map amplification/contracting
Small key, then:
According to the pressing dynamics of the finger identified, determine that amplification/diminution shows the multiple of map.
11. method according to claim 1 or 2, which is characterized in that the operation of the determination user specifically includes:
When the touch screen shows media player interface, if determining according to the positional information, user clicks skip forward/back
Key, then
According to the pressing dynamics of the finger identified, the speed of skip forward/back is adjusted.
12. method according to claim 1 or 2, which is characterized in that the operation of the determination user specifically includes:
When the touch screen shows media player interface, if determining according to the positional information, user clicks volume key,
It is determined according to the finger identified and increases volume or reduction volume；And
According to the pressing dynamics of the finger identified, determine increase or reduce volume number.
13. method according to claim 1 or 2, which is characterized in that the operation of the determination user specifically includes:
When the touch screen shows media player interface, if determining according to the positional information, user clicks file switching
Key, then
It is determined according to the finger identified and plays a upper media file or the next media file of broadcasting.
14. method according to claim 1 or 2, which is characterized in that the operation of the determination user specifically includes:
When the finger identified is specific finger, according to the positional information, the operation of the user is determined；
When the finger identified is not specific finger, according to the finger identified, the operation of user is determined to return to upper one
Grade returns to main screen or opens application menu.
15. method according to claim 1 or 2, which is characterized in that the EMG sensor is ring structure, including circumferential direction point
The multi-group electrode of cloth, and it is integrated with the wireless communication unit that electric signal is sent wirelessly.
16. method according to claim 1 or 2, which is characterized in that the EMG sensor is worn at following at least one: institute
State wrist, the forearm, upper arm of user.
17. method according to claim 1 or 2, which is characterized in that
Determine that user inputs based on the electric signal that the EMG sensor is sensed when wearing on the arm of user；
Wherein, the EMG sensor is configurable for detecting the potential waveform detected for touching the muscles of the arm, and is based on
Potential waveform detected exports the electric signal.
18. a kind of smart machine characterized by comprising
Signal receiving module, the electric signal that the EMG sensor for receiving user's wearing is sent；
Operation acknowledgement module, for touching touch according to the received electric signal of the signal receiving module, and in conjunction with the user
The location information of screen determines the operation of the user；
Respond module is responded for the operation to the user determined；
The operation acknowledgement module specifically includes:
Information combining unit, for touching the touch screen in conjunction with the user according to the finger and/or pressing dynamics identified
Location information, determine the operation of the user.
19. equipment as claimed in claim 18, which is characterized in that the operation acknowledgement module is specific further include:
Signal identification unit, for identifying the user in touch screen according to the received electric signal of the signal receiving module
The pressing dynamics of the finger of upper touch and/or the finger of user on the touch screen.
20. equipment as claimed in claim 18, which is characterized in that
The signal identification unit is specifically used for identifying the finger of user according to the received electric signal of the signal receiving module
Pressing dynamics on the touch screen；And/or using the part classification device trained in advance, electric signal is identified based on the received
The finger that the user touches on the touchscreen out.
21. equipment as claimed in claim 20, which is characterized in that further include:
Classifier training module extracts the letter of sample electric signal for obtaining the sample electric signal of the EMG sensor acquisition
Number feature；According to the corresponding finger information of sample electric signal, the signal characteristic of extraction is demarcated；According to the signal characteristic of calibration to point
Class device is trained, and obtains the part classification device.
22. the equipment as described in claim 19-21 is any, which is characterized in that
The information combining unit is specifically used for according to the positional information, determining when the touch screen shows dummy keyboard
The letter that user clicks out；And determine that the letter is upper case or lower case according to the finger identified.
23. the equipment as described in claim 19-21 is any, which is characterized in that
The information combining unit is specifically used for when the touch screen shows dummy keyboard, if determining according to the positional information
User clicks delete key, then according to the finger that identifies determine deletion object that user specifies be a character or a word,
Or a sentence or a paragraph or full text.
24. the equipment as described in claim 19-21 is any, which is characterized in that
The information combining unit is specifically used for when the touch screen shows map application interface, if according to the positional information
It determines that user clicks map and amplifies/reduce key, then according to the pressing dynamics of the finger identified, determines amplification/diminution explicitly
The multiple of figure.
25. the equipment as described in claim 19-21 is any, which is characterized in that
The information combining unit is specifically used for when the touch screen shows media player interface, if being believed according to the position
It ceases and determines that user clicks volume key, then the finger that basis identifies is determining to be increased volume or reduce volume；And according to identifying
The pressing dynamics of finger, determine increase or reduce volume number.
26. the equipment as described in claim 18-21 is any, which is characterized in that further include: the EMG sensor；
The EMG sensor is ring structure, including circumferentially distributed multi-group electrode, and is integrated with and telecommunications is sent wirelessly
Number wireless communication unit.
27. smart machine according to claim 18, which is characterized in that based on the EMG sensor user arm
The electric signal sensed when upper wearing come determine user input,
Wherein, the EMG sensor is configurable for detecting the potential waveform detected for touching the muscles of the arm, and is based on
Potential waveform detected exports the electric signal.
28. a kind of smart machine characterized by comprising
Processor；
Memory, for storing program；
The processor is used to execute the operation response that described program realizes the described in any item smart machines of claim 1-17
Method.
29. a kind of computer readable storage medium, which is characterized in that the storage medium is stored at least one instruction, at least
One Duan Chengxu, code set or instruction set, at least one instruction, an at least Duan Chengxu, the code set or instruction set
Loaded by processor and executed the operation response method to realize the smart machine as described in claim 1 to 17 is any.
Priority Applications (3)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201510083694.4A CN105988695B (en) | 2015-02-16 | 2015-02-16 | Smart machine and its operation response method |
| KR1020150132868A KR102094751B1 (en) | 2015-02-16 | 2015-09-21 | Method and apparatus for providing user interface |
| US15/016,673 US9946395B2 (en) | 2015-02-16 | 2016-02-05 | User interface method and apparatus |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201510083694.4A CN105988695B (en) | 2015-02-16 | 2015-02-16 | Smart machine and its operation response method |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN105988695A CN105988695A (en) | 2016-10-05 |
| CN105988695B true CN105988695B (en) | 2019-06-28 |
Family
ID=56884262
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201510083694.4A Active CN105988695B (en) | 2015-02-16 | 2015-02-16 | Smart machine and its operation response method |
Country Status (2)
| Country | Link |
|---|---|
| KR (1) | KR102094751B1 (en) |
| CN (1) | CN105988695B (en) |
Families Citing this family (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN106775430A (en) | 2017-03-30 | 2017-05-31 | 维沃移动通信有限公司 | The characters input method and mobile terminal of a kind of mobile terminal |
| CN112162689B (en) * | 2020-09-18 | 2022-03-04 | 维沃移动通信有限公司 | Input method and device and electronic equipment |
Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101819464A (en) * | 2009-02-27 | 2010-09-01 | 株式会社电装 | Wearable electrical apparatus |
| CN102866843A (en) * | 2011-06-29 | 2013-01-09 | Lg电子株式会社 | Mobile terminal with at least a body sensor |
| CN103442129A (en) * | 2013-08-09 | 2013-12-11 | 宇龙计算机通信科技(深圳)有限公司 | Interactive method and system between intelligent watch and mobile terminal |
Family Cites Families (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| KR100994408B1 (en) * | 2008-11-19 | 2010-11-16 | 한국과학기술원 | Method and device for deducting pinch force, method and device for discriminating muscle to deduct pinch force |
| KR102087137B1 (en) * | 2013-03-15 | 2020-03-10 | 엘지전자 주식회사 | Control device and control method thereof |
| US9223459B2 (en) * | 2013-01-25 | 2015-12-29 | University Of Washington Through Its Center For Commercialization | Using neural signals to drive touch screen devices |
| US9170676B2 (en) * | 2013-03-15 | 2015-10-27 | Qualcomm Incorporated | Enhancing touch inputs with gestures |
| KR102129464B1 (en) * | 2013-07-01 | 2020-07-03 | 엘지전자 주식회사 | Display device and control method thereof |
-
2015
- 2015-02-16 CN CN201510083694.4A patent/CN105988695B/en active Active
- 2015-09-21 KR KR1020150132868A patent/KR102094751B1/en active IP Right Grant
Patent Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101819464A (en) * | 2009-02-27 | 2010-09-01 | 株式会社电装 | Wearable electrical apparatus |
| CN102866843A (en) * | 2011-06-29 | 2013-01-09 | Lg电子株式会社 | Mobile terminal with at least a body sensor |
| CN103442129A (en) * | 2013-08-09 | 2013-12-11 | 宇龙计算机通信科技(深圳)有限公司 | Interactive method and system between intelligent watch and mobile terminal |
Also Published As
| Publication number | Publication date |
|---|---|
| KR20160100789A (en) | 2016-08-24 |
| CN105988695A (en) | 2016-10-05 |
| KR102094751B1 (en) | 2020-03-30 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US9946395B2 (en) | User interface method and apparatus | |
| KR20130023954A (en) | Apparatus and method for changing icon in portable terminal | |
| CN104238927B (en) | The control method and device of intelligent terminal application program | |
| US20110258523A1 (en) | Electronic reading apparatus and method for flipping through displayed files | |
| CN103513910A (en) | Information processing method and device and electronic equipment | |
| CN103885596A (en) | Information processing method and electronic device | |
| CN101452354B (en) | Input method of electronic device, content display method and use thereof | |
| CN104541239A (en) | Text select and enter | |
| CN106325663B (en) | Mobile terminal and its screenshotss method | |
| CN102654821B (en) | A kind of localization of text light target method and device | |
| CN103197885A (en) | Method for controlling mobile terminal and mobile terminal thereof | |
| CN106502493A (en) | A kind of multi-screen display method and terminal | |
| CN110618969B (en) | Icon display method and electronic equipment | |
| US9747020B2 (en) | Information transmitting method, device and terminal | |
| CN108475161A (en) | Display methods and terminal | |
| CN109194815A (en) | Operating method, device and computer readable storage medium based on multi-screen terminal | |
| KR20150023151A (en) | Electronic device and method for executing application thereof | |
| CN104216648A (en) | Information input method and device | |
| US9274632B2 (en) | Portable electronic device, touch operation processing method, and program | |
| CN106648707A (en) | Collecting method and collecting system of intelligent terminal application information and intelligent terminal | |
| CN105988695B (en) | Smart machine and its operation response method | |
| CN105843523A (en) | Information processing method and apparatus | |
| CN103176594B (en) | A kind of text maninulation method and system | |
| CN106201295A (en) | A kind of message clone method and device and intelligent terminal | |
| CN105183280A (en) | Operation method for list interface and electronic terminal |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |