CN101266516A - Layout customized intelligent human-machine interface device - Google Patents
Layout customized intelligent human-machine interface device Download PDFInfo
- Publication number
- CN101266516A CN101266516A CNA200810018030XA CN200810018030A CN101266516A CN 101266516 A CN101266516 A CN 101266516A CN A200810018030X A CNA200810018030X A CN A200810018030XA CN 200810018030 A CN200810018030 A CN 200810018030A CN 101266516 A CN101266516 A CN 101266516A
- Authority
- CN
- China
- Prior art keywords
- interface device
- human interface
- man
- mouse
- finger
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Images
Landscapes
- Position Input By Displaying (AREA)
- User Interface Of Digital Computer (AREA)
Abstract
The invention relates to an intelligent man-machine interface device for integrating and substituting the existing a plurality of peripheral equipments of computer such as key-board, mouses, writing pads, sketching board, game peripherals, MIDI keyboard, etc., especially discloses a concept, principle and implementing method of made-to-order layout intelligent man-machine interface device. The man-machine interface device uses the LCD display operations interface to percept the finger movement in a contact or non-contact manner, interpret into corresponding control signals, and load in the computer main unit from interfaces, thereby completing the operations to the operating system or corresponding software. The man-machine interface device is preset with a plurality of man-machine interface layouts, users can use the operations element provided by the system to set up special purpose man-machine interface layouts according to their preference and requirements, or can use the special purpose setting layout provided for software. Users can switch from the man-machine interface layouts. The man-machine interface device adopts a multi-point triggering technique, can recognize single finger complicated operations, multiple finger operations and both hands simultaneous operation.
Description
Technical field
The present invention relates to a kind of intelligent human-machine interface device that is used to replace active computer keyboard, mouse and other external units, disclose a kind of notion, principle, and implementation method of layout customized intelligent human-machine interface device especially.
Background technology
After first invention on computer, computer technology has obtained the development of advancing by leaps and bounds in short decades.The progress of electronic technology probably promotes the processing speed of semi-conductor chip with the speed of Moore's Law.The performance of operation system of computer and various softwares and function make that the hardware and software of present computing machine has not been the apperance when being born fully also from strength to strength.By comparison, the main man-machine interface of computing machine---keyboard and mouse---has then continued initial structure and use-pattern.Invent in mouse in 1964, adopted the design of two orthogonal roller location; The button keyboard comes from the typewriter keyboard of invention in 1868, only has been transplanted on the computing machine in 20th century.Traditional keyboard and mouse can not well support computer to play the part of roles such as following home entertainment center, multimedia hub, efficient operation instrument.
For a long time, the mentality of designing of software is to allow the user make great efforts the specific operation mode of thinking of adaptive system.Along with the raising of performance, computing machine can spare more computing power and provide more humane man-machine interface to the user.The developing direction of man-machine interface is to allow systems attempt adapt to user's custom, allows the user to handle the mode of thinking and the virtual world interaction of things under the true environment.Force feedback technology, 3D operating system, virtual reality, image recognition, speech recognition, idea control, touching technique etc. are quietly changing the human-computer interaction mode.As seen, the innovation of traditional man-machine interface is carried out.
Present mouse action can only carry out with one hand.The user's rolling mouse and the button of clicking the mouse, in order to trigger menu on the screen, in the recreation the firearms trigger or in virtual reality, pull article---but these are only limited to one-handed performance.Under most of situation, it is idle that a hand is always arranged.This inconvenience in true environment, can only be used manual a work equally like people.If can allow both hands cooperate, just can finish more compound actions, thereby make operation more efficient.Such as, two hands cooperate rotation or amplification to dwindle a pictures; File is selected and is dragged in a picking, and the another hand is signed on this document.
More and more with the mode of computing machine interaction, people wish that a kind of human interface device just can replace multiple human interface devices such as existing keyboard, mouse, handwriting pad, plotting sheet, recreation peripheral hardware, MIDI keyboard.Simultaneously, people need a kind of can following according to the user to use preference and needs, the human interface device of customization operations layout.For example, open certain popular software by a key; Progress and volume with slider bar and knob controlling player; At the self-defining keyboard special layout of certain software setting; Change size, position, shape, color, the literal of button; Specific one hand is set or the both hands finger movement is finished special operational etc.
Widely used single-point touches technology, brought very big restriction to operation---synchronization can only respond a finger manipulation.The multiple point touching technology can make the more finger movement combination of system identification, or even the bimanualness that the present invention relates to.
Non-touching technique has been abandoned traditional push type touch sensor, adopts modes such as image, ultrasonic, infrared, laser, electromagnetic field to discern finger movement.The user does not need contact arrangement itself, as long as execution high up in the air in the sensor-triggered district just can be identified and convert to corresponding operating.The rational Application of non-touching technique brings huge change can for the human-computer interaction mode.
Summary of the invention
The invention belongs to the computer man-machine interfacing equipment, it can integrate and replace plurality of devices such as active computer keyboard, mouse, handwriting pad, plotting sheet, recreation peripheral hardware, MIDI keyboard, and can be according to user and software needs, the man-machine interface layout that customization is special-purpose.
The computer man-machine interfacing equipment that the present invention relates to, a LCD is arranged, be used for the man-machine interface picture of display simulation, comprise: pictures such as the button of Control-Menu, text prompt, picture prompting, system intialization or customization, knob, slider bar, thumb wheel.Pseudo operation buttons such as button wherein, knob, slider bar, thumb wheel are called as the operation element in the present invention.After the user sees picture, trigger and operate the sensor of elements correlation with contact or noncontact mode,, be construed to operation code, and send to main frame by interface by the identification of the treatment circuit in the interface at trigger region.The corresponding software that moves in the main frame is interpreted as fill order with operation code, thereby finishes the control to operating system and related software.After described operation element is triggered, should operates element with feedback form such as animation, highlighted, flicker or prompt tone prompting user and be triggered.Described human interface device is provided with the switch or the knob of layout conversion, and the user can be switched in various man-machine interface layouts.
Human interface device of the present invention has preset some cover man-machine interface layouts, as the standard computer keyboard layout, and media player layout, MIDI keyboard layout, game machine peripheral hardware layout, dancing machine layout, networking telephone layout etc.The man-machine interface layout that presets also can be edited, and change, interpolation or deletion action element are to generate customized layout.For example the user can increase extra function button on the basis of standard keyboard layout, formulates function to increase.The user also can utilize described operation element according to preference and needs, is combined into the layout of the needs of oneself.Described operation element can be placed and be presented at the optional position of viewing area, and simultaneously, features such as the size of operation element, shape, direction, color, embedded literal can be edited.For example, in order to customize a networking telephone dialing keyboard, user's holder from the operation element is dragged several buttons to the screen position, on button, add " 0 " and arrive " 9 ", and " * ", " # ", " dialing ", " redialing " and " hanging up " such prompt text, add a volume slider again, at last these operation elements are corresponded on the associative operation of network telephone software and operating system.The dedicated custom layout that application software also can provide them to provide for the user is to improve user's operating efficiency.For example certain photo-editing software provides a cover to make things convenient for picture editor's keyboard, downloads in the human interface device with the interface of document form by described human interface device and computing machine, and the user just can be provided by the keyboard special layout that provides for this software.
Human interface device of the present invention can adopt contact or noncontact mode to discern user's finger motion.In the contact implementation, user's finger need contact the touch sensor of human interface device could be perceived.Touch sensor is positioned on the LCD.User's finger contacts is during to the touch sensor of operation on the element, and this action is interpreted into the user and has triggered this operation element.In contactless implementation, user's finger need not contact human interface device, and its action just can be perceived.Human interface device adopts modes such as image recognition, ultrasonic, infrared, laser, electromagnetic field to discern finger movement.When user's finger moved in trigger region, finger movement can be identified.
Human interface device of the present invention is construed to the corresponding codes signal with user's finger movement, is transferred to main frame by interface; But the also signal that sends to human interface device of receiving computer main frame simultaneously.The form of interface can be a wired connection, also can be wireless connections.Wireless connections can allow the user operate from main frame place far away.
Human interface device of the present invention can be discerned the multiple action of user's finger.Comprise: click, double-click, linear slide, curve slip etc., and by the compound action of these elemental motions combinations.System intialization or more user-defined complicated finger movements can be identified and be construed to specific operation.Comprise that one hand refers to compound action, points compound action and both hands compound action more.For example, draw " L " type pattern, can be understood as that and close opened file or webpage.Because having adopted multiple spot triggering technique, user also is the existing compound action of being finished by many fingers.For example, two fingers move with speed to equidirectional, can be interpreted into holder and drag the file action; Two fingers rotate around certain point, can be interpreted into the rotation file; Two fingers away from each other or close are understood as that and amplify or dwindle the picture operation.The user also can the both hands cooperation finish some both hands compound action.For example, both hands are operated two files respectively; File is selected in a picking, and the another hand is operated on selected file.(annotate: some complex operations needs the support of operating system just can finish)
Control to mouse has two kinds of schemes.First kind of scheme is: open up a special mouse trigger region in the toggle area of human interface device, the finger movement of user in this zone is interpreted as the operation to mouse; Concrete method of operating is (is example with the right-hand operated mouse): user's one finger (being generally middle finger) continues to slide at trigger region, with the position of mouse beacon cursor on computer screen, when this finger left side one finger (being generally forefinger) triggers, be interpreted as the left button of clicking the mouse, when this finger right side one finger (being generally the third finger) triggers, be interpreted as the right button of clicking the mouse; Laterally during move left and right, this action is interpreted as the roll mouse roller to another finger (being generally thumb); Second kind of scheme is not for mouse is provided with special trigger region, but an effective button of mouse is set on described human interface device; When needs made mouse-based operation, a hand triggered this button, and this moment, whole trigger region all can be finished mouse action; Stop to trigger or triggering this button once more, human interface device returns to again in original layout; Identical to the concrete method of operating of mouse and first kind of scheme in second kind of scheme.
The interface of human interface device of the present invention and main frame promptly can be the wired connection mode, also can be the wireless connections mode.Wired connection mode interface is born operation signal and is sent, and host signal receives and obtain from main frame the function of electric power.Wireless connections mode interface is born operation signal and is sent, the host signal receiving function, and the battery that is carried by described human interface device provides electric power.After human interface device was not triggered in a period of time, LCD can enter the screen protection state, also can enter battery saving mode, reduced brightness or closed liquid crystal display displays, was triggered by the user up to human interface device.
Characteristics of the present invention
(1) the present invention is as a kind of brand-new intelligent human-machine interface device, integrate also and can replace existing human interface device, as keyboard, mouse, handwriting pad, plotting sheet, recreation peripheral hardware and MIDI keyboard etc., and can be according to the man-machine interface layout of user and software customized special use.
(2) human interface device that the present invention relates to can be transformed into other interface layout fast from a kind of interface layout.
The triggering mode of the human interface device that (3) the present invention relates to can adopt contact to trigger, and also can adopt contactless triggering.
(4) human interface device that the present invention relates to presets multiple man-machine interface layout.
(5) user can be according to preference and the needs of oneself, and the operation element that using system provides customizes special-purpose man-machine interface layout.
(6) human interface device that the present invention relates to can be provided by the dedicated custom layout that provides for certain software, to improve operating efficiency.
(7) human interface device that the present invention relates to adopts the multiple spot triggering technique, can discern complicated finger manipulation, and can discern both hands and operate simultaneously, allows the user to handle the mode of thinking and the computing machine interaction of things under the true environment.
(8) described human interface device is powerful, and the vision entertainment effect is outstanding.The user meets the trend of electronic product personalization with this personalized man-machine interface that can customize oneself.
Description of drawings
Fig. 1 is that the existing human interface device of described human interface device and its integration and replacement is given an example;
Fig. 2 is a kind of implementation structure of described human interface device;
Fig. 3 is described human interface device theory diagram;
Fig. 4 realizes the various scheme synoptic diagram that preset man-machine interface for described human interface device;
The described human interface device of Fig. 5 is realized the synoptic diagram of software customized placement scheme;
The described human interface device of Fig. 6 is realized a kind of network telephone software placement scheme synoptic diagram of customization;
Fig. 7 is man-machine interface layout editor one example of user to presetting;
Operation element and the operation element combinations synoptic diagram of Fig. 8 for providing in the described human interface device;
Fig. 9 refers to simple motion scheme synoptic diagram for some one hands;
Figure 10 refers to compound action scheme synoptic diagram for some one hands;
Finger movement scheme when Figure 11 is mouse action is made synoptic diagram;
Figure 12 is some many finger movements scheme synoptic diagram;
Figure 13 is some bimanualness scheme synoptic diagram.
Embodiment
The invention will be further described below in conjunction with accompanying drawing.
As shown in Figure 1, human interface device 1 of the present invention is connected with main frame 2 in wired or wireless mode.Its integration also replaces multiple existing human interface device, for example: computer keyboard 3, MIDI keyboard 4, recreation peripheral hardware 5,6,7, dancing machine 8, mouse 11, handwriting pad or plotting sheet 12 etc., and can customize special-purpose man-machine interface layout, for example networking telephone dialer 9, media player 10 etc.
Fig. 2 is a kind of implementation structure of described human interface device.Wherein, 13 is the human interface device main body.14 are layout conversion knob, and 15 are the control button.16 is LCD, and 17 is trigger region, and this trigger region can be contact and triggers, and also can be contactless triggering.
Fig. 3 is described human interface device theory diagram.The user finishes finger movement with the way of contact 18 or noncontact mode 19, the sensor senses finger movement, signal is sent into treatment circuit, treatment circuit is according to the man-machine interface layout that presets, customization layout or software customized layout control liquid crystal display displays corresponding contents, accept and the process user customization operations, obtain the data of software customized layout from interface circuit, process user finger movement signal, transmission is loaded with the data of user's operation information and sends into interface circuit, at last, interface circuit with wired 20 or wireless 21 modes user's service data is transferred to main frame.
Fig. 4 realizes the various scheme synoptic diagram that preset man-machine interface for described human interface device.Wherein, Fig. 4 (a) is the computer keyboard scheme, and Fig. 4 (b) is the MIDI keyboard plan, Fig. 4 (c) is handwriting pad or plotting sheet scheme, and Fig. 4 (d) is the game paddle scheme, and Fig. 4 (e) is a game direction dish scheme, Fig. 4 (f) is the game paddle scheme, and Fig. 4 (g) is the dancing machine scheme.
Fig. 5 realizes the synoptic diagram of software customized placement scheme for described human interface device.Wherein, Fig. 5 (a) is the software customized scheme of media play, and Fig. 5 (b) is the mapping software customized solution.
Fig. 6 is a kind of network telephone software placement scheme synoptic diagram that described human interface device is realized customization.
Fig. 7 is man-machine interface layout editor one example of user to presetting.This figure is for having added the controlling media play button presetting on the basis of computer keyboard.
Operation element and the operation element set synoptic diagram of Fig. 8 for providing in the described human interface device.Comprise button (a), knob (b), slider bar (c), thumb wheel (d), operation element combinations (e) etc.
Fig. 9 refers to the scheme synoptic diagram of simple operations for some one hands.Comprise and click (a), double-click (b), linear slide (c), curve slip (d).
Figure 10 has listed some one hands and has referred to compound action scheme synoptic diagram.These complex operations can preset by human interface device, software customized or customization is special operation.Comprise L shaped (a), shape (b), △ shape (c), zero shape (d), Z-shaped (e), V-arrangement (f).
Finger movement scheme when Figure 11 is mouse action is made synoptic diagram.Wherein, middle finger 22 slides in order to locate to cursor of mouse at trigger region, and when middle finger 22 kept triggering, forefinger 23 was clicked and finished the function of left mouse button, and the function of right mouse button is finished in nameless 24 clicks, and thumb 25 slides and finishes the function of mouse roller.
Figure 12 has listed some many finger movements scheme synoptic diagram.Wherein, Figure 12 (a) is many fingers near far away or from operation, can be used for amplifying or dwindling, and Figure 12 (b) points around certain some rotary manipulation more, can be used for rotating.
Figure 13 has listed some bimanualness scheme synoptic diagram.Wherein, the achievable operation of Figure 13 (a) both hands is different, and for example a hand rest is dragged file, and the another personal letter is write.Figure 13 (a) both hands can be finished identical operations.
This paper has carried out at length setting forth to the implementation method of described layout customized intelligent human-machine interface device.Above embodiment, use-case and illustrated implementation just are used for helping to understand core concept of the present invention, and provide possible solution to enforcement of the present invention.According to notion of the present invention, principle and method, on embodiment, all has the change part.Therefore, the mode in this instructions, use-case and embodiment should not be construed as limitation of the present invention.
Claims (8)
1, a kind of computer man-machine interfacing equipment, this equipment is used for replacing and integrating existing human interface device, comprise computer keyboard, mouse, handwriting pad, plotting sheet, recreation peripheral hardware, MIDI keyboard etc., and can be according to the man-machine interface layout of user and software customized special use; Described human interface device has a LCD, is used for the man-machine interface picture of display simulation; The triggering sensor is housed, in order to the action of perception user finger on the human interface device; When user finger when trigger region moves, this moves by sensor senses, is handled and convert to corresponding signal by internal circuit; This signal is transferred in the main frame by the interface of human interface device and computing machine, and main frame is discerned this signal, thereby finishes the operation to operating system and software; Described human interface device can switch in different equipment modes, thereby finishes the function of keyboard, mouse etc.; Human interface device has preset some cover man-machine interface layouts and has selected to use for the user, also can be according to customized layout, or software customized layout, the special-purpose human interface function who realizes customization.
2, human interface device according to claim 1, wherein, the content of described liquid crystal display displays comprises: pictures such as the button of Control-Menu, text prompt, picture prompting, system intialization or customization, knob, slider bar, thumb wheel; Pseudo operation buttons such as button wherein, knob, slider bar, thumb wheel are called as the operation element in the present invention; The operation element can be placed and be presented at the optional position in liquid crystal display displays zone; Simultaneously, features such as the size of operation element, shape, direction, color, embedded literal can be edited; Displaying contents had both comprised still frame, also comprised dynamic menu; Operation is after element is triggered, and should operate element with feedback form prompting users such as animation, highlighted, flicker or prompt tones and be triggered; Human interface device is provided with layout switch or knob, and the user can be switched in various man-machine interface layouts.
3, human interface device according to claim 1, wherein, described triggering sensor can be that contact triggers sensor, also can be contactless triggering sensor; When adopting contact to trigger sensor, this sensor is placed on the LCD; When the user touched certain operation element corresponding sensor of demonstration, sensor thought that just this operation element is triggered; When adopting contactless triggering sensor, this sensor can adopt modes such as image, ultrasound wave, infrared ray, laser, electromagnetic field to discern finger movement; The user finishes certain action after reaching to a certain degree near certain operation element, and sensor thinks that just the user operates at trigger region, so this operation element is triggered.
4, human interface device according to claim 1, wherein, the man-machine interface layout that described human interface device presets comprises: computer keyboard, mouse, handwriting pad, plotting sheet, recreation peripheral hardware, MIDI keyboard etc.; The man-machine interface layout that presets also can be edited, and change, interpolation or deletion action element are to generate customized layout; The user can be according to preference and needs, and the operation element that utilizes equipment to provide customizes oneself special-purpose man-machine interface layout; Also can download and be applied as certain software customized special-purpose man-machine interface layout.
5, human interface device according to claim 1, wherein, described user's finger movement comprises: click, double-click, linear slide, curve slip etc., and the compound action mode that makes up by these elemental motion modes; System intialization or more user-defined complicated finger movements can be identified and be construed to specific operation; Described compound action comprises: one hand refers to compound action, points compound action and both hands compound action more; Described both hands compound action, the action type that both hands are finished can be identical, also can be different; Can comprise that both hands operate two files respectively, can comprise that also a picking selects file, the another hand is operated on selected file.
6, human interface device according to claim 1 can be taked two kinds of schemes to mouse control.First kind of scheme is: open up a special mouse trigger region in the toggle area of human interface device, the finger movement of user in this zone is interpreted as the operation to mouse; Concrete method of operating is (is example with the right-hand operated mouse): user's one finger (being generally middle finger) continues to slide at trigger region, with the position of mouse beacon cursor on computer screen, when this finger left side one finger (being generally forefinger) triggers, be interpreted as the left button of clicking the mouse, when this finger right side one finger (being generally the third finger) triggers, be interpreted as the right button of clicking the mouse; Laterally during move left and right, this action is interpreted as the roll mouse roller to another finger (being generally thumb); Second kind of scheme is not for mouse is provided with special trigger region, but an effective button of mouse is set on described human interface device; When needs made mouse-based operation, a hand triggered this button, and this moment, whole trigger region all can be finished mouse action; Stop to trigger or triggering this button once more, human interface device returns to again in original layout; Identical to the concrete method of operating of mouse and first kind of scheme in second kind of scheme.
7, human interface device according to claim 1 promptly can be the wired connection mode with the interface of main frame, also can be the wireless connections mode; Described wired connection mode, interface are born operation signal and are sent, and host signal receives and obtain from main frame the function of electric power; Described wireless connections mode, interface are born operation signal and are sent, the function that host signal receives, and the battery that is carried by described human interface device provides electric power.
8, human interface device according to claim 1, in a period of time, do not receive triggering after, described LCD can enter the screen protection state, static state or dynamic display screen curtain protection image is triggered up to human interface device; Also can enter battery saving mode, reduce brightness or close liquid crystal display displays, be triggered up to described human interface device.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CNA200810018030XA CN101266516A (en) | 2008-04-24 | 2008-04-24 | Layout customized intelligent human-machine interface device |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CNA200810018030XA CN101266516A (en) | 2008-04-24 | 2008-04-24 | Layout customized intelligent human-machine interface device |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN101266516A true CN101266516A (en) | 2008-09-17 |
Family
ID=39988954
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CNA200810018030XA Pending CN101266516A (en) | 2008-04-24 | 2008-04-24 | Layout customized intelligent human-machine interface device |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN101266516A (en) |
Cited By (24)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102129344A (en) * | 2010-01-14 | 2011-07-20 | 微软公司 | Layout constraint manipulation via user gesture recognition |
| CN102262498A (en) * | 2010-05-24 | 2011-11-30 | 爱信艾达株式会社 | Information display device, information display method, and program |
| CN102388356A (en) * | 2009-04-15 | 2012-03-21 | 索尼公司 | Menu display device, menu display method, and program |
| CN102455858A (en) * | 2010-10-25 | 2012-05-16 | 宏碁股份有限公司 | Cursor management method and related management system |
| CN102693057A (en) * | 2011-03-21 | 2012-09-26 | 联想(北京)有限公司 | Portable terminal and operation method thereof |
| CN103207724A (en) * | 2012-01-11 | 2013-07-17 | 飞宏科技股份有限公司 | Method for operating computer members and program product thereof |
| CN103630149A (en) * | 2012-08-20 | 2014-03-12 | 艾默生过程控制流量技术有限公司 | Method of transmitter for controlling light-emitting unit of transmitter |
| CN103699315A (en) * | 2013-12-06 | 2014-04-02 | 广东欧珀移动通信有限公司 | Touch screen control method of mobile terminal integrated with gamepad |
| CN103930850A (en) * | 2011-10-03 | 2014-07-16 | 摩托罗拉移动有限责任公司 | Method for detecting false wake conditions of a portable electronic device |
| CN104375756A (en) * | 2013-08-16 | 2015-02-25 | 北京三星通信技术研究有限公司 | Touch operation method and touch operation device |
| CN104641337A (en) * | 2012-08-30 | 2015-05-20 | 谷歌公司 | Displaying a graphical keyboard |
| CN104698932A (en) * | 2015-02-13 | 2015-06-10 | 小米科技有限责任公司 | Device control method and device |
| CN104898860A (en) * | 2015-06-29 | 2015-09-09 | 刘立静 | Portable computer keyboard |
| CN105302303A (en) * | 2015-10-15 | 2016-02-03 | 广东欧珀移动通信有限公司 | Game control method and apparatus and mobile terminal |
| US9367085B2 (en) | 2012-01-26 | 2016-06-14 | Google Technology Holdings LLC | Portable electronic device and method for controlling operation thereof taking into account which limb possesses the electronic device |
| CN106354378A (en) * | 2015-07-13 | 2017-01-25 | 阿里巴巴集团控股有限公司 | Method and device for quickly selecting multiple targets |
| CN107016983A (en) * | 2016-01-28 | 2017-08-04 | 易弹信息科技（上海）有限公司 | A kind of piano control method, system and a kind of electronic equipment |
| US9971496B2 (en) | 2014-08-04 | 2018-05-15 | Google Technology Holdings LLC | Method and apparatus for adjusting a graphical user interface on an electronic device |
| US10048860B2 (en) | 2006-04-06 | 2018-08-14 | Google Technology Holdings LLC | Method and apparatus for user interface adaptation |
| CN110569014A (en) * | 2018-06-06 | 2019-12-13 | 北京唱吧科技股份有限公司 | sound card and sound card setting method |
| US10600399B2 (en) | 2016-01-15 | 2020-03-24 | Sunland Information Technology Co., Ltd. | Smart piano system |
| CN114168022A (en) * | 2021-11-04 | 2022-03-11 | 厦门知本家科技有限公司 | Vibration feedback system and method for editing house type structure model |
| CN114995702A (en) * | 2022-07-19 | 2022-09-02 | 深圳润方创新技术有限公司 | Computer-aided display electronic drawing board for children and display method |
| CN116501233A (en) * | 2023-04-19 | 2023-07-28 | 广州致远仪器有限公司 | Soft keyboard interaction method, equipment and storage medium |
-
2008
- 2008-04-24 CN CNA200810018030XA patent/CN101266516A/en active Pending
Cited By (37)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US10048860B2 (en) | 2006-04-06 | 2018-08-14 | Google Technology Holdings LLC | Method and apparatus for user interface adaptation |
| CN102388356A (en) * | 2009-04-15 | 2012-03-21 | 索尼公司 | Menu display device, menu display method, and program |
| CN102388356B (en) * | 2009-04-15 | 2015-04-22 | 索尼公司 | Menu display device, menu display method, and program |
| US9405449B2 (en) | 2010-01-14 | 2016-08-02 | Microsoft Technology Licensing, Llc | Layout constraint manipulation via user gesture recognition |
| US10599311B2 (en) | 2010-01-14 | 2020-03-24 | Microsoft Technology Licensing, Llc | Layout constraint manipulation via user gesture recognition |
| CN102129344B (en) * | 2010-01-14 | 2016-03-02 | 微软技术许可有限责任公司 | Via the layout constraint manipulation of user's posture identification |
| CN102129344A (en) * | 2010-01-14 | 2011-07-20 | 微软公司 | Layout constraint manipulation via user gesture recognition |
| CN102262498A (en) * | 2010-05-24 | 2011-11-30 | 爱信艾达株式会社 | Information display device, information display method, and program |
| CN102455858A (en) * | 2010-10-25 | 2012-05-16 | 宏碁股份有限公司 | Cursor management method and related management system |
| CN102693057A (en) * | 2011-03-21 | 2012-09-26 | 联想(北京)有限公司 | Portable terminal and operation method thereof |
| CN102693057B (en) * | 2011-03-21 | 2017-09-29 | 联想(北京)有限公司 | Portable terminal and its operating method |
| CN103930850A (en) * | 2011-10-03 | 2014-07-16 | 摩托罗拉移动有限责任公司 | Method for detecting false wake conditions of a portable electronic device |
| US9710048B2 (en) | 2011-10-03 | 2017-07-18 | Google Technology Holdings LLC | Method for detecting false wake conditions of a portable electronic device |
| CN103207724A (en) * | 2012-01-11 | 2013-07-17 | 飞宏科技股份有限公司 | Method for operating computer members and program product thereof |
| US10282155B2 (en) | 2012-01-26 | 2019-05-07 | Google Technology Holdings LLC | Portable electronic device and method for controlling operation thereof taking into account which limb possesses the electronic device |
| US9367085B2 (en) | 2012-01-26 | 2016-06-14 | Google Technology Holdings LLC | Portable electronic device and method for controlling operation thereof taking into account which limb possesses the electronic device |
| CN103630149A (en) * | 2012-08-20 | 2014-03-12 | 艾默生过程控制流量技术有限公司 | Method of transmitter for controlling light-emitting unit of transmitter |
| CN104641337A (en) * | 2012-08-30 | 2015-05-20 | 谷歌公司 | Displaying a graphical keyboard |
| US9959038B2 (en) | 2012-08-30 | 2018-05-01 | Google Llc | Displaying a graphic keyboard |
| CN104375756A (en) * | 2013-08-16 | 2015-02-25 | 北京三星通信技术研究有限公司 | Touch operation method and touch operation device |
| CN103699315A (en) * | 2013-12-06 | 2014-04-02 | 广东欧珀移动通信有限公司 | Touch screen control method of mobile terminal integrated with gamepad |
| CN103699315B (en) * | 2013-12-06 | 2017-03-08 | 广东欧珀移动通信有限公司 | The mobile terminal touch screen control method of integrated game handle |
| US9971496B2 (en) | 2014-08-04 | 2018-05-15 | Google Technology Holdings LLC | Method and apparatus for adjusting a graphical user interface on an electronic device |
| CN104698932B (en) * | 2015-02-13 | 2018-09-04 | 小米科技有限责任公司 | Apparatus control method and device |
| CN104698932A (en) * | 2015-02-13 | 2015-06-10 | 小米科技有限责任公司 | Device control method and device |
| CN104898860A (en) * | 2015-06-29 | 2015-09-09 | 刘立静 | Portable computer keyboard |
| CN106354378A (en) * | 2015-07-13 | 2017-01-25 | 阿里巴巴集团控股有限公司 | Method and device for quickly selecting multiple targets |
| CN105302303A (en) * | 2015-10-15 | 2016-02-03 | 广东欧珀移动通信有限公司 | Game control method and apparatus and mobile terminal |
| US10950137B2 (en) | 2016-01-15 | 2021-03-16 | Sunland Information Technology Co., Ltd. | Smart piano system |
| US10600399B2 (en) | 2016-01-15 | 2020-03-24 | Sunland Information Technology Co., Ltd. | Smart piano system |
| US10636402B2 (en) | 2016-01-15 | 2020-04-28 | Sunland Information Technology Co., Ltd. | Systems and methods for automatic calibration of musical devices |
| US11328618B2 (en) | 2016-01-15 | 2022-05-10 | Sunland Information Technology Co., Ltd. | Systems and methods for calibrating a musical device |
| CN107016983A (en) * | 2016-01-28 | 2017-08-04 | 易弹信息科技（上海）有限公司 | A kind of piano control method, system and a kind of electronic equipment |
| CN110569014A (en) * | 2018-06-06 | 2019-12-13 | 北京唱吧科技股份有限公司 | sound card and sound card setting method |
| CN114168022A (en) * | 2021-11-04 | 2022-03-11 | 厦门知本家科技有限公司 | Vibration feedback system and method for editing house type structure model |
| CN114995702A (en) * | 2022-07-19 | 2022-09-02 | 深圳润方创新技术有限公司 | Computer-aided display electronic drawing board for children and display method |
| CN116501233A (en) * | 2023-04-19 | 2023-07-28 | 广州致远仪器有限公司 | Soft keyboard interaction method, equipment and storage medium |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN101266516A (en) | Layout customized intelligent human-machine interface device | |
| JP5717670B2 (en) | Human interface input acceleration system | |
| CN106484125B (en) | Man-machine interaction device, electronic device and method | |
| US9158387B2 (en) | Actionable-object controller and data-entry attachment for touchscreen-based electronics | |
| CN104871117A (en) | Input device, particularly for computers or the like, and corresponding graphical user interface system | |
| US20090201248A1 (en) | Device and method for providing electronic input | |
| US20120133615A1 (en) | Actionable-object controller and data-entry attachment for touchscreen-based electronics | |
| WO2008074223A1 (en) | Human computer interaction device, electronic device and human computer interaction method | |
| US10928906B2 (en) | Data entry device for entering characters by a finger with haptic feedback | |
| CN101809526A (en) | Multi-touch device having dynamic haptic effects | |
| CN101984384A (en) | Mobile terminal and design method of operation and control technology thereof | |
| KR20080038247A (en) | System and method for user interface | |
| CN104077066A (en) | Portable device and operation method | |
| TWM281363U (en) | Internet protocol phone with integral touch panel function | |
| CN103365451B (en) | Multidimensional speedup space-efficient man-machine interaction method and device for intelligent platform | |
| CN202486951U (en) | Touching remote control | |
| CN103576903B (en) | A kind of writing pencil of information processing method and application this method | |
| CN111078032B (en) | Finger ring type mouse capable of prejudging two-finger merging trend and prejudging method | |
| CN101211228A (en) | Double function operation input key for hand-held device and its operation method | |
| CN206674011U (en) | A kind of rear shell has the smart mobile phone of touchpad operation function | |
| CN109451099A (en) | Mobile phone human body engineering input mode | |
| TW202004438A (en) | Control device and methods of operation thereof | |
| CN209015125U (en) | A kind of touching display screen keyboard | |
| Li | Beyond pinch and flick: Enriching mobile gesture interaction | |
| JP2006050512A (en) | Data input method |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| C02 | Deemed withdrawal of patent application after publication (patent law 2001) | ||
| WD01 | Invention patent application deemed withdrawn after publication |
Open date: 20080917 |