CN101937267A - Method for simulating mouse input and device thereof - Google Patents

Method for simulating mouse input and device thereof Download PDF

Info

Publication number
CN101937267A
CN101937267A CN2009100883827A CN200910088382A CN101937267A CN 101937267 A CN101937267 A CN 101937267A CN 2009100883827 A CN2009100883827 A CN 2009100883827A CN 200910088382 A CN200910088382 A CN 200910088382A CN 101937267 A CN101937267 A CN 101937267A
Authority
CN
China
Prior art keywords
image
coordinate
vibration
master image
mouse
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN2009100883827A
Other languages
Chinese (zh)
Inventor
柳玉冬
严志
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
BEIJING HONGJING JIEXUN NETWORK TECHNOLOGY Co Ltd
Original Assignee
BEIJING HONGJING JIEXUN NETWORK TECHNOLOGY Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by BEIJING HONGJING JIEXUN NETWORK TECHNOLOGY Co Ltd filed Critical BEIJING HONGJING JIEXUN NETWORK TECHNOLOGY Co Ltd
Priority to CN2009100883827A priority Critical patent/CN101937267A/en
Publication of CN101937267A publication Critical patent/CN101937267A/en
Pending legal-status Critical Current

Links

Images

Abstract

The invention provides a method for simulating mouse input and a device thereof. The method comprises the following steps: acquiring images containing a main image; identifying the main image of the acquired images, and determining the coordinates of the identified main image in the acquired images; determining the output coordinates of the simulated mouse according to the coordinates of the determined main image; and generating and outputting a mouse clicking command according to a detected vibration or/and sound signal for simulating mouse clicking. The device comprises an image acquisition module (11), an image processing module (12), a vibration acquisition module (13)/sound acquisition module (15), a vibration processing module (14)/sound processing module (16) and a target determination module (17). By using the method and the device, object images can be acquired by utilizing an equipment camera to realize flexibility and convenience of mouse operation on various electronic devices, in particular mobile electronic devices.

Description

The method and the device of analog mouse input
Technical field
The invention provides a kind of human-computer interaction technology that relates in the virtual reality system, particularly a kind of method and device of analog mouse input.
Background technology
Along with making rapid progress of electronic equipment development at present, the interacting activity of between humans and machines is frequent day by day.These traditional human-computer interaction devices such as mouse, keyboard exist certain limitation meeting in the ergonomics design, long-term use can cause human muscle's fatigue even cause muscle damage, and for mobile device, mouse, keyboard are undoubtedly a kind of burden.Though touch-screen has solved mouse and keyboard to a certain extent in the problem of carrying on the inconvenience, need block the problem of screen when existing operation.
In order to address this problem, video identification technology is introduced into field of human-computer interaction.As, application number is that 02117354.0 Chinese patent application discloses a kind of computer input that is made of image sensing apparatus and induction information extraction element, can obtain hand or assigned object shape information by image sensing apparatus in the space, the image information feature extraction element extracts the characteristic information of this spatial shape and imports main frame into, show on computer display screen and sell or the spatial shape of assigned object that simultaneous computer produces computer-managed instruction according to the characteristic information that is imported into.
But this system needs specific image sensing apparatus and induction information extraction element, and equipment complexity and volume are big, and cost is higher, should not use on mobile device.
Summary of the invention
In view of this, fundamental purpose of the present invention is to provide a kind of method and device of analog mouse input, to solve the purpose that when the enterprising line operate of touch-screen finger blocks the problem of screen and realizes making such device that volume is little, cost is low.
The method of a kind of analog mouse input provided by the invention comprises step:
A, the image that comprises master image is gathered;
B, the image of being gathered is carried out the identification of master image and determines the coordinate of master image in the image of being gathered that identifies;
C, determine the output coordinate of the mouse simulated according to the master image coordinate of being determined;
D, be used for vibration that analog mouse clicks or/and voice signal generates click instruction output according to detected.
Hence one can see that, comprises identification to the coordinate of its master image according to the image that gathers, and can determine the movement locus of the analog mouse in the image; Be used for the vibration of analog mouse click or/and voice signal generates click instruction output according to detected again, thereby realize the operation of analog mouse, reach to solve the purpose that when the enterprising line operate of touch-screen finger blocks the problem of screen and realizes making such device that volume is little, cost is low to equipment.
In the above-mentioned method, it is characterized in that, also comprise the master image initialization step before the steps A, comprising:
The image of gathering in the record master image initialization procedure is a master image.
Hence one can see that, can effectively distinguish master image with background image to the identification of master image in initialized process.
In the above-mentioned method, it is characterized in that the described collection of steps A comprises:
Gather the video flowing that comprises master image in real time;
The video flowing single frames of being gathered is turned to continuous images as the image of being gathered.
Hence one can see that, and collection in real time can farthest reduce to move time delay, makes the mouse control operation more smooth-going.
In the above-mentioned method, it is characterized in that the output coordinate of the described definite mouse of being simulated of step C comprises: according to screen cursor the coordinate on screen of master image coordinate Mapping for institute's analog mouse control.
Hence one can see that, and according to screen cursor the coordinate on screen of master image coordinate Mapping for institute's analog mouse control, the result reflects intuitively.
In the above-mentioned method, it is characterized in that the output coordinate of the described definite mouse of being simulated of step C comprises: according to the direction of the relative institute of master image coordinate images acquired center, screen cursor the moving on screen of control institute analog mouse control.
Hence one can see that, according to the direction of the relative institute of master image coordinate images acquired center, and screen cursor the moving on screen of control institute analog mouse control, analog mouse screen location is more accurate.
In the above-mentioned method, it is characterized in that the described detection of step D comprises: the vibration that will gather or/and voice signal compare to confirm as useful signal with the sampling parameter that sets in advance.
Hence one can see that, and the vibration of gathering or/and voice signal is compared with the sampling parameter that sets in advance to confirm as useful signal, can be filtered out environmental noise effectively, the minimizing environmental noise to effective vibration or/and the interference of voice signal.
In the above-mentioned method, it is characterized in that described step D also comprises: according to the vibration that is detected or/and the intensity of voice signal is clicked the intensity output of strength as analog mouse.
Hence one can see that, or/and the intensity that the intensity of voice signal is clicked strength as analog mouse is exported, the operation reflection is directly perceived, strengthens the interest of man-machine interaction according to the vibration that is detected.
In the above-mentioned method, it is characterized in that, also comprise:
When the master image coordinate that step C determined moved up and down in setting-up time, whether determining step D generated the click instruction, if then step C does not export the coordinate in the described setting-up time.
Hence one can see that, moves up and down in setting-up time according to the master image coordinate, and whether determining step D generates click is instructed, can be to replenishing the accuracy that raising judgement click is operated according to vibrating or/and voice signal judgement click operation is done one.
The device of a kind of analog mouse input provided by the invention is characterized in that, comprising:
Image capture module 11 is used for the image that comprises master image is gathered;
Image processing module 12 is used for the image that image capture module 11 is gathered is carried out the identification of master image and determines the master image that the identifies coordinate at the image of being gathered;
Vibration acquisition module 13 is used to gather vibration signal;
Vibration processing module 14 is used for identifying the vibration signal that analog mouse is clicked that is used for that vibration signal that vibration acquisition module 13 gathers comprises;
Target judge module 17, be used for the master image coordinate determined according to image processing module 12 and determine the output coordinate of the mouse of being simulated, and according to the detected outputs that are used for vibration signals that analog mouse clicks as the click instruction of vibration processing module 14.
Hence one can see that, gathers the image of coming according to acquisition module 11, can determine the movement locus of the analog mouse in the image; Generate click instruction output according to the detected vibration signal that is used for the analog mouse click again, thereby realize the operation of analog mouse, reach to solve the purpose that when the enterprising line operate of touch-screen finger blocks the problem of screen and realizes making such device that volume is little, cost is low to equipment.
The device of a kind of analog mouse input provided by the invention is characterized in that, comprising:
Image capture module 11 is used for the image that comprises master image is gathered;
Image processing module 12 is used for the image that image capture module 11 is gathered is carried out the identification of master image and determines the master image that the identifies coordinate at the image of being gathered;
Sound collection module 15 is used for collected sound signal;
Acoustic processing module 16 is used for identifying the voice signal that analog mouse is clicked that is used for that voice signal that sound collection module 15 gathers comprises;
Target judge module 17, be used for the master image coordinate determined according to image processing module 12 and determine the output coordinate of the mouse of being simulated, and according to the detected outputs that are used for voice signals that analog mouse clicks as the click instruction of acoustic processing module 16.
Hence one can see that, gathers the image of coming according to acquisition module 11, can determine the movement locus of the analog mouse in the image; Generate click instruction output according to the detected voice signal that is used for the analog mouse click again, thereby realize the operation of analog mouse, reach to solve the purpose that when the enterprising line operate of touch-screen finger blocks the problem of screen and realizes making such device that volume is little, cost is low to equipment.
Description of drawings
Fig. 1 is a high-level schematic functional block diagram of the present invention;
Fig. 2 is an analog mouse control flow chart of the present invention;
Fig. 3 is clicking operation simulated technological process figure of the present invention;
Fig. 4 is a simulating keyboard operational flowchart of the present invention.
Embodiment
Show the device that analog mouse provided by the invention is imported as Fig. 1, be used for being implemented in dirigibility and the convenience controlled on the various electronic equipments, particularly mobile electronic device.
Being applied to mobile phone with the device of analog mouse input below is example, and the device of analog mouse input of the present invention is described.Wherein this device comprises:
Image capture module 11 is used for real-time images acquired, and is transferred in the image processing module 12.Wherein, this picture material has comprised user's finger or the assigned object (as pen or lip pencil thing) as master image.In this example, the camera on the employing mobile phone is as image capture module 11, and the picture material of being gathered comprises user's one specific finger.
Image processing module 12 is used for carrying out the identification of master image from the picture signal of image capture module 11 and carry out determining of master image coordinate, and the coordinate of determining is sent to target judge module 17.Wherein,,, confirm finger, and confirm its logical coordinates in institute's images acquired as master image as the identification of characteristic parameter by image recognition technology.
Vibration acquisition module 13 is used to gather vibration signal, and is transferred in the vibration processing module 14.Wherein, the vibration acquisition module can be arranged on described handset shell one side, thereby gathers the object plane that mobile phone is placed, as the vibration signal on the desktop.This vibration acquisition module 13 also can adopt wired or wireless mode to be placed on mobile phone, thereby gathers the vibration signal of the object plane that this vibration acquisition module 13 placed.
Vibration processing module 14, the vibration signal and the sampling parameter that sets in advance that are used for the acquisition module of self-excited oscillation in the future 13, compare as click action vibration frequency, amplitude etc., judge effective vibration signal, and the electronic impulse of exporting corresponding number of times is to target judge module 17.
Sound collection module 15 is used for gathering in real time the user and knocks the voice signal that object produces, and is transferred in the acoustic processing module 16.The same with vibration acquisition module 13, can be arranged on described handset shell one side or adopt wired or wireless mode to be placed on mobile phone.Wherein, can adopt the microphone or the External micro phone of mobile phone.
Acoustic processing module 16, being used for will be from the voice signal of sound collection module 15 and the sampling parameter that sets in advance, compare as parameters such as the frequency of click sound, amplitude, duration, identifying effective voice signal, and export corresponding electronic impulse to target judge module 17.
Target judge module 17, be used for will becoming moving of cursor that mobile phone screen shows as the coordinate conversion of the finger of master image according to the signal of the image processing module 12 that receives, and according to the vibration processing module 14 that receives or/conversion of signals of acoustic processing module 16 becomes the control action of click.
In addition, target judge module 17 also is used for variation speed according to described master image, and to be defined as clicking control action still be the control action that cursor moves, for example will set and once move up and down the click action that is considered as analog mouse in the short time, surpass the mobile control that then is considered as cursor of moving in the setting-up time.
Method referring to the input of the analog mouse shown in Fig. 2,3, be applied on the mobile phone with this device, and with the camera (also can be external) of embedded in mobile phone as image capture module, the vibration transducer that is arranged on the mobile phone is example as vibration acquisition module, microphone as the sound collection module, the mouse action that simulation is used for mobile phone is an example, apparatus of the present invention is realized the method for analog mouse input describes in detail.
At first carry out initialization procedure, this initialization mainly is in order to carry out corresponding with main reference substance (being the staff in this example) coordinate the current coordinate of the cursor of mobile phone screen.Wherein, can be according to the coordinate of main reference substance in institute's images acquired of confirming, with the initialization of mobile phone screen cursor in corresponding position.Also can be to make display highlighting on the mobile phone screen be positioned at the center of screen display, make the coordinate of main reference substance in institute's images acquired corresponding, preferable with it, when initialization, make main reference substance over against camera with center in institute's images acquired.
In addition, when using the inventive method first, can carry out the initialization of master image at least, promptly will be positioned at assigned address as the finger of master image or assigned object as the camera dead ahead, the image of record assigned address, with this image as master image.Wherein, can carry out reinitializing of master image using first or need timing to call initialization procedure, also can call initialization procedure when using the inventive method and carry out reinitializing of master image each.
Afterwards, referring to analog mouse control flow chart as shown in Figure 2, may further comprise the steps:
Step 201:, periodically the image of gathering is sent to handset image processing module 12 by carrying out image acquisition as image capture module 11 embedded in mobile phone cameras.
Wherein, can gather in the cycle during image acquisition.Image acquisition also can be gathered in real time and be formed video flowing (WMA) metadata cache, passing through to load this data streaming file, realize the video data single framesization, and continuous images divided into groups, pass to image processing system and handle with 40 frames/formation second array, final system is deleted the image after the processing automatically.
Step 202: carry out the identification of master image and the determining of the master image coordinate that identifies by the picture signal of 12 pairs of receptions of image processing module of mobile phone.
For example, when finger is positioned at the image of camera collection, identifies master image, and confirm its position coordinates on master image, with two-dimensional array form (X, Y) output as finger.
Step 203: by the coordinate of the cursor that shows on definite control mobile phone screen of target judge module 17 according to the master image coordinate.
Wherein, can be to hint obliquely at for the coordinate on the screen of screen cursor place carries out correspondence according to the master image coordinate to show.
Perhaps, with the relative picture centre of master image coordinate position, the control screen cursor to the counterparty to move, be positioned at the picture centre left side as judging the master image coordinate, then control screen cursor and move, be moved to its picture centre position and stop to move up to detecting master image to its left side.Can control the speed of cursor moving speed according to the distance of master image coordinate distance picture centre distance.
As seen, by above step, just can constantly gather the image that moves of user's finger, and identify finger fingertip movement locus coordinate, (X Y) exports, and is mapped as the mobile message of screen cursor with the two-dimensional array form.That is, the mobile mouse that is modeled to finger moves.
Step 204: when mobile phone detects when being used for vibration signal that analog mouse clicks or voice signal, the instruction that is mapped as click offers mobile phone.Hereinafter will describe in detail step 204.
Wherein, the process of described in the step 204 the analog mouse clicking operation being simulated, the clicking operation simulated technological process figure of the present invention referring to shown in Fig. 3 comprises following concrete steps:
Step 301: the vibration transducer and operation planar (for example, equipment is placed on the table, and then desktop the is an operation planar) contact as vibration acquisition module 13 of embedded in mobile phone are placed, gather the vibration signal that this plane is produced by user's finger tapping.
Perhaps, make embedded in mobile phone or external microphone contact placement, gather the voice signal that this plane is produced by user's finger tapping with described operation planar as sound collection module 15.Microphone is contacted placement with described operation planar, is in order to make the medium of described operation planar as transfer voice, to compare air transfer and decay littler.
Step 302: vibration of gathering in the future by vibration processing module 14 or acoustic processing module 16 or voice signal and the sampling parameter that sets in advance, compare as click action vibration or sound frequency, amplitude etc., judge effective signal, and export the electronic impulse of corresponding number of times.Be specially following steps:
Judge that the vibration of vibration transducer collection or voice signal are whether within the scope that belongs to vibration that the analog mouse that sets in advance clicks or voice signal sampling parameter regulation, Rule of judgment can involving vibrations or frequency of sound, amplitude etc., if belong to, then be considered as this vibration or voice signal for effective.Can effectively remove undesired signal by this step.
Further judge in setting-up time, whether there be second effective signal, with the single-click operation or the double click operation of analog mouse, and the pulse of sending respective numbers.
Step 303: by the quantity of target judge module 17 according to each transmission pulse signal, for example, once simulate a pulse signal of vibration transmission after vibration processing module 14 is handled of mouse-click operation generation, returning with the system parameter values of above-mentioned mouse action is the click action command of correspondence, finishes the simulation of mouse action.
Further, when identifying finger in according to above-mentioned steps 203 for vertical (or near vertically) continuous to-and-fro movement of direction, be that Grid Track is when being the vertically continuous to-and-fro movement of (or near vertically) direction, integrating step 301~303 just can be judged the mobile of analog mouse or carry out click action, controls moving of cursor thereby can avoid the user to be misapplied at the finger movement that knocks operation planar.Be elaborated below:
According to the moving situation of finger, the pursuit movement track, analysis is which finger is in the state that moves up and down, for example, one of them is pointed and falls after (for clicking time parameter) lifts in setting-up time, is considered as once clicking; One of them finger (for double-clicking time parameter) in setting-up time is done and is lifted drop movements for twice, then is considered as once double-clicking.The click action of gathering is combined judgement with the click vibrations or the sound of above-mentioned collection, just unexpected vibration or the unexpected sound (not detecting gesture) that meets scope can be masked, avoid mistake analog mouse click action.
In addition, this device and method also is applicable to the simulating keyboard operation.As shown in Figure 4, finger (except the thumb) with the right-hand man is that benchmark is set up the keyboard coordinate system, the null position of this keyboard coordinate system enters pickup area for the first time with finger, and the position during the initialization finger is as the criterion, and changes with the difference of the position that enters each time.By starting the dummy keyboard program, make finger plane and dummy keyboard planes overlapping.For the stupefied crossing point of each key on the keyboard is divided one with respect to the keyboard coordinate at zero point, identify finger place coordinate key bits corresponding by principle again with above-mentioned steps 203, the principle of integrating step 301-303 is as the method for identification finger point beating keyboard, return the corresponding ASCII character of pseudo operation in the said process at last, finish whole simulation keystroke action.As seen, like this can accurate recognition go out the hammer action of keyboard, and only go to discern key tap by camera collection information and compare, any corresponding up and down the moving of adopting the present invention can avoid pointing all is modeled as hammer action by mistake.
Need explanation the time owing to can gather vibration or sound size in the lump when gathering vibration and acoustic information, so this can also be gone out the strength size of click as the 3rd parameter simulation.This is for some program, when for example needing to simulate thickness (or depth of the color) dynamics that mouse writes according to the dynamics of clicking the mouse, then can simulate in conjunction with above-mentioned the 3rd parameter.Make the font that simulates have more hand-written feature.
The above only is preferred embodiment of the present invention, not in order to restriction the present invention.Within the spirit and principles in the present invention all, any modification of being made, be equal to replacement, improvement etc., all should be included within protection scope of the present invention.

Claims (10)

1. the method for an analog mouse input is characterized in that, comprising:
A, the image that comprises master image is gathered;
B, the image of being gathered is carried out the identification of master image and determines the coordinate of master image in the image of being gathered that identifies;
C, determine the output coordinate of the mouse simulated according to the master image coordinate of being determined;
D, be used for vibration that analog mouse clicks or/and voice signal generates click instruction output according to detected.
2. method according to claim 1 is characterized in that, also comprises the master image initialization step before the steps A, comprising:
The image of gathering in the record master image initialization procedure is a master image.
3. method according to claim 1 is characterized in that, the described collection of steps A comprises:
Gather the video flowing that comprises master image in real time;
The video flowing single frames of being gathered is turned to continuous images as the image of being gathered.
4. method according to claim 1 is characterized in that, the output coordinate of the described definite mouse of being simulated of step C comprises: according to screen cursor the coordinate on screen of master image coordinate Mapping for institute's analog mouse control.
5. method according to claim 1, it is characterized in that, the output coordinate of the described definite mouse of being simulated of step C comprises: according to the direction of the relative institute of master image coordinate images acquired center, and screen cursor the moving on screen of control institute analog mouse control.
6. method according to claim 1 is characterized in that, the described detection of step D comprises: the vibration that will gather or/and voice signal compare to confirm as useful signal with the sampling parameter that sets in advance.
7. according to claim 1 or 6 described methods, it is characterized in that described step D also comprises: according to the vibration that is detected or/and the intensity of voice signal is clicked the intensity output of strength as analog mouse.
8. method according to claim 1 is characterized in that, also comprises:
When the master image coordinate that step C determined moved up and down in setting-up time, whether determining step D generated the click instruction, if then step C does not export the coordinate in the described setting-up time.
9. the device of an analog mouse input is characterized in that, comprising:
Image capture module (11) is used for the image that comprises master image is gathered;
Image processing module (12) is used for the image that image capture module (11) is gathered is carried out the identification of master image and determines the master image that the identifies coordinate at the image of being gathered;
Vibration acquisition module (13) is used to gather vibration signal;
Vibration processing module (14) is used for identifying the vibration signal that analog mouse is clicked that is used for that vibration signal that vibration acquisition module (13) gathers comprises;
Target judge module (17), be used for the master image coordinate determined according to image processing module (12) and determine the output coordinate of the mouse of being simulated, and according to the detected output that is used for vibration signal that analog mouse clicks as the click instruction of vibration processing module (14).
10. the device of analog mouse input is characterized in that described device comprises:
Image capture module (11) is used for the image that comprises master image is gathered;
Image processing module (12) is used for the image that image capture module (11) is gathered is carried out the identification of master image and determines the master image that the identifies coordinate at the image of being gathered;
Sound collection module (15) is used for collected sound signal;
Acoustic processing module (16) is used for identifying the voice signal that analog mouse is clicked that is used for that voice signal that sound collection module (15) gathers comprises;
Target judge module (17), be used for the master image coordinate determined according to image processing module (12) and determine the output coordinate of the mouse of being simulated, and according to the detected output that is used for voice signal that analog mouse clicks as the click instruction of acoustic processing module (16).
CN2009100883827A 2009-07-03 2009-07-03 Method for simulating mouse input and device thereof Pending CN101937267A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN2009100883827A CN101937267A (en) 2009-07-03 2009-07-03 Method for simulating mouse input and device thereof

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN2009100883827A CN101937267A (en) 2009-07-03 2009-07-03 Method for simulating mouse input and device thereof

Publications (1)

Publication Number Publication Date
CN101937267A true CN101937267A (en) 2011-01-05

Family

ID=43390642

Family Applications (1)

Application Number Title Priority Date Filing Date
CN2009100883827A Pending CN101937267A (en) 2009-07-03 2009-07-03 Method for simulating mouse input and device thereof

Country Status (1)

Country Link
CN (1) CN101937267A (en)

Cited By (14)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102520794A (en) * 2011-12-06 2012-06-27 华映视讯(吴江)有限公司 Gesture recognition system and method
CN102638342A (en) * 2012-02-27 2012-08-15 深圳市赛格导航科技股份有限公司 Password authentication method and device based on vibration frequency
CN103200343A (en) * 2013-03-14 2013-07-10 南洋 Mobile phone remote control system based on camera
CN103365432A (en) * 2012-03-27 2013-10-23 深圳富泰宏精密工业有限公司 Input simulation method and input simulation system
CN103442177A (en) * 2013-08-30 2013-12-11 程治永 PTZ video camera control system and method based on gesture identification
CN103873917A (en) * 2012-12-13 2014-06-18 联想(北京)有限公司 Multimedia playing processing method and system
CN104011629A (en) * 2011-10-14 2014-08-27 欧特克公司 Enhanced target selection for a touch-based input enabled user interface
CN104656877A (en) * 2013-11-18 2015-05-27 李君� Human-machine interaction method based on gesture and speech recognition control as well as apparatus and application of human-machine interaction method
CN104951145A (en) * 2014-03-24 2015-09-30 联想(北京)有限公司 Information processing method and apparatus
CN106095081A (en) * 2016-05-30 2016-11-09 合肥联宝信息技术有限公司 Man-machine interaction method and device
CN106814842A (en) * 2015-11-30 2017-06-09 丰唐物联技术(深圳)有限公司 Cursor-moving method and system based on virtual reality
CN109144332A (en) * 2018-10-12 2019-01-04 中国计量大学 Mobile electronic device and its portable keyboard and Intellisense input method
CN109644239A (en) * 2016-08-31 2019-04-16 佳能株式会社 Imaging-control apparatus, display control apparatus and its control method
CN114002973A (en) * 2021-09-28 2022-02-01 深圳面元智能科技有限公司 Vibration control method, device, vibration control equipment and readable storage medium

Cited By (22)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN104011629A (en) * 2011-10-14 2014-08-27 欧特克公司 Enhanced target selection for a touch-based input enabled user interface
CN104011629B (en) * 2011-10-14 2017-12-22 欧特克公司 For enhanced target selecting method, equipment and the system of the user interface that can carry out the input based on touch
US10684768B2 (en) 2011-10-14 2020-06-16 Autodesk, Inc. Enhanced target selection for a touch-based input enabled user interface
CN102520794A (en) * 2011-12-06 2012-06-27 华映视讯(吴江)有限公司 Gesture recognition system and method
CN102520794B (en) * 2011-12-06 2014-11-19 华映视讯(吴江)有限公司 Gesture recognition system and method
CN102638342A (en) * 2012-02-27 2012-08-15 深圳市赛格导航科技股份有限公司 Password authentication method and device based on vibration frequency
CN103365432A (en) * 2012-03-27 2013-10-23 深圳富泰宏精密工业有限公司 Input simulation method and input simulation system
CN103873917A (en) * 2012-12-13 2014-06-18 联想(北京)有限公司 Multimedia playing processing method and system
CN103200343A (en) * 2013-03-14 2013-07-10 南洋 Mobile phone remote control system based on camera
CN103442177A (en) * 2013-08-30 2013-12-11 程治永 PTZ video camera control system and method based on gesture identification
CN104656877A (en) * 2013-11-18 2015-05-27 李君� Human-machine interaction method based on gesture and speech recognition control as well as apparatus and application of human-machine interaction method
CN104951145A (en) * 2014-03-24 2015-09-30 联想(北京)有限公司 Information processing method and apparatus
CN104951145B (en) * 2014-03-24 2018-08-10 联想(北京)有限公司 Information processing method and device
CN106814842A (en) * 2015-11-30 2017-06-09 丰唐物联技术(深圳)有限公司 Cursor-moving method and system based on virtual reality
CN106095081A (en) * 2016-05-30 2016-11-09 合肥联宝信息技术有限公司 Man-machine interaction method and device
CN109644239A (en) * 2016-08-31 2019-04-16 佳能株式会社 Imaging-control apparatus, display control apparatus and its control method
CN109644239B (en) * 2016-08-31 2020-12-15 佳能株式会社 Image pickup control apparatus, display control apparatus, control method therefor, and storage medium
US10992853B2 (en) 2016-08-31 2021-04-27 Canon Kabushiki Kaisha Image capture control apparatus, display control apparatus, and control method for tracking a tracking target in a live view image
US11272093B2 (en) 2016-08-31 2022-03-08 Canon Kabushiki Kaisha Image capture control apparatus, display control apparatus, and control method therefor to track a target and to determine an autofocus position
CN109144332A (en) * 2018-10-12 2019-01-04 中国计量大学 Mobile electronic device and its portable keyboard and Intellisense input method
CN109144332B (en) * 2018-10-12 2024-02-06 中国计量大学 Mobile electronic equipment, portable keyboard thereof and intelligent perception input method
CN114002973A (en) * 2021-09-28 2022-02-01 深圳面元智能科技有限公司 Vibration control method, device, vibration control equipment and readable storage medium

Similar Documents

Publication Publication Date Title
CN101937267A (en) Method for simulating mouse input and device thereof
CN100447723C (en) Controller involving manipulation of virtual objects on a multi-contact touch screen
CN103809733B (en) Man-machine interactive system and method
JP6074170B2 (en) Short range motion tracking system and method
Kjeldsen et al. Toward the use of gesture in traditional user interfaces
US8270670B2 (en) Method for recognizing and tracing gesture
CN104463119B (en) Combined type gesture identification equipment and its control method based on ultrasound with vision
CN103440033B (en) A kind of method and apparatus realizing man-machine interaction based on free-hand and monocular cam
CN107621893A (en) The content creating of electronic input apparatus is used on non-electronic surface
JP2013037675A5 (en)
CN1315024C (en) Video recognition input system
CN101198925A (en) Gestures for touch sensitive input devices
US20130120250A1 (en) Gesture recognition system and method
CN105224069A (en) The device of a kind of augmented reality dummy keyboard input method and use the method
CN103777748A (en) Motion sensing input method and device
CN102103409A (en) Man-machine interaction method and device based on motion trail identification
CN103926997A (en) Method for determining emotional information based on user input and terminal
CN110389659A (en) The system and method for dynamic haptic playback are provided for enhancing or reality environment
WO2016026365A1 (en) Man-machine interaction method and system for achieving contactless mouse control
CN104156068A (en) Virtual maintenance interaction operation method based on virtual hand interaction feature layer model
CN101714044B (en) Camera positioning-based touch screen system
CN101192124B (en) System and method for automatic distinguishing and processing for touch screen input information
CN101859177A (en) Method and device for calling and operating application program on intelligent electronic device
CN106383583B (en) For the pinpoint method and system of control dummy object every empty human-computer interaction
CN102520794B (en) Gesture recognition system and method

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
C10 Entry into substantive examination
SE01 Entry into force of request for substantive examination
C12 Rejection of a patent application after its publication
RJ01 Rejection of invention patent application after publication

Application publication date: 20110105