CN108170261A - Method and apparatus based on gesture manipulation screen shots - Google Patents
Method and apparatus based on gesture manipulation screen shots Download PDFInfo
- Publication number
- CN108170261A CN108170261A CN201611114875.XA CN201611114875A CN108170261A CN 108170261 A CN108170261 A CN 108170261A CN 201611114875 A CN201611114875 A CN 201611114875A CN 108170261 A CN108170261 A CN 108170261A
- Authority
- CN
- China
- Prior art keywords
- screen shots
- gesture
- calculation
- result
- displacement
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/017—Gesture based interaction, e.g. based on a set of recognized hand gestures
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
- G06F3/0484—Interaction techniques based on graphical user interfaces [GUI] for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range
- G06F3/04845—Interaction techniques based on graphical user interfaces [GUI] for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range for image manipulation, e.g. dragging, rotation, expansion or change of colour
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F2203/00—Indexing scheme relating to G06F3/00 - G06F3/048
- G06F2203/048—Indexing scheme relating to G06F3/048
- G06F2203/04806—Zoom, i.e. interaction techniques or interactors for controlling the zooming operation
Abstract
The present invention relates to a kind of method and apparatus based on gesture manipulation screen shots.The three-dimensional coordinate of multiple artis of human finger is obtained by equipment；The three-dimensional coordinate of multiple artis is analyzed, judges gesture state for the state of clenching fist, and record the position of current gesture；The displacement of the moving direction of pre-selection spatial axes is calculated with an adjacent upper position according to the position of current gesture；Addition calculation is carried out to the displacement of the moving direction of continuous multiple pre-selection spatial axes, generates result of calculation；Judge the relationship between result of calculation and predetermined threshold value, perform the corresponding operating of screen shots.The problem of this method solve the drawbacks of in traditional technology, somatosensory device is to gesture identification and limited executive control operation, realize reliability and the flexibility of gesture manipulation screen shots.
Description
Technical field
The present invention relates to motion sensing manipulation technical field, more particularly to a kind of method and dress based on gesture manipulation screen shots
It puts.
Background technology
With the development of electronic field, the equipment for supporting body-sensing function is more and more, this is just to supporting body-sensing function to set
Standby operation improves increasingly higher demands.In traditional technology, above equipment is low to the action recognition rate of human body, identification
Accuracy is poor；Furthermore above equipment has the drawbacks of limited to the realizations of more gesture controlling equipments, lack the reliability of application with
Flexibility.
Invention content
In consideration of it, it is necessary to be directed to traditional technology there are the problem of, provide a kind of based on gesture manipulation screen shots
Method and apparatus can realize the action recognition accuracy to human body, and the reliability with application and flexibility.
To reach goal of the invention, a kind of method based on gesture manipulation screen shots is provided, the method includes：By setting
The three-dimensional coordinate of the standby multiple artis for obtaining human finger；The three-dimensional coordinate of the multiple artis is analyzed,
The gesture state is judged for the state of clenching fist, and records the position of current gesture；According to the position of the current gesture with it is adjacent
A upper position calculate pre-selection spatial axes moving direction displacement；To continuous multiple moving directions for preselecting spatial axes
Displacement carries out addition calculation, generates result of calculation；Judge the relationship between the result of calculation and predetermined threshold value, perform screen map
The corresponding operating of piece.
In one of the embodiments, the equipment includes at least one of kinect feeling devices, depth camera.
In one of the embodiments, the moving directions to continuous multiple pre-selection spatial axes displacement and into
Row addition calculation, generation result of calculation include：The displacement of the moving direction of continuous three z-axis obtained in advance is added
It calculates.
The relationship judged between the result of calculation and predetermined threshold value in one of the embodiments, performs screen
The corresponding operating of picture includes：When the result of calculation be less than the first predetermined threshold value when, function of mouse roller function be called with
Perform the amplifieroperation of screen shots；When the result of calculation is more than the second predetermined threshold value, the function of mouse roller function
It is called with the reduction operation for performing screen shots.
A kind of device based on gesture manipulation screen shots based on same inventive concept, described device include：Obtain mould
Block obtains the three-dimensional coordinate of multiple artis of human finger by equipment；Analysis and logging modle, for the multiple pass
The three-dimensional coordinate of node is analyzed, and judges the gesture state for the state of clenching fist, and record the position of current gesture；Meter
Module is calculated, calculates the position of the moving direction of pre-selection spatial axes with an adjacent upper position for the position according to the current gesture
It moves；Generation module, the displacement for the moving direction to continuous multiple pre-selection spatial axes carry out addition calculation, and generation calculates
As a result；Judgement and execution module, for judging the relationship between the result of calculation and predetermined threshold value, perform the phase of screen shots
It should operate.
The equipment includes at least one of kinect feeling devices, depth camera in one of the embodiments,.
The generation module includes in one of the embodiments,：Computing unit, for obtain in advance continuous three
The displacement of the moving direction of a z-axis carries out addition calculation.
The judgement includes with execution module in one of the embodiments,：Amplifying unit, for working as the result of calculation
During less than the first predetermined threshold value, function of mouse roller function is called with the amplifieroperation for performing screen shots；Reducing unit is used
In when the result of calculation is more than the second predetermined threshold value, the function of mouse roller function is called to perform screen shots
Reduction operation.
A kind of method and apparatus based on gesture manipulation screen shots provided by the invention.Human finger is obtained by equipment
Multiple artis three-dimensional coordinate；The three-dimensional coordinate of multiple artis is analyzed, judges gesture state to clench fist
State, and record the position of current gesture；Pre-selection spatial axes are calculated according to the position of current gesture and an adjacent upper position
The displacement of moving direction；Addition calculation is carried out to the displacement of the moving direction of continuous multiple pre-selection spatial axes, generates result of calculation；
Judge the relationship between result of calculation and predetermined threshold value, perform the corresponding operating of screen shots.This method solve traditional technologies
In, the problem of the drawbacks of somatosensory device is limited to gesture identification and executive control operation, realize gesture manipulation screen shots
Reliability and flexibility.
Description of the drawings
Fig. 1 is a kind of step flow chart of method that screen shots are manipulated based on gesture in one embodiment of the invention；
Fig. 2 is a kind of step flow of method that screen shots are manipulated based on gesture in another embodiment of the present invention
Figure；
Fig. 3 is a kind of structure diagram of device that screen shots are manipulated based on gesture in one embodiment of the invention；
And
Fig. 4 is a kind of structural representation of device that screen shots are manipulated based on gesture in another embodiment of the present invention
Figure.
Specific embodiment
In order to make the purpose , technical scheme and advantage of the present invention be clearer, it is right with reference to the accompanying drawings and embodiments
Method and apparatus the present invention is based on gesture manipulation screen shots are further elaborated.It should be appreciated that described herein
Specific embodiment only to explain the present invention, be not intended to limit the present invention.
As shown in Figure 1, the step flow chart for a kind of method that screen shots are manipulated based on gesture in one embodiment.
Specifically include following steps：
Step 101, the three-dimensional coordinate of multiple artis of human finger is obtained by equipment.Wherein, equipment includes
At least one of kinect feeling devices, depth camera.
Step 102, the three-dimensional coordinate of multiple artis is analyzed, judges gesture state for the state of clenching fist, and record
The position of current gesture.
Step 103, according to the position of current gesture and the moving direction of adjacent upper position calculating pre-selection spatial axes
Displacement.
Step 104, addition calculation is carried out to the displacement of the moving direction of continuous multiple pre-selection spatial axes, generation calculates knot
Fruit.
In the present embodiment, to the displacement and progress addition calculation of the moving direction of continuous multiple pre-selection spatial axes, generation
Result of calculation includes：Addition calculation is carried out to the displacement of the moving direction of continuous three z-axis obtained in advance.
Step 105, judge the relationship between result of calculation and predetermined threshold value, perform the corresponding operating of screen shots.
In the present embodiment, the relationship between result of calculation and predetermined threshold value is judged, perform the corresponding operating packet of screen shots
It includes：When result of calculation is less than the first predetermined threshold value, function of mouse roller function is called to be grasped with the amplification for performing screen shots
Make；When result of calculation is more than the second predetermined threshold value, function of mouse roller function is called to be grasped with the diminution for performing screen shots
Make.
For the more clear and convenient application method proposed by the present invention based on gesture manipulation screen shots, carry out with
Lower example, it should be noted that protection scope of the present invention is not limited to the example below.
As shown in Fig. 2, the step flow for a kind of method that screen shots are manipulated based on gesture in another embodiment
Figure.Specifically include following steps：
Step 201, the three-dimensional of multiple artis that human finger is obtained by kinect feeling devices or depth camera is sat
It marks (x, y, z).
Step 202, the three-dimensional coordinate of multiple artis is analyzed, judges gesture state for the state of clenching fist.It needs
It is bright, only judge gesture state for clench fist state when, the position of current gesture is just recorded.
Step 203, the displacement of the moving direction of continuous three z-axis is obtained, and by three displacement datas with dynamic array
Form stored.
Step 204, the displacement of the moving direction of continuous three z-axis is calculated and as result of calculation.
Step 205, when result of calculation is less than the first predetermined threshold value, function of mouse roller function is called to perform screen
The amplifieroperation of picture.Wherein, the first predetermined threshold value is -7, and function of mouse roller function is mouse_event
(MOUSEEVENTF_WHEEL,0,0,120,0)。
Step 206, when result of calculation is more than the second predetermined threshold value, function of mouse roller function is called to perform screen
The reduction operation of picture.Wherein, the second predetermined threshold value is 7, and function of mouse roller function is mouse_event
(MOUSEEVENTF_WHEEL,0,0,-120,0)。
A kind of method based on gesture manipulation screen shots provided by the invention.The multiple of human finger are obtained by equipment
The three-dimensional coordinate of artis；The three-dimensional coordinate of multiple artis is analyzed, judges gesture state for the state of clenching fist, and
Record the position of current gesture；The moving direction of pre-selection spatial axes is calculated with an adjacent upper position according to the position of current gesture
Displacement；Addition calculation is carried out to the displacement of the moving direction of continuous multiple pre-selection spatial axes, generates result of calculation；Judge to calculate
As a result the relationship between predetermined threshold value performs the corresponding operating of screen shots.This method solve in traditional technology, body-sensing is set
The problem of standby the drawbacks of being limited to gesture identification and executive control operation, realizes reliability and the spirit of gesture manipulation screen shots
Activity.
Based on same inventive concept, a kind of device based on gesture manipulation screen shots is additionally provided, due to this device solution
Certainly the principle of problem is similar to a kind of aforementioned method based on gesture manipulation screen shots, and therefore, the implementation of the device can be by
Realize that overlaps will not be repeated according to the specific steps of preceding method.
As shown in figure 3, the structure diagram for a kind of device that screen shots are manipulated based on gesture in one embodiment.
The device 10 based on gesture manipulation screen shots includes：Acquisition module 100, analysis with logging modle 200, computing module 300,
Generation module 400 and judgement and execution module 500.
Wherein, acquisition module 100 is used to obtain the three-dimensional coordinate of multiple artis of human finger by equipment；Analysis with
Logging modle 200 judges gesture state for the state of clenching fist, and record and work as analyzing the three-dimensional coordinate of multiple artis
The position of preceding gesture；Computing module 300 is used to calculate pre-selection spatial axes with an adjacent upper position according to the position of current gesture
Moving direction displacement；Generation module 400 is used to be added the displacement of the moving direction of continuous multiple pre-selection spatial axes
It calculates, generates result of calculation；Judge and execution module 500 is used to judge the relationship between result of calculation and predetermined threshold value, perform
The corresponding operating of screen shots.Wherein, equipment includes at least one of kinect feeling devices, depth camera.
In the present embodiment, as shown in figure 4, generation module 400 includes：Computing unit 410 is used for continuous to what is obtained in advance
Three z-axis moving direction displacement carry out addition calculation.
In addition, in the present embodiment, judgement includes with execution module 500：Amplifying unit 510 is used to be less than in advance when result of calculation
If during threshold value, function of mouse roller function is called with the amplifieroperation for performing screen shots；Reducing unit 520 is used for when calculating
When being as a result more than predetermined threshold value, function of mouse roller function is called with the reduction operation for performing screen shots.
A kind of device based on gesture manipulation screen shots provided by the invention.It is obtained by acquisition module 100 by equipment
Take the three-dimensional coordinate of multiple artis of human finger；The three-dimensional of multiple artis is sat with logging modle 200 by analyzing again
Mark is analyzed, and judges gesture state for the state of clenching fist, and record the position of current gesture；Further according to 300 basis of computing module
The position of current gesture calculates the displacement of the moving direction of pre-selection spatial axes with an adjacent upper position；Then pass through generation module
The displacement and progress addition calculation of the moving direction of 400 pairs of continuous multiple pre-selection spatial axes, generates result of calculation；Finally by
Judgement and execution module 500 judge the relationship between result of calculation and predetermined threshold value, perform the corresponding operating of screen shots.The dress
It puts and solves in traditional technology, the problem of the drawbacks of somatosensory device is limited to gesture identification and executive control operation, realize hand
The reliability of gesture manipulation screen shots and flexibility.
One of ordinary skill in the art will appreciate that realizing all or part of flow in above-described embodiment method, being can be with
Relevant hardware is instructed to complete by computer program, the program can be stored in a computer read/write memory medium
In, the program is when being executed, it may include such as the flow of the embodiment of above-mentioned each method.Wherein, the storage medium can be magnetic
Dish, CD, read-only memory (Read-Only Memory, ROM) or random access memory (Random Access
Memory, RAM) etc..
Each technical characteristic of embodiment described above can be combined arbitrarily, to make description succinct, not to above-mentioned reality
It applies all possible combination of each technical characteristic in example to be all described, as long as however, the combination of these technical characteristics is not deposited
In contradiction, it is all considered to be the range of this specification record.
Embodiment described above only expresses the several embodiments of the present invention, and description is more specific and detailed, but simultaneously
Cannot the limitation to the scope of the claims of the present invention therefore be interpreted as.It should be pointed out that for those of ordinary skill in the art
For, without departing from the inventive concept of the premise, various modifications and improvements can be made, these belong to the guarantor of the present invention
Protect range.Therefore, the protection domain of patent of the present invention should be determined by the appended claims.
Claims (8)
- A kind of 1. method based on gesture manipulation screen shots, which is characterized in that the method includes：The three-dimensional coordinate of multiple artis of human finger is obtained by equipment；The three-dimensional coordinate of the multiple artis is analyzed, judges the gesture state for the state of clenching fist, and record The position of current gesture；The displacement of the moving direction of pre-selection spatial axes is calculated with an adjacent upper position according to the position of the current gesture；Addition calculation is carried out to the displacement of the moving direction of continuous multiple pre-selection spatial axes, generates result of calculation；Judge the relationship between the result of calculation and predetermined threshold value, perform the corresponding operating of screen shots.
- 2. the method according to claim 1 based on gesture manipulation screen shots, which is characterized in that the equipment includes At least one of kinect feeling devices, depth camera.
- 3. the method according to claim 1 based on gesture manipulation screen shots, which is characterized in that described to continuous multiple The displacement and progress addition calculation of the moving direction of the pre-selection spatial axes, generation result of calculation include：To what is obtained in advance The displacement of the moving direction of continuous three z-axis carries out addition calculation.
- 4. the method according to claim 1 based on gesture manipulation screen shots, which is characterized in that described to judge the meter The relationship between result and predetermined threshold value is calculated, the corresponding operating for performing screen shots includes：When the result of calculation is less than the first predetermined threshold value, function of mouse roller function is called to perform putting for screen shots Big operation；When the result of calculation is more than the second predetermined threshold value, the function of mouse roller function is called to perform screen shots Reduction operation.
- 5. a kind of device based on gesture manipulation screen shots, which is characterized in that described device includes：Acquisition module, for obtaining the three-dimensional coordinate of multiple artis of human finger by equipment；Analysis and logging modle, analyze for the three-dimensional coordinate to the multiple artis, judge the gesture shape State is state of clenching fist, and records the position of current gesture；Computing module calculates the mobile side of pre-selection spatial axes for the position according to the current gesture with an adjacent upper position To displacement；Generation module, the displacement for the moving direction to continuous multiple pre-selection spatial axes carry out addition calculation, generation meter Calculate result；Judgement and execution module, for judging the relationship between the result of calculation and predetermined threshold value, perform the phase of screen shots It should operate.
- 6. the device according to claim 5 based on gesture manipulation screen shots, which is characterized in that the equipment includes At least one of kinect feeling devices, depth camera.
- 7. the device according to claim 5 based on gesture manipulation screen shots, which is characterized in that the generation module packet It includes：Computing unit, for carrying out addition calculation to the displacement of the moving direction of continuous three z-axis obtained in advance.
- 8. the device according to claim 5 based on gesture manipulation screen shots, which is characterized in that the judgement and execution Module includes：Amplifying unit, for when the result of calculation is less than the first predetermined threshold value, function of mouse roller function to be called to hold The amplifieroperation of row screen shots；Reducing unit, for when the result of calculation is more than the second predetermined threshold value, the function of mouse roller function to be called To perform the reduction operation of screen shots.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201611114875.XA CN108170261A (en) | 2016-12-07 | 2016-12-07 | Method and apparatus based on gesture manipulation screen shots |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201611114875.XA CN108170261A (en) | 2016-12-07 | 2016-12-07 | Method and apparatus based on gesture manipulation screen shots |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN108170261A true CN108170261A (en) | 2018-06-15 |
Family
ID=62526480
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201611114875.XA Pending CN108170261A (en) | 2016-12-07 | 2016-12-07 | Method and apparatus based on gesture manipulation screen shots |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN108170261A (en) |
Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20090121903A1 (en) * | 2007-11-12 | 2009-05-14 | Microsoft Corporation | User interface with physics engine for natural gestural control |
| CN103246351A (en) * | 2013-05-23 | 2013-08-14 | 刘广松 | User interaction system and method |
| CN105868715A (en) * | 2016-03-29 | 2016-08-17 | 苏州科达科技股份有限公司 | Hand gesture identifying method, apparatus and hand gesture learning system |
-
2016
- 2016-12-07 CN CN201611114875.XA patent/CN108170261A/en active Pending
Patent Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20090121903A1 (en) * | 2007-11-12 | 2009-05-14 | Microsoft Corporation | User interface with physics engine for natural gestural control |
| CN103246351A (en) * | 2013-05-23 | 2013-08-14 | 刘广松 | User interaction system and method |
| CN105868715A (en) * | 2016-03-29 | 2016-08-17 | 苏州科达科技股份有限公司 | Hand gesture identifying method, apparatus and hand gesture learning system |
Non-Patent Citations (2)
| Title |
|---|
| CSDN: "keybd_event和mouse_event完全彻底细致的模拟鼠标键盘所有动作", 《HTTPS://BLOG.CSDN.NET/TMETEOR/ARTICLE/DETAILS/4658392?UTM_MEDIUM=DISTRIBUTE.PC_RELEVANT_BBS_DOWN.NONE-TASK-OTHER-BAIDUJS-2.NONECASE&DEPTH_1-UTM_SOURCE=DISTRIBUTE.PC_RELEVANT_BBS_DOWN.NONE-TASK-OTHER-BAIDUJS-2.NONECASE》 * |
| 王巍: "《LEAP Motion人机交互应用开发》", 30 November 2015, 西安电子科技大学出版社 * |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN104875203B (en) | Generate the robot simulation device of the path of motion of robot | |
| US20160195401A1 (en) | Method and system for locating an object | |
| US9619042B2 (en) | Systems and methods for remapping three-dimensional gestures onto a finite-size two-dimensional surface | |
| JP2021034021A (en) | Pose prediction with recurrent neural networks | |
| CN103383731A (en) | Projection interactive method and system based on fingertip positioning and computing device | |
| CN108986138A (en) | Method for tracking target and equipment | |
| CN107168539A (en) | A kind of equipment awakening method, device and electronic equipment | |
| US9367738B2 (en) | Method, apparatus and computer program for calculating current distribution inside brain | |
| KR101956073B1 (en) | 3d volumetric display device for providing user interface using visual indicator and method thereof | |
| CN105759961A (en) | Intelligent device and intelligent device control method | |
| US20180081455A1 (en) | Stylus for coordinate measuring | |
| CN108762505A (en) | Virtual object control method, device, storage medium based on gesture and equipment | |
| CN105242780B (en) | A kind of interaction control method and device | |
| CN105242825A (en) | Terminal control method and apparatus | |
| CN103414829A (en) | Method, device and terminal device for controlling screen contents | |
| US9047676B2 (en) | Data processing apparatus generating motion of 3D model and method | |
| CN105446605A (en) | Information processing method and electronic device | |
| CN110401773A (en) | The control method and relevant apparatus of screen state | |
| CN111610869B (en) | Touch pen, electronic device and control method | |
| CN108170261A (en) | Method and apparatus based on gesture manipulation screen shots | |
| CN106896387A (en) | Determine that portable terminal device is in the method and portable terminal device of indoor and outdoor | |
| CN106681506A (en) | Interaction method of non-VR application in terminal equipment and terminal equipment | |
| CN107632760A (en) | Written handwriting circle choosing method and device, touch apparatus, readable storage medium storing program for executing | |
| CN112416115B (en) | Method and equipment for performing man-machine interaction in control interaction interface | |
| CN108051001A (en) | A kind of robot movement control method, system and inertia sensing control device |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20180615 |