CN107024988A - A kind of method and device that operation is performed based on user action - Google Patents
A kind of method and device that operation is performed based on user action Download PDFInfo
- Publication number
- CN107024988A CN107024988A CN201710165230.7A CN201710165230A CN107024988A CN 107024988 A CN107024988 A CN 107024988A CN 201710165230 A CN201710165230 A CN 201710165230A CN 107024988 A CN107024988 A CN 107024988A
- Authority
- CN
- China
- Prior art keywords
- user
- time period
- preset time
- terminal
- action
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/017—Gesture based interaction, e.g. based on a set of recognized hand gestures
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F18/00—Pattern recognition
- G06F18/20—Analysing
- G06F18/22—Matching criteria, e.g. proximity measures
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
- G06F3/0484—Interaction techniques based on graphical user interfaces [GUI] for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
- G06V40/20—Movements or behaviour, e.g. gesture recognition
- G06V40/28—Recognition of hand or arm movements, e.g. recognition of deaf sign language
Abstract
The present invention provides a kind of method and device that operation is performed based on user action, to solve to need user frequently to adjust the progress of browsing during using terminal equipment browse information in the prior art, causes the problem of user is inconvenient for use.This method includes：Multiple images are continuously shot by the camera in terminal in preset time period；Action message of the terminal user in preset time period is obtained from multiple images；Action message is matched with deliberate action information, predetermined registration operation is performed in the case where the match is successful, the program make it that user's operation is more convenient, improves the experience of user.
Description
Technical field
The present invention relates to communication technical field, more particularly to a kind of method and device that operation is performed based on user action.
Background technology
With the arriving in mobile Internet epoch, the popularity rate more and more higher of smart mobile phone.User can more easily
Ground obtains information using smart mobile phone, such as browses webpage or browse document on internet etc..Existing smart mobile phone is general
Electric capacity screen is all configured, the size of screen is limited, but the information content on webpage is more, it is impossible to which the information on webpage is complete
Portion is shown on smart mobile phone screen, therefore user is frequently necessary to slide screen manually to continue to browse currently when browsing webpage
The content on screen is not shown in, as shown in Figure 1.Because user needs frequently to touch or slide screen when browsing webpage
Curtain, causes user to browse webpage more inconvenient, moreover, in the case where the hand of user has oil stain, dirt or the globule,
Also result in touching or slide screen operator failure so that user can not timely and effectively browse on screen and not show for the time being
Content, bad Consumer's Experience is caused to user.At present, user utilizes this mode of smart mobile phone reading information to user
Experience it is poor.
The content of the invention
It is existing to solve it is a primary object of the present invention to provide a kind of method and device that operation is performed based on user action
Need user frequently to adjust the progress of browsing when having using terminal equipment browse information in technology, cause user is awkward to ask
Topic.
According to an aspect of the invention, there is provided a kind of method that operation is performed based on user action, including：Default
Multiple images are continuously shot by the camera in terminal in period；Terminal user is obtained from multiple images in preset time
Action message in section；Action message is matched with deliberate action information, default behaviour is performed in the case where the match is successful
Make.
Optionally, multiple images are continuously shot by the camera in terminal in preset time period, including：When default
Between be continuously shot multipair image by two cameras being arranged in terminal in section, two cameras are front camera,
Two cameras are respectively arranged at two ends relative in terminal, and two cameras are located on same vertical curve.
Optionally, action message of the terminal user in preset time period is obtained from multiple images, including：From shooting
Three-dimensional information of user's hand in preset time period is obtained in multipair image；User's hand is obtained default according to three-dimensional information
Body-sensing data in period；Body-sensing data are identified, action message of the user in preset time period is obtained.
Optionally, three-dimensional information of user's hand in preset time period is obtained from the multipair image of shooting, including：Profit
Three-dimensional information of user's hand in preset time period is obtained from the multipair image of shooting with range of triangle method.
Optionally, predetermined registration operation includes following at least one operation：Slide screen operator, page turn over operation and exit current
Page operation.
According to the second aspect of the invention there is provided a kind of device that operation is performed based on user action, including：Shoot
Module, for being continuously shot multiple images by the camera in terminal in preset time period；Acquisition module, for from multiple
Action message of the terminal user in preset time period is obtained in image；Matching module, for by action message and deliberate action
Information is matched, and predetermined registration operation is performed in the case where the match is successful.
Optionally, above-mentioned taking module specifically for：Two shootings in preset time period by being arranged in terminal
Head is continuously shot multipair image, and two cameras are front camera, and two cameras are respectively arranged at relative in terminal
Two ends, two cameras are located on same vertical curve.
Optionally, above-mentioned acquisition module, including：First acquisition unit, for obtaining user from the multipair image of shooting
Three-dimensional information of the hand in preset time period；Second acquisition unit, for obtaining user's hand default according to three-dimensional information
Body-sensing data in period；Recognition unit, for body-sensing data to be identified, obtains user dynamic in preset time period
Make information.
Optionally, above-mentioned first acquisition unit specifically for：Obtained using range of triangle method from the multipair image of shooting
Take three-dimensional information of the family hand in preset time period.
Optionally, above-mentioned predetermined registration operation includes following at least one operation：Slide screen operator, page turn over operation and exit
Current page is operated.
The present invention has the beneficial effect that：
Scheme provided in an embodiment of the present invention, the information for the action that user performs, root are obtained using the camera in terminal
Determine whether to perform default assigned operation according to the action message so that terminal is capable of the behaviour of more intelligentized response user
Make so that user's operation is more convenient, improves the experience of user.
Brief description of the drawings
Accompanying drawing described herein is used for providing a further understanding of the present invention, constitutes the part of the application, this hair
Bright schematic description and description is used to explain the present invention, does not constitute inappropriate limitation of the present invention.In the accompanying drawings：
Fig. 1 is that user browses the corresponding operation chart of information using terminal in the prior art；
Fig. 2 is the flow chart of the method based on user action execution operation in the inventive method embodiment；
Fig. 3 is the structured flowchart of the device based on user action execution operation in apparatus of the present invention embodiment；
Fig. 4 is the structural representation of mobile terminal in terminal embodiment of the present invention.
Embodiment
Below in conjunction with the accompanying drawing in the embodiment of the present invention, the technical scheme in the embodiment of the present invention is carried out clear, complete
Site preparation is described, it is clear that described embodiment is only a part of embodiment of the invention, rather than whole embodiments.It is based on
Embodiment in the present invention, those of ordinary skill in the art obtained on the premise of creative work is not made it is all its
His embodiment, belongs to the scope of protection of the invention.
Embodiment of the method
A kind of method that operation is performed based on user action is present embodiments provided, Fig. 2 is the flow chart of this method, such as schemed
Shown in 2, this method includes following processing：
Step 201：Multiple images are continuously shot by the camera in terminal in preset time period；
In a specific example, multiple images tool is continuously shot by the camera in terminal in preset time period
Body by two cameras being arranged in terminal can be continuously shot multipair image in preset time period.As shown in figure 3, should
Two cameras are front camera, and two cameras are respectively arranged at upper and lower ends relative in terminal, and this two
Camera aligns, and on the same vertical curve, in the present embodiment, why it is required that the distance between two cameras
As far as possible big, is because the image that can be so shot according to two cameras obtain the three-dimensional of user based on Binocular Vision Principle
Information, and then the body-sensing data of active user can be obtained, the body-sensing data are identified can be dynamic with the current hand of user
Make, for the ease of processing subsequently to image, can make it that the parameters of two cameras are basically identical.
Step 202：Action message of the terminal user in preset time period is obtained in the multiple images obtained from shooting；
In a preferred example, action message tool of the terminal user in preset time period is obtained from multiple images
Body can be the action message of user's hand, based on this, terminal user be obtained from multiple images dynamic in preset time period
Making information can realize according to three below step：User's hand is obtained from the multipair image of shooting in preset time period
Three-dimensional information；Body-sensing data of user's hand in preset time period are obtained according to the three-dimensional information；The body-sensing data are entered
Row identification, obtains action message of user's hand in preset time period, wherein, range of triangle method can be specifically utilized from bat
Three-dimensional information of user's hand in preset time period is obtained in the multipair image taken the photograph；Can repeatedly it be obtained within the regular hour
The three-dimensional information of hand data, and then hand body-sensing data can be obtained, the body-sensing data, which are identified, can obtain user
The data of hand.
Step 203：The action message got is matched with deliberate action information, held in the case where the match is successful
Row predetermined registration operation.
In the present embodiment, when the action message got in step 202. and the basically identical feelings of deliberate action information
Under condition, you can be considered the two, the match is successful, or, the action message got in step 202. and deliberate action information
Between error be less than preset value in the case of, it is determined that the two the match is successful.
Involved predetermined registration operation can include following at least one operation in the present embodiment：
Slide screen operator, page turn over operation and exit current page operation, moved in the action message got with default
Make information matches it is successful in the case of, perform slide screen operator can be specifically, according to the amplitude size of user's hand motion
The big amplitude for determining to slide screen, can also preset specified slip amplitude, when performing page turn over operation, can current page base
Lower one page is jumped on plinth.The different operation of the different hand motion correspondence of user can also be pre-set in the present embodiment.
It should be noted that the hand motion in the present embodiment is a dynamic gesture, for example, user's finger or whole
Individual palm makes the action for sliding screen, and the action is the multidate information in preset time, and some not current prior arts
The gesture that middle user shows static state waits camera to shoot and recognize.
In a specific example, the method that the present embodiment is provided is applied to the given scenario of user's browsing pages, base
In this, can detect terminal be in browsing pages pattern when, that is, start perform it is above-mentioned based on user action perform operation
Two cameras in method, first control terminal are opened, and this method is being performed according to above-mentioned steps 201 to step 203.
The method that the present embodiment is provided so that the screen that user need not touch terminal just can reach page turning browsing pages information
Purpose so that avoid user needed when browsing longer info web repeatedly touching or slide terminal page turning trouble,
Avoid due to the thing for the touching screen that user's hand there are the factors such as oil stain, dirt or the globule to cause terminal None- identified user
The problem of part.
Device embodiment
A kind of device that operation is performed based on user action is present embodiments provided, the device is used to realize that the above method is real
The method provided in example is applied, Fig. 3 is the structured flowchart of the device, as shown in figure 3, the device 30 includes following part：
Taking module 31, for being continuously shot multiple images by the camera in terminal in preset time period；
The taking module 31 in preset time period by two cameras being arranged in terminal specifically for continuously being clapped
Multipair image is taken the photograph, two cameras are front camera, alignment respectively is arranged at upper and lower ends relative in terminal, and position
In on same vertical curve.
Acquisition module 32, for obtaining action message of the terminal user in preset time period from multiple images；
The acquisition module 32 can specifically include：First acquisition unit, for obtaining user from the multipair image of shooting
Three-dimensional information of the hand in preset time period；Second acquisition unit, for obtaining user's hand default according to three-dimensional information
Body-sensing data in period；Recognition unit, for body-sensing data to be identified, obtains user dynamic in preset time period
Make information, wherein, first acquisition unit specifically can be used for：Use is obtained from the multipair image of shooting using range of triangle method
Three-dimensional information of the family hand in preset time period.
Matching module 33, for action message to be matched with deliberate action information, holds in the case where the match is successful
Row predetermined registration operation.
In the present embodiment, predetermined registration operation can include following at least one operation：Slide screen operator, page turn over operation with
And exit current page operation.
The device that the present embodiment is provided so that the screen that user need not touch terminal just can reach page turning browsing pages information
Purpose so that avoid user needed when browsing longer info web repeatedly touching or slide terminal page turning trouble,
Avoid due to the thing for the touching screen that user's hand there are the factors such as oil stain, dirt or the globule to cause terminal None- identified user
The problem of part.
Terminal embodiment
As shown in figure 4, the embodiment of the present invention provides a kind of mobile terminal, including：
Memory 41, RF (Radio Freqency, radio frequency) circuit 42, WiFi module 43 and processor 44, WiFi module
Interconnected between 43 and processor 44 by bus, be stored with computer instruction in memory 41, processor 44 is by performing
Computer instruction, display unit 45 is used for presentation user interface, and the terminal is used to realize following methods：
Multiple images are continuously shot by the camera in terminal in preset time period；
Action message of the terminal user in preset time period is obtained in the multiple images obtained from shooting；
The action message got is matched with deliberate action information, default behaviour is performed in the case where the match is successful
Make.
Wherein, above-mentioned predetermined registration operation includes following at least one operation：Slide screen operator, page turn over operation and exit and work as
Preceding page operation.
Optionally, in some embodiments of wood invention, processor 44 can also be realized following by computer instructions
Method：
In preset time period multipair image, two cameras are continuously shot by two cameras being arranged in terminal
It is front camera, two cameras are respectively arranged at two ends relative in terminal, and two cameras are located at same vertical curve
On.
Three-dimensional information of user's hand in preset time period is obtained from the multipair image of shooting；
Body-sensing data of user's hand in preset time period are obtained according to three-dimensional information；
Body-sensing data are identified, action message of the user in preset time period is obtained.
Three-dimensional letter of user's hand in preset time period is obtained from the multipair image of shooting using range of triangle method
Breath.
The terminal that the present embodiment is provided so that the screen that user need not touch terminal just can reach page turning browsing pages information
Purpose so that avoid user needed when browsing longer info web repeatedly touching or slide terminal page turning trouble,
Avoid due to the thing for the touching screen that user's hand there are the factors such as oil stain, dirt or the globule to cause terminal None- identified user
The problem of part.
Embodiments of the invention are the foregoing is only, are not intended to limit the invention, for those skilled in the art
For member, the present invention can have various modifications and variations.Any modification within the spirit and principles of the invention, being made,
Equivalent substitution, improvement etc., should be included within scope of the presently claimed invention.
Claims (10)
1. a kind of method that operation is performed based on user action, it is characterised in that including：
Multiple images are continuously shot by the camera in terminal in preset time period；
Action message of the terminal user in the preset time period is obtained from the multiple image；
The action message is matched with deliberate action information, predetermined registration operation is performed in the case where the match is successful.
2. according to the method described in claim 1, it is characterised in that described to pass through the camera in terminal in preset time period
Multiple images are continuously shot, including：
In the preset time period multipair image, described two are continuously shot by two cameras being arranged in the terminal
Individual camera is front camera, and described two cameras are respectively arranged at two ends relative in the terminal, described two
Camera is located on same vertical curve.
3. method according to claim 2, it is characterised in that described that terminal user is obtained from the multiple image in institute
The action message in preset time period is stated, including：
Three-dimensional information of user's hand in the preset time period is obtained from the multipair image of shooting；
Body-sensing data of the user's hand in preset time period are obtained according to the three-dimensional information；
The body-sensing data are identified, action message of the user in the preset time period is obtained.
4. method according to claim 3, it is characterised in that user's hand is obtained in the multipair image from shooting and is existed
Three-dimensional information in the preset time period, including：
User's hand is obtained from the multipair image of shooting in the preset time period using range of triangle method
Three-dimensional information.
5. the method according to Claims 1-4 any one, it is characterised in that the predetermined registration operation include it is following at least
One kind operation：
Slide screen operator, page turn over operation and exit current page operation.
6. a kind of device that operation is performed based on user action, it is characterised in that including：
Taking module, for being continuously shot multiple images by the camera in terminal in preset time period；
Acquisition module, for obtaining action message of the terminal user in the preset time period from the multiple image；
Matching module, for the action message to be matched with deliberate action information, is performed in the case where the match is successful
Predetermined registration operation.
7. device according to claim 6, it is characterised in that the taking module specifically for：
In the preset time period multipair image, described two are continuously shot by two cameras being arranged in the terminal
Individual camera is front camera, and described two cameras are respectively arranged at two ends relative in the terminal, described two
Camera is located on same vertical curve.
8. device according to claim 7, it is characterised in that the acquisition module, including：
First acquisition unit, for obtaining three-dimensional letter of user's hand in the preset time period from the multipair image of shooting
Breath；
Second acquisition unit, for obtaining body-sensing number of the user's hand in preset time period according to the three-dimensional information
According to；
Recognition unit, for the body-sensing data to be identified, obtains action of the user in the preset time period
Information.
9. device according to claim 8, it is characterised in that the first acquisition unit specifically for：
User's hand is obtained from the multipair image of shooting in the preset time period using range of triangle method
Three-dimensional information.
10. the device according to claim 6 to 9 any one, it is characterised in that the predetermined registration operation include it is following at least
One kind operation：
Slide screen operator, page turn over operation and exit current page operation.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201710165230.7A CN107024988A (en) | 2017-03-20 | 2017-03-20 | A kind of method and device that operation is performed based on user action |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201710165230.7A CN107024988A (en) | 2017-03-20 | 2017-03-20 | A kind of method and device that operation is performed based on user action |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN107024988A true CN107024988A (en) | 2017-08-08 |
Family
ID=59525740
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201710165230.7A Pending CN107024988A (en) | 2017-03-20 | 2017-03-20 | A kind of method and device that operation is performed based on user action |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN107024988A (en) |
Cited By (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN108932090A (en) * | 2018-05-29 | 2018-12-04 | 北京小米移动软件有限公司 | terminal control method, device and storage medium |
| CN110170999A (en) * | 2019-05-29 | 2019-08-27 | 大国创新智能科技(东莞)有限公司 | Real-time printing method and robot system based on deep learning |
| WO2020097830A1 (en) * | 2018-11-14 | 2020-05-22 | 华为技术有限公司 | Handheld mobile terminal control method and related apparatus |
Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US7352358B2 (en) * | 2002-07-27 | 2008-04-01 | Sony Computer Entertainment America Inc. | Method and system for applying gearing effects to acoustical tracking |
| CN102323859A (en) * | 2011-09-08 | 2012-01-18 | 昆山市工业技术研究院有限责任公司 | Teaching materials Play System and method based on gesture control |
| CN103646425A (en) * | 2013-11-20 | 2014-03-19 | 深圳先进技术研究院 | A method and a system for body feeling interaction |
| CN103940370A (en) * | 2014-04-29 | 2014-07-23 | 西安电子科技大学 | Target object three-dimensional information acquisition method based on periodical co-prime hybrid coding |
| CN105141785A (en) * | 2015-10-15 | 2015-12-09 | 北京锤子数码科技有限公司 | Telephone answering method and device |
| CN106127142A (en) * | 2016-06-21 | 2016-11-16 | 北京小米移动软件有限公司 | Object tracking method and device |
-
2017
- 2017-03-20 CN CN201710165230.7A patent/CN107024988A/en active Pending
Patent Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US7352358B2 (en) * | 2002-07-27 | 2008-04-01 | Sony Computer Entertainment America Inc. | Method and system for applying gearing effects to acoustical tracking |
| CN102323859A (en) * | 2011-09-08 | 2012-01-18 | 昆山市工业技术研究院有限责任公司 | Teaching materials Play System and method based on gesture control |
| CN103646425A (en) * | 2013-11-20 | 2014-03-19 | 深圳先进技术研究院 | A method and a system for body feeling interaction |
| CN103940370A (en) * | 2014-04-29 | 2014-07-23 | 西安电子科技大学 | Target object three-dimensional information acquisition method based on periodical co-prime hybrid coding |
| CN105141785A (en) * | 2015-10-15 | 2015-12-09 | 北京锤子数码科技有限公司 | Telephone answering method and device |
| CN106127142A (en) * | 2016-06-21 | 2016-11-16 | 北京小米移动软件有限公司 | Object tracking method and device |
Cited By (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN108932090A (en) * | 2018-05-29 | 2018-12-04 | 北京小米移动软件有限公司 | terminal control method, device and storage medium |
| WO2020097830A1 (en) * | 2018-11-14 | 2020-05-22 | 华为技术有限公司 | Handheld mobile terminal control method and related apparatus |
| CN110170999A (en) * | 2019-05-29 | 2019-08-27 | 大国创新智能科技(东莞)有限公司 | Real-time printing method and robot system based on deep learning |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| KR101951135B1 (en) | Method for scaling video image, and mobile terminal | |
| US10222968B2 (en) | Image display control apparatus, image display apparatus, non-transitory computer readable medium, and image display control method | |
| CN109583320A (en) | Fingerprint identification method and relevant apparatus | |
| US9582172B2 (en) | Display control apparatus and method, image display apparatus, and non-transitory computer readable medium | |
| CN104615343A (en) | Terminal printscreen method and device | |
| US9430989B2 (en) | Image display control apparatus, image display apparatus, non-transitory computer readable medium, and image display method for displaying images on a divided display | |
| US20150192990A1 (en) | Display control method, apparatus, and terminal | |
| EP2890105A1 (en) | Method, apparatus and terminal for generating thumbnail of image | |
| CN106572207B (en) | Device and method for identifying single-hand mode of terminal | |
| CN110109609B (en) | Display control apparatus and method, and image display apparatus | |
| CN105446607A (en) | Camera touch shooting method and touch terminal thereof | |
| CN105824553A (en) | Touch method and mobile terminal | |
| CN107024988A (en) | A kind of method and device that operation is performed based on user action | |
| CN105426067A (en) | Desktop icon replacement method and apparatus | |
| CN107728877B (en) | Application recommendation method and mobile terminal | |
| CN105892881A (en) | Human-computer interaction method and device, and mobile equipment | |
| CN107885415A (en) | Control method for screen display, device and mobile terminal | |
| CN109284060A (en) | Display control method and relevant apparatus | |
| CN111913674A (en) | Virtual content display method, device, system, terminal equipment and storage medium | |
| CN106775342A (en) | Picture method of cutting out and device based on pressure sensitive technology | |
| CN105335067B (en) | A kind of pair of picture carries out the method and device of mosaic processing | |
| KR20160035911A (en) | Mobile terminal and method for controlling the same | |
| CN104765564B (en) | A kind of screenshot method and device | |
| CN104423774A (en) | Method and equipment for determining mobile terminal operation with left hand or right hand on the basis of fingerprint information | |
| CN109298827A (en) | Suitable for mobile terminal screenshot method, device, computing device and storage medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination |