CN106569716A - One-hand operation and control method and control system - Google Patents
One-hand operation and control method and control system Download PDFInfo
- Publication number
- CN106569716A CN106569716A CN201610942444.6A CN201610942444A CN106569716A CN 106569716 A CN106569716 A CN 106569716A CN 201610942444 A CN201610942444 A CN 201610942444A CN 106569716 A CN106569716 A CN 106569716A
- Authority
- CN
- China
- Prior art keywords
- touch
- manipulation
- display screen
- control surface
- operation control
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
- 238000000034 method Methods 0.000 title claims abstract description 35
- 230000009471 action Effects 0.000 claims abstract description 27
- 238000013507 mapping Methods 0.000 claims description 17
- 238000006243 chemical reaction Methods 0.000 claims description 5
- 238000005516 engineering process Methods 0.000 description 5
- 230000008859 change Effects 0.000 description 4
- 238000005457 optimization Methods 0.000 description 4
- 238000007514 turning Methods 0.000 description 4
- 230000001788 irregular Effects 0.000 description 2
- 230000004308 accommodation Effects 0.000 description 1
- 230000009286 beneficial effect Effects 0.000 description 1
- 230000005540 biological transmission Effects 0.000 description 1
- 238000004891 communication Methods 0.000 description 1
- 238000010586 diagram Methods 0.000 description 1
- 230000004069 differentiation Effects 0.000 description 1
- 230000000694 effects Effects 0.000 description 1
- 230000005057 finger movement Effects 0.000 description 1
- 210000004247 hand Anatomy 0.000 description 1
- 238000003709 image segmentation Methods 0.000 description 1
- 238000005259 measurement Methods 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 238000012545 processing Methods 0.000 description 1
- 230000004044 response Effects 0.000 description 1
- 238000012546 transfer Methods 0.000 description 1
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
- G06F3/0487—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser
- G06F3/0488—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures
Landscapes
- Engineering & Computer Science (AREA)
- General Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Human Computer Interaction (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- User Interface Of Digital Computer (AREA)
- Position Input By Displaying (AREA)
Abstract
The invention discloses a one-hand operation and control method and operation and control system. The one-hand operation and control method includes the following steps that: S1, an operation and control surface and the depth image of an operation and control object on the operation and control surface are acquired; S2, the first position of the operation and control object on the operation and control surface is acquired according to the depth image; S3, a second position located on a display screen is located according to the first position of the operation and control object on the operation and control surface; S4, a predetermined operation and control action is determined according to the shape and motion of the operation and control object, and the predetermined operation and control action is identified and converted into a touch control instruction to be executed; and S5, and touch control operation is performed at the second position according to the touch control instruction. With the one-hand operation and control method and operation and control system of the invention adopted, one-hand operation and control on a large-screen electronic device can be realized through the operation and control surface, and touch control conflict can be avoided.
Description
Technical field
The present invention relates to electronic technology field, more particularly to a kind of singlehanded control method and control system.
Background technology
With the functional requirement more and more higher of the popularization and people of mobile Internet to smart machines such as mobile phones, while and
The functions such as standby communication, online and video playback are the configurations the most basic of current electronic equipment.At present as equipment such as mobile phones
Size has been most likely into the large-size screen monitors epoch, and one-handed performance is out of reach, even so, taking into account larger screen and one-handed performance
It is still demand of the current user to mobile phone.
By taking mobile phone as an example, it is a kind of scheme of solution one-handed performance that function key is increased after cell phone back, but undoubtedly can shadow
The attractive in appearance of the mobile phone back side is rung, thus this scheme is never easily accepted by a user.Another kind of scheme is to increase volume at the mobile phone back side
Outer touch screen, this scheme by overleaf using finger manipulation realize to mobile phone screen cannot one-handed performance region control
System.But this scheme is relatively costly, thus cannot become the one-handed performance scheme of main flow.
Meanwhile, touch control operation being carried out currently with depth image, can not realize to area between manipulation object and display screen
Overseas display screen carries out touch-control, manipulates object position on a display screen and directly maps corresponding on acquired depth image
The coordinate of pixel, that is, it is exactly pixel coordinate mapping of the manipulation object in depth image to manipulate object position on a display screen
, it is this directly by pixel coordinate map and obtain showing position on the screen method can not to manipulate object touch-control less than
Region carries out touch control operation, so the function of some such as page turnings can only be realized simply, it is impossible to solve the list of large-size screen monitors well
Handss manipulate problem.
Furthermore, the scheme that existing utilization depth image carries out touch-control is more by arranging depth camera in display screen side,
Manipulation object position on a display screen is obtained by obtaining the depth image of display screen, best mode connects in manipulation object
Obtained during tactile display screen, this method is applied to the display screen for not possessing touch function, for itself possesses touch function
Touch screen for, finger touch display screen can be identified to screen produce touch-control, if using now manipulate object position
Information carries out touch-control in other regions to display screen, and due to existing two touch commands are generated, and just causes touch-control conflict, so
Just again touch-control can not be carried out to other regions of display screen, when touch-control is carried out to other regions, touch object can only be required not
Contact with display screen, so that mapping relations when obtaining manipulation object position on a display screen by depth image compare
Complexity, experience weakens significantly.
The disclosure of background above technology contents is only used for inventive concept and the technical scheme for aiding in understanding the present invention, and it is not
The prior art of present patent application is necessarily belonged to, without tangible proof the applying date of the above in present patent application is being shown
In the case of disclosed, above-mentioned background technology should not be taken to evaluate the novelty and creativeness of the application.
The content of the invention
Present invention aim at a kind of singlehanded control method and control system are proposed, to solve what above-mentioned prior art was present
The display screen for singlehanded manipulation can not well be realized, possessing touch function to itself carries out the technology that touch-control is also easy to produce touch-control conflict
Problem.
For this purpose, the present invention proposes a kind of singlehanded control method, display screen is in different from the operation control surface for touch control operation
Plane on, comprise the following steps：S1：Obtain the depth image of the manipulation object on operation control surface and the operation control surface；S2：By depth
Degree image obtains first position of the manipulation object on operation control surface；S3：Determined according to first position of the manipulation object on operation control surface
Position goes out the second position positioned at display screen；S4：According to the shape and the predetermined control action of action determination of manipulation object, known
Touch command that is other and changing into needs execution；S5：Touch control operation is performed in second position according to the touch command.
Preferably, control method of the invention can also have following technical characteristic：
The operation control surface includes at least one manipulation region, and at least one manipulation region passes through the depth map for obtaining
The position of picture and the manipulation object of acquisition on the operation control surface delimited automatically.
Easily arrive on the operation control surface when size in the manipulation region delimited automatically is to manipulate object one-handed performance
Reach.
The display screen include for manipulate the easy touch-control of object to nearly Touch Zone and be not easy in addition to nearly Touch Zone to touch
The remote Touch Zone controlled, the manipulation object carries out singlehanded touch-control in nearly Touch Zone using the touch controllable function of display screen itself,
Remote Touch Zone carries out touch-control with the second position that positioning is obtained.
The nearly Touch Zone and remote Touch Zone delimited automatically according to the manipulation object in the position of display screen.
The obtaining step of the depth image includes：S11：Obtain comprising operation control surface and without the first depth of manipulation object
Image；S12：Obtain the second depth image containing operation control surface and manipulation object；S13：By second depth image and institute
State the 3rd depth image that the first depth image obtains the manipulation object.
Obtain the first position to comprise the steps：S21：Whether the manipulation object is judged according to the second depth image
Contact with the operation control surface, if contact, performs next step；S22：The manipulation object is obtained in institute according to the 3rd depth image
The spatial positional information of display screen place coordinate system is stated, the manipulation object vertex coordinate is taken as first position.
The acquisition of the second position is comprised the following steps：S31：Set up the mapping relations of operation control surface and the display screen；
S32：The second position of display screen is obtained by the mapping relations and the first position.
Horizontal stroke, longitudinal size according to the operation control surface and the display screen sets up linear mapping relation.
In addition, the invention allows for a kind of singlehanded control system, for performing above-mentioned touch control method, including image is obtained
Unit, processor, operation control surface and display screen are taken, at the operation control surface and display screen on a different plane；
Described image acquiring unit is used to obtain the depth image and the depth of manipulation object of operation control surface and manipulation object
Information；
The processor includes identification module, locating module, conversion module and performing module, and the identification module is used for root
First position of the manipulation object on operation control surface, and the predetermined manipulation for identifying manipulation object are obtained according to the depth image
Action；The locating module is used to position the second position on the display screen for needing manipulation according to the first position；Described turn
Change module and corresponding touch command is converted into according to predefined control action；The performing module is used in the second
The place of putting performs touch command and completes touch control operation on a display screen.
The beneficial effect that the present invention is compared with the prior art includes：
The present invention is that touch control operation is realized using depth image and is a kind of singlehanded control method, the control method
In.Operation control surface and display screen for manipulation is arranged on a different plane, and manipulation object completes touch control operation on operation control surface,
First position of the manipulation object on operation control surface is obtained using depth image, is further obtained on display screen by first position
The second position, with reference to predetermined control action, performs touch control operation, so when user is in the electronics to large-size screen monitors in second position
When equipment carries out touch-control, when carrying out touch-control to the display screen to possessing touch function, manipulation can be completed on operation control surface, it is complete
Into the determination of manipulation object position on a display screen, it is to avoid existing manipulation and the problem that touch-control conflicts occurs between touching.
Simultaneously for the region for being difficult to touch on display screen, only predetermined manipulation need to be simply completed on operation control surface
Action, just can carry out touch-control to the display screen of another plane, and on operation control surface, manipulation object can be contacted at the moment with operation control surface,
To facilitate the accurate quick obtaining of position of the manipulation object on operation control surface.
For prior art, the present invention not only can realize page turning, return to the display screen for not possessing touch function
Some simple gesture operations such as move back, moreover it is possible to realize singlehanded touch-control well, to it is singlehanded touch less than object can be by manipulation
Face carries out corresponding touch control operation, and can realize accurate touch-control.
In preferred version, operation control surface includes the manipulation region of at least more than one, to solve to manipulate the different touch of object
The acquisition and manipulation of the lower depth image of custom, such as right-hand man, manipulation region delimited automatically according to depth image, it is general and
Speech, manipulation region is a certain region on operation control surface set in advance, the position on manipulation object and depth using manipulation object
Image delimited automatically, just can carry out touch control operation without the need for requiring that manipulation object must be manipulated in a certain region, carried
The high experience of manipulation, particularly, the size in the manipulation region for manipulation object one-handed performance when on the operation control surface easily
Reach, with the shape that optimization manipulates regional assignment, be not limited to rectangle, can be easiest to touch on operation control surface according to manipulation object
The region shape touched is determined, generally irregular sector.
On the basis of based on above-mentioned control method, for display screen possesses touch controllable function in itself, carry out a kind of
Not only carried out mixing the pattern of manipulation using the touch controllable function of itself but also using the control method of directing, such as：The manipulation thing
Body carries out singlehanded touch-control in nearly Touch Zone using the touch controllable function of display screen itself, the second that positioning is obtained in remote Touch Zone
Putting carries out touch-control.This mixing control method can make up that the precision that causes greatly of randomness due to manipulating object movement is low to ask
Topic, provides the user a kind of more preferable experience scheme.Above-mentioned nearly Touch Zone and remote Touch Zone are also to be accustomed to according to the touch-control of user
Automatically delimited, with adapt to user manipulate when custom and the nearly Touch Zone of optimization and remote Touch Zone shape.
Depth image to obtaining carries out obtaining the 3rd of manipulation object according to the first depth image and the second depth image
Depth image, then according to the 3rd depth image obtaining first position, so only wraps due to obtaining the 3rd depth image
The depth image of manipulation object is included, so when obtaining to first position, the amount of calculation of processing procedure can be reduced, is improved
Arithmetic speed, improves the response speed of system.
By setting up mapping relations to being between the operation control surface of Different Plane and display screen, can quickly pass through first
The second position obtained on display screen is put, adopts linear mapping relation more to advise for rectangle etc. to operation control surface or manipulation region
Shape then, according to transverse and longitudinal size mapping relations are quickly set up.
Description of the drawings
Fig. 1 is the structural representation of the control system of the specific embodiment of the invention one；
Fig. 2 is the structural representation of the processor of the specific embodiment of the invention one.
Fig. 3 is the structural representation of the electronic equipment of the specific embodiment of the invention three.
Schematic rear view when Fig. 4 is the singlehanded manipulation mobile phone of the specific embodiment of the invention three and four.
Side schematic view when Fig. 5 is the singlehanded manipulation mobile phone of the specific embodiment of the invention three and four.
Fig. 6 is the schematic diagram of the mixing manipulation of the specific embodiment of the invention two and five.
Fig. 7 is the manipulation flow chart one of the specific embodiment of the invention four.
Fig. 8 is the manipulation flowchart 2 of the specific embodiment of the invention four.
Specific embodiment
With reference to specific embodiment and compare accompanying drawing the present invention is described in further detail.It is emphasized that
What the description below was merely exemplary, rather than in order to limit the scope of the present invention and its application.
With reference to the following drawings, the embodiment of non-limiting and nonexcludability will be described, wherein identical reference is represented
Identical part, unless stated otherwise.
Embodiment one：
The present embodiment proposes a kind of singlehanded control system, as shown in figure 1, including image acquisition unit 1, processor 2, behaviour
Control face 3 and display screen 4；
Described image acquiring unit 1 is used to obtain the depth image and the depth of manipulation object of operation control surface 3 and manipulation object
At degree information, the operation control surface 3 and display screen 4 on a different plane；
As shown in Fig. 2 the processor 2 includes identification module 21, locating module 22, conversion module 23 and performing module
24, the identification module 21 is used to obtain first position of the manipulation object on operation control surface 3, Yi Jishi according to the depth image
The predetermined control action of object is not gone out to manipulate；The locating module 22 is used to be positioned according to the first position needs manipulation
The second position on display screen 4；The conversion module 23 is used to be converted into corresponding touch-control according to predefined control action
Instruction；The performing module 24 is used to complete touch control operation on the display screen 4 in second position execution touch command；
The system can obtain the depth image of operation control surface 3 by image acquisition unit, while also can obtain and display screen 4
The depth image of the manipulation object of contact, manipulation object can be identified in the position of operation control surface 3 according to the depth image and
Action, so as to change into corresponding position and instruction on display screen 4, so just can realize the manipulation to equipment, this enforcement
In example, such as the display screen of E-book reader, it is contemplated that carrying out touch manipulation on a display screen can affect display effect, such as
In e-book constantly use finger page turning when hand will certainly shield portions screen, so as to affect reading experience.And utilize behaviour
Control object is manipulated on operation control surface, can mitigate this problem, lifts the experience of user.
Here image acquisition unit 1 is the depth camera based on structure light or TOF principles, has generally comprised reception single
Unit and transmitter unit composition.
The problem of touch-control conflict can be effectively avoided using operation control surface.Simultaneously for being difficult to what is touched on display screen
Region, only need to be simply completed predetermined control action on operation control surface, just can carry out touch-control to the display screen of another plane,
On operation control surface, manipulation object can be contacted at the moment with operation control surface, to facilitate the accurate fast of position of the manipulation object on operation control surface
Speed is obtained.
Embodiment two：
Compared to embodiment one, difference is that the display screen of the present embodiment completes to touch together with reference to operation control surface 3 and display screen 4
Control operation, the display screen 4 is touch screen.As shown in fig. 6,2. the touch screen includes nearly Touch Zone ①He Yuan Touch Zones, institute
1. the interior touch controllable function of itself according to the touch screen completes touch-control in the nearly Touch Zone to state manipulation object 16, described remote tactile
2. pointed to by operation control surface 16 and complete touch control operation in control area.
Specially：The nearly touch area that can reach of one hand 1. and the remote touch area that can not reach of one hand 2.,
1. nearly Touch Zone still adopt touch manipulation to ensure having more preferable precision, and 2. then adopts the of operation control surface 3 in remote Touch Zone
Performing manipulation, the present embodiment is particularly well-suited to current due to giant-screen for one position and the shape according to touch object and action
The equipment for causing singlehanded mobile phone that cannot be manipulated completely etc. to possess touch function.
Embodiment three：
The present embodiment proposes a kind of electronic equipment, and electronic equipment can be mobile phone, flat board, including for data transfer
Bus 5, as shown in figure 3,4 points of the bus is data/address bus, address bus and controlling bus, is respectively intended to transmission data, number
According to address and control signal.Be connected with the bus 4 have CPU6, display 7, IMU8 (inertial measuring unit), memorizer 9,
Photographic head 11, audio unit 12, network interface 13 and mouse/keyboard 14, for some possess the electronic equipment of touch function
For, the shown device 7 of its mouse-keyboard is replaced, the functional realiey such as IMU device is used to positioning, track.Memorizer 9 is used to store
Operating system, application program etc., it is also possible to for the ephemeral data during storage running.
Image acquisition unit 1 in the control system arranged on this electronic equipment corresponds to photographic head 11, the correspondence of processor 2
In CPU8, or single processor, display screen 4 corresponds to display 7, and operation control surface is arranged on the back side of mobile phone, and aobvious
Display screen is in different planes.
As shown in figure 4, photographic head 11 is generally secured on electronic equipment.In the present embodiment, take the photograph with existing device
As head is compared, there is larger difference in shooting direction.Existing photographic head is generally preposition or rearmounted, and such configuration cannot be obtained
The image of equipment itself.The configuration of photographic head 11 in the present embodiment can have various situations, and by means of rotary shaft, i.e., one kind is
The purpose shot to oneself is reached after by rotation photographic head is rotated by 90 °；Also it is a kind of be external camera form, will
Photographic head is connected entirely through certain fixation and with interfaces such as USB as one with equipment.Those skilled in the art
The form that photographic head is arranged on an electronic device can voluntarily be selected according to practical situation, be not limited.
Now, with existing photographic head for, the photographic head 11 of the present embodiment is depth camera, for obtaining target area
Depth image.
Schematic rear view when being singlehanded manipulation mobile phone shown in Fig. 4.Photographic head 11, photographic head 11 are configured with the top of mobile phone
Collection direction is top-down along mobile phone, can thus obtain operation control surface and finger (manipulation object) on the mobile phone back side
Image, side schematic view when being singlehanded manipulation mobile phone shown in Fig. 5,17 is the first position on operation control surface, and 16 are manipulation object.
It can also not possess touch function that the display 7 of electronic equipment can be to possess touch function, when not having
During standby touch function, only can be manipulated by operation control surface, when possessing touch function, be able to can be touched in manipulation object
Display screen area is manipulated, to touch less than region perform operation control surface manipulation.
Photographic head 11 in the present embodiment can also be common RGB photographic head, for shooting RGB image；Photographic head 11
Can be infrared camera, for shooting infrared image；Can also be depth camera, such as be based on structure light principle or be based on
Depth camera of TOF principles etc..
The depth image obtained using depth camera will not be affected by half-light, even if also can measure in night,
In addition, carry out positioning and action recognition using depth image can be more accurate compared to RGB image.Thus with following description
In, will be illustrated with depth camera and depth image.But the present invention should not be limited to depth camera.
Example IV：
A kind of singlehanded control method, with reference to shown in Fig. 4-5 and Fig. 7, comprises the following steps：
S1：Obtain the depth image of the manipulation object 16 on operation control surface 3 and the operation control surface 3；
S2：First position 17 of the manipulation object 16 on operation control surface 3 is obtained by depth image；
S3：The second position positioned at display screen 4 is oriented according to first position 17 of the manipulation object 16 on operation control surface 3；
S4：According to the shape and the predetermined control action of action determination of manipulation object 16, needs are identified and changed into
The touch command of execution；
S5：Touch control operation is performed in second position according to the touch command.
The operation control surface 3 includes at least one manipulation region 15, and at least one manipulation region 15 is by acquisition
The position of depth image and the manipulation object 16 of acquisition on the operation control surface 3 delimited automatically.Automatically the institute for delimiting
It is accessible on the operation control surface 3 during size manipulation 16 one-handed performance of object for stating manipulation region 15.Automatically delimit
During, contact point when can be contacted with operation control surface 3 according to manipulation object is determined, and is to assert this touch control operation is performed
The institute contacted with touch surface in secondary operation is a little as manipulation region 15.
Operation control surface 3 includes the manipulation region 15 of at least more than one, to solve to manipulate under the different touch custom of object 16
The acquisition and manipulation of depth image, such as right-hand man, manipulation region 15 delimited automatically according to depth image, it is however generally that,
Manipulation region 15 be operation control surface set in advance 3 on a certain region, using manipulation object 16 manipulation object 16 on position and
Depth image delimited automatically, just can carry out touch-control behaviour without the need for requiring that manipulation object 16 must be manipulated in a certain region
Make, improve the experience of manipulation, particularly, in the manipulation when size in the manipulation region 15 is manipulation 16 one-handed performance of object
Easy to reach on face 3, with optimization the shape that region 15 delimited is manipulated, and is not limited to rectangle, can be according to manipulation object 16 in behaviour
The region shape for being easiest to touch on control face 3 is determined, generally irregular sector.
Except comprising other irrelevant portions are also included in addition to operation control surface 3, finger in the depth image of acquisition, now then can be with
Limited by the measurement range to depth camera, that is, set certain threshold value, the depth information more than threshold value is gone
Remove, the information only containing the mobile phone back side and finger can be reduced the calculating of identification by the depth image for obtaining in this way
Amount.In order to further improve system running speed, operand is reduced, obtained using image segmentation when depth image is obtained
Take, one of which method is to comprise the steps：
S11：Obtain comprising operation control surface 3 and without the first depth image of manipulation object 16；
S12：Obtain the second depth image containing operation control surface 3 and manipulation object 16；
S13：It is deep by the 3rd of second depth image and first depth image acquisition manipulation object 16 the
Degree image.
The manipulation object 16 of the present embodiment is finger, the finger front end position that above-mentioned steps are obtained by background segment method
Depth image, can reduce amount of calculation when modeling, and improve calculating speed.
As shown in figure 8, obtain the first position 17 comprising the steps：
S21：Judge whether the manipulation object 16 contacts with the operation control surface 3 according to the second depth image, if contact,
Perform next step；
S22：Space bit of the manipulation object 16 in the place coordinate system of the display screen 4 is obtained according to the 3rd depth image
Confidence ceases, and takes the manipulation apex coordinate of object 16 as first position 17.
The acquisition of the second position is comprised the following steps：
S31：Set up the mapping relations of operation control surface 3 and the display screen 4；
S32：The second position of display screen 4 is obtained by the mapping relations and the first position 17.
Horizontal stroke, longitudinal size according to the operation control surface 3 and the display screen 4 sets up linear mapping relation.
By setting up mapping relations to being between the operation control surface 3 of Different Plane and display screen 4, can quickly pass through first
Position 17 obtains the second position on display screen 4, adopt linear mapping relation can to operation control surface 3 or manipulation region 15 for rectangle
Deng more regular shape, mapping relations are quickly set up according to transverse and longitudinal size.
In existing touching technique, positioning is completed simultaneously with touching, but this is infeasible at invisible back.
So that first position being operated again, control action can be angle between the change of finger shape, such as finger and display screen 4
The change of degree, or the action of finger, such as click action etc..It is existing skill to the shape and action recognition of finger
Art, not describes in detail here.
Certainly some operations without the need for positioning, such as the operation such as page turning, rollback are also not excluded for.For this generic operation, can be with
The shape or action for only recognizing finger just can be with.
In the present embodiment, when finger touches the back side, and reduce the angle of inclination of finger, then complete one click and move
Make.The shape of finger needs to preset with the manipulation instruction corresponding to action.When certain finger shape and action is recognized,
Processor then converts it into corresponding manipulation instruction.
Embodiment five：
In view of the randomness of finger movement, its precision is difficult to reach the degree of touch.Possesses touch thus for some
The singlehanded manipulation of functional mobile phone kind equipment, the region that can be reached in one hand still selects touch operation, and cannot arrive in one hand
It is a kind of scheme for having and more preferably experiencing that noncontact manipulation is implemented in the region for reaching.So the present embodiment display screen 4 possesses tactile for itself
The touch screen of control function, as shown in fig. 6, the display screen 4 is included for manipulating nearly Touch Zone that the easy touch-control of object 16 arrives 1.
Be not easy the remote Touch Zone that touch-control is arrived in addition to nearly Touch Zone, the manipulation object 16 utilizes display screen 4 itself in nearly Touch Zone
Touch controllable function carry out singlehanded touch-control, carry out touch-control with the second position that obtains of positioning in remote Touch Zone.
Hand size, handedness due to different user etc. is different from, thus for Touch Zone 1. with point to area
2. differentiation can be by system automatic identification and delimitation.I.e.：When the finger of the side of display screen 4 is contacted with touch display screen 4, then locate
The signal of the feedback of reason touch display screen 4 and corresponding touch command is performed at reason device, and work as the finger of the side of display screen 4 and touch
When display screen 4 is not contacted, depth camera identifies that this not after contact action, feeds back to processor, and processor is then to depth camera
The depth image of acquisition is processed, and by the second position touch control operation is carried out.
On the basis of based on above-mentioned control method, for display screen 4 possesses touch controllable function in itself, carry out a kind of
Not only carried out mixing the pattern of manipulation using the touch controllable function of itself but also using the control method of directing, such as：The manipulation thing
In nearly Touch Zone, using display screen 4, the touch controllable function of itself carries out singlehanded touch-control to body 16, positioning is obtained in remote Touch Zone the
Two positions carry out touch-control.This mixing control method can make up the precision that the randomness due to manipulating the movement of object 16 is caused greatly
Low problem, provides the user a kind of more preferable experience scheme.Above-mentioned nearly Touch Zone and remote Touch Zone are also touching according to user
Control custom delimited automatically, with adapt to user manipulate when custom and the nearly Touch Zone of optimization and remote Touch Zone shape.
It would be recognized by those skilled in the art that it is possible that numerous accommodations are made to above description, so embodiment is only
For describing one or more particular implementations.
Although having been described above and describing the example embodiment for being counted as the present invention, it will be apparent to those skilled in the art that
It can be variously modified and be replaced, without departing from the spirit of the present invention.Furthermore it is possible to make many modifications with by spy
Condition of pledging love is fitted to the religious doctrine of the present invention, without departing from invention described herein central concept.So, the present invention is unrestricted
May also include belonging to all embodiments and its equivalent of the scope of the invention in specific embodiment disclosed here, but the present invention
Thing.
Claims (10)
1. a kind of singlehanded control method, it is characterised in that display screen is in different planes from the operation control surface for touch control operation
On, comprise the following steps：
S1：Obtain the depth image of the manipulation object on operation control surface and the operation control surface；
S2：First position of the manipulation object on operation control surface is obtained by depth image；
S3：The second position positioned at display screen is oriented according to first position of the manipulation object on operation control surface；
S4：According to the shape and the predetermined control action of action determination of manipulation object, being identified and changing into needs what is performed
Touch command；
S5：Touch control operation is performed in second position according to the touch command.
2. control method as claimed in claim 1, it is characterised in that the operation control surface includes at least one manipulation region, extremely
Position of few one manipulation region by the depth image for obtaining and the manipulation object of acquisition on the operation control surface
Put and delimited automatically.
3. the control method that such as claim 2 is stated, it is characterised in that the size in the manipulation region delimited automatically is manipulation thing
It is accessible on the operation control surface during body one-handed performance.
4. control method as claimed in claim 1, it is characterised in that the display screen is included for manipulating the easy touch-control of object
To nearly Touch Zone and be not easy in addition to nearly Touch Zone the remote Touch Zone that touch-control is arrived, the manipulation object is in nearly Touch Zone using aobvious
The touch controllable function of display screen itself carries out singlehanded touch-control, and touch-control is carried out using the second position that positioning is obtained in remote Touch Zone.
5. control method as claimed in claim 4, it is characterised in that the nearly Touch Zone and remote Touch Zone are according to the manipulation
Object delimited automatically in the position of display screen.
6. control method as claimed in claim 1, it is characterised in that the obtaining step of the depth image includes：
S11：Obtain comprising operation control surface and without the first depth image of manipulation object；
S12：Obtain the second depth image containing operation control surface and manipulation object；
S13：3rd depth image of the manipulation object is obtained by second depth image and first depth image.
7. control method as claimed in claim 6, it is characterised in that obtain the first position and comprise the steps：
S21：Judge whether the manipulation object contacts with the operation control surface according to the second depth image, if contact, under performing
One step；
S22：Spatial positional information of the manipulation object in display screen place coordinate system is obtained according to the 3rd depth image,
The manipulation object vertex coordinate is taken as first position.
8. control method as claimed in claim 1, it is characterised in that the acquisition of the second position is comprised the following steps：
S31：Set up the mapping relations of operation control surface and the display screen；
S32：The second position of display screen is obtained by the mapping relations and the first position.
9. control method as claimed in claim 8, it is characterised in that according to the horizontal, vertical of the operation control surface and the display screen
Linear mapping relation is set up to size.
10. a kind of singlehanded control system, it is characterised in that：The touch control method described in any one of 1-9, bag are required for perform claim
Image acquisition unit, processor, operation control surface and display screen are included, at the operation control surface and display screen on a different plane；
Described image acquiring unit is used to obtain the depth image and the depth information of manipulation object of operation control surface and manipulation object；
The processor includes identification module, locating module, conversion module and performing module, and the identification module is used for according to institute
State depth image and obtain first position of the manipulation object on operation control surface, and identify that the predetermined manipulation of manipulation object is moved
Make；The locating module is used to position the second position on the display screen for needing manipulation according to the first position；The conversion
Module is converted into corresponding touch command according to predefined control action；The performing module is used in the second position
Place performs touch command and completes touch control operation on a display screen.
Priority Applications (2)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201610942444.6A CN106569716B (en) | 2016-10-25 | 2016-10-25 | Single-hand control method and control system |
| PCT/CN2017/089027 WO2018076720A1 (en) | 2016-10-25 | 2017-06-19 | One-hand operation method and control system |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201610942444.6A CN106569716B (en) | 2016-10-25 | 2016-10-25 | Single-hand control method and control system |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN106569716A true CN106569716A (en) | 2017-04-19 |
| CN106569716B CN106569716B (en) | 2020-07-24 |
Family
ID=58536395
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201610942444.6A Active CN106569716B (en) | 2016-10-25 | 2016-10-25 | Single-hand control method and control system |
Country Status (2)
| Country | Link |
|---|---|
| CN (1) | CN106569716B (en) |
| WO (1) | WO2018076720A1 (en) |
Cited By (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN107613094A (en) * | 2017-08-17 | 2018-01-19 | 珠海格力电器股份有限公司 | Method for operating mobile terminal by one hand and mobile terminal |
| WO2018076720A1 (en) * | 2016-10-25 | 2018-05-03 | 深圳奥比中光科技有限公司 | One-hand operation method and control system |
| WO2023220983A1 (en) * | 2022-05-18 | 2023-11-23 | 北京小米移动软件有限公司 | Control method and apparatus for switching single-hand mode, device and storage medium |
Families Citing this family (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN112204511A (en) * | 2018-08-31 | 2021-01-08 | 深圳市柔宇科技股份有限公司 | Input control method and electronic device |
Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102789568A (en) * | 2012-07-13 | 2012-11-21 | 浙江捷尚视觉科技有限公司 | Gesture identification method based on depth information |
| CN102937822A (en) * | 2012-12-06 | 2013-02-20 | 广州视声电子科技有限公司 | Reverse side controlling structure and method of mobile equipment |
| CN103176605A (en) * | 2013-03-27 | 2013-06-26 | 刘仁俊 | Control device of gesture recognition and control method of gesture recognition |
| US20130234949A1 (en) * | 2012-03-06 | 2013-09-12 | Todd E. Chornenky | On-Screen Diagonal Keyboard |
| CN103777701A (en) * | 2014-01-23 | 2014-05-07 | 深圳市国华光电研究所 | Large-screen touch screen electronic equipment |
| CN104331182A (en) * | 2014-03-06 | 2015-02-04 | 广州三星通信技术研究有限公司 | Portable terminal with auxiliary touch screen |
| CN104750188A (en) * | 2015-03-26 | 2015-07-01 | 小米科技有限责任公司 | Mobile terminal |
Family Cites Families (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US9423876B2 (en) * | 2011-09-30 | 2016-08-23 | Microsoft Technology Licensing, Llc | Omni-spatial gesture input |
| CN103440033B (en) * | 2013-08-19 | 2016-12-28 | 中国科学院深圳先进技术研究院 | A kind of method and apparatus realizing man-machine interaction based on free-hand and monocular cam |
| CN105824553A (en) * | 2015-08-31 | 2016-08-03 | 维沃移动通信有限公司 | Touch method and mobile terminal |
| CN106569716B (en) * | 2016-10-25 | 2020-07-24 | 深圳奥比中光科技有限公司 | Single-hand control method and control system |
-
2016
- 2016-10-25 CN CN201610942444.6A patent/CN106569716B/en active Active
-
2017
- 2017-06-19 WO PCT/CN2017/089027 patent/WO2018076720A1/en active Application Filing
Patent Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20130234949A1 (en) * | 2012-03-06 | 2013-09-12 | Todd E. Chornenky | On-Screen Diagonal Keyboard |
| CN102789568A (en) * | 2012-07-13 | 2012-11-21 | 浙江捷尚视觉科技有限公司 | Gesture identification method based on depth information |
| CN102937822A (en) * | 2012-12-06 | 2013-02-20 | 广州视声电子科技有限公司 | Reverse side controlling structure and method of mobile equipment |
| CN103176605A (en) * | 2013-03-27 | 2013-06-26 | 刘仁俊 | Control device of gesture recognition and control method of gesture recognition |
| CN103777701A (en) * | 2014-01-23 | 2014-05-07 | 深圳市国华光电研究所 | Large-screen touch screen electronic equipment |
| CN104331182A (en) * | 2014-03-06 | 2015-02-04 | 广州三星通信技术研究有限公司 | Portable terminal with auxiliary touch screen |
| CN104750188A (en) * | 2015-03-26 | 2015-07-01 | 小米科技有限责任公司 | Mobile terminal |
Cited By (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2018076720A1 (en) * | 2016-10-25 | 2018-05-03 | 深圳奥比中光科技有限公司 | One-hand operation method and control system |
| CN107613094A (en) * | 2017-08-17 | 2018-01-19 | 珠海格力电器股份有限公司 | Method for operating mobile terminal by one hand and mobile terminal |
| WO2023220983A1 (en) * | 2022-05-18 | 2023-11-23 | 北京小米移动软件有限公司 | Control method and apparatus for switching single-hand mode, device and storage medium |
Also Published As
| Publication number | Publication date |
|---|---|
| CN106569716B (en) | 2020-07-24 |
| WO2018076720A1 (en) | 2018-05-03 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| KR101872426B1 (en) | Depth-based user interface gesture control | |
| US9645693B2 (en) | Determining user handedness and orientation using a touchscreen device | |
| US10572012B2 (en) | Electronic device for performing gestures and methods for determining orientation thereof | |
| US9280282B2 (en) | Touch unlocking method and apparatus, and electronic device | |
| US9122353B2 (en) | Kind of multi-touch input device | |
| CN106569716A (en) | One-hand operation and control method and control system | |
| CN103686283A (en) | Smart television remote controller man-machine interaction method | |
| CN109933190B (en) | Head-mounted display equipment and interaction method thereof | |
| CN106062672B (en) | Device control | |
| CN106598422B (en) | hybrid control method, control system and electronic equipment | |
| US9880733B2 (en) | Multi-touch remote control method | |
| US9525906B2 (en) | Display device and method of controlling the display device | |
| US10877554B2 (en) | High efficiency input apparatus and method for virtual reality and augmented reality | |
| WO2020047742A1 (en) | Handwriting pad, handwriting pad apparatus and writing control method | |
| WO2021004413A1 (en) | Handheld input device and blanking control method and apparatus for indication icon of handheld input device | |
| CN112328164B (en) | Control method and electronic equipment | |
| CN105528059B (en) | A kind of gesture operation in three-dimensional space method and system | |
| WO2012008960A1 (en) | First response and second response | |
| CN110162251A (en) | Image-scaling method and device, storage medium, electronic equipment | |
| CN117695648B (en) | Virtual character movement and visual angle control method, device, electronic equipment and medium | |
| CN114415929A (en) | Control method and device of electronic equipment, electronic equipment and readable storage medium | |
| CN105528599A (en) | Image processing method and terminal equipment | |
| KR20140117067A (en) | Method for processing input by touch motion |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant | ||
| CP03 | Change of name, title or address |
Address after: No. 88, Gaoxin North 1st Road, Songpingshan Community, Xili Street, Nanshan District, Shenzhen City, Guangdong Province, China. 2001, Obi Technology Building Patentee after: Obi Zhongguang Technology Group Co.,Ltd. Country or region after: China Address before: A808 Zhongdi Building China University of Geosciences Industry University Research Base No 8 Yuexing 3rd Road Nanshan District Shenzhen Guangdong Province Patentee before: SHENZHEN ORBBEC Co.,Ltd. Country or region before: China |
|
| CP03 | Change of name, title or address |