CN106959808A - A kind of system and method based on gesture control 3D models - Google Patents
A kind of system and method based on gesture control 3D models Download PDFInfo
- Publication number
- CN106959808A CN106959808A CN201710196905.4A CN201710196905A CN106959808A CN 106959808 A CN106959808 A CN 106959808A CN 201710196905 A CN201710196905 A CN 201710196905A CN 106959808 A CN106959808 A CN 106959808A
- Authority
- CN
- China
- Prior art keywords
- finger
- screen
- gesture
- models
- control
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
- G06F3/0484—Interaction techniques based on graphical user interfaces [GUI] for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range
- G06F3/04845—Interaction techniques based on graphical user interfaces [GUI] for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range for image manipulation, e.g. dragging, rotation, expansion or change of colour
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
- G06F3/0487—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser
- G06F3/0488—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures
- G06F3/04883—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures for inputting data by handwriting, e.g. gesture or text
Abstract
The invention discloses a kind of system and method based on gesture control 3D models, belong to 3D model cootrols field.A kind of system based on gesture control 3D models, including, screen event catcher, real-time capture touch-screen left-hand seat self-explanatory characters' part；Gesture processor, coordinate is obtained according to from screen event catcher, calculates change vector；3D model rendering devices, displaying of the 3D models on screen is controlled according to change vector；Control instruction mapper, the corresponding 3D model cootrols instruction of record gesture；The finger information captured is passed to gesture processor by screen event catcher, change vector after calculating is transferred to 3D model rendering devices by gesture processor, display on 3D model renderings device control screen, correspondence carries out corresponding operating procedure, solve the 3D model manipulations engine for touch-screen mentioned in prior art at most to realize by two fingers while only supporting two kinds of operations, it is impossible to realize while supporting the problem of translation, rotation, three kinds of conventional operations of scaling.
Description
Technical field
The present invention relates to 3D model cootrols field, more specifically to a kind of system based on gesture control 3D models
And method.
Background technology
3D models in PC are typically controlled by mouse, i.e. the left button of mouse, right button and intermediate roller
To control the translation, rotation and scaling of 3D models respectively.As 3D models are developed rapidly in the equipment of touch-screen, Ren Menxi
Prestige equally can be operated easily in touch-screen to 3D models.Due to the current 3D model manipulation engines for being directed to touch-screen
Only support two kinds：One kind is singly referred in screen movement, and another is that double refer to is moved on screen；But if will be while Zhi Chiping
Move, rotate, scale three kinds of conventional operations, only do not accomplish by two kinds of gestures.Therefore, to 3D models in current touch-screen
Progress, which is operated, typically the combination of two classes：One class be with one kind be singly refer in screen movement with control 3D models translate and it is double refer to exist
Move to control 3D scaling of model on screen, it is another kind of be with one kind be singly refer in screen movement with control the flat rotation of 3D models with
And double fingers move to control 3D scaling of model on screen.The translation to 3D models, rotation and scaling three can not be supported simultaneously
Plant operation.
Chinese patent application, application number 201510063528.8, publication date on October 5th, 2016, and application number
201210063146.1, publication date 2012 year 09 month 12 days discloses a kind of Intelligent worn device and based on Intelligent worn device
The method for realizing gesture input, the Intelligent worn device is vision class Intelligent worn device, in the display of Intelligent worn device
In the case that device is transparent, methods described includes：The palmistry of the displacement in preset detection zone is obtained for Intelligent worn device
First spatial positional information, if being judged to meet the condition for triggering any preset function according to first spatial positional information,
Corresponding function is realized in triggering, and to complete the gesture input based on Intelligent worn device, Intelligent worn device can be enriched with this
Function, increases the application scenario of Intelligent worn device, is better achieved based on progress between Intelligent worn device and other equipment
Interact, and mode of operation can depart from touch-screen and 3D models are controlled.But this scheme has following defect：1) this scheme needs
By extra preset sensor to perceive specific gesture, this adds extra cost；2) this scheme is needed by shooting
The constantly sectional drawing of head is compared to control the precise displacement of gesture, can cause accuracy and performance because image compares scheme
It will substantially reduce, and need to consume very big internal memory.
Chinese patent application, application number 201010257613.5, publication date 2012 year 03 month 14 days is disclosed by electronics
The method and apparatus of the gesture control equipment operation of device screen, described method includes：Detect finger in electronic equipment screen
The starting point of the upper drag gesture for one of multiple operation objects；The drag gesture is followed, is moved on desired guiding trajectory
The plurality of operation object；The end point of the drag gesture is detected, allows the plurality of operation object to stop with the end of the drag gesture
Stay in current pre- stop place.This can be realized to the translation functions to picture in touch-screen, and forms certain dragging effect,
But this scheme can not be met while supporting the translation to 3D models, three kinds of operations of rotation and scaling.
Chinese patent application, application number 201110046519.X, publication date 2011 year 07 month 13 days is disclosed for touching
The bezel gestures of display, described method includes：Being extended using the frame of equipment can be by using so-called bezel gestures
Come the function of accessing.In at least certain embodiments, it can be created by frame using being moved outside screen by bezel gestures
Screen is inputted.It is different on hand that bezel gestures can include single finger bezel gestures, many finger/same-hand bezel frame gestures, and/or many fingers
Frame gesture.This scheme can realize the operating gesture based on the frame for touching aobvious device to control picture, game object etc. from touch
Screen is into and out but this scheme can not be met while supporting to the translations of 3D models, three kinds of operations of rotation and scaling.
Chinese patent application, application number 201410139930.5, publication date 2014 year 09 month 24 days discloses one kind and is based on
The method of gesture control screen-picture movement, described method includes：An at least contact gesture is obtained by touch-screen；Detection
And recognize whether the contact gesture is consistent with an at least preparatory condition；It is described in response to the preparatory condition if being consistent
The real-time pictures of touch-screen will rotate a default number of degrees automatically by axle center of screen midpoint and be converted at least one default picture.This side
Case can effectively solve user can not free switching screen horizontal/vertical screen display pattern the problem of, realization independently switched by user at any time
Effect of screen horizontal/vertical screen display pattern, but this scheme can not be met while translation, rotation and scaling of the support to 3D models
Three kinds of operations.
Chinese patent application, application number 201510731771.2, publication date 2016 year 02 month 17 days discloses a kind of use
The method of current scale screen picture, described method includes：：Detect palm form；When the palm form is from the first hand-type
When being transformed to the second hand-type, screen picture is set to scalable state；If the palm form remains the second hand-type, and
It is subjected to displacement on preset direction, then zooms in or out the screen picture, this scheme is by detecting that palm form controls image
Scaling, but this scheme can not be met while supporting to the translations of 3D models, three kinds of operations of rotation and scaling.
The content of the invention
1. the technical problem to be solved
Change for two finger spacing present in prior art to control the scaling of 3D models；Can not support simultaneously translation,
The problem of rotation, three kinds of conventional operations of scaling, the invention provides a kind of system and method based on gesture control 3D models.It
The translation, rotation, the realization for scaling three kinds of conventional operations for the operation engine for only supporting two fingers can be realized.
2. technical scheme
The purpose of the present invention is achieved through the following technical solutions.
A kind of system based on gesture control 3D models, including,
Screen event catcher, real-time capture touch-screen left-hand seat self-explanatory characters' part, and the number of the finger on screen is obtained in real time
And coordinate of the correspondence finger on screen；
Gesture processor, according to the finger number, event, screen coordinate obtained from screen event catcher according to calculating
Screen coordinate displacement control the specific change vector of 3D models；
3D model rendering devices, the change vector of the 3D models obtained according to operational order and from gesture processor controls 3D
Displaying of the model on screen；
Control instruction mapper, the corresponding 3D model cootrols instruction of record gesture；
The finger information captured is passed to gesture processor by screen event catcher, and gesture processor is by after calculating
Change vector is transferred to 3D model rendering devices, control instruction of the 3D model renderings device according to corresponding to control instruction mapper, control
Display on screen processed.
Further, the finger event of described screen event catcher is the event that finger is operated on the touchscreen,
Including but not limited to finger clicks on that screen, finger are slided on screen and finger frames out event.Finger support pattern
It is many, it is more convenient identification.
Further, one finger of record is static in control instruction mapper, the gesture correspondence that another finger is slided
The instruction of 3D model cootrols, this control instruction includes：Control the translation of 3D models, control 3D model rotations.Instruct controllable way
It is various, it is convenient and swift.
Further, control instruction mapper is provided for 3D model rendering devices and " referred to according to the corresponding control of gesture inquiry
Make " service.Obtain instruction direct, acquisition speed is fast, treatment effeciency is high.
A kind of method based on gesture control 3D models, step is as follows：
Event argument is obtained from touch-screen step 1, screen event catcher；
Step 2, gesture processor detection finger number, according to finger number judge finger number of the touch on screen whether etc.
In 2, if it is not, then terminating flow；If it is, continuing processing downwards；
Step 3, gesture processor detection gesture, respectively to wherein from the screen coordinate of finger event and correspondence finger
Two fingers are judged, if two fingers are all mobile, terminate flow；If two fingers are all static, return
To step 1；If the static finger movement of a finger, continues processing downwards；
Step 4, gesture processor calculate the coordinate offset vector after finger movement；
Step 5, gesture processor calculate 3D model cootrol values；
Step 6,3D model renderings device are drawn to 3D models, and " finger is quiet for acquisition from control instruction mapper
Only, the corresponding 3D model cootrols instruction of gesture of another finger slip ", if control instruction is movement, enters to 3D models
Row moving operation；If control instruction is rotation, rotation process is carried out to 3D models.
Further, in step 1, its event argument includes finger number, correspondence finger event, the screen of correspondence finger
Coordinate.
Further, in step 3, finger movement judges to determine by jitter value, and coordinate of the finger on screen is with before
The shift value that coordinate subtracts each other thinks that this finger is static less than jitter value, otherwise it is assumed that finger is movement.
Further, in step 4, this coordinate of mobile finger on screen is subtracted each other with a preceding coordinate, obtained
The coordinate offset vector in screen of this finger, i.e. the offset vector in X-axis is Δ x, and the offset vector in Y-axis is Δ
Y, this vector has directionality, i.e. positive direction and negative direction, and this vectorial direction is set to γ.
Further, step 5,3D model cootrol specific methods are calculated as follows, offset vector Δ x is multiplied by a ratio
Kx, obtains controlling value Vx；Offset vector Δ y is multiplied by a ratio K y, controlling value Vy is obtained；Ratio K x, Ky is any real number,
Set different according to different screen.Set-up mode is simple, conveniently moving.
Further, step 6, specific control mode is as follows, takes the absolute value of controlling value Vx, Vy, i.e., with controlling value Vx,
The corresponding arithmetic numbers of Vy control shift position or the anglec of rotation of the 3D renderers to 3D models, and 3D wash with watercolours is controlled with vector direction γ
Moving direction of the device in screen is contaminated, the control of this moving direction can be, but not limited to：Positive direction is to the right or translated up, losing side
To for the left or downwards translation；With vector direction γ control 3D renderers direction of rotation in screen, the control of this direction of rotation can
With but be not limited to：Positive direction is rotate counterclockwise, and negative direction is clockwise.Set-up mode is simple, conveniently moving.
3. beneficial effect
Compared to prior art, the advantage of the invention is that：
(1) a kind of system and method based on gesture control 3D models of the invention, it can realize that a finger is static,
The gesture operation method that another finger is slided, at most can just complete the translation to 3D models, rotation by 2 fingers and contract
Put, i.e., three kinds gestures：It is motionless that piece finger is slided, two fingers are all moved, a finger moves a finger, respectively control translation,
Rotation and scaling, the shortcoming of above-mentioned functions can not be completed by breaching existing 2 fingers of gesture operation method, be provided with new effect
Really；
(2) for the operation engine of only two kinds of gestures of support, this programme can realize that translation, rotation, three kinds of scaling are commonly used
Operation, utilization rate is high, reduces the cost of operation engine, efficiency high；
(3) present invention employs gesture processor new mechanism, according to the finger number obtained from screen event catcher,
Event, screen coordinate control the specific change vector of 3D models according to the screen coordinate displacement calculated, pass through vector
Change judges the movement of finger, determines the finger change of finger；
(4) judgement of jitter value is added when gesture processor detection gesture, jitter value is usually set in advance, typically
Jitter value is set to 2 millimeters, and this value can set different values according to different screens, and the big setting value of screen is big accordingly, screen
The small setting value of curtain is small accordingly, prevents that finger shake from causing erroneous judgement；
(5) control instruction mapper not only provides corresponding instruction, waits when necessary, and " root is provided for 3D model rendering devices
Inquire about corresponding control instruction according to gesture " service, the fast effect of inquiry velocity is good；
(6) 3D model control methods of the invention, control is simple, judges that speed is fast, low cost, it is easy in mobile Internet
In promote rapidly.
Brief description of the drawings
Fig. 1 is gesture schematic diagram of the invention；
Fig. 2 is the module map of gesture operation 3D model systems；
Fig. 3 is control flow chart of the invention.
Embodiment
With reference to Figure of description and specific embodiment, the present invention is described in detail.
Embodiment 1
The present invention constructs a kind of new gestural control system, static based on a finger, the hand that another finger is slided
Gesture method, the translation or rotation of 3D models are controlled to slide the relative coordinate of finger, as shown in Fig. 2 a kind of be based on gesture control
The system of 3D models processed, including screen event catcher, real-time capture touch-screen left-hand seat self-explanatory characters' part, and obtain in real time on screen
The number of finger, and coordinate of the correspondence finger on screen；And the finger information that this is captured is passed into gesture processor；
So-called finger event is exactly the event that finger is operated on the touchscreen, and this event includes but is not limited to finger and clicks on screen, finger
Slided on screen, finger such as frames out at the event；
Gesture processor, according to the finger number, event, screen coordinate obtained from screen event catcher according to calculating
Screen coordinate displacement control the specific change vector of 3D models；And this change vector after calculating is transferred to 3D models
Renderer；
3D model rendering devices, the change vector of the 3D models obtained according to operational order and from gesture processor controls 3D
Displaying of the model on screen；
Control instruction mapper, the corresponding 3D model cootrols instruction of record gesture；Control instruction mapper is 3D model wash with watercolours
Contaminate one finger of record in the service that device provides " inquiring about corresponding control instruction according to gesture ", control instruction mapper static,
The corresponding 3D model cootrols instruction of gesture that another finger is slided, this control instruction includes：To the translation of 3D models, to 3D models
Rotation.
The finger information captured is passed to gesture processor by screen event catcher, and gesture processor is by after calculating
Change vector is transferred to the display on 3D model rendering devices, 3D model renderings device control screen.
Pass through said system, it is possible to achieve the direct control of gesture is carried out to 3D models, it is static based on a finger, it is another
The gesture method that individual finger is slided, controls translation, the rotation of 3D models.
Embodiment 2
As shown in Figure 1,3, a kind of method based on gesture control 3D models, step is as follows：
Event argument is obtained from touch-screen step 1, screen event catcher；Event argument includes finger number, right
Answer finger event, the screen coordinate of correspondence finger.
Step 2, gesture processor detection finger number, according to finger number judge finger number of the touch on screen whether etc.
In 2, if it is not, then terminating flow；If it is, continuing processing downwards；
Step 3, gesture processor detection gesture, respectively to wherein from the screen coordinate of finger event and correspondence finger
Two fingers are judged, if two fingers are all mobile, terminate flow；If two fingers are all static, return
To step 1；If the static finger movement of a finger, continues processing downwards；Finger movement judges true by jitter value
It is fixed, coordinate of the finger on screen and the shift value that a preceding coordinate subtracts each other think less than jitter value this finger be it is static, it is no
It is movement then to think finger.Jitter value is usually set in advance, and general jitter value is set to 2 millimeters, and this value can be according to not
With screen and different values are set, the big setting value of screen is big accordingly, and the small setting value of screen is small accordingly, prevents that finger shake from leading
Cause erroneous judgement.
Step 4, gesture processor calculate the coordinate offset vector after finger movement；By this on screen of mobile finger
Coordinate subtracts each other with a preceding coordinate, obtains the coordinate offset vector in screen of this finger, i.e. the offset vector in X-axis is
Δ x, the offset vector in Y-axis is Δ y, and this vector has directionality, i.e. positive direction and negative direction, and this vectorial direction is set to
γ。
Step 5, gesture processor calculate 3D model cootrol values；Calculate 3D model cootrol specific methods as follows, will offset to
Amount Δ x is multiplied by a ratio K x, obtains controlling value Vx；Offset vector Δ y is multiplied by a ratio K y, controlling value Vy is obtained；Than
Value Kx, Ky is any real number, sets different according to different screen.
Step 6,3D model renderings device are drawn to 3D models, and " finger is quiet for acquisition from control instruction mapper
Only, the corresponding 3D model cootrols instruction of gesture of another finger slip ", if control instruction is movement, enters to 3D models
Row moving operation；If control instruction is rotation, rotation process is carried out to 3D models.Specific control mode is as follows, takes control
The absolute value of value Vx, Vy, i.e., control 3D renderers to the shift position of 3D models with the corresponding arithmetic number of controlling value Vx, Vy or
The anglec of rotation, moving direction of the 3D renderers in screen is controlled with vector direction γ, the control of this moving direction can with but do not limit
In：Positive direction is to the right or translated up that negative direction is to translate to the left or downwards；With vector direction γ control 3D renderers in screen
Direction of rotation in curtain, this direction of rotation control can be, but not limited to：Positive direction is rotate counterclockwise, and negative direction is clockwise.
Complete the corresponding operating to 3D models, swift and convenient to operate, efficiency high.
Embodiment 3
This 3D model-controlled systems, the gesture control 3D models translation also slided including the static finger of a finger,
Singly refer to mobile gesture control 3D models rotation, double fingers are while the gesture control 3D scaling of model of movement, embodiment is such as
Under：
Control instruction mapper：The corresponding relation of the corresponding 3D model cootrols instruction of gesture is recorded, i.e.,：" finger is quiet
Only, the corresponding 3D model cootrols instruction of gesture of another finger slip " is the translation of 3D models, " only has a finger and this hand
The corresponding 3D model cootrols instruction of gesture of finger slip " is the rotation of 3D models, and the gesture of " two fingers are slided simultaneously " is corresponding
The instruction of 3D model cootrols is 3D scaling of model；
Event argument is obtained from touch-screen, its event argument includes step 1, screen event catcher：Finger number,
The screen coordinate of correspondence finger event, correspondence finger；
Step 2, gesture processor detection finger number；According to finger number judge to touch finger number on screen whether etc.
In 2, if finger number is 1 and finger is moved, the translation logic of 3D models is performed, because finger number is 1 and finger is moved
Gesture is not the innovative part of the present invention, therefore is not described further herein；If finger number is 2, step 3 is continued executing with；Otherwise
Terminate flow；
Step 3, gesture processor detection gesture；Respectively to wherein from the screen coordinate of finger event and correspondence finger
Two fingers are judged：This coordinate of this finger on screen is less than jitter value 2 with the shift value that a preceding coordinate subtracts each other
Millimeter, that is, it is static to think this finger, otherwise it is assumed that finger is movement.If two fingers are all mobile, 3D models are performed
Scaling logic；If two fingers are all static, step 1 is back to；If the static finger movement of a finger,
Continue processing downwards；
Step 4, gesture processor calculate the coordinate offset vector after finger movement, by this on screen of mobile finger
Coordinate subtracts each other with a preceding coordinate, obtains the coordinate offset vector in screen of this finger, i.e. the offset vector in X-axis is
Δ x, the offset vector in Y-axis is Δ y, and this vector is all with direction, i.e. positive direction and negative direction, it is assumed that this vectorial side
To for γ；
Step 5, gesture processor calculate 3D model cootrol values, and offset vector Δ x is multiplied by into a ratio K x, controlled
Value Vx；Offset vector Δ y is multiplied by a ratio K y, controlling value Vy is obtained；Ratio K x, Ky can be any real number；
Step 6,3D model renderings device are drawn to 3D models；The absolute value of controlling value Vx, Vy is taken, i.e., with controlling value
The corresponding arithmetic number of Vx, Vy controls the 3D renderers to the shift positions of 3D models, is existed with vector direction γ control 3D renderers
Moving direction in screen, this moving direction control can be, but not limited to：Positive direction to the right or to translate up, negative direction be to
Left or translation downwards；The gesture that " finger is static, and another finger is slided " is obtained from control instruction mapper is corresponding
3D model cootrols are instructed, and this control instruction is movement, then moves operation to 3D models.
Embodiment 4
This 3D model-controlled systems, the gesture control 3D models rotation also slided including the static finger of a finger,
Singly refer to mobile gesture control 3D models translation, double fingers are while the gesture control 3D scaling of model of movement, embodiment is such as
Under：
Control instruction mapper：The corresponding relation of the corresponding 3D model cootrols instruction of gesture is recorded, i.e.,：" finger is quiet
Only, the corresponding 3D model cootrols instruction of gesture of another finger slip " is the rotation of 3D models, " only has a finger and this hand
The corresponding 3D model cootrols instruction of gesture of finger slip " is the translation of 3D models, and the gesture of " two fingers are slided simultaneously " is corresponding
The instruction of 3D model cootrols is 3D scaling of model；
Event argument is obtained from touch-screen, its event argument includes step 1, screen event catcher：Finger number,
The screen coordinate of correspondence finger event, correspondence finger；
Step 2, gesture processor detection finger number；According to finger number judge to touch finger number on screen whether etc.
In 2, if finger number is 1 and finger is moved, the Slewing logic of 3D models is performed；If finger number is 2, step is continued executing with
Rapid 3；Otherwise flow is terminated；
Step 3, gesture processor detection gesture；Respectively to wherein from the screen coordinate of finger event and correspondence finger
Two fingers are judged：This coordinate of this finger on screen is less than jitter value 2 with the shift value that a preceding coordinate subtracts each other
Millimeter, that is, it is static to think this finger, otherwise it is assumed that finger is movement；If two fingers are all mobile, 3D models are performed
Scaling logic；If two fingers are all static, step 1 is back to；If the static finger movement of a finger,
Continue processing downwards；
Step 4, gesture processor calculate the coordinate offset vector after finger movement；By this on screen of mobile finger
Coordinate subtracts each other with a preceding coordinate, obtains the coordinate offset vector in screen of this finger, i.e. the offset vector in X-axis is
Δ x, the offset vector in Y-axis is Δ y, and this vector is all with direction, i.e. positive direction and negative direction, it is assumed that this vectorial side
To for γ；
Step 5, gesture processor calculate 3D model cootrol values.Offset vector Δ x is multiplied by a ratio K x, controlled
Value Vx；Offset vector Δ y is multiplied by a ratio K y, controlling value Vy is obtained；Ratio K x, Ky can be any real number；
Step 6,3D model renderings device are drawn to 3D models；The absolute value of controlling value Vx, Vy is taken, i.e., with controlling value
The corresponding arithmetic number of Vx, Vy controls the 3D renderers to the anglecs of rotation of 3D models, is existed with vector direction γ control 3D renderers
Direction of rotation in screen, this direction of rotation control can be, but not limited to：Positive direction is rotate counterclockwise, and negative direction is up time
Pin；The corresponding 3D model cootrols of gesture of " finger is static, and another finger is slided " are obtained from control instruction mapper
Instruction, this control instruction is rotation, then carries out rotation process to 3D models.
Schematically the invention and embodiments thereof are described above, the description does not have restricted, not
In the case of the spirit or essential characteristics of the present invention, the present invention can be realized in other specific forms.Institute in accompanying drawing
What is shown is also one of embodiment of the invention, and actual structure is not limited thereto, any attached in claim
Icon note should not limit involved claim.So, if one of ordinary skill in the art is enlightened by it, do not departing from
In the case of this creation objective, the frame mode similar to the technical scheme and embodiment are designed without creative, all should
Belong to the protection domain of this patent.In addition, the word of " comprising " one is not excluded for other elements or step, the word of " one " one before element
It is not excluded for including " multiple " element.The multiple element stated in claim to a product can also by an element by software or
Person hardware is realized.The first, the second grade word is used for representing title, and is not offered as any specific order.
Claims (10)
1. a kind of system based on gesture control 3D models, it is characterised in that：Including,
Screen event catcher, real-time capture touch-screen left-hand seat self-explanatory characters' part, and the number of finger is obtained on screen in real time and right
Answer coordinate of the finger on screen；
Gesture processor, according to the finger number, event, screen coordinate obtained from screen event catcher according to the screen calculated
Curtain coordinate bit in-migration controls the specific change vector of 3D models；
3D model rendering devices, the change vector of the 3D models obtained according to operational order and from gesture processor controls 3D models
Displaying on screen；
Control instruction mapper, the corresponding 3D model cootrols instruction of record gesture；
The finger information captured is passed to gesture processor by screen event catcher, and gesture processor is by the change after calculating
Vector is transferred to 3D model rendering devices, control instruction of the 3D model renderings device according to corresponding to control instruction mapper, control flow
Display on curtain.
2. a kind of system based on gesture control 3D models according to claim 1, it is characterised in that：Described screen thing
The finger event of part catcher is the event that finger is operated on the touchscreen, and including but not limited to finger is clicked on screen, finger and existed
Slided on screen and finger frames out event.
3. a kind of system based on gesture control 3D models according to claim 1, it is characterised in that：Control instruction maps
One finger of record is static in device, and the corresponding 3D model cootrols instruction of the gesture that another finger is slided, this control instruction includes：
Control the translation of 3D models, control 3D model rotations.
4. a kind of system based on gesture control 3D models according to claim 1 or 3, it is characterised in that：Control instruction
Mapper provides the service of " inquiring about corresponding control instruction according to gesture " for 3D model rendering devices.
5. a kind of method based on gesture control 3D models, step is as follows：
Event argument is obtained from touch-screen step 1, screen event catcher；
Whether step 2, gesture processor detection finger number, be equal to 2 according to the finger number that finger number judges to touch on screen,
If it is not, then terminating flow；If it is, continuing processing downwards；
Step 3, gesture processor detection gesture, respectively to two of which from the screen coordinate of finger event and correspondence finger
Finger is judged, if two fingers are all mobile, terminates flow；If two fingers are all static, step is back to
Rapid 1；If the static finger movement of a finger, continues processing downwards；
Step 4, gesture processor calculate the coordinate offset vector after finger movement；
Step 5, gesture processor calculate 3D model cootrol values；
Step 6,3D model renderings device are drawn to 3D models, and the corresponding 3D models of gesture are obtained from control instruction mapper
Control instruction, if control instruction is movement, operation is moved to 3D models；If control instruction is rotation, to 3D
Model carries out rotation process.
6. a kind of method based on gesture control 3D models according to claim 5, it is characterised in that：In step 1, event
Key element includes the screen coordinate of finger number, correspondence finger event and correspondence finger.
7. a kind of method based on gesture control 3D models according to claim 5, it is characterised in that：In step 3, finger
It is mobile to judge to determine that the shift value that coordinate of the finger on screen subtracts each other with a preceding coordinate is less than jitter value i.e. by jitter value
It is static to think this finger, otherwise it is assumed that finger is movement.
8. a kind of method based on gesture control 3D models according to claim 5, it is characterised in that：In step 4, it will move
This coordinate for starting to refer on screen subtracts each other with a preceding coordinate, obtains the coordinate offset vector in screen of this finger, i.e.
Offset vector in X-axis is Δ x, and the offset vector in Y-axis is Δ y, and this vector has directionality, i.e. positive direction and losing side
To this vectorial direction is set to γ.
9. a kind of method based on gesture control 3D models according to claim 8, it is characterised in that：Step 5,3D is calculated
Model cootrol specific method is as follows, and offset vector Δ x is multiplied by into a ratio K x, controlling value Vx is obtained；Offset vector Δ y is multiplied
With a ratio K y, controlling value Vy is obtained；Ratio K x, Ky is any real number.
10. a kind of method based on gesture control 3D models according to claim 9, it is characterised in that：Step 6, specifically
Control mode is as follows, takes the absolute value of controlling value Vx, Vy, i.e., control 3D renderers with the corresponding arithmetic number of controlling value Vx, Vy
Shift position or the anglec of rotation to 3D models, moving direction of the 3D renderers in screen is controlled with vector direction γ, this shifting
Dynamic direction controlling can be, but not limited to：Positive direction is to the right or translated up that negative direction is to translate to the left or downwards；With vector side
To γ control 3D renderers direction of rotation in screen, the control of this direction of rotation can be, but not limited to：Positive direction is rotation counterclockwise
Turn, negative direction is clockwise.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201710196905.4A CN106959808A (en) | 2017-03-29 | 2017-03-29 | A kind of system and method based on gesture control 3D models |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201710196905.4A CN106959808A (en) | 2017-03-29 | 2017-03-29 | A kind of system and method based on gesture control 3D models |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN106959808A true CN106959808A (en) | 2017-07-18 |
Family
ID=59471057
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201710196905.4A Pending CN106959808A (en) | 2017-03-29 | 2017-03-29 | A kind of system and method based on gesture control 3D models |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN106959808A (en) |
Cited By (14)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN107678552A (en) * | 2017-10-27 | 2018-02-09 | 济南浪潮高新科技投资发展有限公司 | A kind of method and device by gesture control 3D model editing softwares |
| CN108846898A (en) * | 2018-05-30 | 2018-11-20 | 链家网（北京）科技有限公司 | A kind of method and device that 3D direction being presented on 3D building model |
| CN109445585A (en) * | 2018-10-22 | 2019-03-08 | 广州星唯信息科技有限公司 | One kind simulating true steering direction method based on gesture manipulation |
| CN109669609A (en) * | 2018-12-25 | 2019-04-23 | 广州市久邦数码科技有限公司 | A kind of 3-D graphic operating method and mobile terminal |
| CN109710153A (en) * | 2018-12-28 | 2019-05-03 | 广州市久邦数码科技有限公司 | A kind of 3-D graphic rotation process method and mobile terminal |
| CN110456974A (en) * | 2019-07-25 | 2019-11-15 | 广州彩构网络有限公司 | A kind of three-dimensional objects displaying exchange method and system based on multi-point touch-control panel |
| CN110597509A (en) * | 2018-10-10 | 2019-12-20 | 苏州好玩友网络科技有限公司 | Cross-platform GUI touch event analysis method under Unity environment |
| CN111026266A (en) * | 2019-11-29 | 2020-04-17 | 深圳维示泰克技术有限公司 | Interaction method and device for editing 3D model on mobile platform |
| CN111640182A (en) * | 2020-04-20 | 2020-09-08 | 南京征帆信息科技有限公司 | Wall surface texture drawing system and method |
| CN111831101A (en) * | 2019-04-22 | 2020-10-27 | 四川大学 | Leap Motion-based multi-feature dynamic gesture recognition method |
| CN112000259A (en) * | 2020-06-30 | 2020-11-27 | 深圳点猫科技有限公司 | Method and device for controlling camera based on touch event of mobile terminal |
| CN112379816A (en) * | 2020-12-21 | 2021-02-19 | 文县新农人农业科技有限公司 | Agricultural product information display processing method and device and electronic equipment |
| CN114327229A (en) * | 2020-09-25 | 2022-04-12 | 宏碁股份有限公司 | Image-based gesture control method and electronic device using same |
| CN115145456A (en) * | 2022-06-29 | 2022-10-04 | 重庆长安汽车股份有限公司 | Rotation of 3D car model control system and control method |
Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102169383A (en) * | 2010-11-26 | 2011-08-31 | 苏州瀚瑞微电子有限公司 | Identification method for rotating gestures of touch screen |
| CN103617220A (en) * | 2013-11-22 | 2014-03-05 | 北京掌阔移动传媒科技有限公司 | Method and device for implementing mobile terminal 3D (three dimensional) model |
| CN105214306A (en) * | 2015-09-02 | 2016-01-06 | 网易（杭州）网络有限公司 | The control method of a kind of game role control method and a kind of virtual controlling parts |
-
2017
- 2017-03-29 CN CN201710196905.4A patent/CN106959808A/en active Pending
Patent Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102169383A (en) * | 2010-11-26 | 2011-08-31 | 苏州瀚瑞微电子有限公司 | Identification method for rotating gestures of touch screen |
| CN103617220A (en) * | 2013-11-22 | 2014-03-05 | 北京掌阔移动传媒科技有限公司 | Method and device for implementing mobile terminal 3D (three dimensional) model |
| CN105214306A (en) * | 2015-09-02 | 2016-01-06 | 网易（杭州）网络有限公司 | The control method of a kind of game role control method and a kind of virtual controlling parts |
Cited By (16)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN107678552A (en) * | 2017-10-27 | 2018-02-09 | 济南浪潮高新科技投资发展有限公司 | A kind of method and device by gesture control 3D model editing softwares |
| CN108846898A (en) * | 2018-05-30 | 2018-11-20 | 链家网（北京）科技有限公司 | A kind of method and device that 3D direction being presented on 3D building model |
| CN110597509B (en) * | 2018-10-10 | 2023-10-03 | 苏州沁游网络科技有限公司 | Cross-platform GUI touch event analysis method in Unity environment |
| CN110597509A (en) * | 2018-10-10 | 2019-12-20 | 苏州好玩友网络科技有限公司 | Cross-platform GUI touch event analysis method under Unity environment |
| CN109445585A (en) * | 2018-10-22 | 2019-03-08 | 广州星唯信息科技有限公司 | One kind simulating true steering direction method based on gesture manipulation |
| CN109669609A (en) * | 2018-12-25 | 2019-04-23 | 广州市久邦数码科技有限公司 | A kind of 3-D graphic operating method and mobile terminal |
| CN109710153A (en) * | 2018-12-28 | 2019-05-03 | 广州市久邦数码科技有限公司 | A kind of 3-D graphic rotation process method and mobile terminal |
| CN111831101A (en) * | 2019-04-22 | 2020-10-27 | 四川大学 | Leap Motion-based multi-feature dynamic gesture recognition method |
| CN110456974A (en) * | 2019-07-25 | 2019-11-15 | 广州彩构网络有限公司 | A kind of three-dimensional objects displaying exchange method and system based on multi-point touch-control panel |
| CN111026266A (en) * | 2019-11-29 | 2020-04-17 | 深圳维示泰克技术有限公司 | Interaction method and device for editing 3D model on mobile platform |
| CN111640182A (en) * | 2020-04-20 | 2020-09-08 | 南京征帆信息科技有限公司 | Wall surface texture drawing system and method |
| CN111640182B (en) * | 2020-04-20 | 2023-04-07 | 南京征帆信息科技有限公司 | Wall surface texture drawing system and method |
| CN112000259A (en) * | 2020-06-30 | 2020-11-27 | 深圳点猫科技有限公司 | Method and device for controlling camera based on touch event of mobile terminal |
| CN114327229A (en) * | 2020-09-25 | 2022-04-12 | 宏碁股份有限公司 | Image-based gesture control method and electronic device using same |
| CN112379816A (en) * | 2020-12-21 | 2021-02-19 | 文县新农人农业科技有限公司 | Agricultural product information display processing method and device and electronic equipment |
| CN115145456A (en) * | 2022-06-29 | 2022-10-04 | 重庆长安汽车股份有限公司 | Rotation of 3D car model control system and control method |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN106959808A (en) | A kind of system and method based on gesture control 3D models | |
| CN104238949B (en) | A kind of multi-screen display method and device | |
| US8970490B2 (en) | Electronic device and a method for controlling the functions of the electronic device as well as program product for implementing the method | |
| CN104199547B (en) | Virtual touch screen operation device, system and method | |
| US10839572B2 (en) | Contextual virtual reality interaction | |
| TWI485600B (en) | Pattern swapping method and multi-touch device thereof | |
| US10180714B1 (en) | Two-handed multi-stroke marking menus for multi-touch devices | |
| CN105474150B (en) | Information processing unit, information processing method and program | |
| WO2013118373A1 (en) | Image processing apparatus, image processing method, and program | |
| CN105589553A (en) | Gesture control method and system for intelligent equipment | |
| WO2018099258A1 (en) | Method and device for flight control for unmanned aerial vehicle | |
| CN107577415A (en) | Touch operation response method and device | |
| JP2015035092A (en) | Display controller and method of controlling the same | |
| WO2017139141A1 (en) | Scroll mode for touch/pointing control | |
| US10656746B2 (en) | Information processing device, information processing method, and program | |
| US20180260044A1 (en) | Information processing apparatus, information processing method, and program | |
| CN104516638A (en) | Volume control method and device | |
| US20130127867A1 (en) | Freestyle drawing supported by stencil edge shapes | |
| CN105929954B (en) | It is a kind of control cursor method and device, display equipment | |
| KR20160097410A (en) | Method of providing touchless input interface based on gesture recognition and the apparatus applied thereto | |
| CN104199548A (en) | Man-machine interactive type virtual touch device, system and method | |
| JP2015138360A (en) | System, control program, and control method for object manipulation | |
| TWI486815B (en) | Display device, system and method for controlling the display device | |
| US10073612B1 (en) | Fixed cursor input interface for a computer aided design application executing on a touch screen device | |
| US20140111551A1 (en) | Information-processing device, storage medium, information-processing method, and information-processing system |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| TA01 | Transfer of patent application right |
Effective date of registration: 20191127 Address after: 210042 Xuanwu Avenue, Xuanwu District, Jiangsu, Nanjing 699-1 Applicant after: Taixuan Technology (Nanjing) Co., Ltd. Address before: 210000, Jiangsu, Jiangning, Nanjing District, Rong Qiao family 7, 1003 Applicant before: Wang Zheng |
|
| TA01 | Transfer of patent application right | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20170718 |
|
| RJ01 | Rejection of invention patent application after publication |