CN108346168A - A kind of images of gestures generation method, device and storage medium - Google Patents
A kind of images of gestures generation method, device and storage medium Download PDFInfo
- Publication number
- CN108346168A CN108346168A CN201810145637.8A CN201810145637A CN108346168A CN 108346168 A CN108346168 A CN 108346168A CN 201810145637 A CN201810145637 A CN 201810145637A CN 108346168 A CN108346168 A CN 108346168A
- Authority
- CN
- China
- Prior art keywords
- artis
- dimensional
- gestures
- images
- coordinate
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
- 238000000034 method Methods 0.000 title claims abstract description 74
- 230000009466 transformation Effects 0.000 claims abstract description 283
- 239000011159 matrix material Substances 0.000 claims abstract description 195
- 238000013519 translation Methods 0.000 claims description 29
- 230000008569 process Effects 0.000 claims description 26
- 238000013507 mapping Methods 0.000 claims description 19
- 210000003811 finger Anatomy 0.000 description 108
- 230000014616 translation Effects 0.000 description 27
- 210000003813 thumb Anatomy 0.000 description 20
- 238000010586 diagram Methods 0.000 description 18
- 210000004932 little finger Anatomy 0.000 description 13
- 230000006870 function Effects 0.000 description 11
- 238000012545 processing Methods 0.000 description 11
- 238000012549 training Methods 0.000 description 9
- 230000008859 change Effects 0.000 description 7
- 230000000694 effects Effects 0.000 description 7
- 230000006854 communication Effects 0.000 description 6
- 238000004891 communication Methods 0.000 description 5
- 239000007787 solid Substances 0.000 description 4
- 238000013528 artificial neural network Methods 0.000 description 3
- 230000006399 behavior Effects 0.000 description 3
- 238000005452 bending Methods 0.000 description 3
- 238000005516 engineering process Methods 0.000 description 3
- 244000060701 Kaempferia pandurata Species 0.000 description 2
- 235000016390 Uvaria chamae Nutrition 0.000 description 2
- 238000006243 chemical reaction Methods 0.000 description 2
- 230000005484 gravity Effects 0.000 description 2
- 239000004973 liquid crystal related substance Substances 0.000 description 2
- 230000007774 longterm Effects 0.000 description 2
- 238000012544 monitoring process Methods 0.000 description 2
- 230000003287 optical effect Effects 0.000 description 2
- 230000003362 replicative effect Effects 0.000 description 2
- 230000001133 acceleration Effects 0.000 description 1
- 230000005540 biological transmission Effects 0.000 description 1
- 210000004556 brain Anatomy 0.000 description 1
- 238000010276 construction Methods 0.000 description 1
- 238000005314 correlation function Methods 0.000 description 1
- 230000001419 dependent effect Effects 0.000 description 1
- 229910003460 diamond Inorganic materials 0.000 description 1
- 239000010432 diamond Substances 0.000 description 1
- 230000004069 differentiation Effects 0.000 description 1
- 230000005611 electricity Effects 0.000 description 1
- 238000007689 inspection Methods 0.000 description 1
- 238000010801 machine learning Methods 0.000 description 1
- 238000010295 mobile communication Methods 0.000 description 1
- 210000005036 nerve Anatomy 0.000 description 1
- 230000002093 peripheral effect Effects 0.000 description 1
- 238000007430 reference method Methods 0.000 description 1
- 230000003068 static effect Effects 0.000 description 1
- 238000010897 surface acoustic wave method Methods 0.000 description 1
- 230000000007 visual effect Effects 0.000 description 1
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T11/00—2D [Two Dimensional] image generation
-
- G06T3/06—
Abstract
The embodiment of the invention discloses a kind of images of gestures generation method, device and storage medium, the embodiment of the present invention can obtain multigroup transformation parameter, construct transformation matrix of coordinates respectively according to multigroup transformation parameter, obtain multiple transformation matrix of coordinates；According to each transformation matrix of coordinates, the three-dimensional coordinate point of each artis position of composition gesture is obtained；According to the three-dimensional coordinate point of each artis position, the two-dimensional coordinate point of each artis is determined；Each artis is labeled according to the two-dimensional coordinate of each artis point, and images of gestures is generated according to each artis after mark.The program realizes the images of gestures for automatically generating and marking each artis in gesture, without operations such as each artis for manually being taken pictures and being marked gesture, improves reliability and convenience that images of gestures generates.
Description
Technical field
The present invention relates to technical field of image processing, and in particular to a kind of images of gestures generation method, device and storage are situated between
Matter.
Background technology
In machine learning, training sample is the important factor in order of the accurate model for obtaining neural network, for training
The neural network needs the image for largely marking the two-dimentional gesture for the artis for having finger as training sample, in order to
To do gesture classification or estimation etc. from two-dimentional gesture.
In the prior art, training sample in order to obtain, needs technical staff to take pictures manually to the gesture of people, obtains figure
Then picture is manually labeled each artis of gesture in the image, obtains training sample.However one nerve of training
Network generally requires enormous amount and the miscellaneous training sample of gesture.
Due to manually carrying out the operations such as gesture and each artis of mark of taking pictures, one is trained in order to obtain
Training sample needed for the neural network of gesture identification needs to consume a large amount of human costs, and in the mark of gesture artis
In will appear mark point deviate physical location the problem of, or even in the gesture of some serious shieldings mark be easy error, and
Different people, which is labeled, has larger difference, causes artificial mark to easy to produce error, greatly reduces training sample and obtain
The reliability and convenience taken.
Invention content
A kind of images of gestures generation method of offer of the embodiment of the present invention, device and storage medium, it is intended to improve images of gestures
The reliability and convenience of generation.
In order to solve the above technical problems, the embodiment of the present invention provides following technical scheme：
A kind of images of gestures generation method, including：
Multigroup transformation parameter is obtained, transformation matrix of coordinates is constructed according to multigroup transformation parameter respectively, multiple coordinates is obtained and becomes
Change matrix；
According to each transformation matrix of coordinates, the three-dimensional coordinate point of each artis position of composition gesture is obtained；
According to the three-dimensional coordinate point of each artis position, the two-dimensional coordinate point of each artis is determined；
Each artis is labeled according to the two-dimensional coordinate point of each artis, and according to each of after mark
Artis generates images of gestures.
A kind of images of gestures generating means, including：
Acquiring unit constructs transformation matrix of coordinates according to multigroup transformation parameter, obtains respectively for obtaining multigroup transformation parameter
To multiple transformation matrix of coordinates；
Converter unit, for according to each transformation matrix of coordinates, obtaining each artis position of composition gesture
Three-dimensional coordinate point；
Determination unit determines each artis for the three-dimensional coordinate point according to each artis position
Two-dimensional coordinate point；
Generation unit, for being labeled to each artis according to the two-dimensional coordinate point of each artis, and root
Images of gestures is generated according to each artis after mark.
A kind of storage medium, the storage medium are stored with a plurality of instruction, and described instruction is loaded suitable for processor, with
Execute the step in above-mentioned images of gestures generation method.
The embodiment of the present invention can construct transformation matrix of coordinates respectively according to the multigroup transformation parameter got, obtain multiple
Transformation matrix of coordinates, and according to each transformation matrix of coordinates, obtain the three-dimensional of each artis position of composition gesture
Coordinate points；According to the three-dimensional coordinate point of each artis position, the two-dimensional coordinate point of each artis is determined；Then basis
The two-dimensional coordinate point of each artis is labeled each artis, and generates gesture figure according to each artis after mark
Picture.The program realizes the images of gestures for automatically generating and marking each artis in gesture, and can be according to coordinate transform
The three-dimensional coordinate point that matrix obtains determines the two-dimensional coordinate point of each artis, further according to the two-dimensional coordinate point of each artis
Each artis is labeled, without operations such as each artis for manually being taken pictures and being marked gesture, is carried
The reliability and convenience that high images of gestures generates.
Description of the drawings
To describe the technical solutions in the embodiments of the present invention more clearly, make required in being described below to embodiment
Attached drawing is briefly described, it should be apparent that, drawings in the following description are only some embodiments of the invention, for
For those skilled in the art, without creative efforts, it can also be obtained according to these attached drawings other attached
Figure.
Fig. 1 is the schematic diagram of a scenario that images of gestures provided in an embodiment of the present invention generates system；
Fig. 2 is a flow diagram of images of gestures generation method provided in an embodiment of the present invention；
Fig. 3 is the schematic diagram of gesture construction provided in an embodiment of the present invention；
Fig. 4 is the signal provided in an embodiment of the present invention converted according to coordinate spin matrix to presetting three-dimensional system of coordinate
Figure；
Fig. 5 is the schematic diagram of determining projecting direction provided in an embodiment of the present invention；
Fig. 6 is the two-dimensional coordinate system of foundation provided in an embodiment of the present invention to determine the two-dimensional coordinate point of each artis
Schematic diagram；
Fig. 7 is another flow diagram of images of gestures generation method provided in an embodiment of the present invention；
Fig. 8 is a structural schematic diagram of images of gestures generating means provided in an embodiment of the present invention；
Fig. 9 is another structural schematic diagram of images of gestures generating means provided in an embodiment of the present invention；
Figure 10 is another structural schematic diagram of images of gestures generating means provided in an embodiment of the present invention；
Figure 11 is another structural schematic diagram of images of gestures generating means provided in an embodiment of the present invention；
Figure 12 is another structural schematic diagram of images of gestures generating means provided in an embodiment of the present invention；
Figure 13 is another structural schematic diagram of images of gestures generating means provided in an embodiment of the present invention；
Figure 14 is the structural schematic diagram of terminal provided in an embodiment of the present invention.
Specific implementation mode
Following will be combined with the drawings in the embodiments of the present invention, and technical solution in the embodiment of the present invention carries out clear, complete
Site preparation describes, it is clear that described embodiments are only a part of the embodiments of the present invention, instead of all the embodiments.It is based on
Embodiment in the present invention, the every other implementation that those skilled in the art are obtained without creative efforts
Example, shall fall within the protection scope of the present invention.
A kind of images of gestures generation method of offer of the embodiment of the present invention, device and storage medium.
Referring to Fig. 1, Fig. 1 is generated the schematic diagram of a scenario of system, the hand by the images of gestures that the embodiment of the present invention provides
Gesture image generation system may include images of gestures generating means, which can specifically be integrated in tablet electricity
Brain, laptop and desktop computer etc. have storage element and are equipped with microprocessor and have in the terminal of operational capability,
It is mainly used for obtaining multigroup transformation parameter, transformation matrix of coordinates is constructed according to multigroup transformation parameter respectively, obtains multiple coordinates and become
Change matrix；Wherein, transformation parameter may include Plane Rotation angle, joint height, joint length and angle of inclination etc..Then,
According to each transformation matrix of coordinates, the three-dimensional coordinate point of each artis position of composition gesture is obtained；For example, can root
The default three-dimensional system of coordinate using origin as the palm of the hand is converted according to each transformation matrix of coordinates, obtains multiple targets default three
Dimension coordinate system, the position coordinates that each target is preset to three-dimensional system of coordinate origin are set as the three-dimensional of each artis position
Coordinate points.Secondly, according to the three-dimensional coordinate point of each artis position, the two-dimensional coordinate point of each artis is determined；Example
Such as, rotation angle and the elevation angle that can obtain the vertical direction centered on the palm of the hand are thrown according to rotation angle and the elevation angle to determining
The three-dimensional coordinate point of each artis position is mapped in the two dimensional surface on projecting direction, is obtained each by shadow direction
The two-dimensional coordinate point of artis.Finally, each artis is labeled according to the two-dimensional coordinate of each artis point, and according to
Each artis after mark generates images of gestures；For example, two-dimentional hand can be constructed according to the two-dimensional coordinate point of each artis
Gesture, and each artis in two-dimentional gesture is labeled, to interception is default in two dimensional surface where the two-dimentional gesture after mark
Region generates images of gestures, etc..
In addition, the images of gestures, which generates system, to include server, terminal, can be by hand after obtaining images of gestures
Gesture image is uploaded to server, is stored to images of gestures by server.When terminal is needed using images of gestures, Ke Yixiang
Server sends image and obtains request, and server can feed back images of gestures based on image acquisition request is received to terminal, etc.
Deng.
It should be noted that the schematic diagram of a scenario that images of gestures shown in FIG. 1 generates system is only an example, this hair
It is to more clearly illustrate the technology of the embodiment of the present invention that the images of gestures of bright embodiment description, which generates system and scene,
Scheme does not constitute the restriction for technical solution provided in an embodiment of the present invention, those of ordinary skill in the art it is found that with
Images of gestures generates the appearance of the differentiation and new business scene of system, and technical solution provided in an embodiment of the present invention is for similar
Technical problem, it is equally applicable.
It is described in detail separately below.
In the present embodiment, it will be described from the angle of images of gestures generating means, images of gestures generating means tool
Body, which can be integrated in tablet computer, laptop and desktop computer etc., to be had storage element and is equipped with microprocessor and has
Have in the terminal of operational capability.
A kind of images of gestures generation method, including：Multigroup transformation parameter is obtained, seat is constructed according to multigroup transformation parameter respectively
Transformation matrix is marked, multiple transformation matrix of coordinates are obtained；According to each transformation matrix of coordinates, each artis of composition gesture is obtained
The three-dimensional coordinate point of position；According to the three-dimensional coordinate point of each artis position, the two dimension of each artis is determined
Coordinate points；Each artis is labeled according to the two-dimensional coordinate of each artis point, and according to each joint after mark
Point generates images of gestures.
Referring to Fig. 2, Fig. 2 is the flow diagram for the images of gestures generation method that one embodiment of the invention provides.The hand
Gesture image generating method may include：
In step S101, multigroup transformation parameter is obtained, transformation matrix of coordinates is constructed according to multigroup transformation parameter respectively, is obtained
To multiple transformation matrix of coordinates.
Images of gestures generating means can first build the joint of gesture, then basis during generating images of gestures
Joint builds finger, finally builds gesture according to finger, generates images of gestures, as shown in Figure 3, wherein M shape shape in Fig. 3
Markup information represents each artis, and the generating process of images of gestures will be described in detail below.
Specifically, images of gestures generating means can first obtain multigroup transformation parameter, wherein every group of transformation parameter can wrap
Plane Rotation angle, joint height, joint length and angle of inclination etc. are included, which can be in three dimensions
To the rotation angle that some plane where joint is rotated, which can be the inclination angle of joint planar
Degree.Certainly, transformation parameter can also include other parameters, and particular content is not construed as limiting here.Form each pass of gesture
Node can correspond to one or more groups of transformation parameters, which may include fist hand gesture, triumph gesture, OK gestures, holds up greatly
The miscellaneous gesture such as thumb gesture and palm gesture.
Multigroup transformation parameter is being obtained, images of gestures generating means can construct coordinate change respectively according to multigroup transformation parameter
Matrix is changed, can be corresponded to obtain a transformation matrix of coordinates by one group of transformation parameter, therefore multigroup transformation parameter can be to deserved
To multiple transformation matrix of coordinates.Wherein, transformation matrix of coordinates can be as follows：
Wherein, A denotation coordinations transformation matrix, theta indicate that Plane Rotation angle, alpha indicate that angle of inclination, D indicate
Joint height, L indicate joint length.
It should be noted that in every group of transformation parameter, Plane Rotation angle theta, angle of inclination alpha, joint are high
The different values for spending D and joint length L, can obtain different transformation matrix of coordinates A.For example, can according to theta1,
Alpha1, D1 and L1 obtain A1, can obtain A2 according to theta2, alpha2, D2 and L2, can according to theta3, alpha3,
D3 and L3 obtains A3 etc..
In step s 102, according to each transformation matrix of coordinates, each artis position of composition gesture is obtained
Three-dimensional coordinate point.
After obtaining the corresponding transformation matrix of coordinates of multigroup transformation parameter, images of gestures generating means can be according to each seat
Transformation matrix is marked in three dimensions, obtains the three-dimensional coordinate point of each artis position of composition gesture.Wherein, one
The three-dimensional coordinate point of artis can be obtained by one or more transformation matrix of coordinates.
In some embodiments, according to each transformation matrix of coordinates, each artis institute for obtaining composition gesture is in place
The step of three-dimensional coordinate point set may include：
(1) the default three-dimensional system of coordinate using origin as the palm of the hand is converted according to each transformation matrix of coordinates, is obtained
The corresponding target of each transformation matrix of coordinates presets three-dimensional system of coordinate；
(2) position coordinates that each target presets the origin position of three-dimensional system of coordinate are obtained；
(3) the three-dimensional of each artis position that obtained each position coordinates are respectively set to composition gesture is sat
Punctuate.
Specifically, images of gestures generating means can establish default three-dimensional system of coordinate, the origin of the default three-dimensional system of coordinate
The position where the palm of the hand is could be provided as, the position where this presets the x-axis, y-axis and z-axis of three-dimensional system of coordinate can be according to reality
It needs flexibly to be arranged, specific set content is not construed as limiting here.Then, images of gestures generating means can become coordinate
It changes matrix and acts on the default three-dimensional coordinate and fasten, the transformation such as translated and/or rotated to default three-dimensional system of coordinate, can obtain
Three-dimensional system of coordinate is preset to the corresponding target of the transformation matrix of coordinates, it is default three-dimensional coordinate which, which presets three-dimensional system of coordinate,
Be it is transformed after obtained three-dimensional system of coordinate.Default three-dimensional system of coordinate is being converted according to each transformation matrix of coordinates
Afterwards, the corresponding target of each transformation matrix of coordinates can be obtained and preset three-dimensional system of coordinate.
After obtaining target and presetting three-dimensional system of coordinate, images of gestures generating means can obtain the default three-dimensional seat of each target
Mark the position coordinates of the origin position of system.It is then possible to which obtained each position coordinates are respectively set to composition gesture
Each artis position three-dimensional coordinate point.
It should be noted that when an artis A is the set of matrices B for being corresponding with multiple transformation matrix of coordinates, pass through
Each transformation matrix of coordinates in set of matrices B carries out different transformation to default three-dimensional system of coordinate, obtains each coordinate and becomes
The position coordinates for changing the default three-dimensional system of coordinate origin of the corresponding target of matrix are consistent, and can be used as where artis A
The three-dimensional coordinate point of position.
Optionally, the default three-dimensional system of coordinate using origin as the palm of the hand is converted according to each transformation matrix of coordinates,
Obtaining the step of corresponding target of each transformation matrix of coordinates presets three-dimensional system of coordinate may include：
(a) according to each transformation matrix of coordinates, the z-axis direction of the default three-dimensional system of coordinate using origin as the palm of the hand is rotation
Axis carries out the rotation of preset plane rotation angle, obtains the corresponding first default three-dimensional system of coordinate of each transformation matrix of coordinates；
(b) the first default three-dimensional system of coordinate is translated to the distance for presetting joint height according to z-axis direction, obtains each coordinate
The corresponding second default three-dimensional system of coordinate of transformation matrix；
(c) the second default three-dimensional system of coordinate is translated to the distance for presetting joint length according to y-axis direction, obtains each coordinate
The corresponding third of transformation matrix presets three-dimensional system of coordinate；
(d) the y-axis direction for presetting three-dimensional system of coordinate using third carries out the rotation of predetermined inclination angle, obtains as rotary shaft
The corresponding 4th default three-dimensional system of coordinate of each transformation matrix of coordinates, and set the 4th default three-dimensional system of coordinate to target and preset
Three-dimensional system of coordinate.
Specifically, as shown in figure 4, the default three-dimensional system of coordinate using origin as the palm of the hand is sat to be three-dimensional shown in the dotted line of the left side
Mark system, images of gestures generating means can according to transformation matrix of coordinates, to preset the z-axis direction of three-dimensional system of coordinate as rotary shaft,
The rotation for carrying out preset plane rotation angle theta, obtains the corresponding first default three-dimensional system of coordinate of the transformation matrix of coordinates, should
First default three-dimensional system of coordinate is the three-dimensional system of coordinate that the left side is shown in solid in Fig. 4.Then the first default three-dimensional system of coordinate is pressed
The distance for presetting joint height D is translated according to z-axis direction, obtains the second default three-dimensional system of coordinate, the second default three-dimensional system of coordinate
For three-dimensional system of coordinate shown in upper left side in Fig. 4.Secondly, the second default three-dimensional system of coordinate is translated into default close according to y-axis direction
The distance for saving length L obtains third and presets three-dimensional system of coordinate, and it is dotted line institute in upper right side in Fig. 4 which, which presets three-dimensional system of coordinate,
The three-dimensional system of coordinate shown.Finally, the y-axis direction for presetting three-dimensional system of coordinate using third carries out predetermined inclination angle as rotary shaft
The rotation of alpha, obtains the 4th default three-dimensional system of coordinate, and the 4th default three-dimensional system of coordinate is that upper right side is shown in solid in Fig. 4
Three-dimensional system of coordinate, the 4th default three-dimensional system of coordinate obtained at this time as needs obtained target to preset three-dimensional system of coordinate.
Wherein, preset plane rotation angle theta, the distance D of default joint height, default joint length distance L and
Predetermined inclination angle alpha is same group of transformation parameter, and specific value can be flexibly arranged according to actual needs, here
It is not construed as limiting.
For multiple transformation matrix of coordinates, images of gestures generating means can according to each transformation matrix of coordinates respectively to
Default three-dimensional system of coordinate of the origin as the palm of the hand carries out the z-axis rotation of preset plane rotation angle, is put down according to z-axis direction successively
It moves and presets the distance of joint height, translate the distance for presetting joint length and the y for carrying out predetermined inclination angle according to y-axis direction
Axis rotation etc. obtains the corresponding target of each transformation matrix of coordinates and presets three-dimensional system of coordinate.
It should be noted that during being converted to default three-dimensional system of coordinate according to each transformation matrix of coordinates,
Images of gestures generating means can also translate pre- the default three-dimensional system of coordinate using origin as the palm of the hand according to z-axis direction successively
If the distance of joint height, the z-axis for carrying out preset plane rotation angle rotate, carry out the y-axis rotation of predetermined inclination angle and press
The distance etc. for presetting joint length is translated according to y-axis direction；Either, translation transformation can also only be carried out to default three-dimensional system of coordinate
And without rotation transformation etc.；Its specific conversion process can be flexibly arranged according to actual needs, be not limited thereto.
It will be illustrated for building finger below, the structure of a finger can be become using multiple coordinates
It changes matrix the default three-dimensional system of coordinate using origin as the palm of the hand is converted to obtain, the coordinate that the structure of a finger uses becomes
Changing matrix quantity can be flexibly arranged according to actual needs, and particular number is not limited thereto, can be used for example 5 or
6 etc., for convenience, in embodiments of the present invention, will continuous 5 coordinates be used with the structure of a finger below
Transformation matrix illustrates for being converted.
The coordinate transform T for building a finger entirety can use following formula (1) to indicate：
Wherein, AiIndicate i-th of transformation matrix of coordinates.
Partial coordinate transform TjFollowing formula (2) can be used to indicate：
For example, the 5th joint coordinates for a finger convert T5, can convert and obtain since the palm of the hand：T5=A1×
A2×A3×A4×A5, can also convert and obtain since the 4th artis：T5=T4×A5, wherein A1、A2、A3、A4And A5
5 transformation matrix of coordinates are indicated respectively.
It should be noted that due to the structural particularity of thumb, for thumb, 3 artis can be set,
It is first artis, second artis and third artis successively from root is referred to toward finger tip, i.e., will refers to root position and set
It is set to first artis position, sets finger tip position to third artis position, root will be referred to and referred to
Position is set as second artis position between point.Wherein, in 5 continuous coordinate transforms of structure thumb
In matrix, transformation matrix of coordinates A is since the palm of the hand1And A2Coordinate transform T2Correspondence can obtain where first artis
The three-dimensional coordinate point of position is transformation matrix of coordinates A then since first artis3And A4Coordinate transform T4Correspondence can
To obtain the three-dimensional coordinate point of second artis position, finally since second artis, transformation matrix of coordinates is done
A5Coordinate transform T5Correspondence can obtain the three-dimensional coordinate point of third artis position.Due to acting on the pass of finger
The transformation matrix of coordinates A of section is more, and the activity space in the joint of the finger is bigger, and the joint of finger is more flexible, therefore, for big
More flexible first artis and first artis, are respectively necessary for the effect of 2 transformation matrix of coordinates in thumb.
For the fingers such as index finger, middle finger, the third finger and little finger of toe, 4 artis can be set, from refer to root toward finger tip according to
Secondary is first artis, second artis, third artis and the 4th artis, wherein structure index finger, in
Refer to, in nameless or little finger of toe 5 continuous transformation matrix of coordinates, transformation matrix of coordinates A is since the palm of the hand1Coordinate transform
T1Correspondence can obtain the three-dimensional coordinate point of first artis position, then since first artis, do coordinate
Transformation matrix A2And A3Coordinate transform T3Correspondence can obtain the three-dimensional coordinate point of second artis position, secondly from
Second artis starts, and is transformation matrix of coordinates A4Coordinate transform T4Correspondence can obtain third artis position
Three-dimensional coordinate point be transformation matrix of coordinates A finally since third artis5Coordinate transform T5Correspondence can obtain
The three-dimensional coordinate point of four artis positions.
Since every finger can be converted to obtain by 5 transformation matrix of coordinates, each transformation matrix of coordinates can have
Four parameters such as Plane Rotation angle, joint height, joint length and angle of inclination, therefore every finger can be by 20 parameters
To determine its corresponding posture, wherein Plane Rotation angle theta can determine by the bending angle of finger, joint height D
0 is could be provided as, angle of inclination alpha can be determined by the physiological structure of finger, and joint length L can be by the joint of finger
Length determine.
In step s 103, according to the three-dimensional coordinate point of each artis position, the two dimension of each artis is determined
Coordinate points.
It should be noted that in one embodiment, being sat obtaining the three-dimensional of each artis position of composition gesture
After punctuate, images of gestures generating means can build the three-dimension gesture model of gesture, and three-dimension gesture model is then mapped to two
In dimensional plane, you can obtain two-dimentional gesture, and determine the two-dimensional coordinate point of each artis in two dimensional surface.In another implementation
In example, after obtaining the three-dimensional coordinate point of each artis position of composition gesture, images of gestures generating means can not
The three-dimension gesture model for building gesture, then directly maps to the three-dimensional coordinate point of each artis in two dimensional surface, you can
The two-dimensional coordinate point of each artis is determined in two dimensional surface.
When needing to build the corresponding three-dimension gesture model of gesture, images of gestures generating means can be according to obtained composition
The three-dimensional coordinate point of each artis position of gesture builds the three-dimension gesture model of gesture in three dimensions.In order to
It is convenient that the building process of gesture is illustrated, it is substantially first the least unit in the joint for forming gesture can be set to, for
One transformation matrix of coordinates can correspond to a member substantially, i.e., can obtain a base according to the transformation of a transformation matrix of coordinates
This yuan.After having basic member, so that it may to build the three-dimensional structure in joint, then the three-dimensional structure structure three with joint according to basic member
Finger is tieed up, three-dimension gesture model is finally built according to three-dimensional finger.The three-dimension gesture model can be three-dimension gesture skeleton, also may be used
To be complete three-dimension gesture etc., particular content is not construed as limiting here.
Multiple members substantially can be used for the structure of a finger, basic first quantity that the structure of a finger uses can
To be flexibly arranged according to actual needs, particular number is not limited thereto, and 5 or 6 basic members etc. can be used for example,
It for convenience, in embodiments of the present invention, below will be by taking the structure of a finger be using continuous 5 basic members as an example
It illustrates.
Wherein, the three-dimension gesture model of a hand can be made of 5 fingers, for index finger, middle finger, the third finger and little finger of toe
Deng every finger can be made of 4 joints, and each joint can be by 1 or multiple basic members form.It can for thumb
To be made of 3 joints, each joint can be by 1 or multiple basic members form.The basic member for forming a joint is more,
The activity space in the joint is bigger, and the joint is more flexible, therefore, for more flexible first joint and first in thumb
A joint can be made of 2 basic members respectively, other joints can be made of 1 basic member；For index finger, middle finger, the third finger and
Little finger of toe, other than more flexible second joint can be made of 2 basic members, other joints can be made of 1 basic member.
It is first joint to the 4th joint etc. successively that the sequence in each joint, which can be from finger root toward finger tip, or from root is referred to toward finger
Point is first joint to third joint etc. successively.
It, can be by three-dimension gesture mould after building the three-dimension gesture model of gesture in three dimensions according to these basic members
Type maps in two dimensional surface, you can obtains the two-dimensional coordinate point of two-dimentional gesture and each of which artis.Due to three-dimension gesture mould
Each joint of type can be as actual human hand can be movable, therefore, three-dimension gesture model can be done rotation and/or
After the operations such as translation, the three-dimension gesture model after being converted, then the three-dimension gesture model after transformation is mapped into two dimensional surface
It is interior, obtain the two-dimensional coordinate point of two-dimentional gesture and each of which artis.
It should be noted that can be based on a three-dimension gesture model can generate any number of two-dimentional gesture, for example,
After obtaining a three-dimension gesture model, three-dimension gesture model can be mapped in two dimensional surface and obtain two-dimentional gesture, to this
Two-dimentional gesture is preserved.Then, rotationally and/or translationally equal to three-dimension gesture model to operate, the three-dimension gesture after being converted
Model, then the three-dimension gesture model after transformation is mapped into the two-dimentional gesture after being converted in two dimensional surface, after the transformation
Two-dimentional gesture preserved, transformation can also be continued to three-dimension gesture model and obtain miscellaneous two-dimentional gesture.
When that need not build the corresponding three-dimension gesture model of gesture, images of gestures generating means can directly will be closed each
The three-dimensional coordinate point of node maps in two dimensional surface, you can the two-dimensional coordinate point of each artis is determined in two dimensional surface,
Two-dimentional gesture can also be constructed according to the two-dimensional coordinate point of each artis.Alternatively, the three-dimensional coordinate to each artis clicks through
After row rotationally and/or translationally waits operation, each artis of the gesture after composition transformation is obtained, then each by what is obtained after transformation
Artis maps in two dimensional surface, and the two-dimensional coordinate point of each artis is determined in two dimensional surface.
In some embodiments, according to the three-dimensional coordinate point of each artis position, each artis is determined
The step of two-dimensional coordinate point may include：
Obtain rotation angle and the elevation angle of the vertical direction centered on the palm of the hand；It, will be each according to rotation angle and the elevation angle
The three-dimensional coordinate point of artis position maps to two dimensional surface, obtains the two-dimensional coordinate point of each artis.
Specifically, images of gestures generating means are in the process that the three-dimensional coordinate point of each artis is mapped to two dimensional surface
In, it can first determine a rotation angle of the vertical direction of mapping, and determine an elevation angle, the rotation angle and the elevation angle can
Can also be flexibly to be arranged according to actual needs to be random.It is then possible to be determined according to rotation angle and the elevation angle
One projecting direction, then three-dimensional coordinate point is mapped on the projecting direction.For example, as shown in figure 5, in three dimensions
It is interior, the palm of the hand of gesture can be set to coordinate origin, establish three-dimensional system of coordinate, it is determining in the three-dimensional system of coordinate to be with the palm of the hand
The rotation angle θ of the vertical direction at center and the elevation angleThen according to rotation angle θ and the elevation angleDetermine two dimensional surface, it will be each
The three-dimensional coordinate point of artis position maps in the two dimensional surface, and each artis can be determined in two dimensional surface
Two-dimensional coordinate point.
In some embodiments, according to rotation angle and the elevation angle, by the three-dimensional coordinate point of each artis position
The step of mapping to two dimensional surface, obtaining the two-dimensional coordinate point of each artis may include：
According to rotation angle and the elevation angle, one ray centered on the palm of the hand is set outward；Using the direction where ray as
Projecting direction, and the three-dimensional coordinate point of each artis position is mapped in the two dimensional surface on projecting direction；Two
Each artis is positioned in dimensional plane, obtains the two-dimensional coordinate point of each artis.
Specifically, after obtaining rotation angle and the elevation angle, images of gestures generating means can be centered on the palm of the hand, according to rotation
A ray is made in gyration and elevation angle mapping outward, and the direction where the ray is projecting direction, can be on projecting direction
It determines a two dimensional surface vertical with ray, the three-dimensional coordinate point of each artis position can be mapped to projection side
In the upward two dimensional surface.
Optionally, using the direction where ray as projecting direction, and by the three-dimensional coordinate of each artis position
Putting the step mapped in the two dimensional surface on projecting direction may include：
Using the direction where ray as projecting direction, and obtain the unit vector of projecting direction；By each artis
The three-dimensional coordinate point of position maps on the two dimensional surface vertical with unit vector.
During mapping, images of gestures generating means can take and penetrate using the direction where ray as projecting direction
The mould of the unit vector on projecting direction where line, the unit vector is 1, then by the three-dimensional of each artis position
Coordinate points are mapped on the two dimensional surface vertical with the unit vector.It is understood that the default of projecting direction can also be taken
Vector, the default vector can be the preset multiples of unit vector, and the default vector or preset multiple can be according to actual needs
Flexibly it is arranged, then the three-dimensional coordinate point of each artis position is mapped to the two dimension vertical with the default vector
In plane.
After the three-dimensional coordinate point of each artis position is mapped in the two dimensional surface on projecting direction, gesture
Video generation device can position each artis in two dimensional surface, obtain the two-dimensional coordinate point of each artis.
Optionally, each artis is positioned in two dimensional surface, obtains the two-dimensional coordinate point of each artis
Step may include：
Obtained in two dimensional surface each artis between the palm of the hand at a distance from, apart from longest artis；By distance
Longest artis, as x-axis, using the straight line perpendicular to x-axis as y-axis, is established using the palm of the hand as origin with straight line where the palm of the hand
Two-dimensional coordinate system；The position that each artis is determined according to two-dimensional coordinate system obtains the two-dimensional coordinate point of each artis.
Specifically, images of gestures generating means can first determine two-dimensional coordinate system：First, each artis institute is in place
After the three-dimensional coordinate point set maps in the two dimensional surface on projecting direction, each artis on two dimensional surface can be obtained and corresponded to
Position, the distance between each artis and the palm of the hand can be calculated at this time, from the distance between each artis and the palm of the hand
It filters out apart from longest artis, it, will be apart from straight line where longest artis and the palm of the hand as x using the palm of the hand as origin
Axis can be established using the palm of the hand as the two-dimensional coordinate system of origin, such as using the straight line perpendicular to x-axis as y-axis after determining x-axis
Shown in Fig. 6.The position that each artis is determined in two-dimensional coordinate system that can be shown in Fig. 6, obtains the two dimension of each artis
Coordinate points.It, can due to for different gestures, determining the longest artis of distance as x-axis and straight line where the palm of the hand
It can be different, therefore the diversity of the two-dimentional gesture of the two-dimensional coordinate point composition of each artis can be increased.
It should be noted that two-dimensional coordinate system can also be established at random, for example, using the palm of the hand as origin, in each joint
Point in the distance between palm of the hand, using apart from straight line where shortest artis and the palm of the hand as x-axis with perpendicular to the straight line of x-axis
As y-axis, establish using the palm of the hand as the two-dimensional coordinate system of origin.Either, with the position where first artis of thumb
As origin, takes two orthogonal straight lines respectively as x-axis and y-axis at random, establish two-dimensional coordinate system；Etc..
In step S104, each artis is labeled according to the two-dimensional coordinate of each artis point, and according to mark
Each artis after note generates images of gestures.
After obtaining the two-dimensional coordinate point of each artis of composition gesture, images of gestures generating means can be according to each
The two-dimensional coordinate point of artis is labeled the position where each artis, obtains the corresponding mark letter of each artis
Breath, which can be the shapes such as filled circles, square or five-pointed star, can the markup information of each artis make
With identical shape, either, the markup information of the artis of different fingers uses different shapes, i.e., the same hand respectively
The markup information of the artis of finger uses identical shape etc..Then hand can be generated according to each artis after mark
Gesture image may include each artis and its markup information for forming gesture in the images of gestures.
Images of gestures generating means can also build two-dimentional gesture according to the two-dimensional coordinate point of each artis, in the two dimension
The position where each artis is labeled in gesture, images of gestures can be generated according to each artis after mark,
May include the markup information of two-dimentional gesture and each artis in the two dimension gesture in the images of gestures, which is
Gesture in two dimensional surface.It realizes the full-automatic of images of gestures to generate, avoids the error generated when artificial mark.
It should be noted that may include one or more gestures in an images of gestures, for example, can be according to obtaining
After the two-dimensional coordinate point of each artis builds a two-dimentional gesture, which the behaviour such as is replicated and is moved or rotated
Make, obtain another two-dimentional gesture, after obtaining multiple two-dimentional gestures, each artis of multiple two-dimentional gestures can be carried out
Mark can generate images of gestures according to multiple two-dimentional gestures after mark.
In some embodiments, each artis is labeled according to the two-dimensional coordinate of each artis point, and root
According to after mark each artis generate images of gestures the step of may include：
(1) two-dimentional gesture is constructed according to the two-dimensional coordinate of each artis point, and according to the two-dimensional coordinate of each artis
Point is labeled each artis in two-dimentional gesture；
(2) to intercepting predeterminable area where the two-dimentional gesture after mark in two dimensional surface, images of gestures is generated.
Specifically, images of gestures generating means, can be first according to each artis during generating images of gestures
Two-dimensional coordinate point constructs a gesture in two dimensional surface, obtains two-dimentional gesture.For example, images of gestures generating means can be
Pixel value is set in the predeterminable area around join domain and the palm of the hand between each artis of each finger, you can structure
Go out two-dimentional gesture.Either, images of gestures generating means can obtain sample from local or the preset images of gestures library of server
The upper pixel value of gesture in sample images of gestures is copied to the gesture area around corresponding each artis by this images of gestures
It is interior, you can to construct two-dimentional gesture；Etc..Wherein the specific value of join domain, pixel value and gesture area etc. is not here
It is construed as limiting.
After obtaining two-dimentional gesture, images of gestures generating means can be according to the two-dimensional coordinate point of each artis to two dimension
Each artis is labeled in gesture, the two-dimentional gesture after being marked.Then to two dimension where the two-dimentional gesture after mark
Predeterminable area is intercepted in plane, generates images of gestures.Wherein, which can be flexibly arranged according to actual needs,
Particular content is not construed as limiting here.
Optionally, to intercepting predeterminable area in two dimensional surface where the two-dimentional gesture after mark, the step of images of gestures is generated
Suddenly may include：
The distance between each artis and the palm of the hand are obtained, multiple distances are obtained；It is filtered out from multiple distances longest
Target range；Using the preset multiple of target range as the length of side, to being cut in two dimensional surface where the two-dimentional gesture after mark
It takes, obtains the predeterminable area centered on the palm of the hand；Images of gestures is generated according to predeterminable area.
Specifically, images of gestures generating means can first determine the size of interception area, in order to ensure the gesture figure generated
Two-dimentional gesture as in is complete, and in order to ensure that two-dimentional gesture will not be blocked, images of gestures generating means can be obtained first
The distance between each artis and the palm of the hand are taken, multiple distances are obtained；For example, when there are 19 artis, 19 can be obtained
A distance.At this point it is possible to filter out longest target range from multiple distances, which is the longest of multiple distances
Distance, then, centered on the palm of the hand, and using the preset multiple of the target range as the length of side, to the two-dimentional hand after mark
One box of interception is carried out where gesture in two dimensional surface, obtains the predeterminable area centered on the palm of the hand.Wherein, preset multiple can be with
3 times or 6 times etc. are set as, specific value can be flexibly arranged according to actual needs, be not construed as limiting here.Interception obtains
Predeterminable area can be square, can also according to actual needs will be with the first preset multiple of target range (such as 5 times)
As length, using the second preset multiple (such as 3 times) of target range as width, to two dimensional surface where the two-dimentional gesture after mark
Rectangular region of the interior interception one centered on the palm of the hand.Alternatively, using the third preset multiple (such as 6 times) of target range as
Diameter, to intercepting a border circular areas centered on the palm of the hand where the two-dimentional gesture after mark in two dimensional surface；Etc..Most
Afterwards, images of gestures can be generated according to the predeterminable area being truncated to.
In some embodiments, to intercepting predeterminable area where the two-dimentional gesture after mark in two dimensional surface, hand is generated
After the step of gesture image, method further includes：
Translation and/or rotation process are carried out to the gesture in images of gestures, obtain target images of gestures.
The pattern of gesture in images of gestures is obtained in order to abundant, after obtaining images of gestures, images of gestures generating means can
To carry out translation and/or rotation process to the gesture in images of gestures, for example, it may be entire gesture is carried out random angles
Rotation, and/or, entire gesture is carried out to the translation of random distance, obtains target images of gestures, which is pair
The image that gesture in images of gestures carries out translation and/or rotation process obtains；Either, gesture is carried out centered on the palm of the hand
The rotation of random angles obtains target images of gestures, which is to be translated to the gesture in images of gestures
And/or the image that rotation process obtains.
Either, images of gestures generating means can preserve the images of gestures after obtaining images of gestures, and then replicating should
One or more images of gestures carries out different translations respectively to replicating the gesture in one or more obtained images of gestures
And/or rotation process, one or more different target images of gestures is obtained, and preserve the one or more target gesture figure
Picture, so as to automatically generate the target images of gestures of any amount and the good each artis of mark by an images of gestures,
Improve the flexibility of images of gestures acquisition.
In some embodiments, to intercepting predeterminable area where the two-dimentional gesture after mark in two dimensional surface, hand is generated
After the step of gesture image, method further includes：
Gesture in images of gestures is carried out according to preset ratio to zoom in or out operation, obtains target images of gestures.
Specifically, after obtaining images of gestures, images of gestures generating means can be to the images of gestures according to preset ratio
It carries out zooming in or out operation, obtains target images of gestures.For example, images of gestures generating means can be to entire images of gestures
It carries out zooming in or out operation according to preset ratio, obtains target images of gestures；Can also be to the hand in entire images of gestures
Gesture carries out zooming in or out operation according to preset ratio, obtains target images of gestures.Wherein, preset ratio can be according to practical need
Flexibly it is arranged, specific value is not construed as limiting here.Either, images of gestures generating means are obtaining images of gestures
Afterwards, the images of gestures can be preserved, one or more images of gestures is then replicated, one or more gesture that duplication is obtained
Gesture in image carries out zooming in or out operation respectively according to preset ratio, obtains one or more different target gesture figure
Picture.
From the foregoing, it will be observed that the embodiment of the present invention can construct coordinate transform square respectively according to the multigroup transformation parameter got
Battle array obtains multiple transformation matrix of coordinates, and according to each transformation matrix of coordinates, where each artis for obtaining composition gesture
The three-dimensional coordinate point of position；According to the three-dimensional coordinate point of each artis position, the two-dimensional coordinate of each artis is determined
Point；Then each artis is labeled according to the two-dimensional coordinate of each artis point, and according to each joint after mark
Point generates images of gestures.The program realizes the images of gestures for automatically generating and marking each artis in gesture, and can be with
The three-dimensional coordinate point obtained according to transformation matrix of coordinates determines the two-dimensional coordinate point of each artis, further according to each artis
Two-dimensional coordinate point each artis is labeled, each joint without manually being taken pictures and being marked gesture
The operations such as point improve reliability and convenience that images of gestures generates.
According to method described in above-described embodiment, citing is described in further detail below.
By taking images of gestures generating means are terminal as an example, which can give birth to the present embodiment according to images of gestures generation method
At miscellaneous images of gestures, referring to Fig. 7, Fig. 7 is the another of images of gestures generation method provided in an embodiment of the present invention
Flow diagram.This method flow may include：
201, terminal obtains multigroup transformation parameter, constructs transformation matrix of coordinates respectively according to multigroup transformation parameter, obtains more
A transformation matrix of coordinates.
Wherein, every group of transformation parameter may include Plane Rotation angle, joint height, joint length and angle of inclination etc.,
Certainly, transformation parameter can also include other parameters, and particular content is not construed as limiting here.The gesture may include fist hand
The miscellaneous gestures such as gesture, triumph gesture, OK gestures, gesture of thumbing up and palm gesture.
The demand that terminal can be built according to gesture obtains multigroup transformation parameter, and the structure of a finger can be used
The quantity of multigroup transformation parameter, the transformation parameter that the structure of a finger uses can be flexibly arranged according to actual needs,
Particular number is not limited thereto, and 5 groups or 6 groups transformation parameters etc. can be used for example, for convenience, below will be with one
The structure of root finger for 5 groups of transformation parameters using illustrating.
For example, index finger, middle finger, the third finger or the corresponding 5 groups of transformation parameters of little finger of toe can be as shown in table 1 below：
Table 1
| Transformation parameter title | Plane Rotation angle theta | Joint height D | Joint length L | Angle of inclination alpha |
| First group of transformation parameter | Theta11 | 0 | L11 | 0 |
| Second group of transformation parameter | Theta12 | 0 | 0 | 90° |
| Third group transformation parameter | Theta13 | 0 | L12 | 0 |
| 4th group of transformation parameter | Theta14 | 0 | L13 | 0 |
| 5th group of transformation parameter | Theta15 | 0 | L14 | 0 |
Wherein, 5 transformation matrix of coordinates can be constructed by 5 groups of transformation parameters in table 1, can be become by this 5 coordinates
Matrix is changed to be converted to obtain corresponding index finger, middle finger, the third finger or the three-dimensional coordinate point of each artis position of little finger of toe.
As shown in Table 1, the acquisition of the three-dimensional coordinate point of index finger, middle finger, the third finger or each artis of little finger of toe, can have theta11 extremely
Theta15, L11 to 9 parameters such as L14 it needs to be determined that.
Wherein, Plane Rotation angle theta can be determined by the bending angle of finger, and joint height D could be provided as
0, angle of inclination alpha can be determined that joint length L can be by the length in the joint of finger Lai really by the physiological structure of finger
It is fixed.
The corresponding 5 groups of transformation parameters of thumb can be as shown in table 2 below：
Table 2
| Transformation parameter title | Plane Rotation angle theta | Joint height D | Joint length L | Angle of inclination alpha |
| First group of transformation parameter | Theta21 | 0 | 0 | 90° |
| Second group of transformation parameter | Theta22 | 0 | L21 | -90° |
| Third group transformation parameter | Theta23 | 0 | 0 | 90° |
| 4th group of transformation parameter | Theta24 | 0 | L22 | 0 |
| 5th group of transformation parameter | Theta25 | 0 | L23 | 0 |
Wherein, 5 transformation matrix of coordinates can be constructed by 5 groups of transformation parameters in table 2, can be become by this 5 coordinates
Matrix is changed to be converted to obtain the three-dimensional coordinate point of the corresponding each artis position of thumb.As shown in Table 1, thumb
The acquisition of the three-dimensional coordinate point of each artis can have theta21 to be needed to theta25, L21 to 8 parameters such as L23 true
It is fixed.
After obtaining multigroup transformation parameter, transformation matrix of coordinates can be constructed respectively according to multigroup transformation parameter, by one group
Transformation parameter can correspond to obtain a transformation matrix of coordinates, therefore multigroup transformation parameter can correspond to obtain multiple coordinate transforms
Matrix, the transformation matrix of coordinates can be as follows：
Wherein, A denotation coordinations transformation matrix, theta indicate that Plane Rotation angle, alpha indicate that angle of inclination, D indicate
Joint height, L indicate joint length.For example, A1 can be obtained according to theta1, alpha1, D1 and L1, it can basis
Theta2, alpha2, D2 and L2 obtain A2, and A3 etc. can be obtained according to theta3, alpha3, D3 and L3.
202, terminal converts the default three-dimensional system of coordinate using origin as the palm of the hand according to each transformation matrix of coordinates,
It obtains the corresponding target of each transformation matrix of coordinates and presets three-dimensional system of coordinate.
After obtaining the corresponding transformation matrix of coordinates of multigroup transformation parameter, terminal can be established using origin as the pre- of the palm of the hand
If three-dimensional system of coordinate, the position where this presets the x-axis, y-axis and z-axis of three-dimensional system of coordinate can carry out flexibly according to actual needs
Setting.
Then, the transformation such as translated and/or rotated to default three-dimensional system of coordinate according to transformation matrix of coordinates, for example, can
To be to preset the z-axis direction of three-dimensional system of coordinate as rotary shaft, carry out the rotation of Plane Rotation angle theta, it is pre- to obtain first
If three-dimensional system of coordinate；The distance that first default three-dimensional system of coordinate is translated to joint height D according to z-axis direction, it is default to obtain second
Three-dimensional system of coordinate；By the second default three-dimensional system of coordinate according to the distance of y-axis direction translation joint length L, third default three is obtained
Dimension coordinate system；The y-axis direction of three-dimensional system of coordinate is preset as rotary shaft using third, carries out the rotation of angle of inclination alpha, obtains the
Four default three-dimensional system of coordinates, and set the 4th default three-dimensional system of coordinate to target and preset three-dimensional system of coordinate.It is understood that
The transformation of other modes can also be carried out to presetting three-dimensional system of coordinate according to transformation matrix of coordinates.
After being converted to default three-dimensional system of coordinate according to each transformation matrix of coordinates, each coordinate can be obtained and become
It changes the corresponding target of matrix and presets three-dimensional system of coordinate.
After obtaining target and presetting three-dimensional system of coordinate, terminal can obtain the origin institute that each target presets three-dimensional system of coordinate
Position coordinates in position；For example, when there are 30 transformation matrix of coordinates, 30 targets can be obtained and preset three-dimensional system of coordinate
The corresponding position coordinates of origin.
203, each target is preset the position coordinates of the origin position of three-dimensional system of coordinate by terminal, is respectively set to group
At the three-dimensional coordinate point of each artis position of gesture.
After terminal obtains the default three-dimensional system of coordinate of target, each target can be preset to the position of the origin of three-dimensional system of coordinate
Coordinate is set as the three-dimensional coordinate point of each artis position.Wherein, an artis can correspond to one or more seats
Transformation matrix is marked, therefore the three-dimensional coordinate point of an artis can be preset the origin of three-dimensional system of coordinate by one or more targets
To determine.
For example, for thumb, 3 artis can be set, be first artis, second successively from root is referred to toward finger tip
A artis and third artis, wherein in 5 continuous transformation matrix of coordinates of structure thumb, since the palm of the hand
Pass sequentially through transformation matrix of coordinates A1And A2It is coordinately transformed, the three-dimensional coordinate of first artis position can be obtained
Point.Then since first artis, transformation matrix of coordinates A is passed sequentially through3And A4It is coordinately transformed, second can be obtained
The three-dimensional coordinate point of a artis position.Finally since second artis, pass through transformation matrix of coordinates A5It is sat
Mark transformation, can obtain the three-dimensional coordinate point of third artis position.
For index finger, middle finger, the third finger and little finger of toe, 4 artis can be set, be first successively from root is referred to toward finger tip
Artis, second artis, third artis and the 4th artis, wherein structure index finger, it is middle refer to, it is nameless or
In the continuous transformation matrix of coordinates of 5 of little finger of toe, transformation matrix of coordinates A is begun through from the palm of the hand1It is coordinately transformed, can obtain
To the three-dimensional coordinate point of first artis position.Then since first artis, pass through transformation matrix of coordinates A2
And A3It is coordinately transformed, the three-dimensional coordinate point of second artis position can be obtained.Secondly, from second artis
Start, passes through transformation matrix of coordinates A4It is coordinately transformed, the three-dimensional coordinate point of third artis position can be obtained.
Finally, since third artis, pass through transformation matrix of coordinates A5It is coordinately transformed, the 4th artis institute can be obtained
Three-dimensional coordinate point in position.
204, terminal determines projecting direction, is mapped the three-dimensional coordinate point of each artis position according to projecting direction
To two dimensional surface, the two-dimensional coordinate point of each artis is obtained.
After the three-dimensional coordinate point for obtaining each artis position, terminal can be by the three-dimensional coordinate of each artis
Point maps in two dimensional surface, and the two-dimensional coordinate point of each artis can be determined in two dimensional surface.
Specifically, first, terminal can first determine a rotation angle of vertical direction, and determine an elevation angle, should
Rotation angle and the elevation angle can be random, can also be flexibly to be arranged according to actual needs.Then, according to rotation angle
A ray centered on the palm of the hand is arranged in degree and the elevation angle outward, using the direction where ray as projecting direction.Secondly, throwing is taken
The three-dimensional coordinate point of each artis position is mapped to two vertical with the unit vector by the unit vector on shadow direction
On dimensional plane.Finally, each artis can be positioned in two dimensional surface, for example, each artis institute is in place
After the three-dimensional coordinate point set maps in the two dimensional surface on projecting direction, each artis on two dimensional surface can be obtained and corresponded to
Position, the distance between each artis and the palm of the hand can be calculated at this time, from the distance between each artis and the palm of the hand
It filters out apart from longest artis, it, will be apart from straight line where longest artis and the palm of the hand as x using the palm of the hand as origin
Axis can be established using the straight line perpendicular to x-axis as y-axis using the palm of the hand as the two-dimensional coordinate system of origin after determining x-axis, can
To determine the position of each artis in this two-dimensional coordinate system, the two-dimensional coordinate point of each artis is obtained.
205, terminal constructs two-dimentional gesture according to the two-dimensional coordinate point of each artis, and to each being closed in two-dimentional gesture
Node is labeled.
After obtaining the two-dimensional coordinate point of each artis, terminal can be constructed according to the two-dimensional coordinate point of each artis
Two-dimentional gesture, for example, terminal can be in the preset areas around the join domain and the palm of the hand between each artis of each finger
Pixel value is set in domain, you can constructs two-dimentional gesture；Either, it is obtained from local or the preset images of gestures library of server
The upper pixel value of gesture in sample images of gestures is copied to the gesture area around corresponding each artis by sample images of gestures
In domain, you can construct two-dimentional gesture；Etc..
After obtaining two-dimentional gesture, terminal can be according to the two-dimensional coordinate point of each artis to each being closed in two-dimentional gesture
Node is labeled, the two-dimentional gesture after being marked.Wherein, notation methods can use filled circles, square or five-pointed star
Etc. shapes the position where each artis is labeled.
206, predeterminable area is intercepted in two dimensional surface where the two-dimentional gesture after terminal-pair mark, generates images of gestures.
To intercepting predeterminable area in two dimensional surface where two-dimentional gesture after mark, the predeterminable area can be square,
Ellipse, the round, regions such as rectangular, hexagon or diamond shape, the size of the predeterminable area can carry out spirit according to actual needs
Then setting living can generate images of gestures according to predeterminable area.For example, can obtain between each artis and the palm of the hand away from
From obtaining multiple distances；Then longest target range is filtered out from multiple distances, and with 3 times of target range or 6 times etc.
Preset multiple is as the length of side, to being intercepted the square centered on the palm of the hand where the two-dimentional gesture after mark in two dimensional surface
Region；Alternatively, using the preset multiples such as 3 times of target range or 6 times as diameter, it is flat to two dimension where the two-dimentional gesture after mark
The border circular areas etc. centered on the palm of the hand is intercepted in face.
207, the gesture in terminal-pair images of gestures carries out translation and/or rotation process, and/or, in images of gestures
Gesture carries out zooming in or out operation according to preset ratio, obtains target images of gestures.
After obtaining images of gestures, terminal can carry out the gesture in images of gestures translation and/or rotation process, example
Such as, can be by entire gesture carry out random angles rotation, and/or, by entire gesture carry out random distance translation；Or
It is to carry out the rotation of random angles to gesture centered on the palm of the hand, obtain target images of gestures, which is pair
Gesture in images of gestures carries out translation and/or rotation process.Terminal can also carry out the images of gestures according to preset ratio
Operation is zoomed in or out, for example, images of gestures generating means can be reduced according to preset ratio to entire images of gestures
Or amplifieroperation, can also be to carry out zooming in or out operation etc. according to preset ratio to the gesture in entire images of gestures.Eventually
End is carrying out translation and/or rotation process to the gesture in images of gestures, and/or carries out according to preset ratio zooming in or out behaviour
After work, target images of gestures can be obtained.
The embodiment of the present invention can convert default three-dimensional system of coordinate by transformation matrix of coordinates, to obtain each pass
The three-dimensional coordinate point of node, and the three-dimensional coordinate point of each artis is mapped into two dimensional surface, obtain the two of each artis
Dimension coordinate point can construct two-dimentional gesture according to the two-dimensional coordinate point of each artis and be labeled to each artis, be obtained
To images of gestures.It realizes and automatically generates the two-dimentional gesture for having marked each artis, to obtain images of gestures, without very important person
The operations such as each artis of gesture are taken pictures and marked manually to work, improves flexibility and convenience that images of gestures generates.
For ease of preferably implementing images of gestures generation method provided in an embodiment of the present invention, the embodiment of the present invention also provides
A kind of device based on above-mentioned images of gestures generation method.The wherein meaning of noun and phase in above-mentioned images of gestures generation method
Together, specific implementation details can be with the explanation in reference method embodiment.
Referring to Fig. 8, Fig. 8 is the structural schematic diagram of images of gestures generating means provided in an embodiment of the present invention, wherein should
Images of gestures generating means may include acquiring unit 301, converter unit 302, determination unit 303 and generation unit 304.
Wherein, acquiring unit 301 construct coordinate according to multigroup transformation parameter and become respectively for obtaining multigroup transformation parameter
Matrix is changed, multiple transformation matrix of coordinates are obtained.
Images of gestures generating means can first build the joint of gesture, then basis during generating images of gestures
Joint builds finger, finally builds gesture according to finger, generates images of gestures, as shown in Figure 3, wherein M shape shape in Fig. 3
Markup information represents each artis, and the generating process of images of gestures will be described in detail below.
Specifically, acquiring unit 301 can first obtain multigroup transformation parameter, wherein every group of transformation parameter may include putting down
Face rotation angle, joint height, joint length and angle of inclination etc., the Plane Rotation angle can be in three dimensions to closing
The rotation angle that some plane where section is rotated, which can be the angle of inclination of joint planar.When
So, transformation parameter can also include other parameters, and particular content is not construed as limiting here.The each artis for forming gesture can
With the one or more groups of transformation parameters of correspondence, which may include fist hand gesture, triumph gesture, OK gestures, hand of thumbing up
The miscellaneous gesture such as gesture and palm gesture.
Multigroup transformation parameter is being obtained, acquiring unit 301 can construct coordinate transform square respectively according to multigroup transformation parameter
Battle array can correspond to obtain a transformation matrix of coordinates by one group of transformation parameter, thus multigroup transformation parameter can correspond to obtain it is more
A transformation matrix of coordinates.Wherein, transformation matrix of coordinates can be as follows：
Wherein, A denotation coordinations transformation matrix, theta indicate that Plane Rotation angle, alpha indicate that angle of inclination, D indicate
Joint height, L indicate joint length.
It should be noted that in every group of transformation parameter, Plane Rotation angle theta, angle of inclination alpha, joint are high
The different values for spending D and joint length L, can obtain different transformation matrix of coordinates A.For example, can according to theta1,
Alpha1, D1 and L1 obtain A1, can obtain A2 according to theta2, alpha2, D2 and L2, can according to theta3, alpha3,
D3 and L3 obtains A3 etc..
Converter unit 302, for according to each transformation matrix of coordinates, obtaining each artis position of composition gesture
Three-dimensional coordinate point.
After obtaining the corresponding transformation matrix of coordinates of multigroup transformation parameter, converter unit 302 can become according to each coordinate
Matrix is changed in three dimensions, obtains the three-dimensional coordinate point of each artis position of composition gesture.Wherein, a joint
The three-dimensional coordinate point of point, can be obtained by one or more transformation matrix of coordinates.
In some embodiments, as shown in figure 11, converter unit 302 may include that transformation subelement 3021, coordinate obtain
Subelement 3022 and setting subelement 3023 etc. are taken, it specifically can be as follows：
Subelement 3021 is converted, is used for according to each transformation matrix of coordinates to the default three-dimensional coordinate using origin as the palm of the hand
System is converted, and is obtained the corresponding target of each transformation matrix of coordinates and is preset three-dimensional system of coordinate；
Coordinate obtains subelement 3022, the position for presetting the origin position of three-dimensional system of coordinate for obtaining each target
Coordinate；
Subelement 3023 is set, each artis for obtained each position coordinates to be respectively set to composition gesture
The three-dimensional coordinate point of position.
Specifically, transformation subelement 3021 can establish default three-dimensional system of coordinate, and the origin of the default three-dimensional system of coordinate can
To be set as the position where the palm of the hand, the position where this presets the x-axis, y-axis and z-axis of three-dimensional system of coordinate can be according to practical need
Flexibly it is arranged, specific set content is not construed as limiting here.Then, transformation subelement 3021 can be by coordinate transform square
Battle array acts on the default three-dimensional coordinate and fastens, and the transformation such as is translated and/or is rotated to default three-dimensional system of coordinate, can be somebody's turn to do
The corresponding target of transformation matrix of coordinates presets three-dimensional system of coordinate, and it is default three-dimensional system of coordinate warp which, which presets three-dimensional system of coordinate,
The three-dimensional system of coordinate obtained after transformation.It, can after being converted to default three-dimensional system of coordinate according to each transformation matrix of coordinates
Three-dimensional system of coordinate is preset to obtain the corresponding target of each transformation matrix of coordinates.
After obtaining target and presetting three-dimensional system of coordinate, coordinate, which obtains subelement 3022, can obtain the default three-dimensional of each target
The position coordinates of the origin position of coordinate system.Then, setting subelement 3023 can be by obtained each position coordinates point
It is not set as the three-dimensional coordinate point of each artis position of composition gesture.
It should be noted that when an artis A is the set of matrices B for being corresponding with multiple transformation matrix of coordinates, pass through
Each transformation matrix of coordinates in set of matrices B carries out different transformation to default three-dimensional system of coordinate, obtains each coordinate and becomes
The position coordinates for changing the default three-dimensional system of coordinate origin of the corresponding target of matrix are consistent, and can be used as where artis A
The three-dimensional coordinate point of position.
Optionally, transformation subelement 3021 can be specifically used for：
According to each transformation matrix of coordinates, the z-axis direction of the default three-dimensional system of coordinate using origin as the palm of the hand as rotary shaft,
The rotation for carrying out preset plane rotation angle, obtains the corresponding first default three-dimensional system of coordinate of each transformation matrix of coordinates；
First default three-dimensional system of coordinate is translated to the distance for presetting joint height according to z-axis direction, each coordinate is obtained and becomes
Change the corresponding second default three-dimensional system of coordinate of matrix；
Second default three-dimensional system of coordinate is translated to the distance for presetting joint length according to y-axis direction, each coordinate is obtained and becomes
It changes the corresponding third of matrix and presets three-dimensional system of coordinate；
The y-axis direction for presetting three-dimensional system of coordinate using third carries out the rotation of predetermined inclination angle, obtains each as rotary shaft
The corresponding 4th default three-dimensional system of coordinate of transformation matrix of coordinates, and set the 4th default three-dimensional system of coordinate to the default three-dimensional of target
Coordinate system.
Specifically, as shown in figure 4, the default three-dimensional system of coordinate using origin as the palm of the hand is sat to be three-dimensional shown in the dotted line of the left side
Mark system, transformation subelement 3021 can according to transformation matrix of coordinates, to preset the z-axis direction of three-dimensional system of coordinate as rotary shaft, into
The rotation of row preset plane rotation angle theta obtains the corresponding first default three-dimensional system of coordinate of the transformation matrix of coordinates, this
One default three-dimensional system of coordinate is the three-dimensional system of coordinate that the left side is shown in solid in Fig. 4.Then by the first default three-dimensional system of coordinate according to z
The distance of joint height D is preset in axis direction translation, obtains the second default three-dimensional system of coordinate, which is figure
Three-dimensional system of coordinate shown in upper left side in 4.Secondly, the second default three-dimensional system of coordinate is long according to the default joint of y-axis direction translation
The distance for spending L obtains third and presets three-dimensional system of coordinate, which presets three-dimensional system of coordinate as shown in upper right side dotted line in Fig. 4
Three-dimensional system of coordinate.Finally, the y-axis direction for presetting three-dimensional system of coordinate using third carries out predetermined inclination angle alpha's as rotary shaft
Rotation, obtains the 4th default three-dimensional system of coordinate, and the 4th default three-dimensional system of coordinate is the three-dimensional seat that upper right side is shown in solid in Fig. 4
Mark system, the 4th default three-dimensional system of coordinate obtained at this time as need obtained target to preset three-dimensional system of coordinate.
Wherein, preset plane rotation angle theta, the distance D of default joint height, default joint length distance L and
Predetermined inclination angle alpha is same group of transformation parameter, and specific value can be flexibly arranged according to actual needs, here
It is not construed as limiting.
For multiple transformation matrix of coordinates, transformation subelement 3021 can be according to each transformation matrix of coordinates respectively to original
Default three-dimensional system of coordinate of the point as the palm of the hand carries out the z-axis rotation of preset plane rotation angle, is translated according to z-axis direction successively
The distance of default joint height translates the distance for presetting joint length and the y-axis for carrying out predetermined inclination angle according to y-axis direction
Rotation etc. obtains the corresponding target of each transformation matrix of coordinates and presets three-dimensional system of coordinate.
It should be noted that during being converted to default three-dimensional system of coordinate according to each transformation matrix of coordinates,
Subelement 3021 is converted to translate default the default three-dimensional system of coordinate using origin as the palm of the hand according to z-axis direction successively
The distance of joint height, the z-axis rotation for carrying out preset plane rotation angle, the y-axis rotation for carrying out predetermined inclination angle and according to
The distance etc. of joint length is preset in the translation of y-axis direction；Either, translation transformation can also be carried out only to default three-dimensional system of coordinate and
Without rotation transformation etc.；Its specific conversion process can be flexibly arranged according to actual needs, be not limited thereto.
It will be illustrated for building finger below, the structure of a finger can be become using multiple coordinates
It changes matrix the default three-dimensional system of coordinate using origin as the palm of the hand is converted to obtain, the coordinate that the structure of a finger uses becomes
Changing matrix quantity can be flexibly arranged according to actual needs, and particular number is not limited thereto, can be used for example 5 or
6 etc., for convenience, in embodiments of the present invention, will continuous 5 coordinates be used with the structure of a finger below
Transformation matrix illustrates for being converted.
The coordinate transform T for building a finger entirety can use following formula (1) to indicate：
Wherein, AiIndicate i-th of transformation matrix of coordinates.
Partial coordinate transform TjFollowing formula (2) can be used to indicate：
For example, the 5th joint coordinates for a finger convert T5, can convert and obtain since the palm of the hand：T5=A1×
A2×A3×A4×A5, can also convert and obtain since the 4th artis：T5=T4×A5, wherein A1、A2、A3、A4And A5
5 transformation matrix of coordinates are indicated respectively.
It should be noted that due to the structural particularity of thumb, for thumb, 3 artis can be set,
It is first artis, second artis and third artis successively from root is referred to toward finger tip, i.e., will refers to root position and set
It is set to first artis position, sets finger tip position to third artis position, root will be referred to and referred to
Position is set as second artis position between point.Wherein, in 5 continuous coordinate transforms of structure thumb
In matrix, transformation matrix of coordinates A is since the palm of the hand1And A2Coordinate transform T2Correspondence can obtain where first artis
The three-dimensional coordinate point of position is transformation matrix of coordinates A then since first artis3And A4Coordinate transform T4Correspondence can
To obtain the three-dimensional coordinate point of second artis position, finally since second artis, transformation matrix of coordinates is done
A5Coordinate transform T5Correspondence can obtain the three-dimensional coordinate point of third artis position.Due to acting on the pass of finger
The transformation matrix of coordinates A of section is more, and the activity space in the joint of the finger is bigger, and the joint of finger is more flexible, therefore, for big
More flexible first artis and first artis, are respectively necessary for the effect of 2 transformation matrix of coordinates in thumb.
For the fingers such as index finger, middle finger, the third finger and little finger of toe, 4 artis can be set, from refer to root toward finger tip according to
Secondary is first artis, second artis, third artis and the 4th artis, wherein structure index finger, in
Refer to, in nameless or little finger of toe 5 continuous transformation matrix of coordinates, transformation matrix of coordinates A is since the palm of the hand1Coordinate transform
T1Correspondence can obtain the three-dimensional coordinate point of first artis position, then since first artis, do coordinate
Transformation matrix A2And A3Coordinate transform T3Correspondence can obtain the three-dimensional coordinate point of second artis position, secondly from
Second artis starts, and is transformation matrix of coordinates A4Coordinate transform T4Correspondence can obtain third artis position
Three-dimensional coordinate point be transformation matrix of coordinates A finally since third artis5Coordinate transform T5Correspondence can obtain
The three-dimensional coordinate point of four artis positions.
Since every finger can be converted to obtain by 5 transformation matrix of coordinates, each transformation matrix of coordinates can have
Four parameters such as Plane Rotation angle, joint height, joint length and angle of inclination, therefore every finger can be by 20 parameters
To determine its corresponding posture, wherein Plane Rotation angle theta can determine by the bending angle of finger, joint height D
0 is could be provided as, angle of inclination alpha can be determined by the physiological structure of finger, and joint length L can be by the joint of finger
Length determine.
Determination unit 303 determines the two of each artis for the three-dimensional coordinate point according to each artis position
Dimension coordinate point.
It should be noted that in one embodiment, being sat obtaining the three-dimensional of each artis position of composition gesture
After punctuate, determination unit 303 can build the three-dimension gesture model of gesture, and three-dimension gesture model is then mapped to two dimensional surface
It is interior, you can to obtain two-dimentional gesture, and determine the two-dimensional coordinate point of each artis in two dimensional surface.In another embodiment,
After obtaining the three-dimensional coordinate point of each artis position of composition gesture, determination unit 303 can not build gesture
Then three-dimension gesture model directly maps to the three-dimensional coordinate point of each artis in two dimensional surface, you can in two dimensional surface
The two-dimensional coordinate point of the interior each artis of determination.
When needing to build the corresponding three-dimension gesture model of gesture, determination unit 303 can be according to obtained composition gesture
Each artis position three-dimensional coordinate point, in three dimensions build gesture three-dimension gesture model.For convenience
The building process of gesture is illustrated, it is substantially first the least unit in the joint for forming gesture can be set to, for one
Transformation matrix of coordinates can correspond to a member substantially, i.e., can obtain one substantially according to the transformation of a transformation matrix of coordinates
Member.After having basic member, so that it may to build the three-dimensional structure in joint according to basic member, then it is three-dimensional with the three-dimensional structure structure in joint
Finger finally builds three-dimension gesture model according to three-dimensional finger.The three-dimension gesture model can be three-dimension gesture skeleton, can also
It is complete three-dimension gesture etc., particular content is not construed as limiting here.
Multiple members substantially can be used for the structure of a finger, basic first quantity that the structure of a finger uses can
To be flexibly arranged according to actual needs, particular number is not limited thereto, and 5 or 6 basic members etc. can be used for example,
It for convenience, in embodiments of the present invention, below will be by taking the structure of a finger be using continuous 5 basic members as an example
It illustrates.
Wherein, the three-dimension gesture model of a hand can be made of 5 fingers, for index finger, middle finger, the third finger and little finger of toe
Deng every finger can be made of 4 joints, and each joint can be by 1 or multiple basic members form.It can for thumb
To be made of 3 joints, each joint can be by 1 or multiple basic members form.The basic member for forming a joint is more,
The activity space in the joint is bigger, and the joint is more flexible, therefore, for more flexible first joint and first in thumb
A joint can be made of 2 basic members respectively, other joints can be made of 1 basic member；For index finger, middle finger, the third finger and
Little finger of toe, other than more flexible second joint can be made of 2 basic members, other joints can be made of 1 basic member.
It is first joint to the 4th joint etc. successively that the sequence in each joint, which can be from finger root toward finger tip, or from root is referred to toward finger
Point is first joint to third joint etc. successively.
It, can be by three-dimension gesture mould after building the three-dimension gesture model of gesture in three dimensions according to these basic members
Type maps in two dimensional surface, you can obtains the two-dimensional coordinate point of two-dimentional gesture and each of which artis.Due to three-dimension gesture mould
Each joint of type can be as actual human hand can be movable, therefore, three-dimension gesture model can be done rotation and/or
After the operations such as translation, the three-dimension gesture model after being converted, then the three-dimension gesture model after transformation is mapped into two dimensional surface
It is interior, obtain the two-dimensional coordinate point of two-dimentional gesture and each of which artis.
It should be noted that can be based on a three-dimension gesture model can generate any number of two-dimentional gesture, for example,
After obtaining a three-dimension gesture model, three-dimension gesture model can be mapped in two dimensional surface and obtain two-dimentional gesture, to this
Two-dimentional gesture is preserved.Then, rotationally and/or translationally equal to three-dimension gesture model to operate, the three-dimension gesture after being converted
Model, then the three-dimension gesture model after transformation is mapped into the two-dimentional gesture after being converted in two dimensional surface, after the transformation
Two-dimentional gesture preserved, transformation can also be continued to three-dimension gesture model and obtain miscellaneous two-dimentional gesture.
When that need not build the corresponding three-dimension gesture model of gesture, determination unit 303 can be directly by each artis
Three-dimensional coordinate point map in two dimensional surface, you can the two-dimensional coordinate point that each artis is determined in two dimensional surface may be used also
To construct two-dimentional gesture according to the two-dimensional coordinate of each artis point.Alternatively, being revolved to the three-dimensional coordinate point of each artis
Turn and/or translation etc. is after operations, obtains each artis of the gesture after composition transformation, then each joint that will be obtained after transformation
Point maps in two dimensional surface, and the two-dimensional coordinate point of each artis is determined in two dimensional surface.
In some embodiments, as shown in Figure 10, determination unit 303 may include obtaining subelement 3031 and mapping
Unit 3032 etc., specifically can be as follows：
Subelement 3031 is obtained, the rotation angle for obtaining the vertical direction centered on the palm of the hand and the elevation angle；
Subelement 3032 is mapped, is used for according to rotation angle and the elevation angle, by the three-dimensional coordinate of each artis position
Point maps to two dimensional surface, obtains the two-dimensional coordinate point of each artis.
Specifically, during the three-dimensional coordinate point of each artis is mapped to two dimensional surface, subelement is obtained
3031 can first determine a rotation angle of the vertical direction of mapping, and determine an elevation angle, the rotation angle and the elevation angle
It can be random, can also be flexibly to be arranged according to actual needs.Then, mapping subelement 3032 can be according to rotation
Gyration and the elevation angle determine a projecting direction, then are mapped three-dimensional coordinate point on the projecting direction.For example, such as Fig. 5
It is shown, in three dimensions, the palm of the hand of gesture can be set to coordinate origin, three-dimensional system of coordinate be established, in the three-dimensional coordinate
Rotation angle θ and the elevation angle of the vertical direction centered on the palm of the hand are determined in systemThen according to rotation angle θ and the elevation angleReally
Determine two dimensional surface, the three-dimensional coordinate point of each artis position is mapped in the two dimensional surface, maps subelement 3032
The two-dimensional coordinate point of each artis can be determined in two dimensional surface.
In some embodiments, mapping subelement 3032 may include setup module, mapping block and locating module etc.,
It specifically can be as follows：
Setup module, for a ray centered on the palm of the hand to be arranged outward according to rotation angle and the elevation angle；
Mapping block, for using the direction where ray as projecting direction, and by the three of each artis position
Dimension coordinate point maps in the two dimensional surface on projecting direction；
Locating module, for being positioned to each artis in two dimensional surface, the two dimension for obtaining each artis is sat
Punctuate.
Specifically, after obtaining rotation angle and the elevation angle, setup module can centered on the palm of the hand, according to rotation angle and
A ray is made in elevation angle mapping outward, and the direction where the ray is projecting direction, and one can be determined on projecting direction
The three-dimensional coordinate point of each artis position can be mapped to projection side by the two dimensional surface vertical with ray, mapping block
In the upward two dimensional surface.
Optionally, mapping block can be specifically used for：Using the direction where ray as projecting direction, and obtain projection
The unit vector in direction；The three-dimensional coordinate point of each artis position is mapped into the two dimensional surface vertical with unit vector
On.
During mapping, mapping block can be using the direction where ray as projecting direction, where taking ray
The mould of unit vector on projecting direction, the unit vector is 1, then reflects the three-dimensional coordinate point of each artis position
It is mapped on the two dimensional surface vertical with the unit vector.It is understood that the default vector of projecting direction can also be taken, this is pre-
If vector can be the preset multiple of unit vector, the default vector or preset multiple can flexibly be set according to actual needs
It sets, then the three-dimensional coordinate point of each artis position is mapped to the two dimension vertical with the default vector and put down by mapping block
On face.
After the three-dimensional coordinate point of each artis position is mapped in the two dimensional surface on projecting direction, positioning
Module can position each artis in two dimensional surface, obtain the two-dimensional coordinate point of each artis.
Optionally, locating module can be specifically used for：
Obtained in two dimensional surface each artis between the palm of the hand at a distance from, apart from longest artis；By distance
Longest artis, as x-axis, using the straight line perpendicular to x-axis as y-axis, is established using the palm of the hand as origin with straight line where the palm of the hand
Two-dimensional coordinate system；The position that each artis is determined according to two-dimensional coordinate system obtains the two-dimensional coordinate point of each artis.
Specifically, locating module can first determine two-dimensional coordinate system：First, by the three-dimensional of each artis position
After coordinate points map in the two dimensional surface on projecting direction, the corresponding position of each artis on two dimensional surface can be obtained,
The distance between each artis and the palm of the hand can be calculated at this time, filtered out from the distance between each artis and the palm of the hand away from
From longest artis, using the palm of the hand as origin, x will be being determined as x-axis apart from straight line where longest artis and the palm of the hand
Can be established using the palm of the hand as the two-dimensional coordinate system of origin, as shown in Figure 6 using the straight line perpendicular to x-axis as y-axis after axis.It is fixed
The position that each artis is determined in the two-dimensional coordinate system that position module can be shown in Fig. 6, the two dimension for obtaining each artis are sat
Punctuate.It, may due to for different gestures, determining the longest artis of distance as x-axis and straight line where the palm of the hand
It is different, therefore the diversity of the two-dimentional gesture of the two-dimensional coordinate point composition of each artis can be increased.
It should be noted that two-dimensional coordinate system can also be established at random, for example, using the palm of the hand as origin, in each joint
Point in the distance between palm of the hand, using apart from straight line where shortest artis and the palm of the hand as x-axis with perpendicular to the straight line of x-axis
As y-axis, establish using the palm of the hand as the two-dimensional coordinate system of origin.Either, with the position where first artis of thumb
As origin, takes two orthogonal straight lines respectively as x-axis and y-axis at random, establish two-dimensional coordinate system；Etc..
Generation unit 304, for being labeled to each artis according to the two-dimensional coordinate point of each artis, and according to
Each artis after mark generates images of gestures.
After obtaining the two-dimensional coordinate point of each artis of composition gesture, generation unit 304 can be according to each joint
The two-dimensional coordinate point of point is labeled the position where each artis, obtains the corresponding markup information of each artis, should
Markup information can be the shapes such as filled circles, square or five-pointed star, can each artis markup information use it is identical
Shape, either, the markup information of the artis of different fingers uses different shapes, i.e., the pass of the same finger respectively
The markup information of node uses identical shape etc..Then gesture figure can be generated according to each artis after mark
Picture may include each artis and its markup information for forming gesture in the images of gestures.
Generation unit 304 can also build two-dimentional gesture according to the two-dimensional coordinate point of each artis, in the two dimension gesture
On the position where each artis is labeled, can according to each artis after mark generate images of gestures, the hand
May include the markup information of two-dimentional gesture and each artis in the two dimension gesture in gesture image, which is two
Gesture in dimensional plane.It realizes the full-automatic of images of gestures to generate, avoids the error generated when artificial mark.
It should be noted that may include one or more gestures in an images of gestures, for example, can be according to obtaining
After the two-dimensional coordinate point of each artis builds a two-dimentional gesture, which the behaviour such as is replicated and is moved or rotated
Make, obtain another two-dimentional gesture, after obtaining multiple two-dimentional gestures, each artis of multiple two-dimentional gestures can be carried out
Mark can generate images of gestures according to multiple two-dimentional gestures after mark.
In some embodiments, as shown in figure 9, generation unit 304 may include mark subelement 3041 and interception
Unit 3042 etc., specifically can be as follows：
Subelement 3041 is marked, for constructing two-dimentional gesture according to the two-dimensional coordinate point of each artis, and according to each
The two-dimensional coordinate point of artis is labeled each artis in two-dimentional gesture；
Subelement 3042 is intercepted, for intercepting predeterminable area in two dimensional surface where the two-dimentional gesture after mark, generating
Images of gestures.
Specifically, during generating images of gestures, mark subelement 3041 can be first according to the two of each artis
Dimension coordinate point constructs a gesture in two dimensional surface, obtains two-dimentional gesture.For example, images of gestures generating means can be every
Pixel value is set in the predeterminable area around join domain and the palm of the hand between each artis of a finger, you can constructs
Two-dimentional gesture.Either, images of gestures generating means can obtain sample from local or the preset images of gestures library of server
The upper pixel value of gesture in sample images of gestures is copied to the gesture area around corresponding each artis by images of gestures
It is interior, you can to construct two-dimentional gesture；Etc..Wherein the specific value of join domain, pixel value and gesture area etc. is not here
It is construed as limiting.
After obtaining two-dimentional gesture, mark subelement 3041 can be according to the two-dimensional coordinate point of each artis to two-dimentional hand
Each artis is labeled in gesture, the two-dimentional gesture after being marked.Then interception subelement 3042 is to the two dimension after mark
Predeterminable area is intercepted where gesture in two dimensional surface, generates images of gestures.Wherein, the predeterminable area can according to actual needs into
Flexibly setting, particular content are not construed as limiting row here.
Optionally, interception subelement 3042 can be specifically used for：
The distance between each artis and the palm of the hand are obtained, multiple distances are obtained；It is filtered out from multiple distances longest
Target range；Using the preset multiple of target range as the length of side, to being cut in two dimensional surface where the two-dimentional gesture after mark
It takes, obtains the predeterminable area centered on the palm of the hand；Images of gestures is generated according to predeterminable area.
Specifically, interception subelement 3042 can first determine the size of interception area, in order to ensure the images of gestures generated
In two-dimentional gesture be complete, in order to ensure that two-dimentional gesture will not be blocked, interception subelement 3042 can first obtain often
The distance between a artis and the palm of the hand obtain multiple distances；For example, when there are 19 artis, can obtain 19 away from
From.At this point it is possible to filter out longest target range from multiple distances, the target range be multiple distances longest away from
From then, centered on the palm of the hand, and using the preset multiple of the target range as the length of side, to the two-dimentional gesture after mark
One box of interception is carried out in the two dimensional surface of place, obtains the predeterminable area centered on the palm of the hand.Wherein, preset multiple can be set
3 times or 6 times etc. are set to, specific value can be flexibly arranged according to actual needs, be not construed as limiting here.What interception obtained
Predeterminable area can be square, will can also be made according to actual needs with the first preset multiple of target range (such as 5 times)
For length, using the second preset multiple (such as 3 times) of target range as width, to where the two-dimentional gesture after mark in two dimensional surface
Rectangular region of the interception one centered on the palm of the hand.Alternatively, using the third preset multiple (such as 6 times) of target range as directly
Diameter, to intercepting a border circular areas centered on the palm of the hand where the two-dimentional gesture after mark in two dimensional surface；Etc..Finally,
Images of gestures can be generated according to the predeterminable area being truncated to.
In some embodiments, as shown in figure 12, images of gestures generating means can also include：
Operating unit 305 carries out translation and/or rotation process for obtaining the gesture in images of gestures, and to gesture, obtains
To target images of gestures.
The pattern of gesture in images of gestures is obtained in order to abundant, after obtaining images of gestures, operating unit 305 can be with opponent
Gesture in gesture image carries out translation and/or rotation process, for example, it may be entire gesture is carried out to the rotation of random angles,
And/or entire gesture is carried out to the translation of random distance, target images of gestures is obtained, which is to gesture
The image that gesture in image carries out translation and/or rotation process obtains；Either, gesture is carried out centered on the palm of the hand random
The rotation of angle obtains target images of gestures, the target images of gestures be to the gesture in images of gestures carry out translation and/or
The image that rotation process obtains.
Either, operating unit 305 can preserve the images of gestures after obtaining images of gestures, then replicate this
Or multiple images of gestures, to the gesture in obtained one or more images of gestures of duplication carry out respectively different translations and/or
Rotation process obtains one or more different target images of gestures, and preserves the one or more target images of gestures, to
Any amount can be automatically generated by an images of gestures and marks the target images of gestures of good each artis, improve hand
The flexibility that gesture image obtains.
In some embodiments, as shown in figure 13, images of gestures generating means can also include：
Unit for scaling 306 zooms in or out operation for being carried out according to preset ratio to the gesture in images of gestures, obtains
Target images of gestures.
Specifically, after obtaining images of gestures, unit for scaling 306 can contract to the images of gestures according to preset ratio
Small or amplifieroperation obtains target images of gestures.For example, unit for scaling 306 can be to entire images of gestures according to default ratio
Example carries out zooming in or out operation, obtains target images of gestures；Can also be to the gesture in entire images of gestures according to default
Ratio carries out zooming in or out operation, obtains target images of gestures.Wherein, preset ratio can carry out flexibly according to actual needs
Setting, specific value are not construed as limiting here.Either, after obtaining images of gestures, unit for scaling 306 can preserve the gesture
Then image replicates one or more images of gestures, the gesture in one or more images of gestures obtained to duplication is distinguished
It carries out zooming in or out operation according to preset ratio, obtains one or more different target images of gestures.
From the foregoing, it will be observed that the embodiment of the present invention can be distinguished by acquiring unit 301 according to the multigroup transformation parameter got
Transformation matrix of coordinates is constructed, multiple transformation matrix of coordinates and converter unit 302 is obtained according to each transformation matrix of coordinates, obtains
Take the three-dimensional coordinate point of each artis position of composition gesture；Again by determination unit 303 according to where each artis
The three-dimensional coordinate point of position determines the two-dimensional coordinate point of each artis；Then generation unit 304 is according to the two of each artis
Dimension coordinate point is labeled each artis, and generates images of gestures according to each artis after mark.The program is realized
Automatically generate the images of gestures that each artis is marked in gesture, and the three-dimensional that can be obtained according to transformation matrix of coordinates
Coordinate points determine the two-dimensional coordinate point of each artis, are clicked through to each joint further according to the two-dimensional coordinate point of each artis
Rower is noted, and without operations such as each artis for manually being taken pictures and being marked gesture, is improved images of gestures and is generated
Reliability and convenience.
Correspondingly, the embodiment of the present invention also provides a kind of terminal, as shown in figure 14, the terminal may include radio frequency (RF,
Radio Frequency) circuit 601, the memory 602, defeated that includes one or more computer readable storage mediums
Enter unit 603, display unit 604, sensor 605, voicefrequency circuit 606, Wireless Fidelity (WiFi, Wireless Fidelity)
Module 607, include there are one or more than one processing core processor 608 and the components such as power supply 609.This field skill
Art personnel are appreciated that the restriction of the not structure paired terminal of terminal structure shown in Figure 14, may include than illustrate it is more or
Less component either combines certain components or different components arrangement.Wherein：
RF circuits 601 can be used for receiving and sending messages or communication process in, signal sends and receivees, particularly, by base station
After downlink information receives, one or the processing of more than one processor 608 are transferred to；In addition, the data for being related to uplink are sent to
Base station.In general, RF circuits 601 include but not limited to antenna, at least one amplifier, tuner, one or more oscillators, use
Family identity module (SIM, Subscriber Identity Module) card, transceiver, coupler, low-noise amplifier
(LNA, Low Noise Amplifier), duplexer etc..In addition, RF circuits 601 can also by radio communication with network and its
He communicates equipment.The wireless communication can use any communication standard or agreement, including but not limited to global system for mobile telecommunications system
Unite (GSM, Global System of Mobile communication), general packet radio service (GPRS, General
Packet Radio Service), CDMA (CDMA, Code Division Multiple Access), wideband code division it is more
Location (WCDMA, Wideband Code Division Multiple Access), long term evolution (LTE, Long Term
Evolution), Email, short message service (SMS, Short Messaging Service) etc..
Memory 602 can be used for storing software program and module, and processor 608 is stored in memory 602 by operation
Software program and module, to perform various functions application and data processing.Memory 602 can include mainly storage journey
Sequence area and storage data field, wherein storing program area can storage program area, the application program (ratio needed at least one function
Such as sound-playing function, image player function) etc.；Storage data field can be stored uses created data according to terminal
(such as audio data, phone directory etc.) etc..In addition, memory 602 may include high-speed random access memory, can also include
Nonvolatile memory, for example, at least a disk memory, flush memory device or other volatile solid-state parts.Phase
Ying Di, memory 602 can also include Memory Controller, to provide processor 608 and input unit 603 to memory 602
Access.
Input unit 603 can be used for receiving the number or character information of input, and generate and user setting and function
Control related keyboard, mouse, operating lever, optics or the input of trace ball signal.Specifically, in a specific embodiment
In, input unit 603 may include touch sensitive surface and other input equipments.Touch sensitive surface, also referred to as touch display screen or tactile
Control plate, collect user on it or neighbouring touch operation (such as user using any suitable object such as finger, stylus or
Operation of the attachment on touch sensitive surface or near touch sensitive surface), and corresponding connection dress is driven according to preset formula
It sets.Optionally, touch sensitive surface may include both touch detecting apparatus and touch controller.Wherein, touch detecting apparatus is examined
The touch orientation of user is surveyed, and detects the signal that touch operation is brought, transmits a signal to touch controller；Touch controller from
Touch information is received on touch detecting apparatus, and is converted into contact coordinate, then gives processor 608, and can reception processing
Order that device 608 is sent simultaneously is executed.Furthermore, it is possible to a variety of using resistance-type, condenser type, infrared ray and surface acoustic wave etc.
Type realizes touch sensitive surface.In addition to touch sensitive surface, input unit 603 can also include other input equipments.Specifically, other are defeated
Enter equipment and can include but is not limited to physical keyboard, function key (such as volume control button, switch key etc.), trace ball, mouse
It is one or more in mark, operating lever etc..
Display unit 604 can be used for showing information input by user or be supplied to user information and terminal it is various
Graphical user interface, these graphical user interface can be made of figure, text, icon, video and its arbitrary combination.Display
Unit 604 may include display panel, optionally, may be used liquid crystal display (LCD, Liquid Crystal Display),
The forms such as Organic Light Emitting Diode (OLED, Organic Light-Emitting Diode) configure display panel.Further
, touch sensitive surface can cover display panel, when touch sensitive surface detects on it or after neighbouring touch operation, send processing to
Device 608 is followed by subsequent processing device 608 and is provided on a display panel accordingly according to the type of touch event to determine the type of touch event
Visual output.Although in fig. 14, touch sensitive surface and display panel are to realize input and defeated as two independent components
Enter function, but in some embodiments it is possible to touch sensitive surface and display panel is integrated and realizes and outputs and inputs function.
Terminal may also include at least one sensor 605, such as optical sensor, motion sensor and other sensors.
Specifically, optical sensor may include ambient light sensor and proximity sensor, wherein ambient light sensor can be according to ambient light
Light and shade adjust the brightness of display panel, proximity sensor can close display panel and/or the back of the body when terminal is moved in one's ear
Light.As a kind of motion sensor, gravity accelerometer can detect in all directions (generally three axis) acceleration
Size can detect that size and the direction of gravity when static, can be used to identify mobile phone posture application (such as horizontal/vertical screen switching,
Dependent game, magnetometer pose calibrating), Vibration identification correlation function (such as pedometer, tap) etc.；It can also configure as terminal
The other sensors such as gyroscope, barometer, hygrometer, thermometer, infrared sensor, details are not described herein.
Voicefrequency circuit 606, loud speaker, microphone can provide the audio interface between user and terminal.Voicefrequency circuit 606 can
By the transformed electric signal of the audio data received, it is transferred to loud speaker, voice signal output is converted to by loud speaker；It is another
The voice signal of collection is converted to electric signal by aspect, microphone, and audio data is converted to after being received by voicefrequency circuit 606, then
After the processing of audio data output processor 608, through RF circuits 601 to be sent to such as another terminal, or by audio data
Output is further processed to memory 602.Voicefrequency circuit 606 is also possible that earphone jack, with provide peripheral hardware earphone with
The communication of terminal.
WiFi belongs to short range wireless transmission technology, and terminal can help user's transceiver electronics postal by WiFi module 607
Part, browsing webpage and access streaming video etc., it has provided wireless broadband internet to the user and has accessed.Although Figure 14 is shown
WiFi module 607, but it is understood that, and it is not belonging to must be configured into for terminal, it can not change as needed completely
Become in the range of the essence of invention and omits.
Processor 608 is the control centre of terminal, using the various pieces of various interfaces and connection whole mobile phone, is led to
It crosses operation or executes the software program and/or module being stored in memory 602, and call and be stored in memory 602
Data execute the various functions and processing data of terminal, to carry out integral monitoring to mobile phone.Optionally, processor 608 can wrap
Include one or more processing cores；Preferably, processor 608 can integrate application processor and modem processor, wherein answer
With the main processing operation system of processor, user interface and application program etc., modem processor mainly handles wireless communication.
It is understood that above-mentioned modem processor can not also be integrated into processor 608.
Terminal further includes the power supply 609 (such as battery) powered to all parts, it is preferred that power supply can pass through power supply pipe
Reason system and processor 608 are logically contiguous, to realize management charging, electric discharge and power managed by power-supply management system
Etc. functions.Power supply 609 can also include one or more direct current or AC power, recharging system, power failure inspection
The random components such as slowdown monitoring circuit, power supply changeover device or inverter, power supply status indicator.
Although being not shown, terminal can also include camera, bluetooth module etc., and details are not described herein.Specifically in this implementation
In example, the processor 608 in terminal can be corresponding by the process of one or more application program according to following instruction
Executable file is loaded into memory 602, and runs the application program of storage in the memory 602 by processor 608, from
And realize various functions：
Multigroup transformation parameter is obtained, transformation matrix of coordinates is constructed according to multigroup transformation parameter respectively, multiple coordinates is obtained and becomes
Change matrix；According to each transformation matrix of coordinates, the three-dimensional coordinate point of each artis position of composition gesture is obtained；According to
The three-dimensional coordinate point of each artis position, determines the two-dimensional coordinate point of each artis；According to the two of each artis
Dimension coordinate point is labeled each artis, and generates images of gestures according to each artis after mark.
Optionally, each artis is labeled according to the two-dimensional coordinate of each artis point, and according to mark after
Each the step of artis generation images of gestures may include：Two-dimentional gesture is constructed according to the two-dimensional coordinate of each artis point,
And each artis in two-dimentional gesture is labeled according to the two-dimensional coordinate of each artis point；To the two-dimentional gesture after mark
Predeterminable area is intercepted in the two dimensional surface of place, generates images of gestures.
Optionally, according to the three-dimensional coordinate point of each artis position, the two-dimensional coordinate point of each artis is determined
The step of may include：Obtain rotation angle and the elevation angle of the vertical direction centered on the palm of the hand；According to rotation angle and the elevation angle,
The three-dimensional coordinate point of each artis position is mapped into two dimensional surface, obtains the two-dimensional coordinate point of each artis.
Optionally, it according to each transformation matrix of coordinates, obtains the three-dimensional of each artis position of composition gesture and sits
The step of punctuate may include：The default three-dimensional system of coordinate using origin as the palm of the hand is become according to each transformation matrix of coordinates
It changes, obtains the corresponding target of each transformation matrix of coordinates and preset three-dimensional system of coordinate；It obtains each target and presets three-dimensional system of coordinate
The position coordinates of origin position；Obtained each position coordinates are respectively set to where each artis of composition gesture
The three-dimensional coordinate point of position.
Optionally, to intercepting predeterminable area in two dimensional surface where the two-dimentional gesture after mark, the step of images of gestures is generated
After rapid, images of gestures generation method can also include：Translation and/or rotation process are carried out to the gesture in images of gestures, obtained
To target images of gestures.
Optionally, to intercepting predeterminable area in two dimensional surface where the two-dimentional gesture after mark, the step of images of gestures is generated
After rapid, images of gestures generation method can also include：Gesture in images of gestures is reduced or put according to preset ratio
Big operation, obtains target images of gestures.
From the foregoing, it will be observed that the embodiment of the present invention can construct coordinate transform square respectively according to the multigroup transformation parameter got
Battle array obtains multiple transformation matrix of coordinates, and according to each transformation matrix of coordinates, where each artis for obtaining composition gesture
The three-dimensional coordinate point of position；According to the three-dimensional coordinate point of each artis position, the two-dimensional coordinate of each artis is determined
Point；Then each artis is labeled according to the two-dimensional coordinate of each artis point, and according to each joint after mark
Point generates images of gestures.The program realizes the images of gestures for automatically generating and marking each artis in gesture, and can be with
The three-dimensional coordinate point obtained according to transformation matrix of coordinates determines the two-dimensional coordinate point of each artis, further according to each artis
Two-dimensional coordinate point each artis is labeled, each joint without manually being taken pictures and being marked gesture
The operations such as point improve reliability and convenience that images of gestures generates.
In the above-described embodiments, it all emphasizes particularly on different fields to the description of each embodiment, there is no the portion being described in detail in some embodiment
Point, the detailed description above with respect to images of gestures generation method is may refer to, details are not described herein again.
It will appreciated by the skilled person that all or part of step in the various methods of above-described embodiment can be with
It is completed by instructing, or controls relevant hardware by instructing and complete, which can be stored in one and computer-readable deposit
In storage media, and is loaded and executed by processor.
For this purpose, the embodiment of the present invention provides a kind of storage medium, wherein being stored with a plurality of instruction, which can be handled
Device is loaded, to execute the step in any images of gestures generation method that the embodiment of the present invention is provided.For example, this refers to
Order can execute following steps：
Multigroup transformation parameter is obtained, transformation matrix of coordinates is constructed according to multigroup transformation parameter respectively, multiple coordinates is obtained and becomes
Change matrix；According to each transformation matrix of coordinates, the three-dimensional coordinate point of each artis position of composition gesture is obtained；According to
The three-dimensional coordinate point of each artis position, determines the two-dimensional coordinate point of each artis；According to the two of each artis
Dimension coordinate point is labeled each artis, and generates images of gestures according to each artis after mark.
Optionally, each artis is labeled according to the two-dimensional coordinate of each artis point, and according to mark after
Each the step of artis generation images of gestures may include：Two-dimentional gesture is constructed according to the two-dimensional coordinate of each artis point,
And each artis in two-dimentional gesture is labeled according to the two-dimensional coordinate of each artis point；To the two-dimentional gesture after mark
Predeterminable area is intercepted in the two dimensional surface of place, generates images of gestures.
Optionally, according to the three-dimensional coordinate point of each artis position, the two-dimensional coordinate point of each artis is determined
The step of may include：Obtain rotation angle and the elevation angle of the vertical direction centered on the palm of the hand；According to rotation angle and the elevation angle,
The three-dimensional coordinate point of each artis position is mapped into two dimensional surface, obtains the two-dimensional coordinate point of each artis.
Optionally, it according to each transformation matrix of coordinates, obtains the three-dimensional of each artis position of composition gesture and sits
The step of punctuate may include：The default three-dimensional system of coordinate using origin as the palm of the hand is become according to each transformation matrix of coordinates
It changes, obtains the corresponding target of each transformation matrix of coordinates and preset three-dimensional system of coordinate；It obtains each target and presets three-dimensional system of coordinate
The position coordinates of origin position；Obtained each position coordinates are respectively set to where each artis of composition gesture
The three-dimensional coordinate point of position.
Optionally, to intercepting predeterminable area in two dimensional surface where the two-dimentional gesture after mark, the step of images of gestures is generated
After rapid, images of gestures generation method can also include：Translation and/or rotation process are carried out to the gesture in images of gestures, obtained
To target images of gestures.
Optionally, to intercepting predeterminable area in two dimensional surface where the two-dimentional gesture after mark, the step of images of gestures is generated
After rapid, images of gestures generation method can also include：Gesture in images of gestures is reduced or put according to preset ratio
Big operation, obtains target images of gestures.
The specific implementation of above each operation can be found in the embodiment of front, and details are not described herein.
Wherein, which may include：Read-only memory (ROM, Read Only Memory), random access memory
Body (RAM, Random Access Memory), disk or CD etc..
By the instruction stored in the storage medium, any gesture figure that the embodiment of the present invention is provided can be executed
As the step in generation method, it is thereby achieved that any images of gestures generation method institute that the embodiment of the present invention is provided
The advantageous effect that can be realized, refers to the embodiment of front, details are not described herein.
A kind of images of gestures generation method, device and storage medium is provided for the embodiments of the invention above to have carried out in detail
Thin to introduce, principle and implementation of the present invention are described for specific case used herein, and above example is said
The bright method and its core concept for being merely used to help understand the present invention；Meanwhile for those skilled in the art, according to this hair
Bright thought, there will be changes in the specific implementation manner and application range, in conclusion the content of the present specification should not manage
Solution is limitation of the present invention.
Claims (23)
1. a kind of images of gestures generation method, which is characterized in that including：
Multigroup transformation parameter is obtained, transformation matrix of coordinates is constructed according to multigroup transformation parameter respectively, obtains multiple coordinate transform squares
Battle array；
According to each transformation matrix of coordinates, the three-dimensional coordinate point of each artis position of composition gesture is obtained；
According to the three-dimensional coordinate point of each artis position, the two-dimensional coordinate point of each artis is determined；
Each artis is labeled according to the two-dimensional coordinate point of each artis, and according to each joint after mark
Point generates images of gestures.
2. images of gestures generation method according to claim 1, which is characterized in that according to the two dimension of each artis
Coordinate points are labeled each artis, and the step of generating images of gestures according to each artis after mark includes：
Two-dimentional gesture is constructed according to the two-dimensional coordinate of each artis point, and according to the two-dimensional coordinate of each artis point to described
Each artis is labeled in two-dimentional gesture；
To intercepting predeterminable area where the two-dimentional gesture after mark in two dimensional surface, images of gestures is generated.
3. images of gestures generation method according to claim 2, which is characterized in that the two-dimentional gesture institute after described pair of mark
The step of intercepting predeterminable area in two dimensional surface, generating images of gestures include：
The distance between each artis and the palm of the hand are obtained, multiple distances are obtained；
Longest target range is filtered out from the multiple distance；
Using the preset multiple of the target range as the length of side, to being cut in two dimensional surface where the two-dimentional gesture after mark
It takes, obtains the predeterminable area centered on the palm of the hand；
Images of gestures is generated according to the predeterminable area.
4. images of gestures generation method according to claim 1, which is characterized in that described according to each artis institute
The step of three-dimensional coordinate point in position, the two-dimensional coordinate point for determining each artis includes：
Obtain rotation angle and the elevation angle of the vertical direction centered on the palm of the hand；
According to the rotation angle and the elevation angle, it is flat that the three-dimensional coordinate point of each artis position is mapped into two dimension
Face obtains the two-dimensional coordinate point of each artis.
5. images of gestures generation method according to claim 4, which is characterized in that described according to the rotation angle and to face upward
The three-dimensional coordinate point of each artis position is mapped to two dimensional surface by angle, and the two dimension for obtaining each artis is sat
The step of punctuate includes：
According to the rotation angle and the elevation angle, one ray centered on the palm of the hand is set outward；
Using the direction where the ray as projecting direction, and the three-dimensional coordinate point of each artis position is reflected
It is incident upon in the two dimensional surface on the projecting direction；
Each artis is positioned in the two dimensional surface, obtains the two-dimensional coordinate point of each artis.
6. images of gestures generation method according to claim 5, which is characterized in that the direction by where the ray
The two dimension on the projecting direction is mapped to as projecting direction, and by the three-dimensional coordinate point of each artis position
Step in plane includes：
Using the direction where the ray as projecting direction, and obtain the unit vector of the projecting direction；
The three-dimensional coordinate point of each artis position is mapped on the two dimensional surface vertical with the unit vector.
7. images of gestures generation method according to claim 5, which is characterized in that it is described in the two dimensional surface to every
A artis is positioned, and the step of obtaining the two-dimensional coordinate point of each artis includes：
Obtained in the two dimensional surface each artis between the palm of the hand at a distance from, apart from longest artis；
It, using the straight line perpendicular to x-axis as y-axis, will be established with hand apart from longest artis and palm of the hand place straight line as x-axis
The heart is the two-dimensional coordinate system of origin；
The position that each artis is determined according to the two-dimensional coordinate system obtains the two-dimensional coordinate point of each artis.
8. images of gestures generation method according to claim 1, which is characterized in that each coordinate transform square of basis
Battle array, obtain composition gesture each artis position three-dimensional coordinate point the step of include：
The default three-dimensional system of coordinate using origin as the palm of the hand is converted according to each transformation matrix of coordinates, obtains each coordinate
The corresponding target of transformation matrix presets three-dimensional system of coordinate；
Obtain the position coordinates that each target presets the origin position of three-dimensional system of coordinate；
Obtained each position coordinates are respectively set to the three-dimensional coordinate point of each artis position of composition gesture.
9. images of gestures generation method according to claim 8, which is characterized in that each transformation matrix of coordinates of basis
Default three-dimensional system of coordinate using origin as the palm of the hand is converted, the corresponding target of each transformation matrix of coordinates default three is obtained
The step of dimension coordinate system includes：
According to each transformation matrix of coordinates, the z-axis direction of the default three-dimensional system of coordinate using origin as the palm of the hand is carried out as rotary shaft
The rotation of preset plane rotation angle obtains the corresponding first default three-dimensional system of coordinate of each transformation matrix of coordinates；
First default three-dimensional system of coordinate is translated to the distance for presetting joint height according to z-axis direction, obtains each coordinate transform square
The corresponding second default three-dimensional system of coordinate of battle array；
Second default three-dimensional system of coordinate is translated to the distance for presetting joint length according to y-axis direction, obtains each coordinate transform square
The corresponding third of battle array presets three-dimensional system of coordinate；
The y-axis direction for presetting three-dimensional system of coordinate using the third carries out the rotation of predetermined inclination angle, obtains each as rotary shaft
The corresponding 4th default three-dimensional system of coordinate of transformation matrix of coordinates, and set the 4th default three-dimensional system of coordinate to target and preset
Three-dimensional system of coordinate.
10. according to claim 1 to 9 any one of them images of gestures generation method, which is characterized in that after described pair of mark
After the step of intercepting predeterminable area where two-dimentional gesture in two dimensional surface, generating images of gestures, the method further includes：
Translation and/or rotation process are carried out to the gesture in the images of gestures, obtain target images of gestures.
11. according to claim 1 to 9 any one of them images of gestures generation method, which is characterized in that after described pair of mark
After the step of intercepting predeterminable area where two-dimentional gesture in two dimensional surface, generating images of gestures, the method further includes：
The images of gestures is carried out according to preset ratio to zoom in or out operation, obtains target images of gestures.
12. a kind of images of gestures generating means, which is characterized in that including：
Acquiring unit constructs transformation matrix of coordinates according to multigroup transformation parameter, obtains more respectively for obtaining multigroup transformation parameter
A transformation matrix of coordinates；
Converter unit, for according to each transformation matrix of coordinates, obtaining the three-dimensional of each artis position of composition gesture
Coordinate points；
Determination unit determines the two dimension of each artis for the three-dimensional coordinate point according to each artis position
Coordinate points；
Generation unit, for being labeled to each artis according to the two-dimensional coordinate point of each artis, and according to mark
Each artis after note generates images of gestures.
13. images of gestures generating means according to claim 12, which is characterized in that the generation unit includes：
Subelement is marked, for constructing two-dimentional gesture according to the two-dimensional coordinate point of each artis, and according to each artis
Two-dimensional coordinate point is labeled each artis in the two-dimentional gesture；
Subelement is intercepted, for intercepting predeterminable area where the two-dimentional gesture after mark in two dimensional surface, generating images of gestures.
14. images of gestures generating means according to claim 13, which is characterized in that the interception subelement is specifically used
In：
The distance between each artis and the palm of the hand are obtained, multiple distances are obtained；
Longest target range is filtered out from the multiple distance；
Using the preset multiple of the target range as the length of side, to being cut in two dimensional surface where the two-dimentional gesture after mark
It takes, obtains the predeterminable area centered on the palm of the hand；
Images of gestures is generated according to the predeterminable area.
15. images of gestures generating means according to claim 12, which is characterized in that the determination unit includes：
Subelement is obtained, the rotation angle for obtaining the vertical direction centered on the palm of the hand and the elevation angle；
Subelement is mapped, is used for according to the rotation angle and the elevation angle, by the three-dimensional coordinate of each artis position
Point maps to two dimensional surface, obtains the two-dimensional coordinate point of each artis.
16. images of gestures generating means according to claim 15, which is characterized in that the mapping subelement includes：
Setup module, for a ray centered on the palm of the hand to be arranged outward according to the rotation angle and the elevation angle；
Mapping block, for using the direction where the ray as projecting direction, and by each artis position
Three-dimensional coordinate point map in the two dimensional surface on the projecting direction；
Locating module, for being positioned to each artis in the two dimensional surface, the two dimension for obtaining each artis is sat
Punctuate.
17. images of gestures generating means according to claim 16, which is characterized in that the mapping block is specifically used for：
Using the direction where the ray as projecting direction, and obtain the unit vector of the projecting direction；
The three-dimensional coordinate point of each artis position is mapped on the two dimensional surface vertical with the unit vector.
18. images of gestures generating means according to claim 16, which is characterized in that the locating module is specifically used for：
Obtained in the two dimensional surface each artis between the palm of the hand at a distance from, apart from longest artis；
It, using the straight line perpendicular to x-axis as y-axis, will be established with hand apart from longest artis and palm of the hand place straight line as x-axis
The heart is the two-dimensional coordinate system of origin；
The position that each artis is determined according to the two-dimensional coordinate system obtains the two-dimensional coordinate point of each artis.
19. images of gestures generating means according to claim 12, which is characterized in that the converter unit includes：
Subelement is converted, for becoming to the default three-dimensional system of coordinate using origin as the palm of the hand according to each transformation matrix of coordinates
It changes, obtains the corresponding target of each transformation matrix of coordinates and preset three-dimensional system of coordinate；
Coordinate obtains subelement, the position coordinates for presetting the origin position of three-dimensional system of coordinate for obtaining each target；
Subelement is set, each artis position for obtained each position coordinates to be respectively set to composition gesture
Three-dimensional coordinate point.
20. images of gestures generating means according to claim 19, which is characterized in that the transformation subelement is specifically used
In：
According to each transformation matrix of coordinates, the z-axis direction of the default three-dimensional system of coordinate using origin as the palm of the hand is carried out as rotary shaft
The rotation of preset plane rotation angle obtains the corresponding first default three-dimensional system of coordinate of each transformation matrix of coordinates；
First default three-dimensional system of coordinate is translated to the distance for presetting joint height according to z-axis direction, obtains each coordinate transform square
The corresponding second default three-dimensional system of coordinate of battle array；
Second default three-dimensional system of coordinate is translated to the distance for presetting joint length according to y-axis direction, obtains each coordinate transform square
The corresponding third of battle array presets three-dimensional system of coordinate；
The y-axis direction for presetting three-dimensional system of coordinate using the third carries out the rotation of predetermined inclination angle, obtains each as rotary shaft
The corresponding 4th default three-dimensional system of coordinate of transformation matrix of coordinates, and set the 4th default three-dimensional system of coordinate to target and preset
Three-dimensional system of coordinate.
21. according to claim 12 to 20 any one of them images of gestures generating means, which is characterized in that the images of gestures
Generating means further include：
Operating unit carries out translation and/or rotation process for obtaining the gesture in the images of gestures, and to the gesture,
Obtain target images of gestures.
22. according to claim 12 to 20 any one of them images of gestures generating means, which is characterized in that the images of gestures
Generating means further include：
Unit for scaling zooms in or out operation for being carried out according to preset ratio to the images of gestures, obtains target gesture figure
Picture.
23. a kind of storage medium, which is characterized in that the storage medium is stored with a plurality of instruction, and described instruction is suitable for processor
It is loaded, the step in 1 to 11 any one of them images of gestures generation method is required with perform claim.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201810145637.8A CN108346168B (en) | 2018-02-12 | 2018-02-12 | A kind of images of gestures generation method, device and storage medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201810145637.8A CN108346168B (en) | 2018-02-12 | 2018-02-12 | A kind of images of gestures generation method, device and storage medium |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN108346168A true CN108346168A (en) | 2018-07-31 |
| CN108346168B CN108346168B (en) | 2019-08-13 |
Family
ID=62960204
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201810145637.8A Active CN108346168B (en) | 2018-02-12 | 2018-02-12 | A kind of images of gestures generation method, device and storage medium |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN108346168B (en) |
Cited By (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN109284407A (en) * | 2018-08-21 | 2019-01-29 | 芜湖启迪睿视信息技术有限公司 | Device for training automatic labeling data set of intelligent sales counter |
| CN110532704A (en) * | 2019-09-02 | 2019-12-03 | 北京润科通用技术有限公司 | A kind of dynamic date acquisition methods and device |
| CN110942007A (en) * | 2019-11-21 | 2020-03-31 | 北京达佳互联信息技术有限公司 | Hand skeleton parameter determination method and device, electronic equipment and storage medium |
| CN111489283A (en) * | 2019-01-25 | 2020-08-04 | 鸿富锦精密工业(武汉)有限公司 | Picture format conversion method and device and computer storage medium |
| CN112016370A (en) * | 2019-05-31 | 2020-12-01 | 北京易讯理想科技有限公司 | Static gesture recognition method based on morphology |
| CN112262393A (en) * | 2019-12-23 | 2021-01-22 | 商汤国际私人有限公司 | Gesture recognition method and device, electronic equipment and storage medium |
| CN112927290A (en) * | 2021-02-18 | 2021-06-08 | 青岛小鸟看看科技有限公司 | Bare hand data labeling method and system based on sensor |
| CN113238650A (en) * | 2021-04-15 | 2021-08-10 | 青岛小鸟看看科技有限公司 | Gesture recognition and control method and device and virtual reality equipment |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102063618A (en) * | 2011-01-13 | 2011-05-18 | 中科芯集成电路股份有限公司 | Dynamic gesture identification method in interactive system |
| US20150177842A1 (en) * | 2013-12-23 | 2015-06-25 | Yuliya Rudenko | 3D Gesture Based User Authorization and Device Control Methods |
| CN105045496A (en) * | 2015-07-01 | 2015-11-11 | 中北大学 | Gesture interaction method based on joint point transformation |
| CN105389539A (en) * | 2015-10-15 | 2016-03-09 | 电子科技大学 | Three-dimensional gesture estimation method and three-dimensional gesture estimation system based on depth data |
| CN107368820A (en) * | 2017-08-03 | 2017-11-21 | 中国科学院深圳先进技术研究院 | One kind becomes more meticulous gesture identification method, device and equipment |
-
2018
- 2018-02-12 CN CN201810145637.8A patent/CN108346168B/en active Active
Patent Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102063618A (en) * | 2011-01-13 | 2011-05-18 | 中科芯集成电路股份有限公司 | Dynamic gesture identification method in interactive system |
| US20150177842A1 (en) * | 2013-12-23 | 2015-06-25 | Yuliya Rudenko | 3D Gesture Based User Authorization and Device Control Methods |
| CN105045496A (en) * | 2015-07-01 | 2015-11-11 | 中北大学 | Gesture interaction method based on joint point transformation |
| CN105389539A (en) * | 2015-10-15 | 2016-03-09 | 电子科技大学 | Three-dimensional gesture estimation method and three-dimensional gesture estimation system based on depth data |
| CN107368820A (en) * | 2017-08-03 | 2017-11-21 | 中国科学院深圳先进技术研究院 | One kind becomes more meticulous gesture identification method, device and equipment |
Cited By (12)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN109284407A (en) * | 2018-08-21 | 2019-01-29 | 芜湖启迪睿视信息技术有限公司 | Device for training automatic labeling data set of intelligent sales counter |
| CN111489283A (en) * | 2019-01-25 | 2020-08-04 | 鸿富锦精密工业(武汉)有限公司 | Picture format conversion method and device and computer storage medium |
| CN111489283B (en) * | 2019-01-25 | 2023-08-11 | 鸿富锦精密工业(武汉)有限公司 | Picture format conversion method and device and computer storage medium |
| CN112016370A (en) * | 2019-05-31 | 2020-12-01 | 北京易讯理想科技有限公司 | Static gesture recognition method based on morphology |
| CN110532704A (en) * | 2019-09-02 | 2019-12-03 | 北京润科通用技术有限公司 | A kind of dynamic date acquisition methods and device |
| CN110942007A (en) * | 2019-11-21 | 2020-03-31 | 北京达佳互联信息技术有限公司 | Hand skeleton parameter determination method and device, electronic equipment and storage medium |
| CN110942007B (en) * | 2019-11-21 | 2024-03-05 | 北京达佳互联信息技术有限公司 | Method and device for determining hand skeleton parameters, electronic equipment and storage medium |
| CN112262393A (en) * | 2019-12-23 | 2021-01-22 | 商汤国际私人有限公司 | Gesture recognition method and device, electronic equipment and storage medium |
| CN112927290A (en) * | 2021-02-18 | 2021-06-08 | 青岛小鸟看看科技有限公司 | Bare hand data labeling method and system based on sensor |
| CN113238650A (en) * | 2021-04-15 | 2021-08-10 | 青岛小鸟看看科技有限公司 | Gesture recognition and control method and device and virtual reality equipment |
| CN113238650B (en) * | 2021-04-15 | 2023-04-07 | 青岛小鸟看看科技有限公司 | Gesture recognition and control method and device and virtual reality equipment |
| US11947729B2 (en) | 2021-04-15 | 2024-04-02 | Qingdao Pico Technology Co., Ltd. | Gesture recognition method and device, gesture control method and device and virtual reality apparatus |
Also Published As
| Publication number | Publication date |
|---|---|
| CN108346168B (en) | 2019-08-13 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN108346168B (en) | A kind of images of gestures generation method, device and storage medium | |
| CN105005457B (en) | Geographical location methods of exhibiting and device | |
| CN108921795A (en) | A kind of image interfusion method, device and storage medium | |
| CN103140862B (en) | User interface system and operational approach thereof | |
| CN106991367A (en) | The method and apparatus for determining face rotational angle | |
| CN105959675A (en) | Video data processing method and device | |
| CN108037871A (en) | Screenshotss method and mobile terminal | |
| CN104751404B (en) | A kind of method and device of image transformation | |
| CN108495029A (en) | A kind of photographic method and mobile terminal | |
| CN108984067A (en) | A kind of display control method and terminal | |
| CN109862258A (en) | A kind of image display method and terminal device | |
| CN110069190A (en) | Equipment, method and the graphic user interface of system-level behavior for 3D model | |
| CN108985220A (en) | A kind of face image processing process, device and storage medium | |
| CN108920053A (en) | A kind of alignment schemes and mobile terminal | |
| CN109491738A (en) | A kind of control method and terminal device of terminal device | |
| CN107943390A (en) | A kind of word clone method and mobile terminal | |
| CN109474786A (en) | A kind of preview image generation method and terminal | |
| CN108415641A (en) | A kind of processing method and mobile terminal of icon | |
| CN107255813A (en) | Distance-finding method, mobile terminal and storage medium based on 3D technology | |
| CN110166439A (en) | Collaborative share method, terminal, router and server | |
| CN110458921A (en) | A kind of image processing method, device, terminal and storage medium | |
| CN110536006A (en) | A kind of object's position method of adjustment and electronic equipment | |
| CN108881544A (en) | A kind of method taken pictures and mobile terminal | |
| CN103458362B (en) | Numeric value transfer, terminal, server and system | |
| CN110308838A (en) | A kind of application interaction processing method and terminal device |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant | ||
| TR01 | Transfer of patent right |
Effective date of registration: 20210927 Address after: 518057 Tencent Building, No. 1 High-tech Zone, Nanshan District, Shenzhen City, Guangdong Province, 35 floors Patentee after: TENCENT TECHNOLOGY (SHENZHEN) Co.,Ltd. Patentee after: TENCENT CLOUD COMPUTING (BEIJING) Co.,Ltd. Address before: 518057 Tencent Building, No. 1 High-tech Zone, Nanshan District, Shenzhen City, Guangdong Province, 35 floors Patentee before: TENCENT TECHNOLOGY (SHENZHEN) Co.,Ltd. |
|
| TR01 | Transfer of patent right |