CN110428486A - Body building method, electronic equipment and the storage medium of virtual interactive - Google Patents
Body building method, electronic equipment and the storage medium of virtual interactive Download PDFInfo
- Publication number
- CN110428486A CN110428486A CN201810399778.2A CN201810399778A CN110428486A CN 110428486 A CN110428486 A CN 110428486A CN 201810399778 A CN201810399778 A CN 201810399778A CN 110428486 A CN110428486 A CN 110428486A
- Authority
- CN
- China
- Prior art keywords
- vector
- video data
- identification
- terminal
- movement
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T15/00—3D [Three Dimensional] image rendering
- G06T15/005—General purpose rendering architectures
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T17/00—Three dimensional [3D] modelling, e.g. data description of 3D objects
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
- G06V40/20—Movements or behaviour, e.g. gesture recognition
- G06V40/23—Recognition of whole body movements, e.g. for sport training
Abstract
Body building method, electronic equipment and the storage medium of present invention offer virtual interactive, wherein, body building method converts video data to three-dimensional bone action model, obtains target action the following steps are included: acquire the audio data and video data of first kind user by first terminal；In second terminal playing audio-fequency data and video data；The three dimensional video data for acquiring the second class user in real time by each second terminal, obtains movement to be measured；And judge whether the movement to be measured of each second terminal matches with target action, if not, then obtain the body image of first kind user and the body image of the second class user, the body image of second class user is added in the video data of first kind user, and it is played in first terminal, the body image of first kind user is added in the video data of the second class user, and is played in second terminal.The invention avoids entity fitness equipments to the occupancy in space, greatly reduces the threshold of body-building.
Description
Technical field
The present invention relates to computer application technology more particularly to a kind of body building methods of virtual interactive, electronic equipment
And storage medium.
Background technique
Currently, body-building is one of important need of contemporary people, people like gymnasium or voluntarily purchase more and more
It buys health and fitness facilities and carries out body-building, but it is expensive due to consulting experienced guide price in gymnasium, and also fitness equipment is not easy to store,
These problems have raised the threshold of body-building.For example, the places such as hotel, office, it is limited to be limited by place, user be almost difficult into
Row is effective to take exercise.
The motion capture and recognition methods of the mankind has very extensive application in today's society, such as: intelligent monitoring,
The somatic sensation television game of human-computer interaction, video frequency searching etc..
The motion detection of the mankind identifies, from the RGB-D video sequence based on traditional rgb video row transition to current prevalence
Column, motion profile are used as always important feature growth.The capture of traditional motion profile is often based upon the detection of characteristic point
Algorithm, different feature point detecting methods can obtain entirely different motion profile.Simultaneously as inspection of the characteristic point in different frame
Rope is highly unstable, and in entire video sequence, characteristic point is often discontinuous, therefore feature point trajectory fado is used and is based on
The statistical method of histogram after entire video sequence is calculated and counted, is divided using classifiers such as support vector machines
Class.
The matching primitives method of these video sequences is computationally intensive, can not summary responses, can not also be suitable for civilian rank
Human-computer interaction, particularly in live scene action recognition compare and error correction.Therefore, the prior art is in live scene
Body-building identifies for the human-computer interaction of error correction, it is difficult to realize system Real-time Feedback acts the demand whether to malfunction.
Summary of the invention
The present invention provides body building method, the electronics of a kind of virtual interactive to overcome the problems of the above-mentioned prior art
Equipment and storage medium overcome the difficulty of the prior art, avoid entity fitness equipment to the occupancy in space, can will be common
Display capital improvement be interactive body building equipment, create a kind of novel experience of the one-to-one guidance of online fitness, side
Fitness is helped to greatly reduce the threshold of body-building from the movement of long-range correction student.
According to an aspect of the present invention, a kind of body building method of virtual interactive is provided, comprising the following steps:
S110, the audio data and video data that first kind user is acquired by first terminal, the video data is turned
It is changed to three-dimensional bone action model, obtains in video data and is formed between the coordinate and multiple skeleton points of multiple skeleton points of human body
Vector, according to the vector formed between the coordinate and multiple skeleton points of multiple skeleton points of human body in video data in video
Human body carries out action recognition to determine target action；
S120, the audio data and video counts acquired by the first terminal is played in one or more second terminals
According to；
S130, the three dimensional video data for acquiring the second class user in real time by each second terminal, and generate in real time
Three-dimensional bone action model to be measured, will current three-dimensional to be measured according to the target action of the video data currently played in second terminal
Bone action model forms a match group with the target action as a movement to be measured, by the movement to be measured；And
S140, judge whether the movement to be measured of each second terminal matches with target action, if then return step
S130, if it is not, thening follow the steps S150；
S150, the body image that figure obtains first kind user is scratched from the video data of the first kind user, from not
The body image that figure obtains the second class user is scratched in the video data of the second class user matched, by unmatched described second
The body image of class user is added in the video data of the first kind user, and plays in the first terminal, will be described
The body image of first kind user is added in the video data of the unmatched second class user, and in the second terminal
It plays, return step S140.
Preferably, in the step S150, the body image of the unmatched second class user is added to as prospect
In the video data of the first kind user,
The body image of the first kind user is added to the video counts of the unmatched second class user as prospect
In.
Preferably, in the step S150, the two-way language of the first terminal Yu the unmatched second terminal is established
Sound channel.
Preferably, the step S110 include: when identification one movement continuously repeat occur when, moved using the movement as target
Make；
The step S120 includes: the target action at least postponing the video data that one currently plays in second terminal
The audio data and video data acquired from the first terminal that duration plays in the second terminal.
Preferably, the step S110 comprises determining that the duration of target action；
The step S130 includes: to act since determining current three-dimensional bone action model to be measured to currently whole second
Hold the duration of the target action of the video data played by the current three-dimensional bone action model to be measured in the duration
As a movement to be measured.
Preferably, the step S110 further include:
By the target action by the three-dimensional bone action model dismantling at five physical feelings: left arm, right arm, left leg,
Right leg and trunk, each physical feeling include: three vectors that three skeleton points, three skeleton points are formed and described
Angle in three vectors between two vectors,
One or more procedure-orienteds are generated to the position movement of at least one physical feeling or towards the identification of displacement
, each identification item includes that identification object, identification parameter and recognition rule, the identification object include in three skeleton points
At least one skeleton point；At least one vector in three vectors；And in three vectors between two vectors one
It is one or more in a angle,
Wherein, the identification item of the procedure-oriented further includes a standard procedure vector library, and standard procedure vector library is pressed
Time sequencing stores at least one vector of the position movement,
The step S130 further include:
Movement to be measured is divided into corresponding detected part and acted by the target site movement according to target action, will be to be measured dynamic
The detected part movement of work acts to form the whole body body region match group with the target site of corresponding target action；
To each physical feeling match group, the identification item of target site movement is obtained, acts mould according to the three-dimensional bone
Vector that coordinate, the skeleton point that type obtains the skeleton point of the corresponding identification object of detected part movement are formed and/or to
Angle between amount, if the identification item is the identification item of procedure-oriented, the vector that the detected part is acted and standard
Correspondence vector in process vector library is carried out matching primitives and is compared with the vector threshold set with the identification parameter, if not
Meet the recognition rule, then feeds back detected part stroke defect.
Preferably, left arm includes: left finesse artis, left hand elbow joint point, left shoulder joint node, left shoulder joint node to left hand
Elbow joint point formed primary vector, left hand elbow joint point to left finesse artis formed secondary vector, left shoulder joint node extremely
The angle between third vector and the primary vector and the secondary vector that left finesse artis is formed；
Right arm includes: right finesse artis, right hand elbow joint point, right shoulder joint node, right shoulder joint node to right hand elbow joint
Put the primary vector formed, the secondary vector that right hand elbow joint point to right finesse artis is formed, right shoulder joint node to right finesse
The angle between third vector and the primary vector and the secondary vector that artis is formed；
Trunk includes: the backbone of head center, the backbone center of neck, the backbone center of trunk, head center to neck
Secondary vector that the backbone of backbone center to the trunk of the primary vector, neck that are centrally formed is centrally formed, head center to body
The angle that the third vector and the primary vector and the secondary vector that dry backbone is centrally formed are formed；
Left leg includes: left ankle artis, left knee artis, left hip joint point, left hip joint point to left knee joint
Secondary vector, the left hip joint point to left ankle that the primary vector of point formation, left knee artis are formed to left ankle artis
The angle between third vector and the primary vector and the secondary vector that artis is formed；
Right leg includes: right ankle artis, right knee endoprosthesis point, right hip joint point, right hip joint point to right knee endoprosthesis
Secondary vector, the right hip joint point to right ankle that primary vector, the right knee endoprosthesis point to right ankle artis of point formation are formed
The angle between third vector and the primary vector and the secondary vector that artis is formed.
Preferably, the vector detected part acted carries out matching meter with the corresponding vector in standard procedure vector library
Calculation is compared with the vector threshold set with the identification parameter includes:
Calculate the vector in standard procedure vector libraryWith the vector of detected part movement Between angle theta cosine value:
VectorWith vectorBetween angle theta cosine value be used for the vector threshold that is set with the identification parameter into
Row compares.
Preferably, the identification item of the procedure-oriented includes track identification, negative track identification and keeps identifying；
The identification item towards displacement includes displacement identification and negative displacement identification.
Preferably, it is replaced in step S150 of the invention, it can also be in the video data according to the first kind user
The first 3D person model of body video generation for obtaining first kind user passes through the first 3D person model people in the video data
The body image of object covering first kind user；According to the body for obtaining the second class user in the video data of the second class user
The 2nd 3D person model of video generation covers the body of the second class user in the video data by the 2nd 3D person model personage
Body image.Further, the body image superposition of subsequent the 2nd 3D person model by the unmatched second class user
It is played into the video data of the first kind user, and in the first terminal, by the first 3D people of the first kind user
The body image of object model is added in the video data of the unmatched second class user, and broadcasts in the second terminal
It puts, allows first kind user and the second class user in whole process not occur my concrete image, thus personal protection
Privacy, return step S140.
Preferably, the body building method of virtual interactive of the invention is applicable to scene below: fitness exercise, Yoga, Tai Ji,
Street dance, rehabilitation training etc., but not limited to this.First kind user impromptu can act, and first terminal through the invention is by
The video of a kind of user and three-dimensional bone action model are sent to second terminal, allow the second class user to carry out movement and follow.It can also
It goes to complete preset a set of motion flow with first kind user, such as: setting-up exercises to music, dancing, rehabilitation gymnastics etc. also can be by this hairs
The video of first kind user and three-dimensional bone action model are sent second terminal by bright first terminal, allow the second class user into
Action follows.
Preferably, first kind user can free movement, pass through first terminal and acquire audio-visual data and three-dimensional bone
Bone model, the three-dimensional skeleton model recording audio and video that can also be provided according to system；Second terminal playing audio-fequency data and
Video data.
According to another aspect of the invention, a kind of electronic equipment is also provided, the electronic equipment includes:
Processor；
Storage medium is stored thereon with computer program, executes such as when the computer program is run by the processor
Above-mentioned step.
According to another aspect of the invention, a kind of storage medium is also provided, computer journey is stored on the storage medium
Sequence executes such as above-mentioned step when the computer program is run by processor.
Compared with prior art, the invention avoids entity fitness equipments to the occupancy in space, can set common display
Standby reconstruction is interactive body building equipment, creates a kind of novel experience of one-to-one guidance of online fitness, helps body-building religion
Practice the movement from long-range correction student, greatly reduces the threshold of body-building.
Detailed description of the invention
Its example embodiment is described in detail by referring to accompanying drawing, above and other feature of the invention and advantage will become
It is more obvious.
Fig. 1 shows the flow chart of the body building method of virtual interactive according to an embodiment of the present invention.
Fig. 2 to Fig. 6 shows the schematic diagram of the body building method operational process of virtual interactive according to an embodiment of the present invention.
Fig. 7 shows the schematic diagram of skeleton model according to an embodiment of the present invention.
Fig. 8 to Figure 12 shows the schematic diagram of 5 physical feelings according to an embodiment of the present invention.
Figure 13 shows vector and the comparison of acquisition vector in real time in standard procedure vector according to an embodiment of the present invention library.
And
Figure 14 and Figure 15 respectively illustrate angle in standard procedure vector according to an embodiment of the present invention library between vector with
Angle between acquisition vector in real time.
Figure 16 schematically shows a kind of computer readable storage medium schematic diagram in disclosure exemplary embodiment.And
Figure 17 schematically shows a kind of electronic equipment schematic diagram in disclosure exemplary embodiment.
Specific embodiment
Example embodiment is described more fully with reference to the drawings.However, example embodiment can be with a variety of shapes
Formula is implemented, and is not understood as limited to example set forth herein；On the contrary, thesing embodiments are provided so that the disclosure will more
Fully and completely, and by the design of example embodiment comprehensively it is communicated to those skilled in the art.Described feature, knot
Structure or characteristic can be incorporated in any suitable manner in one or more embodiments.
In addition, attached drawing is only the schematic illustrations of the disclosure, it is not necessarily drawn to scale.Identical attached drawing mark in figure
Note indicates same or similar part, thus will omit repetition thereof.Some block diagrams in attached drawing are function realities
Body, not necessarily must be corresponding with physically or logically independent entity.These functions reality can be realized using software form
Body, or these functional entitys are realized in one or more hardware modules or integrated circuit, or in heterogeneous networks and/or processor
These functional entitys are realized in device and/or microcontroller device.
Fig. 1 shows the flow chart of the body building method of virtual interactive according to an embodiment of the present invention.Fig. 2 to Fig. 6 is shown
The schematic diagram of the body building method operational process of virtual interactive according to an embodiment of the present invention.As shown in Figures 1 to 6, void of the invention
First terminal, second terminal in the body building method of quasi- interaction can be mobile phone, notebook with three-dimensional video acquisition function
Computer etc. is not limited.The method of the present invention includes the following steps:
S110, the audio data and video data that first kind user 6 (such as: fitness) is acquired by first terminal,
The video data is converted into three-dimensional bone action model, obtains in video data the coordinate of multiple skeleton points of human body and more
The vector formed between a skeleton point, according to shape between the coordinate and multiple skeleton points of multiple skeleton points of human body in video data
At vector in video human body carry out action recognition to determine target action.The step S110 comprises determining that target action
Duration.When the movement of identification one, which continuously repeats, to be occurred, using the movement as target action.First terminal includes one
Three-dimensional video acquisition device 2 and a display 1.
S120, first terminal are connected respectively to multiple second terminals by network server 3, eventually in one or more second
End plays the audio data and video data acquired by the first terminal.The step S120 includes: at least to postpone one
The duration of the target action of the video data currently played in second terminal in the second terminal play from described the
The audio data and video data of one terminal acquisition.Second terminal includes a three-dimensional video acquisition device 5 and a display
4。
S130, the 3 D video number for acquiring the second class user 7 (such as: student) in real time by each second terminal
According to, and three-dimensional bone action model to be measured is generated in real time, according to the target action of the video data currently played in second terminal
Currently three-dimensional bone action model to be measured the movement to be measured will be formed one with the target action and matched as a movement to be measured
Group.The step S130 includes: since acting determining current three-dimensional bone action model to be measured to currently broadcasting in second terminal
The duration of the target action for the video data put using the current three-dimensional bone action model to be measured in the duration as
One movement to be measured.
S140, judge whether the movement to be measured of each second terminal matches with target action, if then return step
S130, if it is not, thening follow the steps S150.
S150, the body image that figure obtains first kind user 6 is scratched from the video data of the first kind user 6, from not
The body image that figure obtains the second class user 7 is scratched in the video data of the matched second class user 7, it will be unmatched described
The body image of second class user 7 is added in the video data of the first kind user 6, and plays in the first terminal,
The body image of the first kind user 6 is added in the video data of the unmatched second class user 7, and described
Second terminal plays, return step S140.
The present invention by will in a preferred embodiment, in the step S150, the unmatched second class user's 7
Body image is added in the video data of the first kind user 6 as prospect, and the body image of the first kind user 6 is made
It is added in the video data of the unmatched second class user 7 for prospect.
It in a preferred embodiment, could alternatively be, can also be used according to the first kind in step S150 of the invention
The first 3D person model of body video generation that first kind user is obtained in the video data at family, by the in the video data
The body image of one 3D person model personage covering first kind user；According to obtaining in the video data of the second class user
The 2nd 3D person model of body video generation of two class users is covered in the video data by the 2nd 3D person model personage
The body image of second class user.Further, subsequent the 2nd 3D person model by the unmatched second class user
Body image be added in the video data of the first kind user, and the first terminal play, by the first kind
The body image of the first 3D person model of user is added in the video data of the unmatched second class user, and in institute
Second terminal broadcasting is stated, first kind user and the second class user in whole process is allowed not occur my concrete image,
To personal protection privacy, return step S140.
In a preferred embodiment, the body building method of virtual interactive of the invention is applicable to scene below: fitness exercise,
Yoga, Tai Ji, street dance, rehabilitation training etc., but not limited to this.First kind user impromptu can act, and through the invention
The video of first kind user and three-dimensional bone action model are sent second terminal by one terminal, and the second class user is allowed to act
It follows.It can also go to complete preset a set of motion flow with first kind user, such as: setting-up exercises to music, dancing, rehabilitation gymnastics etc. also can
The video of first kind user and three-dimensional bone action model are sent second terminal by first terminal through the invention, allows second
Class user carries out movement and follows.
In a preferred embodiment, first kind user can free movement, pass through first terminal acquire audio frequency and video number
According to three-dimensional skeleton model, the three-dimensional skeleton model recording audio and video that can also be provided according to system；Second terminal plays
Audio data and video data.
In a preferred embodiment, in the step S150, the first terminal and unmatched described second is established eventually
The double-directional speech channel at end 7.
Specifically, the matched judgement of work in the present invention is to be accomplished in that be set with each human body
15 skeleton points (reference can be made to Fig. 7), 15 skeleton points are as follows: head center 211, neck center (such as backbone center of neck)
212, trunk center 213 (such as: the backbone center of trunk), left shoulder joint node 221, left hand elbow joint point 222, left hand wrist joint
Point 223, right shoulder joint node 231, right hand elbow joint point 232, right finesse artis 233, left hip joint point 241, left knee joint
Point 242, left ankle artis 243, right hip joint point 251, right knee endoprosthesis point 252, right ankle artis 253.
In this case to this 15 skeleton points as unit of 3 skeleton points, it is divided into five body parts: trunk (see Fig. 8),
Left arm (see Fig. 9), right arm (see Figure 10), left leg (see Figure 11) and right leg (see Figure 12).Wherein, the skeleton point in each physical feeling
Between also form vector, also form angle between vector.
Specifically, trunk (see Fig. 8) include head center 211, the backbone center 212 of neck, trunk backbone center
213, the backbone center 212 of head center 211 is formed to the backbone center 212 of neck primary vector 214, neck is to trunk
The third vector 216 that the backbone center 213 of secondary vector 215, head center 211 to trunk that backbone center 213 is formed is formed
And the angle 217 that the primary vector 214 and the secondary vector 215 are formed.
Left arm (see Fig. 9) includes left finesse artis 223, left hand elbow joint point 222, left shoulder joint node 221, left shoulder joint
Primary vector 224, left hand elbow joint point 222 to left finesse artis 223 formation of the point 221 to the formation of left hand elbow joint point 222
Secondary vector 225, left shoulder joint node 221 to left finesse artis 223 the third vector 226 and the primary vector that are formed
Angle 227 between 224 and the secondary vector 225.
Right arm (see Figure 10) includes right finesse artis 233, right hand elbow joint point 232, right shoulder joint node 231, right shoulder joint
Primary vector 234 that node 231 is formed to right hand elbow joint point 232, right hand elbow joint point 232 to 233 shape of right finesse artis
At secondary vector 235, right shoulder joint node 231 to right finesse artis 233 the third vector 236 and the primary vector that are formed
Angle 237 between 234 and the secondary vector 235.
Left leg includes that (see Figure 11) includes left ankle artis 243, left knee artis 242, left hip joint point 241, a left side
Primary vector 244 that hip joint point 241 is formed to left knee artis 242, left knee artis 242 to left ankle artis
243 formed secondary vector 245, the third vector 246 that is formed of left hip joint points 241 to left ankle artis 243 and this
Angle 247 between one vector 244 and the secondary vector 245.
Right leg includes that (see Figure 12) includes right ankle artis 253, right knee endoprosthesis point 252, right hip joint point 251, the right side
Primary vector 254 that hip joint point 251 is formed to right knee endoprosthesis point 252, right knee endoprosthesis point 252 to right ankle artis
253 formed secondary vector 255, the third vector 256 that is formed of right hip joint points 251 to right ankle artis 253 and this
Angle between one vector 254 and the secondary vector 255.
By the target action by dismantling at five physical feelings: left arm, right arm, left leg, right leg and trunk.Each body
Position includes three vectors and three vectors that three skeleton points as shown in Fig. 8 to Figure 12, three skeleton points are formed
In angle between two vectors.The corresponding one or more procedure-orienteds of target site movement of at least one physical feeling or
Identification item towards displacement.Each identification item includes identification object, identification parameter and recognition rule, and the identification object includes portion
Position acts at least one skeleton point in three skeleton points；At least one vector in three vectors；And described three
It is one or more in an angle in vector between two vectors.
Identification item for position movement is that procedure-oriented still can be by presetting maneuver library and phase towards displacement
The classification answered is realized.It can also act and set by multiple positions by way of machine learning in yet other embodiments,
The model of the fixed procedure-oriented still test set training machine study of the label towards displacement, and then can be right during live streaming
Classify in the partial act that target action divides.
The identification item of procedure-oriented need to match sentence by a standard procedure vector library with the vector acquired in real time
It is disconnected whether to meet identification item.Standard procedure vector library stores the position movement at least with a sample frequency in chronological order
One vector.For example, the left leg for push-up acts, left arm is stored at least in chronological order with the sample frequency of 5 times/second
Primary vector 224, secondary vector 225 (and angle 227), as a standard procedure vector library.
Specifically, the identification item of procedure-oriented includes track identification, negative track identification and keeps identifying；Towards
The identification item of displacement includes displacement identification and negative displacement identification.
Whether position movement moves track identification according to desired trajectory for identification, if not moved according to desired trajectory,
It then prompts to malfunction.It identifies that object includes two at least one vector and/or three vectors in three vectors
An angle between vector.Corresponding to identification object, identification parameter sets one or more threshold values.Threshold value includes described three
The angle threshold value of the vector threshold of vector and the angle, the identification parameter is determined according to the identification object uses vector threshold
Value and/or angle threshold value.
Specifically, above-mentioned vector threshold and the angle threshold value vector (and angle) that is used to judge to acquire in real time whether with this
Vector (and angle) in standard procedure vector library matches.For example, can refer to Figure 11, for vector threshold, when real-time acquisition
One position movement skeleton point 222 to skeleton point 293 vectorTemporally in standard procedure
The correspondence skeleton point 222 of corresponding time is found in vector library to the vector of skeleton point 223
Calculate the vector in standard procedure vector libraryWith the vector of the position movement acquired in real time Between angle theta cosine value:
VectorWith vectorBetween the cosine value (cosine value be -1 to 1) of angle theta be used for and the knowledge
The vector threshold of other parameter setting is compared.Vector threshold can be set to 0.1, and corresponding vector threshold is -1 to 0.1.To
The range of amount threshold value can also be directly disposed as -0.1 to 0.1.It can be compared according to the vector threshold and cosine value calculated
Compared with to determine vectorWhether within the scope of the vector threshold.
For example, standard procedure vector library at least stores in chronological order in the embodiment of setting angle threshold value
The primary vector and secondary vector of the position movement can calculate the angle between vector according to two vectors or directly will
The angle is stored in standard procedure vector library.With reference to Figure 12 and Figure 13, angle threshold value is used to act with the position acquired in real time
(skeleton point 292 to skeleton point 291) primary vector 294 and (skeleton point 292 to skeleton point 293) secondary vector 295 it
Between 297 α of angle and standard procedure vector library in correspond to the time (skeleton point 222 to skeleton point 221) primary vector 224 and
The ratio α/β of 227 β of angle between the secondary vector 225 of (skeleton point 222 to skeleton point 223) compares to determine acquisition in real time
Position movement angle whether be located in the range of the angle threshold value.Vector threshold can be set to 0.8, corresponding vector
Threshold value is 0.8 to 1.The range of vector threshold can also be directly disposed as 0.8 to 1.Can according to the angle threshold value with it is calculated
Whether angle ratio is compared to determine the angle between primary vector and secondary vector within the scope of the vector threshold.
Further, the identification parameter of track identification further includes a starting amplitude threshold and reaches amplitude threshold, originates width
Degree threshold value reaches amplitude threshold for judging position movement terminates whether to complete to reach width for judging whether position movement starts
Degree.Specifically, can be set a position movement angle starting maximum value, and be arranged start amplitude threshold value be 0.8 (or its
The value of his 0 to 1 centre).When the angle of position movement reaches the 80% of the starting maximum value, it can be determined that position movement is opened
Begin.For reaching amplitude threshold, the maximum value of reaching of the angle of position movement can be set, and be arranged and reach amplitude threshold and be
0.2 (or value of other 0 to 1 centres).When the angle of position movement reaches (1-20%) that reaches maximum value, it can be determined that
Position movement is completed to reach amplitude.In some change case, the coordinate of vector and/or skeleton point can also be used to calculate above-mentioned
Beginning amplitude threshold and reach amplitude threshold.Above-mentioned starting maximum value and reach maximum value can be used as in standard procedure vector library the
One data and the last one data.Alternatively, in further embodiments, start amplitude threshold value and reaches amplitude threshold and all use
The last one data in standard procedure vector library are calculated, at this point, start amplitude threshold value for example can be set to 0.2,
Reaching amplitude threshold for example may be set to be 0.2.
Corresponding to the identification object and identification parameter of above-mentioned setting, the recognition rule of track identification includes reaching rule and can
Select different mistake rules.The rule of reaching of track identification originates in start amplitude threshold value institute for the identification object of position movement
The position of expression and identification object is in set vector threshold and/or angle threshold value；The identification object of position movement
From position represented by start amplitude threshold value to during reaching position represented by amplitude threshold, identifying object set
In fixed vector threshold and/or angle threshold value；And the identification object of position movement is reached represented by amplitude threshold
Position and identification object in set vector threshold and/or angle threshold value.The different mistake rule packets of track identification
It includes: beyond corresponding vector threshold mistake (for example, large arm represented by vector one or thigh are beyond threshold value)；Beyond corresponding angle threshold
Value mistake (for example, the angle of angle or knee at elbow represented by angle exceeds threshold value)；And insufficient amplitude mistake.Width
Not wrong enough the recognition rule of degree is that the identification object of position movement originates in position represented by start amplitude threshold value and knowledge
Other object is in set vector threshold and/or angle threshold value；The identification object of position movement is from start amplitude threshold value
Represented position is to during reaching position represented by amplitude threshold, identifying object in set vector threshold
And/or in angle threshold value；And the identification object of position movement, which does not reach, reaches position represented by amplitude threshold and identification
Object is in set vector threshold and/or angle threshold value.
Whether position movement moves negative track identification according to desired trajectory for identification, if transporting according to desired trajectory
It is dynamic, then it prompts to malfunction.Similar with track identification for negating track identification, identification object includes in three vectors
An angle at least one vector and/or three vectors between two vectors (preferably, is primary vector and second
Angle between vector).It negate the one or more threshold values of identification parameter setting of track identification, the threshold value includes described three
The angle threshold value of the vector threshold of vector and the angle, the identification parameter is determined according to the identification object uses vector threshold
Value and/or angle threshold value.It negate track identification unlike track identification, negative track identification reaches rule are as follows: the position
The identification object of movement originate in position represented by start amplitude threshold value and identify object set vector threshold and/
Or in angle threshold value；The identification object of position movement is from position represented by start amplitude threshold value to reaching amplitude threshold institute table
During the position shown, identify object in set vector threshold and/or angle threshold value；The identification of position movement
Object reaches position represented by amplitude threshold and identification object in set vector threshold and/or angle threshold value
It is interior；And currently there is the identification in addition to negative identification and other than keeping identification to be in ongoing state (in other words, the rail of movement
Mark or displacement amplitude are increasing).When reaching above-mentioned rule, then cueing track malfunctions.In other words, if identification object is in the body
In the motion process at position always not in the threshold range of identification parameter setting, and represented by the identification object
Position movement generates track and/or displacement during the motion, then will not prompt to malfunction.
Keeping identification, whether position movement is maintained under a certain state during the motion (for example, keeping straight for identification
Vertical or one bending angle of holding), it prompts to malfunction if being not maintained under the state.The identification object for keeping identification includes described three
An angle at least one vector and/or three vectors in a vector between two vectors.Identification parameter setting
One or more threshold values, the threshold value include the vector threshold of three vectors and the angle threshold value of the angle, identification ginseng
Number is determined according to the identification object uses vector threshold and/or angle threshold value.Keep identification reaches rule are as follows: the position is dynamic
The identification object of work is always in set vector threshold and/or angle threshold value.Keep what is identified to reach rule if not reaching,
Then prompt the corresponding mistake for keeping identification.
For displacement identification and negative displacement identification, although described here as towards displacement rather than the identification of object-oriented
, but whether displacement identification and negative displacement identification actually also need recognition site movement in lasting motion state, if position
Movement is not in lasting motion state and then interrupts identification, directly prompt mistake；Or it is re-started since current location
Identification.
Displacement identification identifies whether object reaches scheduled direction of displacement and shift length for judging, mentions if not up to
Mistake is shown.The identification object of displacement identification includes one or more of three skeleton points.Preferably, the position is specified to act
One skeleton point.(direction of displacement can map to the pros of the X-axis in three-dimensional coordinate for identification parameter setting shift length, direction of displacement
To, X-axis negative direction, Y-axis positive direction, Y-axis negative direction, Z axis positive direction, Z axis negative direction, without calculating specific direction of displacement)
And start amplitude threshold value.The start amplitude threshold value of displacement is the value in 0 to 1.For example, start amplitude threshold value can be set to 0.2,
And indicate that position movement starts or displacement identification is opened when the displacement of specified skeleton point is more than the 20% of setting shift length
Begin.The recognition rule of displacement identification includes reaching rule and optional different mistake rule.Displacement identification reaches rule to refer to
It is consistent to determine the direction of displacement being arranged in the moving direction and identification parameter of skeleton point, and the shift length of a persistent movement is greater than
Equal to the shift length being arranged in identification parameter.Different mistake rules includes that the displacement of specified skeleton point is less than start amplitude
When threshold value, origination action insufficient amplitude is prompted；Specified skeleton point displacement amplitude is more than the shifting of start amplitude threshold value, specified skeleton point
The direction of displacement being arranged in dynamic direction and identification parameter is consistent and the shift length of a persistent movement is less than in identification parameter
The shift length of setting, then insufficient amplitude is reached in prompt.
Negative displacement identification identifies whether object reaches scheduled direction of displacement and shift length for judging, if reaching
Prompt error.Similar with displacement identification, identification object includes one or more of three skeleton points.Preferably, the portion is specified
One skeleton point of position movement.Identification parameter setting shift length, (direction of displacement can map in three-dimensional coordinate direction of displacement
X-axis positive direction, X-axis negative direction, Y-axis positive direction, Y-axis negative direction, Z axis positive direction, Z axis negative direction) and start amplitude threshold value.It is no
Determine displacement identification to reach the direction of displacement being arranged in moving direction and identification parameter of the rule for specified skeleton point consistent, once
The shift length of persistent movement is more than or equal to the shift length being arranged in identification parameter and currently has in addition to negative identification and protect
It holds the identification other than identification and is in the ongoing state of movement (in other words, track or displacement amplitude are increasing).When reaching
Above-mentioned rule, then cueing track malfunctions.In other words, if identification object does not press the identification during movements of parts of the body
The direction of displacement of parameter setting is mobile or moving distance is greater than the shift length that the identification parameter is set, then does not prompt
It is wrong.
Above-mentioned identification item is arranged at least one position acted movement, by least one position act and it is described extremely
Motion file of the identification item of few position movement as the movement, the motion file and movement number are associatedly stored
In the standard operation database.
In a specific embodiment, deep-knee-bend is acted, identification item is provided with to trunk, left leg and right leg.Trunk
Identification item include keep identification and displacement identification.In the holding identification of trunk, identification object is only that head center arrives neck
The primary vector at vertebra center is correspondingly arranged the parameter of the primary vector, and saves by the primary vector of trunk in deep-knee-bend mistake
Standard procedure vector library in journey is for subsequent match.When the primary vector of the trunk acquired in real time is more than the threshold of primary vector
Value, then it represents that body is not kept upright, and error is prompted.Herein, due to the characteristic of trunk, when in the vertebra of head center to neck
When the primary vector of the heart is kept upright, it generally can directly assert the vertebra center of neck to the secondary vector at the backbone center of trunk
Also it is kept upright, the threshold value for only setting a vector improves the efficiency of subsequent real-time error to reduce subsequent calculation amount.
In the displacement identification of trunk, identification object is the skeleton point at the backbone center of trunk, and corresponding identification parameter is should
The predetermined displacement distance of skeleton point and scheduled direction of displacement (direction is Y-axis negative direction).When the backbone center of trunk is negative along Y-axis
When direction movement is more than preset distance, then it represents that the identification of position movement is reached.If the backbone center of trunk is along Y-axis negative direction
It is mobile be less than predetermined displacement apart from when, then it represents that the insufficient amplitude of position movement.
Left leg is provided with negative displacement identification, for reminding in deep-knee-bend knee no more than tiptoe.The negative of left leg is displaced
In identification, identification object is the artis of left knee, and identification parameter is predetermined displacement distance, scheduled direction of displacement (direction Z
Axis positive direction) and start amplitude threshold value.When left knee along Z axis positive direction move more than predetermined displacement apart from when, then prompt to indicate
Position stroke defect.When left knee move along Z axis positive direction be less than predetermined displacement apart from when, then it represents that the knowledge of position movement
Do not reach.The identification item of right leg is identical as left leg, and it will not be described here.
In there are some specific embodiments, has for deep-knee-bend, push-up etc. and bob works, it can be only to coming and go back to centre
Process set and identified.For example, movement when only squatting down to deep-knee-bend carries out the setting of identification item and identification is entangled
It is wrong；Movement when only to push-up prostrate carries out the setting and identification error correction of identification item, thus can be further reduced action recognition
Calculation amount to increase the real-time of error correction.
It is of the invention use process is as follows:
With reference to Fig. 2, first kind user 6 (fitness) can pass through network in the multiple of different seats in own home
Second class user 7 (student) carries out body-building and gives lessons.
With reference to Fig. 3, after the movement of first kind user 6 (fitness) is shot by three-dimensional video acquisition device 2, in the second class
It is played in the second terminal of user 7 (student), and the three-dimensional video acquisition device 5 of the second terminal of the second class user 7 can also be adopted
Collect the movement of the second class user 7, and whether the movement for comparing the second class user 7 in real time matches with the movement of first kind user 6,
To evaluate the effect of body-building movement.
With reference to Fig. 4 to 7, when the movement of the second class user 7 and the mismatch of first kind user 6, i.e. the second class user's 7 is dynamic
Make the nonstandard body for when needing to instruct, obtaining first kind user 6 by the way that figure will be scratched in the video data of the first kind user 6
Image scratches the body image that figure obtains the second class user 7 from the video data of the unmatched second class user 7, will not
The body image of the matched second class user 7 is added in the video data of the first kind user 6, and described first
The body image of the first kind user 6 is added to the video data of the unmatched second class user 7 by terminal plays
In, and played in the second terminal, so that first kind user 6 (fitness) and the second class user 7 (student) can distinguish
Although just looking like to be two people a gymnasium to the practical video that mutual limbs interact on display 1 and display 4
In, adjustment student movement is the same at one's side by coach, and first kind user 6 (fitness) can intuitively teach in this way
It leads the second class user 7 (student) and completes correct movement.So user experience of the invention is very good, dealing body-building is also eliminated
The time in room avoids high body-building expense.
In an exemplary embodiment of the disclosure, a kind of computer readable storage medium is additionally provided, meter is stored thereon with
Calculation machine program, the program may be implemented electronic prescription described in any one above-mentioned embodiment and circulate when being executed by such as processor
The step of processing method.In some possible embodiments, various aspects of the invention are also implemented as a kind of program production
The form of product comprising program code, when described program product is run on the terminal device, said program code is for making institute
It states terminal device and executes described in this specification above-mentioned electronic prescription circulation processing method part various examples according to the present invention
The step of property embodiment.
With reference to shown in Figure 16, the program product for realizing the above method of embodiment according to the present invention is described
300, can using portable compact disc read only memory (CD-ROM) and including program code, and can in terminal device,
Such as it is run on PC.However, program product of the invention is without being limited thereto, in this document, readable storage medium storing program for executing can be with
To be any include or the tangible medium of storage program, the program can be commanded execution system, device or device use or
It is in connection.
Described program product can be using any combination of one or more readable mediums.Readable medium can be readable letter
Number medium or readable storage medium storing program for executing.Readable storage medium storing program for executing for example can be but be not limited to electricity, magnetic, optical, electromagnetic, infrared ray or
System, device or the device of semiconductor, or any above combination.The more specific example of readable storage medium storing program for executing is (non exhaustive
List) include: electrical connection with one or more conducting wires, portable disc, hard disk, random access memory (RAM), read-only
Memory (ROM), erasable programmable read only memory (EPROM or flash memory), optical fiber, portable compact disc read only memory
(CD-ROM), light storage device, magnetic memory device or above-mentioned any appropriate combination.
The computer readable storage medium may include in a base band or the data as the propagation of carrier wave a part are believed
Number, wherein carrying readable program code.The data-signal of this propagation can take various forms, including but not limited to electromagnetism
Signal, optical signal or above-mentioned any appropriate combination.Readable storage medium storing program for executing can also be any other than readable storage medium storing program for executing
Readable medium, the readable medium can send, propagate or transmit for by instruction execution system, device or device use or
Person's program in connection.The program code for including on readable storage medium storing program for executing can transmit with any suitable medium, packet
Include but be not limited to wireless, wired, optical cable, RF etc. or above-mentioned any appropriate combination.
The program for executing operation of the present invention can be write with any combination of one or more programming languages
Code, described program design language include object oriented program language-Java, C++ etc., further include conventional
Procedural programming language-such as " C " language or similar programming language.Program code can be fully in tenant
It calculates and executes in equipment, partly executed in tenant's equipment, being executed as an independent software package, partially in tenant's calculating
Upper side point is executed on a remote computing or is executed in remote computing device or server completely.It is being related to far
Journey calculates in the situation of equipment, and remote computing device can pass through the network of any kind, including local area network (LAN) or wide area network
(WAN), it is connected to tenant and calculates equipment, or, it may be connected to external computing device (such as utilize ISP
To be connected by internet).
It can be with one or more programming Integrated Development Environment (IDE, Integrated Development
Environment), any combination of development of games engine establishes the engineering process for executing operation of the present invention, such as
Unity3D, Unreal, Visual Studio etc..
In an exemplary embodiment of the disclosure, a kind of electronic equipment is also provided, which may include processor,
And the memory of the executable instruction for storing the processor.Wherein, the processor is configured to via described in execution
Executable instruction is come the step of executing the circulation processing method of electronic prescription described in any one above-mentioned embodiment.
Person of ordinary skill in the field it is understood that various aspects of the invention can be implemented as system, method or
Program product.Therefore, various aspects of the invention can be embodied in the following forms, it may be assumed that complete hardware embodiment, complete
The embodiment combined in terms of full Software Implementation (including firmware, microcode etc.) or hardware and software, can unite here
Referred to as circuit, " module " or " system ".
The electronic equipment 600 of this embodiment according to the present invention is described referring to Figure 17.The electricity that Figure 17 is shown
Sub- equipment 600 is only an example, should not function to the embodiment of the present invention and use scope bring any restrictions.
As shown in figure 17, electronic equipment 600 is showed in the form of universal computing device.The component of electronic equipment 600 can be with
Including but not limited to: at least one processing unit 610, at least one storage unit 620, the different system components of connection (including are deposited
Storage unit 620 and processing unit 610) bus 630, display unit 640 etc..
Wherein, the storage unit is stored with program code, and said program code can be held by the processing unit 610
Row, so that the processing unit 610 executes described in this specification above-mentioned electronic prescription circulation processing method part according to this
The step of inventing various illustrative embodiments.For example, the processing unit 610 can execute step as shown in Figure 1.
The storage unit 620 may include the readable medium of volatile memory cell form, such as random access memory
Unit (RAM) 6201 and/or cache memory unit 6202 can further include read-only memory unit (ROM) 6203.
The storage unit 620 can also include program/practical work with one group of (at least one) program module 6205
Tool 6204, such program module 6205 includes but is not limited to: operating system, one or more application program, other programs
It may include the realization of network environment in module and program data, each of these examples or certain combination.
Bus 630 can be to indicate one of a few class bus structures or a variety of, including storage unit bus or storage
Cell controller, peripheral bus, graphics acceleration port, processing unit use any bus structures in a variety of bus structures
Local bus.
Electronic equipment 600 can also be with one or more external equipments 700 (such as keyboard, sensing equipment, bluetooth equipment
Deng) communication, the equipment that also tenant can be enabled interact with the electronic equipment 600 with one or more communicates, and/or with make
Any equipment (such as the router, modulation /demodulation that the electronic equipment 600 can be communicated with one or more of the other calculating equipment
Device etc.) communication.This communication can be carried out by input/output (I/O) interface 650.Also, electronic equipment 600 can be with
By network adapter 660 and one or more network (such as local area network (LAN), wide area network (WAN) and/or public network,
Such as internet) communication.Network adapter 660 can be communicated by bus 630 with other modules of electronic equipment 600.It should
Understand, although not shown in the drawings, other hardware and/or software module can be used in conjunction with electronic equipment 600, including but unlimited
In: microcode, device driver, redundant processing unit, external disk drive array, RAID system, tape drive and number
According to backup storage system etc..
Compared with prior art, the body building method of virtual interactive of the invention, electronic equipment and storage medium avoid entity
Common display capital improvement can be interactive body building equipment, created a kind of online by fitness equipment to the occupancy in space
The novel experience of the one-to-one guidance of fitness helps fitness to greatly reduce body-building from the movement of long-range correction student
Threshold.
Those skilled in the art after considering the specification and implementing the invention disclosed here, will readily occur to its of the disclosure
Its embodiment.This application is intended to cover any variations, uses, or adaptations of the disclosure, these modifications, purposes or
Person's adaptive change follows the general principles of this disclosure and including the undocumented common knowledge in the art of the disclosure
Or conventional techniques.The description and examples are only to be considered as illustrative, and the true scope and spirit of the disclosure are by appended
Claim is pointed out.
Claims (12)
1. a kind of body building method of virtual interactive, which comprises the following steps:
S110, the audio data and video data that first kind user is acquired by first terminal, the video data is converted to
Three-dimensional bone action model, obtain video data in human body multiple skeleton points coordinate and multiple skeleton points between formed to
Amount, according to the vector formed between the coordinate and multiple skeleton points of multiple skeleton points of human body in video data to human body in video
Action recognition is carried out to determine target action；
S120, the audio data and video data acquired by the first terminal is played in one or more second terminals；
S130, the three dimensional video data for acquiring the second class user in real time by each second terminal, and generate in real time to be measured
Three-dimensional bone action model, will current three-dimensional bone to be measured according to the target action of the video data currently played in second terminal
Action model forms a match group with the target action as a movement to be measured, by the movement to be measured；And
S140, judge whether the movement to be measured of each second terminal matches with target action, if then return step S130,
If it is not, thening follow the steps S150；
S150, the body image that figure obtains first kind user is scratched from the video data of the first kind user, from unmatched
The body image that figure obtains the second class user is scratched in the video data of the second class user, and unmatched second class is used
The body image at family is added in the video data of the first kind user, and plays in the first terminal, by described first
The body image of class user is added in the video data of the unmatched second class user, and broadcasts in the second terminal
It puts, return step S140.
2. the body building method of virtual interactive as described in claim 1, which is characterized in that unmatched in the step S150
The body image of the second class user is added in the video data of the first kind user as prospect,
The body image of the first kind user is added in the video data of the unmatched second class user as prospect.
3. the body building method of virtual interactive as described in claim 1, which is characterized in that in the step S150, described in foundation
The double-directional speech channel of first terminal and the unmatched second terminal.
4. the body building method of virtual interactive as described in claim 1, which is characterized in that the step S110 includes: when identification
One movement continuously repeats when occurring, using the movement as target action；
The step S120 includes: at least to postpone one currently to continue in the target action of the video data of second terminal broadcasting
The audio data and video data acquired from the first terminal that time plays in the second terminal.
5. the body building method of virtual interactive as claimed in claim 4, which is characterized in that
The step S110 comprises determining that the duration of target action；
The step S130 includes: since acting determining current three-dimensional bone action model to be measured to currently broadcasting in second terminal
The duration of the target action for the video data put using the current three-dimensional bone action model to be measured in the duration as
One movement to be measured.
6. the body building method of virtual interactive as described in claim 1, which is characterized in that
The step S110 further include:
By the target action by the three-dimensional bone action model dismantling at five physical feelings: left arm, right arm, left leg, right leg
And trunk, each physical feeling include: three vectors that three skeleton points, three skeleton points are formed and three described
Angle in vector between two vectors,
The one or more procedure-orienteds of position movement generation at least one physical feeling or the identification item towards displacement, often
A identification item includes identification object, identification parameter and recognition rule, the identification object include in three skeleton points extremely
A few skeleton point；At least one vector in three vectors；An and folder in three vectors between two vectors
It is one or more in angle,
Wherein, the identification item of the procedure-oriented further includes a standard procedure vector library, and standard procedure vector library is temporally
Ordered storage has at least one vector of the position movement,
The step S130 further include:
Movement to be measured is divided into corresponding detected part and acted by the target site movement according to target action, by movement to be measured
Detected part movement acts to form the whole body body region match group with the target site of corresponding target action；
To each physical feeling match group, the identification item of target site movement is obtained, is obtained according to the three-dimensional bone action model
The vector and/or vector for taking coordinate, the skeleton point of the skeleton point of the corresponding identification object of detected part movement to be formed it
Between angle, if the identification item is the identification item of procedure-oriented, the vector that the detected part is acted and standard procedure
Correspondence vector in vector library is carried out matching primitives and is compared with the vector threshold set with the identification parameter, if not meeting
The recognition rule then feeds back detected part stroke defect.
7. the body building method of virtual interactive as claimed in claim 6, which is characterized in that
Left arm includes: left finesse artis, left hand elbow joint point, left shoulder joint node, left shoulder joint node to left hand elbow joint dot
At primary vector, left hand elbow joint point to left finesse artis formed secondary vector, left shoulder joint node to left hand wrist joint
The angle between third vector and the primary vector and the secondary vector that point is formed；
Right arm includes: right finesse artis, right hand elbow joint point, right shoulder joint node, right shoulder joint node to right hand elbow joint dot
At primary vector, right hand elbow joint point to right finesse artis formed secondary vector, right shoulder joint node to right hand wrist joint
The angle between third vector and the primary vector and the secondary vector that point is formed；
Trunk includes: the backbone center of head center, the backbone center of neck, the backbone center of trunk, head center to neck
Secondary vector that the primary vector of formation, the backbone of backbone center to the trunk of neck are centrally formed, head center to trunk
The angle that the third vector and the primary vector and the secondary vector that backbone is centrally formed are formed；
Left leg includes: left ankle artis, left knee artis, left hip joint point, left hip joint point to left knee joint dot
At primary vector, left knee the artis secondary vector, the left hip joint point to left foot ankle-joint that are formed to left ankle artis
The angle between third vector and the primary vector and the secondary vector that point is formed；
Right leg includes: right ankle artis, right knee endoprosthesis point, right hip joint point, right hip joint point to right knee endoprosthesis dot
At primary vector, right knee endoprosthesis point to right ankle the artis secondary vector, the right hip joint point to right crus of diaphragm ankle-joint that are formed
The angle between third vector and the primary vector and the secondary vector that point is formed.
8. the body building method of virtual interactive as claimed in claim 7, which is characterized in that the vector for acting the detected part
Matching primitives are carried out with the corresponding vector in standard procedure vector library to be compared with the vector threshold set with the identification parameter
Relatively include:
Calculate the vector in standard procedure vector libraryWith the vector of detected part movement Between angle theta cosine value:
VectorWith vectorBetween the cosine value of angle theta be used for the vector threshold that sets with the identification parameter and compared
Compared with.
9. the body building method of virtual interactive as claimed in claim 6, which is characterized in that the identification item of the procedure-oriented includes
Track identification, negative track identification and holding identification；
The identification item towards displacement includes displacement identification and negative displacement identification.
10. the body building method of virtual interactive as described in claim 1, which is characterized in that the step S150 replacement are as follows: according to
The first 3D person model of body video generation that first kind user is obtained in the video data of the first kind user, in the video
The body image of first kind user is covered in data by the first 3D person model；According to the video data of the second class user
Middle the 2nd 3D person model of body video generation for obtaining the second class user, passes through the 2nd 3D person model in the video data
Cover the body image of the second class user, the body shadow of subsequent the 2nd 3D person model by the unmatched second class user
It is played as being added in the video data of the first kind user, and in the first terminal, by the of the first kind user
The body image of one 3D person model is added in the video data of the unmatched second class user, and eventually described second
End plays, return step S140.
11. a kind of electronic equipment, which is characterized in that the electronic equipment includes:
Processor；
Storage medium is stored thereon with computer program, and such as right is executed when the computer program is run by the processor
It is required that 1 to 10 described in any item steps.
12. a kind of storage medium, which is characterized in that be stored with computer program, the computer program on the storage medium
Step as described in any one of claim 1 to 10 is executed when being run by processor.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201810399778.2A CN110428486B (en) | 2018-04-28 | 2018-04-28 | Virtual interaction fitness method, electronic equipment and storage medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201810399778.2A CN110428486B (en) | 2018-04-28 | 2018-04-28 | Virtual interaction fitness method, electronic equipment and storage medium |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN110428486A true CN110428486A (en) | 2019-11-08 |
| CN110428486B CN110428486B (en) | 2022-09-27 |
Family
ID=68407141
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201810399778.2A Active CN110428486B (en) | 2018-04-28 | 2018-04-28 | Virtual interaction fitness method, electronic equipment and storage medium |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN110428486B (en) |
Cited By (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN110929641A (en) * | 2019-11-21 | 2020-03-27 | 三星电子（中国）研发中心 | Action demonstration method and system |
| CN112090053A (en) * | 2020-09-14 | 2020-12-18 | 成都拟合未来科技有限公司 | 3D interactive fitness training method, device, equipment and medium |
| CN112348942A (en) * | 2020-09-18 | 2021-02-09 | 当趣网络科技(杭州)有限公司 | Body-building interaction method and system |
| CN112364818A (en) * | 2020-11-27 | 2021-02-12 | Oppo广东移动通信有限公司 | Action correcting method and device, electronic equipment and storage medium |
| CN112418046A (en) * | 2020-11-17 | 2021-02-26 | 武汉云极智能科技有限公司 | Fitness guidance method, storage medium and system based on cloud robot |
| CN113241148A (en) * | 2021-04-28 | 2021-08-10 | 厦门艾地运动科技有限公司 | Fitness scheme generation method and device, terminal equipment and storage medium |
| CN113409651A (en) * | 2020-03-16 | 2021-09-17 | 上海史贝斯健身管理有限公司 | Live broadcast fitness method and system, electronic equipment and storage medium |
| CN113569688A (en) * | 2021-07-21 | 2021-10-29 | 上海健指树健康管理有限公司 | Body fitness testing method and device based on limb recognition technology and storage medium |
Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP2000353252A (en) * | 1999-06-14 | 2000-12-19 | Nippon Telegr & Teleph Corp <Ntt> | Video superimposing method, device therefor and recording medium for recording video superimpose program |
| CN103390174A (en) * | 2012-05-07 | 2013-11-13 | 深圳泰山在线科技有限公司 | Physical education assisting system and method based on human body posture recognition |
| US20150099252A1 (en) * | 2013-10-03 | 2015-04-09 | Autodesk, Inc. | Enhancing movement training with an augmented reality mirror |
| US20160216770A1 (en) * | 2015-01-28 | 2016-07-28 | Electronics And Telecommunications Research Institute | Method and system for motion based interactive service |
| CN105903157A (en) * | 2016-04-19 | 2016-08-31 | 深圳泰山体育科技股份有限公司 | Electronic coach realization method and system |
| CN106022213A (en) * | 2016-05-04 | 2016-10-12 | 北方工业大学 | Human body motion recognition method based on three-dimensional bone information |
| CN106485055A (en) * | 2016-09-22 | 2017-03-08 | 吉林大学 | A kind of old type ii diabetes patient moving training system based on Kinect sensor |
-
2018
- 2018-04-28 CN CN201810399778.2A patent/CN110428486B/en active Active
Patent Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP2000353252A (en) * | 1999-06-14 | 2000-12-19 | Nippon Telegr & Teleph Corp <Ntt> | Video superimposing method, device therefor and recording medium for recording video superimpose program |
| CN103390174A (en) * | 2012-05-07 | 2013-11-13 | 深圳泰山在线科技有限公司 | Physical education assisting system and method based on human body posture recognition |
| US20150099252A1 (en) * | 2013-10-03 | 2015-04-09 | Autodesk, Inc. | Enhancing movement training with an augmented reality mirror |
| US20160216770A1 (en) * | 2015-01-28 | 2016-07-28 | Electronics And Telecommunications Research Institute | Method and system for motion based interactive service |
| CN105903157A (en) * | 2016-04-19 | 2016-08-31 | 深圳泰山体育科技股份有限公司 | Electronic coach realization method and system |
| CN106022213A (en) * | 2016-05-04 | 2016-10-12 | 北方工业大学 | Human body motion recognition method based on three-dimensional bone information |
| CN106485055A (en) * | 2016-09-22 | 2017-03-08 | 吉林大学 | A kind of old type ii diabetes patient moving training system based on Kinect sensor |
Non-Patent Citations (1)
| Title |
|---|
| 朱国刚等: "基于Kinect传感器骨骼信息的人体动作识别", 《计算机仿真》 * |
Cited By (10)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN110929641A (en) * | 2019-11-21 | 2020-03-27 | 三星电子（中国）研发中心 | Action demonstration method and system |
| CN113409651A (en) * | 2020-03-16 | 2021-09-17 | 上海史贝斯健身管理有限公司 | Live broadcast fitness method and system, electronic equipment and storage medium |
| CN113409651B (en) * | 2020-03-16 | 2024-04-16 | 上海史贝斯健身管理有限公司 | Live broadcast body building method, system, electronic equipment and storage medium |
| CN112090053A (en) * | 2020-09-14 | 2020-12-18 | 成都拟合未来科技有限公司 | 3D interactive fitness training method, device, equipment and medium |
| CN112348942A (en) * | 2020-09-18 | 2021-02-09 | 当趣网络科技(杭州)有限公司 | Body-building interaction method and system |
| CN112348942B (en) * | 2020-09-18 | 2024-03-19 | 当趣网络科技(杭州)有限公司 | Body-building interaction method and system |
| CN112418046A (en) * | 2020-11-17 | 2021-02-26 | 武汉云极智能科技有限公司 | Fitness guidance method, storage medium and system based on cloud robot |
| CN112364818A (en) * | 2020-11-27 | 2021-02-12 | Oppo广东移动通信有限公司 | Action correcting method and device, electronic equipment and storage medium |
| CN113241148A (en) * | 2021-04-28 | 2021-08-10 | 厦门艾地运动科技有限公司 | Fitness scheme generation method and device, terminal equipment and storage medium |
| CN113569688A (en) * | 2021-07-21 | 2021-10-29 | 上海健指树健康管理有限公司 | Body fitness testing method and device based on limb recognition technology and storage medium |
Also Published As
| Publication number | Publication date |
|---|---|
| CN110428486B (en) | 2022-09-27 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN110428486A (en) | Body building method, electronic equipment and the storage medium of virtual interactive | |
| Kyan et al. | An approach to ballet dance training through ms kinect and visualization in a cave virtual reality environment | |
| CN110298218B (en) | Interactive fitness device and interactive fitness system | |
| CN109308438A (en) | Method for building up, electronic equipment, the storage medium in action recognition library | |
| CN110298220A (en) | Action video live broadcasting method, system, electronic equipment, storage medium | |
| CN103678859B (en) | Motion comparison method and motion comparison system | |
| Obdržálek et al. | Real-time human pose detection and tracking for tele-rehabilitation in virtual reality | |
| CN109308437A (en) | Action recognition error correction method, electronic equipment, storage medium | |
| JPWO2019130527A1 (en) | Extraction program, extraction method and information processing equipment | |
| US9418470B2 (en) | Method and system for selecting the viewing configuration of a rendered figure | |
| CN110298221A (en) | Self-service body building method, system, electronic equipment, storage medium | |
| CN113409651B (en) | Live broadcast body building method, system, electronic equipment and storage medium | |
| US11954869B2 (en) | Motion recognition-based interaction method and recording medium | |
| KR102356685B1 (en) | Home training providing system based on online group and method thereof | |
| CN111353347B (en) | Action recognition error correction method, electronic device, and storage medium | |
| CN111353345B (en) | Method, apparatus, system, electronic device, and storage medium for providing training feedback | |
| Tian et al. | Design and implementation of dance teaching system based on Unity3D | |
| Zhou | Role of human body posture recognition method based on wireless network Kinect in line dance aerobics and gymnastics training | |
| Lo et al. | richyoga: An interactive yoga recognition system based on rich skeletal joints | |
| Barioni et al. | BalletVR: a Virtual Reality System for Ballet Arm Positions Training | |
| WO2021178589A1 (en) | Exercise instruction and feedback systems and methods | |
| Kishore et al. | Smart yoga instructor for guiding and correcting yoga postures in real time | |
| KR20040084173A (en) | Real Time Motion Comparing Method and System | |
| KR102533490B1 (en) | A display device | |
| US20240042281A1 (en) | User experience platform for connected fitness systems |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| TA01 | Transfer of patent application right | ||
| TA01 | Transfer of patent application right |
Effective date of registration: 20210819 Address after: 200125 room 328, floor 3, unit 2, No. 231, Expo Village Road, pilot Free Trade Zone, Pudong New Area, Shanghai Applicant after: Shanghai shibeisi Fitness Management Co.,Ltd. Address before: 200233 room 136, building 20, tianlinfang, 130 Tianlin Road, Xuhui District, Shanghai Applicant before: SHANGHAI MYSHAPE INFORMATION TECHNOLOGY Co.,Ltd. |
|
| GR01 | Patent grant | ||
| GR01 | Patent grant |