CN104408775B - Depth perception based three-dimensional shadow play production method - Google Patents
Depth perception based three-dimensional shadow play production method Download PDFInfo
- Publication number
- CN104408775B CN104408775B CN201410798524.XA CN201410798524A CN104408775B CN 104408775 B CN104408775 B CN 104408775B CN 201410798524 A CN201410798524 A CN 201410798524A CN 104408775 B CN104408775 B CN 104408775B
- Authority
- CN
- China
- Prior art keywords
- shadow
- areal
- joint
- play
- model
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Abstract
The invention provides a depth perception based three-dimensional shadow play production method, belongs to the technical field of digital shadow play production and aims to solve the problem that the conventional shadow play inheritance mode cannot truly reflect conversion between fiction and fact and cannot be matched with shadow play patterns adaptively. The method comprises the following steps: firstly, the whole image of a to-be-produced shadow puppet is taken as a front view of a three-dimensional model production module so as to serve as a reference for a three-dimensional model of the shadow puppet; plane models of the whole body parts of the shadow puppet are produced; the plane models are subjected to surface color mapping; the plane models of the whole body parts of the to-be-produced shadow puppet are stitched and connected sequentially to form a three-dimensional model of the shadow puppet; the three-dimensional model of the shadow puppet is bound with all bones; a mapping relation between all the bones of the three-dimensional model of the shadow puppet and three-dimensional coordinate information of corresponding human body bones and joints is established; and the bones of the three-dimensional model of the shadow puppet is then controlled to move by a human bone movement sequence. The depth perception based three-dimensional shadow play production method is applied to three-dimensional shadow play production.
Description
Technical field
The present invention relates to the three-dimensional shadow show manufacture method based on depth perception, belongs to digital shadow show manufacturing technology neck
Domain.
Background technology
Shadow show originates from Han dynasty, is the curtain shadow art viewed and admired for people earliest in the world.Figure for shadow-play art experiences 1,100
Development and pass on, with folk custom mutually carry, and local tradition and folk culture mutually merge, its Modeling Technology form is only
Spy, with special representability and formal aesthetic sense, be China's tradition Chinese musical telling art of acting and folk industrial art perfect adaptation and
Into unique artistic kind, be once people's daily life amusement important component part.However, with other artistic forms with
And the appearance of information technology with develop rapidly, people are gradually accustomed to by the home-confined ground in TV, personal computer and the Internet
Acquisition information and entertainment interactive is carried out, colourful modern recreational facility makes us the high-tech product having more visitors or business than one can attend to, makes skin
The spectators of leather-silhouette show are seriously lost in.Additionally, shadow show is still mainly passed in the way of master and apprentice's teaching, figure for shadow-play actor or actress's complex manufacturing technology
And be difficult to preserve, performance need to be carried out in specific place, and music for voices in a Chinese opera dialect is difficult on a large scale by well-established, many shadow shows
Moulding, the directory and music for voices in a Chinese opera are all the reproductions of traditional performance, and new drama, new modeling, new performance form is seldom presented, skin is caused
Succession of the leather-silhouette show in the present age gets into a difficult position.By taking the Wangkui shadow show for being together put into World Immaterial Heritages as an example, figure for shadow-play
Play inheritance people performs the mean age of artists more than 70 years old with other, but still without clear and definite inheritance people, the immaterial text
Change legacy and almost face lost desperate situation.
Shadow show is on the verge of the attention that the present situation of extinction has caused many scholars, starts using different thinkings to shadow show
Protected and passed on.Some scholars are started with from the succession of the performance form of shadow show, such as paying less for Xian Electronics Science and Technology University
Cutting edge of a knife or a sword et al. replaces figure for shadow-play actor or actress to carry out Tang Aofei of shadow play performing, Xi'an University of Technology et al. machineries using intelligent robot
The control mode of automatization replaces Traditional Shadow Play artist to control motion of the figure for shadow-play actor or actress in performance space using stick.But machine
The performance action of people or Jing Mechanical courses need to be carried out according to the formula for pre-setting all the time, ossify and unnatural, can only be mechanically
Figure for shadow-play its shape is imitated, and its god cannot be passed.Another part scholar carves complex process processed from figure for shadow-play actor or actress and is difficult to the predicament for preserving
Start with, such as Hua Qingyi of Northwest University et al. is scanned to each ingredient and figure for shadow-play background of Traditional Shadow Play actor or actress and numeral
Change, propose two-dimentional figure for shadow-play personage and the modeling method of figure for shadow-play background, realize that a kind of use mouse based on the Internet is interacted
Digital shadow show manufacture method.Cai Jianping of Beijing University of Technology et al. is material using the manual Traditional Shadow Play personage for drawing system
Build the shadow play digital performance platform based on Flash two-dimension cartoon making softwares, it is allowed to which user is using mouse and touch screen reality
Existing interactively shadow show cartoon making.But these methods be only define the 2 D animation with figure for shadow-play style be equipped with it is close
The background music of style, impromptu of the performing artist emphasized in reaching the purpose of succession figure for shadow-play art, and figure for shadow-play art by real difficulty
Wave and appropriate expression is also difficult to the real-time interactive of spectators.Wen Yan of East China Normal University et al. is using the body based on Kinect
Sense control method, the action for setting up shadow puppet performance between person and two-dimensional digital figure for shadow-play personage are contacted, and are tried hard to dynamic with the body of performing artist
Make control figure for shadow-play personage to be performed, so that performance of the remote client computer screen ornamental to shadow show.But the method
Only figure for shadow-play personage is imitated using the two-dimensional signal of human motion in shadow curtain plane move horizontally mode, it is true to reflect
By away from the false or true conversion effect presented with close shadow curtain during shadow puppet performance.That is, although the performance of Traditional Shadow Play
It is to be realized by the translucent effect of shadow curtain, but figure for shadow-play personage is not close on shadow curtain and moves, but in shadow curtain plane and shadow
The three dimensions middle mold constituted by backstage side imitates real human motion.Qiu Hang of University of Electronic Science and Technology et al. discloses one kind will
Common threedimensional model style turns to the three-dimensional figure for shadow-play model production method with Traditional Shadow Play aesthetic characteristics, but applies the method
The three-dimensional figure for shadow-play model being made has certain thickness, is not inconsistent the characteristics of with Traditional Shadow Play model almost without thickness, and letter
The decorative pattern of some Traditional Shadow Plays random stylization is also run counter to into figure for shadow-play digital protection in the figure for shadow-play model for being generated singlely
With succession.
The content of the invention
The invention aims to the false or true conversion that the existing shadow show form of succession can not truly reflect shadow puppet performance is solved,
Can not it is adaptive matching figure for shadow-play decorative pattern problem, there is provided a kind of three-dimensional shadow show manufacture method based on depth perception.
Three-dimensional shadow show manufacture method based on depth perception of the present invention, it comprises the following steps：
Step one：Figure for shadow-play personage general image to be produced is made into the front view of module, the front view as threedimensional model
Used as the reference of figure for shadow-play personage's threedimensional model, the figure for shadow-play personage general image to be produced is presented 90 degree of actions of trick；
Step 2：Figure for shadow-play personage whole body part areal model to be produced is set up according to the front view；
Step 3：The pinup picture of surface color is carried out to figure for shadow-play personage to be produced whole body part areal model；
Step 4：The position of figure for shadow-play personage to be produced whole body part areal model is adjusted, and which is sequentially sewed is connect, shape
Cutification actor or actress's thing threedimensional model；
Step 5：All skeletons of figure for shadow-play personage's threedimensional model, then the eyelid covering by skeleton are set up, figure for shadow-play personage is three-dimensional
Model is set up with all skeletons and is bound；
Step 6：Skeleton motion is caught using depth transducer, the three-dimensional coordinate of all human body skeletal joints is obtained
Three-dimensional coordinate information of all skeletons of figure for shadow-play personage's threedimensional model with corresponding human body skeletal joint is set up mapping pass by information
System；All skeleton motions of catcher's body skeleton motion sequence control figure for shadow-play personage's threedimensional model are recycled, it is synchronous to play record
Performing artist's music for voices in a Chinese opera or accompaniment melody of system, realizes that three-dimensional shadow show makes.
In step one, the preparation method of figure for shadow-play personage general image to be produced is：Shoot and obtain figure for shadow-play personage entirety to be produced
Photograph, carries out background to figure for shadow-play personage to be produced entirety photograph using image processing tool and removes, then save as png forms text
Part is used as figure for shadow-play personage general image to be produced.
The concrete grammar that figure for shadow-play personage to be produced whole body part areal model is set up in step 2 is：
Make in module in threedimensional model, according to the front view as threedimensional model making module described in step one
Figure for shadow-play personage general image to be produced, newly-built areal model, the parameter for changing the newly-built areal model obtain first planting part successively
P1 areal models, upper body P2 areal models, right large arm P3 areal model, right forearm P4 areal models, right hand P5 areal models, a left side
Large arm P6 areal model, left forearm P7 areal models, left hand P8 areal models, upper right lower limb P9 areal models, bottom right lower limb P10 planes
Model, right crus of diaphragm P11 areal models, upper left leg P12 areal model, left lower leg P13 areal models and left foot P14 areal models；
The modification of the parameter for changing the newly-built areal model is according to being：By figure for shadow-play personage to be produced disassemble for the first planting,
Two upper arm, two forearms, two handss, a body, two thighs, two shanks and two feet totally 14 body parts,
The positive and negative photograph for obtaining 14 body parts is shot respectively, using image processing tool respectively to 14 body parts
Positive and negative photograph carries out background and removes, and the parameter for then saving as png formatted files respectively as corresponding newly-built areal model is repaiied
Change foundation.
In step 3 to figure for shadow-play personage to be produced whole body part areal model carry out surface color pinup picture it is concrete
Method is：
Make in module in threedimensional model, it then follows from left to right, order from top to bottom, to all body part plane moulds
Type carries out pinup picture：First select first planting part P1 areal models, create the Planar Mapping of its Z-direction, then using with the first planting
The png formatted files of part P1 areal models correspondence body part carry out the patch of surface color to first planting part P1 areal models
Figure；Then in this way, successively 14 body part areal models are carried out with the pinup picture of surface color.
In step 4, the concrete grammar of formation figure for shadow-play personage's threedimensional model is：
When first planting part P1 is towards right side：
Mobile Z-direction, positive direction represent reach, and negative direction represents retrogressing；By following hierarchical sequence by 14 body
Part areal model is sewed and is connect：Upper body P2 areal models cover first planting part P1 areal models；Right hand P5 areal models cover right forearm
P4 areal models, right forearm P4 areal models cover right large arm P3 areal model, and right large arm P3 areal model covers upper body P2 and puts down
Surface model；Right crus of diaphragm P11 areal models cover bottom right lower limb P10 areal models, and bottom right lower limb P10 areal models cover upper right lower limb P9 planes
Model, upper right lower limb P9 areal models cover upper body P2 areal models；Upper body P2 areal models cover left large arm P6 areal model, left
Large arm P6 areal model covers left forearm P7 areal models, and left forearm P7 areal models cover left hand P8 areal models；Upper body P2
Areal model covers upper left leg P12 areal model, and upper left leg P12 areal model covers left lower leg P13 areal models, left lower leg
P13 areal models cover left foot P14 areal models；Form figure for shadow-play personage's threedimensional model.
In step 5 by the concrete grammar that figure for shadow-play personage threedimensional model sets up binding with all skeletons it is：
The all skeletons for setting up figure for shadow-play personage's threedimensional model are respectively 15 articulares：Joint of head S1, both shoulders central authorities S2,
Right shoulder joint S3, right elbow joint S4, right carpal joint S5, left shoulder joint S6, left elbow joint S7, left carpal joint S8, buttocks central authorities close
Section S9, RG joint S10, right knee joint S11, right ankle joint S12, left buttocks joint S13, left knee joint S14 and left ankle are closed
Section S15；Again by the eyelid covering of skeleton, all skeletons of figure for shadow-play personage's threedimensional model are tied up with figure for shadow-play personage's three-dimension modeling
It is fixed.
By the three-dimensional coordinate information of all skeletons of figure for shadow-play personage's threedimensional model and corresponding human body skeletal joint in step 6
The concrete grammar for setting up mapping relations is：
The skeleton motion of performing artist is caught using depth transducer, the skeletal joint point three when performing artist moves is obtained
Dimension coordinate information；The music for voices in a Chinese opera of performing artist and the opera of band performance are obtained with the microphone array at depth transducer two ends simultaneously；
Preserve the performing artist for obtaining skeleton motion sequence and corresponding audio signal during whole performance；
By 20 skeletal joint point three-dimensional coordinate informations of performing artist are extracted in each frame of skeleton motion sequence, by this 20
15 corresponding skeletal joint point three-dimensional coordinate informations in skeletal joint point three-dimensional coordinate information and figure for shadow-play personage's threedimensional model
It is as follows that 15 articulares set up mapping relations：Joint of head point three-dimensional coordinate information in head skeleton position module is assigned to into head
Portion joint S1；Shoulder joints point three-dimensional coordinate information in shoulder frame position module is assigned to into both shoulders central authorities S2；By right shoulder bone
In rack position module, right shoulder joint node three-dimensional coordinate information is assigned to right shoulder joint S3；Right elbow in right elbow frame position module is closed
Nodes Three-dimensional coordinate information is assigned to right elbow joint S4；Right carpal joint point three-dimensional coordinate information in right carpal bone rack position module is assigned
It is worth to right carpal joint S5；Left shoulder joint node three-dimensional coordinate information in left shoulder frame position module is assigned to into left shoulder joint S6；Will
In left elbow frame position module, left elbow joint point three-dimensional coordinate information is assigned to left elbow joint S7；By in left carpal bone rack position module
Left carpal joint point three-dimensional coordinate information is assigned to left carpal joint S8；By buttocks central authorities articulare in buttocks central authorities frame position module
Three-dimensional coordinate information is assigned to buttocks central authorities joint S9；RG articulare three-dimensional coordinate in RG frame position module is believed
Breath is assigned to RG joint S10；Right knee joint point three-dimensional coordinate information in right kneecap rack position module is assigned to right knee joint to close
Section S11；Right ankle joint point three-dimensional coordinate information in right anklebone rack position module is assigned to into right ankle joint S12；By left buttocks bone
In rack position module, left buttocks articulare three-dimensional coordinate information is assigned to left buttocks joint S13；By in left kneecap rack position module
Left knee joint point three-dimensional coordinate information is assigned to left knee joint S14；Sit left ankle joint point in left anklebone rack position module three-dimensional
Mark information is assigned to left ankle joint S15；
Using the concrete side of all skeleton motions of catcher's body skeleton motion sequence control figure for shadow-play personage's threedimensional model
Method is：
Using the adjacent two frames x-axis direction relative distance control skin in skeleton motion sequence with both shoulders central authorities S2 correspondence images
The figure for shadow-play character facial direction of actor or actress's thing threedimensional model：Standard is extended to the left with x-axis positive axis, when adjacent two frames skeleton sequence
In be timing with the difference of the x coordinate of both shoulders central authorities S2 correspondence images, the first planting part P1 plane moulds controlled by joint of head S1
Type is overturn to the left, when the difference in adjacent two frames skeleton sequence with the x coordinate of both shoulders central authorities S2 correspondence images is negative, head is closed
The first planting part P1 areal models controlled by section S1 are overturn to the right；Remaining respective image action in connected applications skeleton motion sequence
Remaining all skeleton motion of control figure for shadow-play personage's threedimensional model, resynchronisation play the performing artist's music for voices in a Chinese opera or accompaniment melody recorded,
Realize that three-dimensional shadow show makes.
Advantages of the present invention：The present invention is a kind of digital shadow show manufacture method, and it is in Traditional Shadow Play actor or actress's picture material
On the basis of, sense of reality three-dimensional figure for shadow-play person model is generated, and then the table of traditional opera performing artist is caught using depth transducer
Drill the corresponding skeleton motion sequence of action and record performing artist music for voices in a Chinese opera and accompaniment melody, finally by the skeleton data for capturing with
The skeleton binding of three-dimensional figure for shadow-play person model, generates the sense of reality three-dimensional shadow show different from traditional opera.
The inventive method can be with the virtual figure for shadow-play personage's threedimensional model of real-time control, and it is caught by specific depth transducer
Catch the motion feature of human body, and then set up the relation of skeleton and figure for shadow-play skeleton, to realize the motion skeleton sequence control of employment
Figure for shadow-play skeleton processed is moved.So as to generate three-dimensional shadow show that is real-time, having feeling of immersion, sense of reality, it really reflects
The false or true conversion of shadow puppet performance, and realize adaptive figure for shadow-play decorative pattern matching.
Description of the drawings
Fig. 1 is figure for shadow-play personage whole body part areal model schematic diagram to be produced；
Fig. 2 is to disassemble schematic diagram to true figure for shadow-play personage；
Fig. 3 is to sew the figure for shadow-play personage's threedimensional model after connecing in order；
Fig. 4 is the schematic diagram of all skeletal joint points of figure for shadow-play personage's threedimensional model；
Fig. 5 is all skeleton schematic diagrams of figure for shadow-play personage's threedimensional model.
Specific embodiment
Specific embodiment one：Present embodiment is illustrated with reference to Fig. 1 to Fig. 5, depth is based on described in present embodiment
The three-dimensional shadow show manufacture method of perception, it comprises the following steps：
Step one：Figure for shadow-play personage general image to be produced is made into the front view of module, the front view as threedimensional model
Used as the reference of figure for shadow-play personage's threedimensional model, the figure for shadow-play personage general image to be produced is presented 90 degree of actions of trick；
Step 2：Figure for shadow-play personage whole body part areal model to be produced is set up according to the front view；
Step 3：The pinup picture of surface color is carried out to figure for shadow-play personage to be produced whole body part areal model；
Step 4：The position of figure for shadow-play personage to be produced whole body part areal model is adjusted, and which is sequentially sewed is connect, shape
Cutification actor or actress's thing threedimensional model；
Step 5：All skeletons of figure for shadow-play personage's threedimensional model, then the eyelid covering by skeleton are set up, figure for shadow-play personage is three-dimensional
Model is set up with all skeletons and is bound；
Step 6：Skeleton motion is caught using depth transducer, the three-dimensional coordinate of all human body skeletal joints is obtained
Three-dimensional coordinate information of all skeletons of figure for shadow-play personage's threedimensional model with corresponding human body skeletal joint is set up mapping pass by information
System；All skeleton motions of catcher's body skeleton motion sequence control figure for shadow-play personage's threedimensional model are recycled, it is synchronous to play record
Performing artist's music for voices in a Chinese opera or accompaniment melody of system, realizes that three-dimensional shadow show makes.
Specific embodiment two：Present embodiment is described further to embodiment one, figure for shadow-play to be produced in step one
The preparation method of personage's general image is：Shoot and obtain figure for shadow-play personage entirety photograph to be produced, treated using image processing tool
Making figure for shadow-play personage's entirety photograph carries out background and removes, and then saves as png formatted files as figure for shadow-play personage entirety to be produced
Image.
Image processing tool in present embodiment can adopt Photoshop.
Specific embodiment three：Present embodiment is illustrated with reference to Fig. 1 to Fig. 3, present embodiment is to embodiment two
It is described further, the concrete grammar that figure for shadow-play personage whole body part areal model to be produced is set up in step 2 is：
Make in module in threedimensional model, according to the front view as threedimensional model making module described in step one
Figure for shadow-play personage general image to be produced, newly-built areal model, the parameter for changing the newly-built areal model obtain first planting part successively
P1 areal models, upper body P2 areal models, right large arm P3 areal model, right forearm P4 areal models, right hand P5 areal models, a left side
Large arm P6 areal model, left forearm P7 areal models, left hand P8 areal models, upper right lower limb P9 areal models, bottom right lower limb P10 planes
Model, right crus of diaphragm P11 areal models, upper left leg P12 areal model, left lower leg P13 areal models and left foot P14 areal models；
The modification of the parameter for changing the newly-built areal model is according to being：By figure for shadow-play personage to be produced disassemble for the first planting,
Two upper arm, two forearms, two handss, a body, two thighs, two shanks and two feet totally 14 body parts,
The positive and negative photograph for obtaining 14 body parts is shot respectively, using image processing tool respectively to 14 body parts
Positive and negative photograph carries out background and removes, and the parameter for then saving as png formatted files respectively as corresponding newly-built areal model is repaiied
Change foundation.
In present embodiment, figure for shadow-play personage general image to be produced is imported in threedimensional model makes the front view of module,
The center position of its front view is placed on, and the figure for shadow-play figure action that trick is into 90 degree is formed as the object of reference of modeling.According to front
Figure for shadow-play personage general image to be produced in view, adjusts the length of respective planes model, and width ratio makes the ratio of areal model
Example is matched with the size of actual figure for shadow-play personage, as shown in Figure 1.Secondly, after the completion of the size matching of areal model, by increasing
The point of areal model, adjusts the position of respective point, with reference to the material of background figure for shadow-play actor or actress, the appearance proportion of areal model is more connect
Nearly actual figure for shadow-play actor or actress.
Specific embodiment four：Present embodiment is described further to embodiment three, to skin to be produced in step 3
The concrete grammar of actor or actress's thing whole body part areal model pinup picture for carrying out surface color is：
Make in module in threedimensional model, it then follows from left to right, order from top to bottom, to all body part plane moulds
Type carries out pinup picture：First select first planting part P1 areal models, create the Planar Mapping of its Z-direction, then using with the first planting
The png formatted files of part P1 areal models correspondence body part carry out the patch of surface color to first planting part P1 areal models
Figure；Then in this way, successively 14 body part areal models are carried out with the pinup picture of surface color.
Specific embodiment five：Present embodiment is illustrated with reference to Fig. 1, Fig. 2 and Fig. 3, present embodiment is to embodiment party
Formula four is described further, and the concrete grammar that figure for shadow-play personage's threedimensional model is formed in step 4 is：
When first planting part P1 is towards right side：
Mobile Z-direction, positive direction represent reach, and negative direction represents retrogressing；By following hierarchical sequence by 14 body
Part areal model is sewed and is connect：Upper body P2 areal models cover first planting part P1 areal models；Right hand P5 areal models cover right forearm
P4 areal models, right forearm P4 areal models cover right large arm P3 areal model, and right large arm P3 areal model covers upper body P2 and puts down
Surface model；Right crus of diaphragm P11 areal models cover bottom right lower limb P10 areal models, and bottom right lower limb P10 areal models cover upper right lower limb P9 planes
Model, upper right lower limb P9 areal models cover upper body P2 areal models；Upper body P2 areal models cover left large arm P6 areal model, left
Large arm P6 areal model covers left forearm P7 areal models, and left forearm P7 areal models cover left hand P8 areal models；Upper body P2
Areal model covers upper left leg P12 areal model, and upper left leg P12 areal model covers left lower leg P13 areal models, left lower leg
P13 areal models cover left foot P14 areal models；Form figure for shadow-play personage's threedimensional model.
As figure for shadow-play is to sew to pick up to exist before and after figure for shadow-play part sews knot by line by figure for shadow-play personage's each several part in itself
Should also there is corresponding tandem between the position relationship of order, therefore each several part of the figure for shadow-play areal model set up.With
Head is oriented standard, and present embodiment adjusts the position of areal model towards as a example by the right side by head.First figure for shadow-play model is carried out
Split, as shown in Figure 2.Present embodiment is sewed the mode for connecing by 14 figure for shadow-play part areal models, can form figure for shadow-play personage
Left surface farther out, the nearer distance perspective of right flank, sew after the completion of connecing, i.e., the characteristics of possessing substantially figure for shadow-play personage and sew knot, such as Fig. 3
It is shown.
Specific embodiment six：With reference to Fig. 4 and Fig. 5 explanation present embodiments, present embodiment is to embodiment five
It is described further, in step 5 by the concrete grammar that figure for shadow-play personage threedimensional model sets up binding with all skeletons is：
The all skeletons for setting up figure for shadow-play personage's threedimensional model are respectively 15 articulares：Joint of head S1, both shoulders central authorities S2,
Right shoulder joint S3, right elbow joint S4, right carpal joint S5, left shoulder joint S6, left elbow joint S7, left carpal joint S8, buttocks central authorities close
Section S9, RG joint S10, right knee joint S11, right ankle joint S12, left buttocks joint S13, left knee joint S14 and left ankle are closed
Section S15；Again by the eyelid covering of skeleton, all skeletons of figure for shadow-play personage's threedimensional model are tied up with figure for shadow-play personage's three-dimension modeling
It is fixed.
As the moulding of figure for shadow-play personage is based on side and half side-view, skeleton has the spy of oneself uniqueness during motion
Point, therefore the skeleton binding of figure for shadow-play personage also has the characteristic of oneself.According to the characteristics of figure for shadow-play personage, by the main bone of figure for shadow-play personage
Bone is divided into above-mentioned 15 articulares, as shown in Figure 4.
In threedimensional model Software for producing, according to the characteristics of figure for shadow-play personage, set up from head to foot successively, from left hand to
The skeleton of the right hand, as shown in Figure 5.Then, by the eyelid covering of skeleton, enable the motion of skeleton really with figure for shadow-play personage's threedimensional model
Set up contact.Finally, by brush weight making single skeleton affect single model assembly.So far, figure for shadow-play personage three-dimensional mould
Type and its corresponding skeleton have been set up and have been bound.
Specific embodiment seven：With reference to Fig. 4 and Fig. 5 explanation present embodiments, present embodiment is to embodiment six
It is described further, by the three-dimensional coordinate of all skeletons of figure for shadow-play personage's threedimensional model and corresponding human body skeletal joint in step 6
Information sets up the concrete grammar of mapping relations：
The skeleton motion of performing artist is caught using depth transducer, the skeletal joint point three when performing artist moves is obtained
Dimension coordinate information；The music for voices in a Chinese opera of performing artist and the opera of band performance are obtained with the microphone array at depth transducer two ends simultaneously；
Preserve the performing artist for obtaining skeleton motion sequence and corresponding audio signal during whole performance；
By 20 skeletal joint point three-dimensional coordinate informations of performing artist are extracted in each frame of skeleton motion sequence, by this 20
15 corresponding skeletal joint point three-dimensional coordinate informations in skeletal joint point three-dimensional coordinate information and figure for shadow-play personage's threedimensional model
It is as follows that 15 articulares set up mapping relations：Joint of head point three-dimensional coordinate information in head skeleton position module is assigned to into head
Portion joint S1；Shoulder joints point three-dimensional coordinate information in shoulder frame position module is assigned to into both shoulders central authorities S2；By right shoulder bone
In rack position module, right shoulder joint node three-dimensional coordinate information is assigned to right shoulder joint S3；Right elbow in right elbow frame position module is closed
Nodes Three-dimensional coordinate information is assigned to right elbow joint S4；Right carpal joint point three-dimensional coordinate information in right carpal bone rack position module is assigned
It is worth to right carpal joint S5；Left shoulder joint node three-dimensional coordinate information in left shoulder frame position module is assigned to into left shoulder joint S6；Will
In left elbow frame position module, left elbow joint point three-dimensional coordinate information is assigned to left elbow joint S7；By in left carpal bone rack position module
Left carpal joint point three-dimensional coordinate information is assigned to left carpal joint S8；By buttocks central authorities articulare in buttocks central authorities frame position module
Three-dimensional coordinate information is assigned to buttocks central authorities joint S9；RG articulare three-dimensional coordinate in RG frame position module is believed
Breath is assigned to RG joint S10；Right knee joint point three-dimensional coordinate information in right kneecap rack position module is assigned to right knee joint to close
Section S11；Right ankle joint point three-dimensional coordinate information in right anklebone rack position module is assigned to into right ankle joint S12；By left buttocks bone
In rack position module, left buttocks articulare three-dimensional coordinate information is assigned to left buttocks joint S13；By in left kneecap rack position module
Left knee joint point three-dimensional coordinate information is assigned to left knee joint S14；Sit left ankle joint point in left anklebone rack position module three-dimensional
Mark information is assigned to left ankle joint S15；
Using the concrete side of all skeleton motions of catcher's body skeleton motion sequence control figure for shadow-play personage's threedimensional model
Method is：
Using the adjacent two frames x-axis direction relative distance control skin in skeleton motion sequence with both shoulders central authorities S2 correspondence images
The figure for shadow-play character facial direction of actor or actress's thing threedimensional model：Standard is extended to the left with x-axis positive axis, when adjacent two frames skeleton sequence
In be timing with the difference of the x coordinate of both shoulders central authorities S2 correspondence images, the first planting part P1 plane moulds controlled by joint of head S1
Type is overturn to the left, when the difference in adjacent two frames skeleton sequence with the x coordinate of both shoulders central authorities S2 correspondence images is negative, head is closed
The first planting part P1 areal models controlled by section S1 are overturn to the right；Remaining respective image action in connected applications skeleton motion sequence
Remaining all skeleton motion of control figure for shadow-play personage's threedimensional model, resynchronisation play the performing artist's music for voices in a Chinese opera or accompaniment melody recorded,
Realize that three-dimensional shadow show makes.
In present embodiment, depth transducer can adopt Kinect depth cameras, and Kinect depth cameras can be right
Human body carries out complete skeleton tracking, and provides the three-dimensional coordinate information of 20 skeletal joint points.Therefore, here by figure for shadow-play personage
15 skeletal joint points in threedimensional model set up mapping relations with the corresponding joint point provided by Kinect, you can realize application
Kinect catcher's body motor control figure for shadow-play personage's threedimensional models are moved.
When the skeleton node caught using Kinect directly controls the motion of figure for shadow-play personage threedimensional model, it is impossible to distinguish its face
Direction.According in shadow show with cervical region as the strong point control figure for shadow-play personage turn round the characteristics of, used here as both shoulders central authorities joint
X-axis direction relative distances of the point S2 in adjacent two frame is controlling the direction of figure for shadow-play character facial.Here take the photograph from Kinect depth
As the visual angle of head, standard is extended to the left with x-axis positive axis, when the difference of the x coordinate of S2 in adjacent two frames skeleton sequence is timing,
The first planting part P1 controlled by joint of head S1 is overturn to the left, when the difference of the x coordinate of S2 in adjacent two frames skeleton sequence is negative
When, the first planting part P1 controlled by joint of head S1 is overturn to the right.This addresses the problem the figure for shadow-play model controlled with Kinect
Head is all the time towards the problem of side.
It is in skeleton motion sequence control figure for shadow-play personage's threedimensional model that application is captured, synchronous to play recorded performance
The music for voices in a Chinese opera and accompaniment melody of person, you can corresponding sense of reality three-dimensional shadow show is presented.Skin can both have been generated using the inventive method
Shadow performance artist carries out the three-dimensional shadow show directory of performance with limbs, it is also possible to by the performance of other traditional operas performing artist
Action control figure for shadow-play person model combines recorded music for voices in a Chinese opera and accompaniment Music Generation has other biographies of shadow play performing style
System opera three-dimensional shadow show.
Claims (1)
1. a kind of three-dimensional shadow show manufacture method based on depth perception, it comprises the following steps：
Step one：Figure for shadow-play personage general image to be produced is made into the front view of module, the front view conduct as threedimensional model
The reference of figure for shadow-play personage's threedimensional model, the figure for shadow-play personage general image to be produced are presented 90 degree of actions of trick；
Step 2：Figure for shadow-play personage whole body part areal model to be produced is set up according to the front view；
Step 3：The pinup picture of surface color is carried out to figure for shadow-play personage to be produced whole body part areal model；
Step 4：The position of figure for shadow-play personage to be produced whole body part areal model is adjusted, and which is sequentially sewed is connect, form skin
Actor or actress's thing threedimensional model；
Step 5：All skeletons of figure for shadow-play personage's threedimensional model, then the eyelid covering by skeleton are set up, by figure for shadow-play personage's threedimensional model
Set up with all skeletons and bind；
Step 6：Skeleton motion is caught using depth transducer, the three-dimensional coordinate information of all human body skeletal joints is obtained,
Three-dimensional coordinate information of all skeletons of figure for shadow-play personage's threedimensional model with corresponding human body skeletal joint is set up into mapping relations；It is sharp again
It is with all skeleton motions of catcher's body skeleton motion sequence control figure for shadow-play personage's threedimensional model, synchronous to play the performance recorded
Person's music for voices in a Chinese opera or accompaniment melody, realize that three-dimensional shadow show makes；
In step one, the preparation method of figure for shadow-play personage general image to be produced is：Shoot and obtain figure for shadow-play personage entirety phase to be produced
Piece, carries out background to figure for shadow-play personage to be produced entirety photograph using image processing tool and removes, then save as png formatted files
As figure for shadow-play personage general image to be produced；
The concrete grammar that figure for shadow-play personage to be produced whole body part areal model is set up in step 2 is：
Make in module in threedimensional model, according to the front view for making module described in step one as threedimensional model wait make
Make figure for shadow-play personage's general image, newly-built areal model, the parameter for changing the newly-built areal model obtain first planting part P1 successively and put down
Surface model, upper body P2 areal models, right large arm P3 areal model, right forearm P4 areal models, right hand P5 areal models, left large arm
P6 areal models, left forearm P7 areal models, left hand P8 areal models, upper right lower limb P9 areal models, bottom right lower limb P10 plane moulds
Type, right crus of diaphragm P11 areal models, upper left leg P12 areal model, left lower leg P13 areal models and left foot P14 areal models；
The modification of the parameter for changing the newly-built areal model is according to being：By figure for shadow-play personage to be produced disassemble for the first planting, two
Upper arm, two forearms, two handss, a body, two thighs, two shanks and two feet totally 14 body parts, respectively
The positive and negative photograph for obtaining 14 body parts is shot, using image processing tool respectively to the positive and negative of 14 body parts
Face photograph carries out background and removes, then save as respectively png formatted files as corresponding newly-built areal model parameter modification according to
According to；
The concrete grammar of the pinup picture of surface color is carried out in step 3 to figure for shadow-play personage to be produced whole body part areal model
For：
Make in module in threedimensional model, it then follows from left to right, order from top to bottom is entered to all body part areal models
Row pinup picture：First planting part P1 areal models are selected first, are created the Planar Mapping of its Z-direction, are then used and first planting part
The png formatted files of P1 areal models correspondence body part carry out the pinup picture of surface color to first planting part P1 areal models；So
Afterwards in this way, successively 14 body part areal models are carried out with the pinup picture of surface color；
In step 4, the concrete grammar of formation figure for shadow-play personage's threedimensional model is：
When first planting part P1 is towards right side：
Mobile Z-direction, positive direction represent reach, and negative direction represents retrogressing；14 body parts are put down by following hierarchical sequence
Surface model is sewed and is connect：Upper body P2 areal models cover first planting part P1 areal models；Right hand P5 areal models cover right forearm P4 and put down
Surface model, right forearm P4 areal models cover right large arm P3 areal model, and right large arm P3 areal model covers upper body P2 plane moulds
Type；Right crus of diaphragm P11 areal models cover bottom right lower limb P10 areal models, and bottom right lower limb P10 areal models cover upper right lower limb P9 plane moulds
Type, upper right lower limb P9 areal models cover upper body P2 areal models；Upper body P2 areal models cover left large arm P6 areal model, Zuo great
Arm P6 areal models cover left forearm P7 areal models, and left forearm P7 areal models cover left hand P8 areal models；Upper body P2 puts down
Surface model covers upper left leg P12 areal model, and upper left leg P12 areal model covers left lower leg P13 areal models, left lower leg P13
Areal model covers left foot P14 areal models；Form figure for shadow-play personage's threedimensional model；
In step 5 by the concrete grammar that figure for shadow-play personage threedimensional model sets up binding with all skeletons it is：
The all skeletons for setting up figure for shadow-play personage's threedimensional model are respectively 15 articulares：Joint of head S1, both shoulders central authorities S2, right shoulder
Joint S3, right elbow joint S4, right carpal joint S5, left shoulder joint S6, left elbow joint S7, left carpal joint S8, buttocks central authorities joint S9,
RG joint S10, right knee joint S11, right ankle joint S12, left buttocks joint S13, left knee joint S14 and left ankle joint S15；
Again by the eyelid covering of skeleton, all skeletons of figure for shadow-play personage's threedimensional model are bound with figure for shadow-play personage three-dimension modeling；
Characterized in that, the three-dimensional in step 6 by all skeletons of figure for shadow-play personage's threedimensional model with corresponding human body skeletal joint is sat
Mark information sets up the concrete grammar of mapping relations：
The skeleton motion of performing artist is caught using depth transducer, skeletal joint point three-dimensional when performing artist moves is obtained and is sat
Mark information；The music for voices in a Chinese opera of performing artist and the opera of band performance are obtained with the microphone array at depth transducer two ends simultaneously；Preserve
The performing artist of acquisition skeleton motion sequence and corresponding audio signal during whole performance；
By 20 skeletal joint point three-dimensional coordinate informations of performing artist are extracted in each frame of skeleton motion sequence, by 20 skeletons
15 of 15 corresponding skeletal joint point three-dimensional coordinate informations and figure for shadow-play personage's threedimensional model in articulare three-dimensional coordinate information
It is as follows that articulare sets up mapping relations：Joint of head point three-dimensional coordinate information in head skeleton position module is assigned to into head pass
Section S1；Shoulder joints point three-dimensional coordinate information in shoulder frame position module is assigned to into both shoulders central authorities S2；By right shoulder skeleton position
In putting module, right shoulder joint node three-dimensional coordinate information is assigned to right shoulder joint S3；By right elbow joint point in right elbow frame position module
Three-dimensional coordinate information is assigned to right elbow joint S4；Right carpal joint point three-dimensional coordinate information in right carpal bone rack position module is assigned to
Right carpal joint S5；Left shoulder joint node three-dimensional coordinate information in left shoulder frame position module is assigned to into left shoulder joint S6；By left elbow
In frame position module, left elbow joint point three-dimensional coordinate information is assigned to left elbow joint S7；By left wrist in left carpal bone rack position module
Articulare three-dimensional coordinate information is assigned to left carpal joint S8；Will be buttocks central authorities articulare in buttocks central authorities frame position module three-dimensional
Coordinate information is assigned to buttocks central authorities joint S9；RG articulare three-dimensional coordinate information in RG frame position module is assigned
It is worth and gives RG joint S10；Right knee joint point three-dimensional coordinate information in right kneecap rack position module is assigned to into right knee joint
S11；Right ankle joint point three-dimensional coordinate information in right anklebone rack position module is assigned to into right ankle joint S12；By left buttocks skeleton
In position module, left buttocks articulare three-dimensional coordinate information is assigned to left buttocks joint S13；Will be left in left kneecap rack position module
Knee joint point three-dimensional coordinate information is assigned to left knee joint S14；By left ankle joint point three-dimensional coordinate in left anklebone rack position module
Information is assigned to left ankle joint S15；
Using the concrete grammar of all skeleton motions of catcher's body skeleton motion sequence control figure for shadow-play personage's threedimensional model it is：
Using the adjacent two frames x-axis direction relative distance control figure for shadow-play people in skeleton motion sequence with both shoulders central authorities S2 correspondence images
The figure for shadow-play character facial direction of thing threedimensional model：Standard is extended to the left with x-axis positive axis, when in adjacent two frames skeleton sequence with
The difference of the x coordinate of both shoulders central authorities S2 correspondence images be timing, the first planting part P1 areal models controlled by joint of head S1 to
Left upset, when the difference in adjacent two frames skeleton sequence with the x coordinate of both shoulders central authorities S2 correspondence images is negative, by joint of head S1
The first planting part P1 areal models for being controlled are overturn to the right；Remaining respective image action control in connected applications skeleton motion sequence
Remaining all skeleton motion of figure for shadow-play personage's threedimensional model, resynchronisation play the performing artist's music for voices in a Chinese opera or accompaniment melody recorded, and realize
Three-dimensional shadow show makes.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201410798524.XA CN104408775B (en) | 2014-12-19 | 2014-12-19 | Depth perception based three-dimensional shadow play production method |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201410798524.XA CN104408775B (en) | 2014-12-19 | 2014-12-19 | Depth perception based three-dimensional shadow play production method |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN104408775A CN104408775A (en) | 2015-03-11 |
| CN104408775B true CN104408775B (en) | 2017-04-26 |
Family
ID=52646403
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201410798524.XA Active CN104408775B (en) | 2014-12-19 | 2014-12-19 | Depth perception based three-dimensional shadow play production method |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN104408775B (en) |
Families Citing this family (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN106251389B (en) * | 2016-08-01 | 2019-12-24 | 北京小小牛创意科技有限公司 | Method and device for producing animation |
| US10679404B2 (en) | 2017-10-04 | 2020-06-09 | Google Llc | Shadows for inserted content |
| CN107945285B (en) * | 2017-10-11 | 2021-05-04 | 浙江慧脑信息科技有限公司 | Three-dimensional model map changing and deforming method |
| CN108304064A (en) * | 2018-01-09 | 2018-07-20 | 上海大学 | More people based on passive optical motion capture virtually preview system |
| CN110288684B (en) * | 2019-05-22 | 2023-02-28 | 广西一九岂非影视传媒有限公司 | Method and system for rapidly generating two-dimensional animation based on shadow play preview |
| CN111724483A (en) * | 2020-04-16 | 2020-09-29 | 北京诺亦腾科技有限公司 | Image transplanting method |
| CN114782645B (en) * | 2022-03-11 | 2023-08-29 | 科大讯飞(苏州)科技有限公司 | Virtual digital person making method, related equipment and readable storage medium |
Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102716587A (en) * | 2012-06-15 | 2012-10-10 | 西安理工大学 | System and method for controlling automatic puppet performance |
| CN102778953A (en) * | 2012-06-28 | 2012-11-14 | 华东师范大学 | Motion sensing control method of shadow play remote digital performing based on Kinect |
| CN103065357A (en) * | 2013-01-10 | 2013-04-24 | 电子科技大学 | Manufacturing method of shadow figure model based on common three-dimensional model |
| CN103425136A (en) * | 2012-05-23 | 2013-12-04 | 西安宣仁电子科技有限责任公司 | Control method of intelligent interactive robot shadow puppet show |
Family Cites Families (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| TWI377055B (en) * | 2007-08-10 | 2012-11-21 | Ind Tech Res Inst | Interactive rehabilitation method and system for upper and lower extremities |
-
2014
- 2014-12-19 CN CN201410798524.XA patent/CN104408775B/en active Active
Patent Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103425136A (en) * | 2012-05-23 | 2013-12-04 | 西安宣仁电子科技有限责任公司 | Control method of intelligent interactive robot shadow puppet show |
| CN102716587A (en) * | 2012-06-15 | 2012-10-10 | 西安理工大学 | System and method for controlling automatic puppet performance |
| CN102778953A (en) * | 2012-06-28 | 2012-11-14 | 华东师范大学 | Motion sensing control method of shadow play remote digital performing based on Kinect |
| CN103065357A (en) * | 2013-01-10 | 2013-04-24 | 电子科技大学 | Manufacturing method of shadow figure model based on common three-dimensional model |
Non-Patent Citations (2)
| Title |
|---|
| Chinese Shadow Puppetry with an Interactive Interface Using the KINECT Sensor;ZHANG Hui et al.;《Proceedings of the 12th international conference on computer vision 2012》;20121231(第1期);第 352-361y页 * |
| 交互式视声一体化皮影动画系统的设计与实现;尉彦斌;《中国优秀硕士学位论文全文数据库信息科技辑》;20141115(第11期);第25-38页 * |
Also Published As
| Publication number | Publication date |
|---|---|
| CN104408775A (en) | 2015-03-11 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN104408775B (en) | Depth perception based three-dimensional shadow play production method | |
| US9240067B2 (en) | Animation of photo-images via fitting of combined models | |
| US8830269B2 (en) | Method and apparatus for deforming shape of three dimensional human body model | |
| CN107170030A (en) | A kind of virtual newscaster's live broadcasting method and system | |
| CN105528808B (en) | Jingchu folktale clay figure digital three-dimemsional model synthetic method and system | |
| CN107248185A (en) | A kind of virtual emulation idol real-time live broadcast method and system | |
| CN105243682B (en) | A kind of method of limb member model, role and two-dimension cartoon making | |
| EP4160545A1 (en) | Three-dimensional avatar generation device, three-dimensional avatar generation method, and three-dimensional avatar generation program | |
| Rawson | Sculpture | |
| CN110288684A (en) | A kind of method and system quickly generating 2 D animation based on shadow show preview | |
| Harrison | A Pheidian Head of Aphrodite Ourania | |
| KR101560354B1 (en) | Complex editing system for creating 3-Dimensional character, and complex editing method using the same | |
| Echavarria et al. | Digital workflow for creating 3D puzzles to engage audiences in the interpretation of archaeological artefacts | |
| CN113838189A (en) | Eyelash rendering method and device | |
| Soles | APHRODITE AT CORINTH: A STUDY OF THE SCULPTURAL TYPES. | |
| Yan et al. | The interactive narration of Chinese shadow play | |
| Kalshoven | Re-animating skin: Probing the surface in taxidermic practice | |
| Cao et al. | VR Display of the Stone Statue of a General and the Study of Armor Culture | |
| Gorzelany-Nowak | False inspirations: Antique terracotta in 19th c. forms from the collection of Princes Czartoryski Museum | |
| Blakeslee | Cherchez la Femme: Reassassing Francis Picabia's World War II Nudes | |
| Yan | Study on the Thin Flesh Sculptures of Northern Zhou Dynasty in Maijishan Grottoes | |
| Fan et al. | Animation design of Qu Tan temple mural based on Maya | |
| Haapapuro | The process of modelling and animating a stylised 3D video game character | |
| Pierce | ANTH 258/CIS 106 | |
| Melli | Verrocchio the Drasman: Model and Maestro |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |