CN101853668B - Method and system for transforming MIDI music into cartoon - Google Patents
Method and system for transforming MIDI music into cartoon Download PDFInfo
- Publication number
- CN101853668B CN101853668B CN201010136575.8A CN201010136575A CN101853668B CN 101853668 B CN101853668 B CN 101853668B CN 201010136575 A CN201010136575 A CN 201010136575A CN 101853668 B CN101853668 B CN 101853668B
- Authority
- CN
- China
- Prior art keywords
- analysis
- music
- animation
- lyrics
- animated element
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Expired - Fee Related
Links
- 238000000034 method Methods 0.000 title claims abstract description 40
- 230000001131 transforming effect Effects 0.000 title abstract 2
- 230000000007 visual effect Effects 0.000 claims abstract description 23
- 239000000463 material Substances 0.000 claims abstract description 18
- 230000015572 biosynthetic process Effects 0.000 claims description 10
- 238000003786 synthesis reaction Methods 0.000 claims description 10
- 230000007704 transition Effects 0.000 claims description 9
- 238000010276 construction Methods 0.000 claims description 7
- 238000006243 chemical reaction Methods 0.000 claims description 6
- 230000001360 synchronised effect Effects 0.000 claims description 3
- 230000009466 transformation Effects 0.000 abstract description 3
- 230000009471 action Effects 0.000 description 14
- XLYOFNOQVPJJNP-UHFFFAOYSA-N water Substances O XLYOFNOQVPJJNP-UHFFFAOYSA-N 0.000 description 10
- 238000010586 diagram Methods 0.000 description 8
- 230000008569 process Effects 0.000 description 7
- 230000008859 change Effects 0.000 description 6
- 230000000366 juvenile effect Effects 0.000 description 6
- 235000002493 Salix babylonica Nutrition 0.000 description 4
- 241000734985 Salix x sepulcralis Species 0.000 description 4
- 239000004020 conductor Substances 0.000 description 4
- 239000000203 mixture Substances 0.000 description 4
- 230000000694 effects Effects 0.000 description 3
- 238000005516 engineering process Methods 0.000 description 3
- 230000033764 rhythmic process Effects 0.000 description 3
- 241000531807 Psophiidae Species 0.000 description 2
- 238000010009 beating Methods 0.000 description 2
- 230000008901 benefit Effects 0.000 description 2
- 238000007664 blowing Methods 0.000 description 2
- 239000003086 colorant Substances 0.000 description 2
- 230000008451 emotion Effects 0.000 description 2
- 241001465754 Metazoa Species 0.000 description 1
- ZYXYTGQFPZEUFX-UHFFFAOYSA-N benzpyrimoxan Chemical compound O1C(OCCC1)C=1C(=NC=NC=1)OCC1=CC=C(C=C1)C(F)(F)F ZYXYTGQFPZEUFX-UHFFFAOYSA-N 0.000 description 1
- 230000005540 biological transmission Effects 0.000 description 1
- 230000000295 complement effect Effects 0.000 description 1
- 239000000470 constituent Substances 0.000 description 1
- 238000000605 extraction Methods 0.000 description 1
- 230000006870 function Effects 0.000 description 1
- 239000003607 modifier Substances 0.000 description 1
- 238000005457 optimization Methods 0.000 description 1
- 238000004088 simulation Methods 0.000 description 1
- 230000003068 static effect Effects 0.000 description 1
- 239000002352 surface water Substances 0.000 description 1
Landscapes
- Auxiliary Devices For Music (AREA)
- Processing Or Creating Images (AREA)
Abstract
The invention provides a method and a system for transforming MIDI music into cartoons. The method comprises the following steps: analyzing the musical structure of MIDI music to obtain musical analysis results and the time attribute of the music; constructing each animation element and corresponding relationships thereof based on preset rules or parameters input by the user in accordance with a preset animation material library and the musical analysis results; and combining the animation elements and the corresponding relationships thereof to form cartoons according to the time attribute. The invention can realize the transformation of the MIDI music into the visual information with rich contents related to the contents expressed in the music, thereby achieving the visual and audio binding of the cartoons and music, and satisfying needs of simultaneous and unified visual and audio enjoyment.
Description
Technical field
The present invention relates to electronic music technical field of data processing, particularly relate to a kind of method and system that MIDI music is generated to animation.
Background technology
Along with growth in the living standard, people enter in daily life gradually for the appreciation of music, become the important way of amusement and recreation.Conventionally, people play music and just meet enjoyment acoustically, but with eyes, experience the information of music expression, but await people's R and D.
A kind of common method is that to make to form the different structure element of music corresponding from different colors, the variation that is color by the change transitions of music, according to the music attribute of different colours representative, by the variation of color category and the depth of color, change, the performing content that reflects music, for example cheerful and light-hearted or melancholy, releive or fierceness.Also has a kind of method, that music is combined with color and several picture, broadcasting along with music, the distortion of colorific variation and several picture and restructuring, the method has increased geometric variation, compared with independent change color, increased manifestation mode, more directly perceived, user can according to the variation patterns of figure and speed, obtain musical content.Said method only obtains the style of music expression and rhythm etc., and performing content is dull, the contents such as the personage in music, scene, action cannot be expressed, and lacks expressive force.
Instrument devices digital interface (MIDI, Musical Instrument Digital Interface) technology is the application of computer multimedia technology in audio area.Be different from the digital waveform audio files such as MP3, WAV, waveform to sound is sampled, itself does not record any sound waveform MIDI file, only records following information: certain MIDI passage and certain time send certain musical instrument to sound-producing devices such as MIDI compositors and what state need to carry out (comprising pitch, dynamics, volume, reverberation etc.) information of sounding with.MIDI transmission be not voice signal, but instructions such as note, control parameter, what its indication MIDI equipment will be done, how to do, for example, play which note, much volumes, what tone finish, in addition what accompaniment etc.MIDI system is actual is exactly the performance system of a composition, orchestration, electronic simulation.Therefore, in MIDI music, comprise a large amount of data messages, be easy to carry out operational processes.
Feature based on MIDI music, needs the problem that those skilled in the art solve to be exactly: how MIDI music to be generated as to abundant in content, corresponding with the content of music expression visual information at present.
Summary of the invention
Technical matters to be solved by this invention is to provide a kind of method and system that MIDI music is generated to animation, MIDI music can be generated as to abundant in content, corresponding with the content of music expression visual information.
In order to address the above problem, the invention discloses a kind of method that MIDI music is generated to animation, comprising:
MIDI music is carried out to the analysis of music structure, obtain the time attribute of music analysis result and music;
Parameter according to preset cartoon material storehouse and above-mentioned music analysis result by presetting rule or user's input builds each animated element and corresponding relation thereof;
According to described time attribute, each animated element and corresponding relation thereof are combined into animation.
Preferably, the analysis of described music structure comprises: one or more in analyzing of note analysis, syllable analysis, phrase analysis, period analysis, track.
Preferably, while having the lyrics in described MIDI music, described method also comprises:
Carry out the analysis of lyrics information, obtain lyrics analysis result;
Described lyrics analysis result is incorporated in the structure of each animated element and corresponding relation thereof.
Preferably, the analysis of described lyrics information comprises: one or more in analyzing of lemma analysis, grammatical analysis, Sentence analysis, paragraph analysis, chapters and sections.
Further, each animated element of described structure and corresponding relation thereof specifically comprise:
By one or more combination in note analysis, syllable analysis and lemma analysis, build the animated element that comprises role, behavior, subfield scape, by grammatical analysis, build the corresponding relation of above-mentioned each animated element;
One or more combination in analyzing by phrase analysis, period analysis, track analysis and Sentence analysis, paragraph analysis, chapters and sections builds the total scene being comprised of corresponding subfield scape.
Further, describedly each animated element and corresponding relation thereof be combined into animation specifically comprise:
In described total scene, add corresponding role, behavior and carry out integral body and synthesize;
According to described time attribute, set the time that each animated element occurs, animation is synchronizeed with the reproduction time of MIDI music.
Preferably, describedly each animated element and corresponding relation thereof be combined into animation specifically also comprise:
Set visual angle route of transition, the visual angle between each animated element is changed and is connected.
In addition, the invention also discloses a kind of system that MIDI music is generated to animation, comprising:
Music analysis module, for MIDI music being carried out to the analysis of music structure, obtains the time attribute of music analysis result and music;
Element builds module, for according to preset cartoon material storehouse and above-mentioned music analysis result, the parameter by presetting rule or user's input builds each animated element and corresponding relation thereof;
Animation synthesis module, for being combined into animation according to described time attribute by each animated element and corresponding relation thereof.
Preferably, described system also comprises:
Lyrics analysis module, for when described MIDI music has the lyrics, carries out the analysis of lyrics information, obtains lyrics analysis result;
Lyrics analysis module is input to described lyrics analysis result in element structure module, and element builds module and according to preset cartoon material storehouse, music analysis result and described lyrics analysis result, carries out the structure of each animated element and corresponding relation thereof.
Preferably, described element structure module comprises:
Daughter element construction unit, builds for one or more combination by note analysis, syllable analysis and lemma analysis the animated element that comprises role, behavior, subfield scape, builds the corresponding relation of above-mentioned each animated element by grammatical analysis;
Total scene construction unit, builds for one or more combination of analyzing by phrase analysis, period analysis, track analysis and Sentence analysis, paragraph analysis, chapters and sections the total scene being comprised of corresponding subfield scape.
Preferably, described animation synthesis module comprises:
Element integral unit, for adding corresponding role, behavior and carrying out integral body and synthesize in described total scene;
Time synchronized unit, the time occurring, makes animation synchronize with the reproduction time of MIDI music for set each animated element according to described time attribute.
Preferably, described animation synthesis module also comprises: visual angle conversion unit, for setting visual angle route of transition, changes the visual angle between each animated element to be connected.
Compared with prior art, the present invention has the following advantages:
The present invention carries out the analysis of music structure to MIDI music, by the parameter of presetting rule or user's input, choose each animated element and corresponding relation thereof from cartoon material storehouse; Finally according to the time attribute of MIDI music, each animated element and corresponding relation thereof are combined into animation.The present invention is associated MIDI music with animated element, for the music that there is no the lyrics, by system definition or user, arrange and generate corresponding animation, final Music Television (MTV) (the MV that forms, Music Television) animation, realize the audiovisual binding of animation and music, meet that the sense of hearing and vision are enjoyed, mutual unified demand simultaneously.In addition, for the music that has the lyrics, by lyrics analysis, build animated element and relation thereof, the animation of generation can give expression to the content of the lyrics, and abundant expression forms is more proper with the performance of music.
In a word, the present invention, according to the feature of MIDI music, can generate the animation matching with music by MIDI music, has realized audiovisual binding, has improved user's Experience Degree, has increased the recreational of music.
accompanying drawing explanation
Fig. 1 is a kind of process flow diagram that MIDI music is generated to the embodiment of the method for animation of the present invention;
Fig. 2 is a kind of process flow diagram that MIDI music is generated to the method preferred embodiment of animation of the present invention;
Fig. 3 is a kind of schematic diagram that MIDI music is generated to the system embodiment of animation of the present invention;
Fig. 4 is music score schematic diagram corresponding to one section of MIDI music described in the inventive method preferred embodiment.
embodiment
For above-mentioned purpose of the present invention, feature and advantage can be become apparent more, below in conjunction with the drawings and specific embodiments, the present invention is further detailed explanation.
The present invention, by the analysis to MIDI music, is mated music with animated element, MIDI music generates the animation of corresponding contents the most at last, and the animation that makes user can watch different music to present, has realized the unification of Voice & Video.
With reference to Fig. 1, show a kind of process flow diagram that MIDI music is generated to the embodiment of the method for animation of the present invention, comprise the steps:
Step 101, carries out the analysis of music structure to MIDI music, obtain the time attribute of music analysis result and music;
The least unit of music structure is note, and by note groups syllabication, syllable forms phrase, phrase recomposition period, and each period forms a track, and track is divided into melody rail, accompaniment rail and background rail, by each track, forms a first complete music.Accordingly, the analysis of music structure comprises: note analysis, syllable analysis, phrase analysis, period analysis, track analysis.
For note, analysis is the time of determining that each note occurs in whole MIDI music, makes note corresponding with the time, obtains the time attribute of music.The analysis of syllable is to analyze the note that each trifle syllable comprises, and according to note, determines the structure of a chord under syllable.Analysis for phrase is to analyze the syllable composition that meets chord rule.Analysis for period is the composition of analyzing the phrase that meets chord rule, thereby determines that chord, along with the situation of change of music, further obtains the variation of the degree of stability of music.In general, I chord and VI chord are stable, and II chord and IV chord are more stable, and V chord and III chord are unstable.For the analysis of track, be analyze the length of melody rail, accompaniment rail and rhythm rail, just, strong and weak note forms, and obtains the representation style of music, for example releive or cheerful and light-hearted.
Step 102, the parameter according to preset cartoon material storehouse and above-mentioned music analysis result by presetting rule or user's input builds each animated element and corresponding relation thereof;
In preset cartoon material storehouse, store a large amount of image elements, such as standard people shape library, performance band shape library, all kinds of animals graphics storehouse, background graphics storehouse, character and graphic storehouse etc.According to the music analysis result of step 101 and preset cartoon material storehouse, build each animated element and corresponding relation thereof, can be according to the rule of system intialization, the parameter that also can input according to user.
For example, according to the analysis of music, judge that this music is that symphony is played, according to the rule of system intialization, from cartoon material storehouse, select to play the roles such as philharmonic society's figure, conductor's figure, drummer's figure, trumpeter's figure and build role's list; Meanwhile, select to have the figure structure scene list of playing hall; And definite each role moves accordingly and builds behavior act list, as commanded action, the action of beating a drum, playing wind instruments action etc.Can be according to the rule of system intialization, the variation of chord in above-mentioned music analysis result and background color variation is corresponding, for example for stable I chord, give yellow stage background; For unsettled V chord, give red stage background etc.Can also arrange according to the parameter of user's input, as carried out the selection of figure according to the scale of performance band, the background color in performance hall etc.Finally, the element in role's list is carried out corresponding with the element in action lists: conductor is corresponding with commander's action; Drummer is corresponding with the action of beating a drum; Trumpeter is with to play wind instruments action corresponding etc.
In addition, can also set flexibly other animated element according to music analysis result, for example, play the lighting effects of stage, suppose to obtain by the analysis of track, the last period, the melody of music was releived, and light was set for representing soft yellow; The melody of middle one section of music is cheerful and light-hearted, light is set for representing fierce redness, and the melody of final stage music is quiet, the color of light is set for blue.
Step 103, is combined into animation according to described time attribute by each animated element and corresponding relation thereof.
The time definite according to note, for every segment music, determine the time of occurrence of different role and its corresponding behavior in scene, the time that a certain role's appearance can be corresponded to a certain appointment note is upper, or a certain role's behavior act is corresponding with the time of another appointment note.This step sets according to time attribute the time that different role occurs, for example, while starting, according to the time of the first phrase first note, occurs playing the animation that band plays together in playing hall scene; Afterwards, the time according to the second phrase first note, cartoon role is replaced with to conductor, the animation that picture conversion conducts orchestra for conductor; Then, the time according to the 3rd phrase first note, cartoon role is replaced with to drummer, the cartoon scene that picture conversion is beaten a drum for drummer, finally makes the reproduction time of music and the reproduction time of animation consistent.Finally, by the holistic approach of MIDI music, set pilot route of transition, the transformation of each role, scene is connected.
The embodiment of the present invention is carried out the analysis of music structure to MIDI music, for the music that there is no the lyrics, by the parameter of presetting rule or user's input, extract the cartoon material with music expression characteristic, by each animated element and corresponding relation thereof, be combined into animation.The method can enough visually-perceptible music change information, by MIDI music is combined with the animation of conversion, generate MV animation, realized the audiovisual of animation and music and bound, meet that the sense of hearing and vision are enjoyed simultaneously, mutual unified demand.
For the situation that comprises the lyrics in MIDI music, except the analysis of music structure, can also analyze the lyrics, according to the analysis result of the lyrics, build corresponding animated element, make the performance of animation corresponding with the content of lyrics expression.
With reference to Fig. 2, show a kind of process flow diagram that MIDI music is generated to the method preferred embodiment of animation of the present invention.It is example that the song < < let us of take has swung two oar > >:
Choosing one section of MIDI music, as shown in Figure 4, is music score schematic diagram corresponding to one section of MIDI music described in the inventive method preferred embodiment, its corresponding lyrics are: " let us has swung two oars; canoe is pushed wave open, and beautiful White Tower is being reflected on sea, surrounded by the red wall of greenery.Canoe gently, drifts in water, has head-on blown nice and cool wind." above-mentioned MIDI music of being furnished with the lyrics is generated to animation.According to above-mentioned music, describe the preferred embodiment of the present invention in detail below, comprise step:
Step 201, carries out the analysis of music structure to MIDI music, obtain the time attribute of music analysis result and music;
The analysis of described music structure comprises: note analysis, syllable analysis, phrase analysis, period analysis, track analysis.The time occurring in whole MIDI music according to each note of note Analysis deterrmination, make note corresponding with the time.MIDI music is carried out to syllable analysis, normally analyze melody rail, be i.e. that less rail of note overlap ratio.Each syllable is given one or more chord attributes according to the composition of note, in the present embodiment, to a syllable, gives a chord attribute.As syllable
give VI chord,
give III chord.Chord attribute to each syllable carries out phrase analysis, obtains meeting the phrase of musical rule, and musical rule is that chord carries out rule, as several syllables below:
Be that a VI-III-III-VI chord carries out, analyze being changed to of obtaining and revolve: stablize chord-unstable chord-unstable chord-stablize chord, the chord that is a rule carries out.In this step, can be in conjunction with lyrics information to the analysis of music structure, the punctuation mark by the lyrics carries out pre-service to the phrase of MIDI music.In the present embodiment, by punctuation mark analysis, show that above-mentioned front four syllables form a reasonable phrase, the analysis classes of other phrase seemingly.
According to the multiplicity of the multiplicity of phrase and the lyrics, roughly determine period, several phrases form period.In this song, whole song can be divided into three periods, and the present embodiment is only analyzed for previous period.In addition, MIDI music not only comprises melody rail, conventionally also comprises rhythm rail (drum rail, low track etc.), accompaniment rail etc.In this class track, some note multiplicities are higher, to the analysis of these tracks, can obtain cadence information, for the structure of animated graphics provides reference frame.For the analysis of track, obtain the representation style of music for releiving.In addition, conventionally comprised the information such as speed, beat, musical instrument in MIDI music, these information are also the bases of above each music structure analysis.
Step 202, carries out the analysis of lyrics information, obtains lyrics analysis result;
The analysis of described lyrics information comprises: lemma analysis, grammatical analysis, Sentence analysis.A lyrics text is from see the character string being comprised of Chinese character (comprising punctuation mark etc.) in form.By word, can form lemma, by lemma, can form sentence, and then form paragraph, chapters and sections by some sentences.
Analysis to lemma, can utilize the segmenting method based on string matching, according to certain strategy, Chinese character string to be analyzed is mated with the entry in preset dictionary, if find certain character string in dictionary, the match is successful, identifies a lemma; Also can utilize the segmenting method based on understanding, allow the understanding of anthropomorphic distich of computer mould, its basic thought is in participle, to carry out syntax, semantic analysis, utilizes syntactic information and semantic information to process Ambiguity, reaches the effect of identification word; Can also utilize the segmenting method based on statistics, because lemma is the combination of stable word, therefore the number of times that adjacent word occurs is simultaneously more, just more likely form a word, utilize the confidence level of the frequency of word and the adjacent co-occurrence of word or the word of probability reflection, frequency to the combination of each word of adjacent co-occurrence is added up, and calculates their information that appears alternatively, thereby carries out lemma identification.By lemma, analyze, obtain the implication that each lemma is expressed, such as whom is, what things, what behavior, what scene etc.
Grammatical analysis is part of speech, the inflection of word or other means and function and the relation of analysing word in sentence of expression mutual relationship of analyzing by determining that usage is used.By the constituent of parsing sentence, determine attribute, the adverbial modifier, complement, subject, predicate, object, understand the relation between lemma, thereby determine the meaning that sentence is expressed.
Statement is to consist of related one group of word on a word or syntax, by Sentence analysis, can draw opinion, hope or the artistic conception etc. of each minor sentence expression of the lyrics.The word pause that the situations such as paragraph and chapters and sections are article thoughts when expressing owing to transfer, emphasizing, intermittence cause.By the analysis of paragraph and chapters and sections, lyrics content is divided, determine the contents such as every part emotion to be expressed, artistic conception.
Step 203, builds the animated element that comprises role, behavior, subfield scape by note analysis, syllable analysis, melody analysis and lemma analysis, build the corresponding relation of above-mentioned each animated element by grammatical analysis;
Note in MIDI music, phrase, period be word or lemma, statement, paragraph or the chapters and sections of the corresponding lyrics respectively.The speed obtaining in music analysis, style information can be in conjunction with the emotion of the lyrics construction basis as figure style.By " we, two oar, canoe, wave, sea, White Tower, greenery, Hong Qiang, water, wind ", these lemmas are analyzed, can from cartoon material storehouse, choose the figures such as corresponding people, thing, scape, for example Young Pioneer is juvenile, the character graphic such as quant, canoe, weeping willow, red wall, the sub-scene graph of the blue water surface, green hill greenery, further adds these figures in role's list and the list of subfield scape.By the analysis of " swung, push open, waft, blown " these lemmas, build and the behavior list such as to row the boat, push open, to blow.
By grammatical analysis, build the corresponding relation of list element between role's list, the list of subfield scape, behavior list.As Young Pioneer is juvenile, quant is corresponding with the behavior of rowing the boat; Canoe, wave and the action of pushing open are corresponding; Wind is corresponding with the action of blowing; Canoe, White Tower are corresponding with the subfield scape of the blue water surface; The subfield scape of weeping willow, red wall and green hill greenery is corresponding etc.
Step 204, one or more combination in analyzing by phrase analysis, period analysis and Sentence analysis, paragraph analysis, chapters and sections builds the total scene being comprised of corresponding subfield scape;
The cadence information obtaining in music structure analysis can provide foundation for the tempo variation of figure.By each sentence to the lyrics, analyze, obtain the situation of each expression, the lyrics section providing in this example is analyzed, obtain the content that this paragraph is expressed, according to the corresponding relation of each lyrics statement and MIDI music phrase, in the list of subfield scape, extract each subfield scape, according to the corresponding relation of lyrics paragraph and music period, each subfield scape is combined into a total scene, and this total scene has transformation angle according to the appearance of subfield scape: around the blue water surface-water surface-and green hill greenery-blue water surface.
Step 205 adds corresponding role, behavior and carries out integral body and synthesize in described total scene;
Character graphic Young Pioneer is juvenile, quant is corresponding with the behavior of rowing the boat joins total scene; Join total scene by the character graphic of canoe, wave is corresponding with the action of pushing open; Join in total scene the figure of wind is corresponding with the action of blowing.Other roles join in total scene as static graphics successively as White Tower, weeping willow, red wall etc.Finally integrate to form animation: several Young Pioneers that are seated in canoe are juvenile, in juvenile hand, hold quant and row the boat, the canoe wave that rises in the water surface that drifts; The water surface is reflecting White Tower, and the surrounding kind of water weeping willow, around red wall; Gentle breeze blows afloat, and canoe drifts in water, and Young Pioneer juvenile in ship waves with the wind.
Step 206, sets according to time attribute the time that each animated element occurs, animation is synchronizeed with the reproduction time of MIDI music;
According to the time arranging according to note, for every segment music, determine the time of occurrence of different role and its corresponding behavior in scene.In the present embodiment, according to the time of second of the first trifle note bass 6, determine the time of occurrence of Young Pioneer teenager and rowing action; According to the time of second of the 5th trifle note 1, determine the time of occurrence of canoe, according to the time of the 6th trifle first note 5, determine that wave and canoe push wave action open.The set of time of other roles, behavior, scene is similar to the above.
Step 207, sets visual angle route of transition, and the visual angle between each animated element is changed mutually and is connected.
This step arranges visual angle route of transition, determines the visual angle of each animated element and the excessive relation between element, carries out processing, the optimization process of visual effect, makes the play smooth nature of animation.
Further, can also in cartoon material storehouse, extract corresponding Word message, carry out after art is processed joining in animation, realize the explanation of animation, highlight the effects such as content.Can also carry out word extraction according to lyrics information, generate corresponding captions and show, the accompaniment rail in MIDI music is added in animation, form Karaoke music file.
The embodiment of the present invention, for the music that has the lyrics, builds animated element and corresponding relation thereof by lyrics analysis, demonstrates the content of lyrics expression by the broadcasting of animation, and performing content is abundant.In addition, the animation of generation has increased the recreational of music, has improved user's Experience Degree.
With reference to Fig. 3, show a kind of schematic diagram that MIDI music is generated to the system embodiment of animation of the present invention, comprising:
Music analysis module 301, for MIDI music being carried out to the analysis of music structure, obtains the time attribute of music analysis result and music;
Element builds module 302, for according to preset cartoon material storehouse and above-mentioned music analysis result, the parameter by presetting rule or user's input builds each animated element and corresponding relation thereof;
Animation synthesis module 303, for being combined into animation according to described time attribute by each animated element and corresponding relation thereof.
First, the MIDI music that 301 pairs of music analysis modules will be changed is carried out the music structure analysis about note, syllable, phrase, period, track, and reproduction time corresponding to definite note, obtain time attribute, then music structure analysis result is input to element and builds module 302; Element builds module 302 and utilizes role, behavior, the scene of determining animation in music analysis result and cartoon material storehouse by the parameter of presetting rule or user's input, generates animated element list and corresponding relation thereof; Finally, animated element list and corresponding relation thereof that the time attribute that animation synthesis module 303 obtains according to music analysis module 301 and element build module 302 generations combine each animated element and corresponding relation thereof, finally form animation.
In a preferred embodiment of the invention, described system also comprises:
Lyrics analysis module 304, for when described MIDI music has the lyrics, carries out the analysis of lyrics information, obtains lyrics analysis result;
Lyrics analysis module 304 is input to described lyrics analysis result in element structure module 302, and element builds module 302 and according to preset cartoon material storehouse, music analysis result and described lyrics analysis result, carries out the structure of each animated element and corresponding relation thereof.
Further, at element described in the preferred embodiment of the present invention, building module 302 comprises:
Daughter element construction unit 3021, builds for one or more combination by note analysis, syllable analysis and lemma analysis the animated element that comprises role, behavior, subfield scape, builds the corresponding relation of above-mentioned each animated element by grammatical analysis;
Total scene construction unit 3022, builds for one or more combination of analyzing by phrase analysis, period analysis, track analysis and Sentence analysis, paragraph analysis, chapters and sections the total scene being comprised of corresponding subfield scape.
Preferably, described animation synthesis module 303 comprises:
Element integral unit 3031, for adding corresponding role, behavior and carrying out integral body and synthesize in described total scene;
Time synchronized unit 3032, the time occurring, makes animation synchronize with the reproduction time of MIDI music for set each animated element according to described time attribute.
Further, described animation synthesis module 303 also comprises:
Visual angle conversion unit 3033, for setting visual angle route of transition, changes the visual angle between each animated element to be connected.
Each embodiment in this instructions all adopts the mode of going forward one by one to describe, and each embodiment stresses is the difference with other embodiment, between each embodiment identical similar part mutually referring to.For system embodiment, because it is substantially similar to embodiment of the method, so description is fairly simple, relevant part is referring to the part explanation of embodiment of the method.
Above to a kind of method and system that MIDI music is generated to animation provided by the present invention, be described in detail, applied specific case herein principle of the present invention and embodiment are set forth, the explanation of above embodiment is just for helping to understand method of the present invention and core concept thereof; , for one of ordinary skill in the art, according to thought of the present invention, all will change in specific embodiments and applications, in sum, this description should not be construed as limitation of the present invention meanwhile.
Claims (10)
1. MIDI music is generated to a method for animation, it is characterized in that, comprising:
MIDI music is carried out to the analysis of music structure, obtain the time attribute of music analysis result and music;
Parameter according to preset cartoon material storehouse and above-mentioned music analysis result by presetting rule or user's input builds each animated element and corresponding relation thereof;
According to described time attribute, each animated element and corresponding relation thereof are combined into animation;
Each animated element of described structure and corresponding relation thereof specifically comprise:
By one or more combination in note analysis, syllable analysis and lemma analysis, build the animated element that comprises role, behavior, subfield scape, by grammatical analysis, build the corresponding relation of above-mentioned each animated element; One or more combination in analyzing by phrase analysis, period analysis, track analysis and Sentence analysis, paragraph analysis, chapters and sections builds the total scene being comprised of corresponding subfield scape.
2. method according to claim 1, is characterized in that, the analysis of described music structure comprises: one or more in analyzing of note analysis, syllable analysis, phrase analysis, period analysis, track.
3. method according to claim 2, is characterized in that, while having the lyrics in described MIDI music, described method also comprises:
Carry out the analysis of lyrics information, obtain lyrics analysis result;
Described lyrics analysis result is incorporated in the structure of each animated element and corresponding relation thereof.
4. method according to claim 3, is characterized in that, the analysis of described lyrics information comprises: one or more in analyzing of lemma analysis, grammatical analysis, Sentence analysis, paragraph analysis, chapters and sections.
5. method according to claim 1, is characterized in that, describedly each animated element and corresponding relation thereof are combined into animation specifically comprise:
In described total scene, add corresponding role, behavior and carry out integral body and synthesize;
According to described time attribute, set the time that each animated element occurs, animation is synchronizeed with the reproduction time of MIDI music.
6. method according to claim 5, is characterized in that, describedly each animated element and corresponding relation thereof are combined into animation specifically also comprise:
Set visual angle route of transition, the visual angle between each animated element is changed and is connected.
7. MIDI music is generated to a system for animation, it is characterized in that, comprising:
Music analysis module, for MIDI music being carried out to the analysis of music structure, obtains the time attribute of music analysis result and music;
Element builds module, for according to preset cartoon material storehouse and above-mentioned music analysis result, the parameter by presetting rule or user's input builds each animated element and corresponding relation thereof;
Animation synthesis module, for being combined into animation according to described time attribute by each animated element and corresponding relation thereof;
Described element builds module and comprises: daughter element construction unit, for one or more combination by note analysis, syllable analysis and lemma analysis, build the animated element that comprises role, behavior, subfield scape, by grammatical analysis, build the corresponding relation of above-mentioned each animated element; Total scene construction unit, builds for one or more combination of analyzing by phrase analysis, period analysis, track analysis and Sentence analysis, paragraph analysis, chapters and sections the total scene being comprised of corresponding subfield scape.
8. system according to claim 7, is characterized in that, described system also comprises:
Lyrics analysis module, for when described MIDI music has the lyrics, carries out the analysis of lyrics information, obtains lyrics analysis result;
Lyrics analysis module is input to described lyrics analysis result in element structure module, and element builds module and according to preset cartoon material storehouse, music analysis result and described lyrics analysis result, carries out the structure of each animated element and corresponding relation thereof.
9. system according to claim 7, is characterized in that, described animation synthesis module comprises:
Element integral unit, for adding corresponding role, behavior and carrying out integral body and synthesize in described total scene;
Time synchronized unit, the time occurring, makes animation synchronize with the reproduction time of MIDI music for set each animated element according to described time attribute.
10. system according to claim 9, is characterized in that, described animation synthesis module also comprises: visual angle conversion unit, for setting visual angle route of transition, changes the visual angle between each animated element to be connected.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201010136575.8A CN101853668B (en) | 2010-03-29 | 2010-03-29 | Method and system for transforming MIDI music into cartoon |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201010136575.8A CN101853668B (en) | 2010-03-29 | 2010-03-29 | Method and system for transforming MIDI music into cartoon |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN101853668A CN101853668A (en) | 2010-10-06 |
| CN101853668B true CN101853668B (en) | 2014-10-29 |
Family
ID=42805123
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201010136575.8A Expired - Fee Related CN101853668B (en) | 2010-03-29 | 2010-03-29 | Method and system for transforming MIDI music into cartoon |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN101853668B (en) |
Families Citing this family (13)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN104392729B (en) * | 2013-11-04 | 2018-10-12 | 贵阳朗玛信息技术股份有限公司 | A kind of providing method and device of animated content |
| CN104320889A (en) * | 2014-11-10 | 2015-01-28 | 苏州乐聚一堂电子科技有限公司 | Method for changing basic brightness level through action induction |
| KR102358025B1 (en) * | 2015-10-07 | 2022-02-04 | 삼성전자주식회사 | Electronic device and music visualization method thereof |
| CN105355193B (en) * | 2015-10-30 | 2020-09-25 | 百度在线网络技术（北京）有限公司 | Speech synthesis method and device |
| CN107507629B (en) * | 2017-08-16 | 2020-08-25 | 重庆科技学院 | Thermal touch music perception system and control method thereof |
| CN108174498A (en) * | 2017-12-28 | 2018-06-15 | 福建海媚数码科技有限公司 | A kind of control method and system of the scene lamp based on intelligent Matching |
| JP6699677B2 (en) * | 2018-02-06 | 2020-05-27 | ヤマハ株式会社 | Information processing method, information processing apparatus, and program |
| CN109615682A (en) * | 2018-12-07 | 2019-04-12 | 北京微播视界科技有限公司 | Animation producing method, device, electronic equipment and computer readable storage medium |
| CN110766443A (en) * | 2019-09-09 | 2020-02-07 | 浙江大搜车软件技术有限公司 | Material acquisition method and device, computer equipment and storage medium |
| CN110753245A (en) * | 2019-09-30 | 2020-02-04 | 深圳市嘀哒知经科技有限责任公司 | Audio and animation synchronous coordinated playing method and system and terminal equipment |
| CN111770375B (en) * | 2020-06-05 | 2022-08-23 | 百度在线网络技术（北京）有限公司 | Video processing method and device, electronic equipment and storage medium |
| CN114363698A (en) * | 2022-01-14 | 2022-04-15 | 北京华亿创新信息技术股份有限公司 | Sports event admission ceremony type sound and picture generation method, device, equipment and storage medium |
| CN114446323B (en) * | 2022-01-25 | 2023-03-10 | 电子科技大学 | Dynamic multi-dimensional music emotion analysis method and system |
Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2006126687A1 (en) * | 2005-05-27 | 2006-11-30 | Matsushita Electric Industrial Co., Ltd. | Display device |
| CN1885976A (en) * | 2005-06-24 | 2006-12-27 | 英华达(上海)电子有限公司 | Method for making sound graphic display and playing on mobile phone display screen |
| CN101141603A (en) * | 2006-09-06 | 2008-03-12 | 富士胶片株式会社 | Method, program and apparatus for generating scenario for music-and-image-synchronized motion picture |
| CN101546587A (en) * | 2008-03-25 | 2009-09-30 | 国际商业机器公司 | Method and device for automatically displaying visual elements in song-playing process |
-
2010
- 2010-03-29 CN CN201010136575.8A patent/CN101853668B/en not_active Expired - Fee Related
Patent Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2006126687A1 (en) * | 2005-05-27 | 2006-11-30 | Matsushita Electric Industrial Co., Ltd. | Display device |
| CN1885976A (en) * | 2005-06-24 | 2006-12-27 | 英华达(上海)电子有限公司 | Method for making sound graphic display and playing on mobile phone display screen |
| CN101141603A (en) * | 2006-09-06 | 2008-03-12 | 富士胶片株式会社 | Method, program and apparatus for generating scenario for music-and-image-synchronized motion picture |
| CN101546587A (en) * | 2008-03-25 | 2009-09-30 | 国际商业机器公司 | Method and device for automatically displaying visual elements in song-playing process |
Also Published As
| Publication number | Publication date |
|---|---|
| CN101853668A (en) | 2010-10-06 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN101853668B (en) | Method and system for transforming MIDI music into cartoon | |
| CN101901595B (en) | Method and system for generating animation according to audio music | |
| Larsen | Film music | |
| Potter et al. | The Ashgate research companion to minimalist and postminimalist music | |
| Webb | Music analysis down the (You) tube? Exploring the potential of cross-media listening for the music classroom | |
| Knight | The intersection of improvisation and composition: A music practice in flux | |
| Serhaniuk et al. | Genre in the music communication system and the artist's mission | |
| Washburne | Salsa Romántica: an analysis of style | |
| Rogers | The musical script: Norman McLaren, animated sound, and audiovisuality | |
| Massey | Thomas Adès in Five Essays | |
| Leung | Creativity in Cantonese operatic singing: Analysis of excerpts from Hu Bu Gui by three artists as examples | |
| Takanori et al. | Nō and kyōgen: music from the medieval theatre | |
| Kapilow | All you have to do is listen: Music from the inside out | |
| Oddekalv | What makes the shit dope | |
| Bakker | Two responses to modernism: minimalism and new complexity in solo flute repertoire | |
| Fuzai | Synesthesia of Music and Image | |
| O'Reilly | Who we be: the musical and social aesthetics of grime in London | |
| Mamidipudi et al. | Raga and the Problem of Ownership: Knowledge and Culture in Carnatic Music | |
| Theisen | A multifaceted approach to analyzing form in Elliott Carter's Boston Concerto | |
| Belcher | Contemporary Improvised Music Methodologies, Modes of Reading, and Hybridity of Notation in Burr Van Nostrand’s Voyage in a White Building I and Ae. M/Four-Mile Run for fixed media and optional performers | |
| Fragomeni | Optimality Theory and the Semiotic Triad: A New Approach for Songwriting, Sound Recording, and Artistic Analysis | |
| Marshall | Constraint and creative decision making in the composition of concert works, film and video-game soundtracks | |
| Gustavson | Exploring a Pantheon of Styles: Musical eclecticism in Treasure Planet | |
| Hansen et al. | Negotiating girlhood in rock music: Nandi Bushell, prodigy discourse and adult mentor-fans | |
| Li et al. | The Artistic Characteristics of Hisaishi Film Score and its Dissemination in China |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| C14 | Grant of patent or utility model | ||
| GR01 | Patent grant | ||
| C41 | Transfer of patent application or patent right or utility model | ||
| TR01 | Transfer of patent right |
Effective date of registration: 20151218 Address after: 519031 Guangdong city of Zhuhai province Hengqin Baohua Road No. 6, room 105 -478 Patentee after: Guangdong Zhongxing Electronics Co.,Ltd. Address before: 100083 Haidian District, Xueyuan Road, No. 35, the world building, the second floor of the building on the ground floor, No. 16 Patentee before: VIMICRO Corp. |
|
| CF01 | Termination of patent right due to non-payment of annual fee | ||
| CF01 | Termination of patent right due to non-payment of annual fee |
Granted publication date: 20141029 |