CN101853668A - Method and system for transforming MIDI music into cartoon - Google Patents
Method and system for transforming MIDI music into cartoon Download PDFInfo
- Publication number
- CN101853668A CN101853668A CN201010136575A CN201010136575A CN101853668A CN 101853668 A CN101853668 A CN 101853668A CN 201010136575 A CN201010136575 A CN 201010136575A CN 201010136575 A CN201010136575 A CN 201010136575A CN 101853668 A CN101853668 A CN 101853668A
- Authority
- CN
- China
- Prior art keywords
- analysis
- music
- lyrics
- animation
- animated element
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
- 238000000034 method Methods 0.000 title claims abstract description 40
- 230000001131 transforming effect Effects 0.000 title abstract 2
- 230000000007 visual effect Effects 0.000 claims abstract description 23
- 239000000463 material Substances 0.000 claims abstract description 19
- 230000009466 transformation Effects 0.000 claims abstract description 7
- 230000015572 biosynthetic process Effects 0.000 claims description 10
- 238000003786 synthesis reaction Methods 0.000 claims description 10
- 230000001360 synchronised effect Effects 0.000 claims description 9
- 230000007704 transition Effects 0.000 claims description 9
- 238000010276 construction Methods 0.000 claims description 7
- 238000006243 chemical reaction Methods 0.000 claims description 6
- 230000008676 import Effects 0.000 claims description 6
- 230000000875 corresponding effect Effects 0.000 description 67
- 230000009471 action Effects 0.000 description 12
- XLYOFNOQVPJJNP-UHFFFAOYSA-N water Substances O XLYOFNOQVPJJNP-UHFFFAOYSA-N 0.000 description 10
- 238000010586 diagram Methods 0.000 description 8
- 230000008859 change Effects 0.000 description 7
- 230000008569 process Effects 0.000 description 6
- 235000002493 Salix babylonica Nutrition 0.000 description 4
- 239000004020 conductor Substances 0.000 description 4
- 241000734985 Salix x sepulcralis Species 0.000 description 3
- 230000000694 effects Effects 0.000 description 3
- 238000005516 engineering process Methods 0.000 description 3
- 230000000366 juvenile effect Effects 0.000 description 3
- 239000000203 mixture Substances 0.000 description 3
- 230000033764 rhythmic process Effects 0.000 description 3
- 241000531807 Psophiidae Species 0.000 description 2
- 238000010009 beating Methods 0.000 description 2
- 230000008901 benefit Effects 0.000 description 2
- 238000007664 blowing Methods 0.000 description 2
- 239000003086 colorant Substances 0.000 description 2
- 230000000295 complement effect Effects 0.000 description 2
- 230000008451 emotion Effects 0.000 description 2
- 239000012467 final product Substances 0.000 description 2
- 241001465754 Metazoa Species 0.000 description 1
- 244000020191 Salix babylonica Species 0.000 description 1
- ZYXYTGQFPZEUFX-UHFFFAOYSA-N benzpyrimoxan Chemical compound O1C(OCCC1)C=1C(=NC=NC=1)OCC1=CC=C(C=C1)C(F)(F)F ZYXYTGQFPZEUFX-UHFFFAOYSA-N 0.000 description 1
- 230000005540 biological transmission Effects 0.000 description 1
- 239000000470 constituent Substances 0.000 description 1
- 230000006870 function Effects 0.000 description 1
- 239000003607 modifier Substances 0.000 description 1
- 238000005457 optimization Methods 0.000 description 1
- 230000008521 reorganization Effects 0.000 description 1
- 238000004088 simulation Methods 0.000 description 1
- 230000003068 static effect Effects 0.000 description 1
- 239000002352 surface water Substances 0.000 description 1
Images
Landscapes
- Auxiliary Devices For Music (AREA)
- Processing Or Creating Images (AREA)
Abstract
The invention provides a method and a system for transforming MIDI music into cartoons. The method comprises the following steps: analyzing the musical structure of MIDI music to obtain musical analysis results and the time attribute of the music; constructing each animation element and corresponding relationships thereof based on preset rules or parameters input by the user in accordance with a preset animation material library and the musical analysis results; and combining the animation elements and the corresponding relationships thereof to form cartoons according to the time attribute. The invention can realize the transformation of the MIDI music into the visual information with rich contents related to the contents expressed in the music, thereby achieving the visual and audio binding of the cartoons and music, and satisfying needs of simultaneous and unified visual and audio enjoyment.
Description
Technical field
The present invention relates to the electronic music technical field of data processing, particularly relate to a kind of MIDI music generation cartoon method and system.
Background technology
Along with growth in the living standard, people enter in the daily life gradually for the appreciation of music, become the important way of amusement and recreation.Usually, people's playing back music just satisfies enjoyment acoustically, still experiences the information of music expression with eyes, but awaits people's R and D.
Common a kind of method is to make the different structure element of forming music corresponding with different colors, with the change transitions of music is change in color, music attribute according to the different colours representative, change by the variation of color category and the depth of color, the performing content that reflects music, for example cheerful and light-hearted still melancholy, it is still fierce to releive.Also has a kind of method, be that music is combined with color and several picture, broadcast along with music, the distortion of colorific variation and several picture and reorganization, this method has increased geometric variation, compared with independent change color, increased manifestation mode, relatively more directly perceived, the user can according to the variation patterns of figure and speed, obtain the musical content.Said method only obtains the style of music expression and rhythm etc., and the performing content dullness can't be expressed contents such as the personage in the music, scene, action, lacks expressive force.
Instrument devices digital interface (MIDI, Musical Instrument Digital Interface) technology is the application of computer multimedia technology in audio area.Be different from digital waveform audio files such as MP3, WAV, waveform to sound is sampled, itself does not write down any sound waveform the MIDI file, only writes down following information: certain MIDI passage and certain time send the information that certain musical instrument need come sounding with what state (comprising pitch, dynamics, volume, reverberation etc.) to sound-producing devices such as MIDI compositors.MIDI transmission be not voice signal, but instructions such as note, controlled variable, what its indication MIDI equipment will be done, how to do, and for example plays which note, much volumes, what tone finish, in addition what accompaniment or the like.The MIDI system is actual to be exactly the performance system of a composition, orchestration, electronic simulation.Therefore, comprise lot of data information in the MIDI music, be easy to carry out operational processes.
Based on the characteristics of MIDI music, need the problem that those skilled in the art solve to be exactly at present: how the MIDI music is generated as abundant in content, with the corresponding visual information of content of music expression.
Summary of the invention
Technical matters to be solved by this invention provides and a kind of the MIDI music is generated cartoon method and system, the MIDI music can be generated as abundant in content, with the corresponding visual information of content of music expression.
In order to address the above problem, the invention discloses and a kind of the MIDI music is generated cartoon method, comprising:
The MIDI music is carried out the analysis of music structure, obtain the time attribute of music analysis result and music;
Make up each animated element and corresponding relation thereof according to cartoon material storehouse of presetting and above-mentioned music analysis result by the parameter that presetting rule or user import;
According to described time attribute each animated element and corresponding relation thereof are combined into animation.
Preferably, the analysis of described music structure comprises: one or more during note analysis, syllable analysis, phrase analysis, period analysis, track are analyzed.
Preferably, when in the described MIDI music lyrics being arranged, described method also comprises:
Carry out the analysis of lyrics information, obtain lyrics analysis result;
Described lyrics analysis result is incorporated in the structure of each animated element and corresponding relation thereof.
Preferably, the analysis of described lyrics information comprises: one or more during lemma analysis, grammatical analysis, statement analysis, paragraph analysis, chapters and sections are analyzed.
Further, each animated element of described structure and corresponding relation thereof specifically comprise:
Make up the animated element that comprises role, behavior, sub-scene by one or more combination in note analysis, syllable analysis and the lemma analysis, make up the corresponding relation of above-mentioned each animated element by grammatical analysis;
Make up total scene of forming by corresponding sub-scene by one or more combination in phrase analysis, period analysis, track analysis and statement analysis, paragraph analysis, the chapters and sections analysis.
Further, describedly each animated element and corresponding relation thereof be combined into animation specifically comprise:
In described total scene, add corresponding role, behavior and carry out integral body and synthesize;
Set the time that each animated element occurs according to described time attribute, make the reproduction time of animation and MIDI music synchronous.
Preferably, describedly each animated element and corresponding relation thereof be combined into animation specifically also comprise:
Set the visual angle route of transition, the transformation of the visual angle between each animated element is connected.
In addition, the invention also discloses a kind of system, comprising MIDI music generation animation:
The music analysis module is used for the MIDI music is carried out the analysis of music structure, obtains the time attribute of music analysis result and music;
Element makes up module, is used for making up each animated element and corresponding relation thereof according to cartoon material storehouse of presetting and above-mentioned music analysis result by the parameter that presetting rule or user import;
The animation synthesis module is used for according to described time attribute each animated element and corresponding relation thereof being combined into animation.
Preferably, described system also comprises:
Lyrics analysis module is used for carrying out the analysis of lyrics information when described MIDI music has the lyrics, obtains lyrics analysis result;
Then lyrics analysis module is input to described lyrics analysis result in the element structure module, and element makes up module is carried out each animated element and corresponding relation thereof according to the cartoon material storehouse, music analysis result and the described lyrics analysis result that preset structure.
Preferably, described element structure module comprises:
The daughter element construction unit is used for making up the animated element that comprises role, behavior, sub-scene by one or more combination of note analysis, syllable analysis and lemma analysis, makes up the corresponding relation of above-mentioned each animated element by grammatical analysis;
Total scene construction unit, one or more combination that is used for analyzing by phrase analysis, period analysis, track analysis and statement analysis, paragraph analysis, chapters and sections makes up total scene of being made up of corresponding sub-scene.
Preferably, described animation synthesis module comprises:
The element integral unit is used for adding corresponding role, behavior and carrying out integral body and synthesize in described total scene;
The time synchronized unit is used for setting the time that each animated element occurs according to described time attribute, makes the reproduction time of animation and MIDI music synchronous.
Preferably, described animation synthesis module also comprises: the visual angle conversion unit, be used to set the visual angle route of transition, and the transformation of the visual angle between each animated element is connected.
Compared with prior art, the present invention has the following advantages:
The present invention carries out the analysis of music structure to the MIDI music, chooses each animated element and corresponding relation thereof by the parameter of presetting rule or user's input from the cartoon material storehouse; Time attribute according to the MIDI music is combined into animation with each animated element and corresponding relation thereof at last.The present invention interrelates MIDI music and animated element, for the music that does not have the lyrics, by system definition or user the corresponding animation of generation is set, final Music Television (MTV) (the MV that forms, Music Television) animation, realize the audiovisual binding of animation and music, satisfy that the sense of hearing and vision are enjoyed simultaneously, mutual unified demand.In addition, for the music that the lyrics are arranged, make up animated element and relation thereof by lyrics analysis, the animation of generation can give expression to the content of the lyrics, and abundant expression forms is more proper with the performance of music.
In a word, the present invention can generate the animation that is complementary with music with the MIDI music according to the characteristics of MIDI music, has realized the audiovisual binding, has improved user's Experience Degree, has increased the recreational of music.
Description of drawings
Fig. 1 is a kind of process flow diagram that the MIDI music is generated cartoon method embodiment of the present invention;
Fig. 2 is a kind of process flow diagram that the MIDI music is generated the cartoon method preferred embodiment of the present invention;
Fig. 3 is a kind of synoptic diagram that the MIDI music is generated the system embodiment of animation of the present invention;
Fig. 4 is the music score synoptic diagram of the described one section MIDI music correspondence of the inventive method preferred embodiment.
Embodiment
For above-mentioned purpose of the present invention, feature and advantage can be become apparent more, the present invention is further detailed explanation below in conjunction with the drawings and specific embodiments.
The present invention is mated music and animated element by the analysis to the MIDI music, and the MIDI music generates the animation of corresponding contents the most at last, and the animation that makes the user can watch different music to present has been realized the unification of Voice ﹠ Video.
With reference to Fig. 1, show a kind of process flow diagram of the present invention with MIDI music generation cartoon method embodiment, comprise the steps:
Step 101 is carried out the analysis of music structure to the MIDI music, obtains the time attribute of music analysis result and music;
The least unit of music structure is a note, and by the note groups syllabication, phrase formed in syllable, phrase recomposition period, and each period is formed a track, and track is divided into melody rail, accompaniment rail and background rail, forms a first complete music by each track.Accordingly, the analysis of music structure comprises: note analysis, syllable analysis, phrase analysis, period analysis, track analysis.
Analysis is the time of determining that each note occurs in whole M IDI music for note, makes note corresponding with the time, obtains the time attribute of music.The analysis of syllable is to analyze the note that each trifle syllable is comprised, and determines structure of a chord under the syllable according to note.Analysis for phrase is to analyze the syllable that meets the chord rule to form.Analysis for period is a composition of analyzing the phrase that meets the chord rule, thereby determines the situation of change of chord along with music, further obtains the variation of the degree of stability of music.In general, I chord and VI chord are stable, and II chord and IV chord are more stable, V chord and III chord instability.For the analysis of track, be analyze the length of melody rail, accompaniment rail and rhythm rail, just, strong and weak note forms, and obtains the representation style of music, for example releive or cheerful and light-hearted.
Step 102 makes up each animated element and corresponding relation thereof according to cartoon material storehouse of presetting and above-mentioned music analysis result by the parameter that presetting rule or user import;
Store a large amount of figure materials in the cartoon material storehouse of presetting, for example normal man's shape library, performance band shape library, all kinds of animals graphics storehouse, background graphics storehouse, character and graphic storehouse etc.Make up each animated element and corresponding relation thereof according to the music analysis result of step 101 and the cartoon material storehouse of presetting, can be according to the rule of system intialization, also can be according to the parameter of user's input.
For example,, judge that this music is that symphony is played,, from the cartoon material storehouse, select to play roles such as philharmonic society's figure, conductor's figure, drummer's figure, trumpeter's figure and make up role's tabulation then according to the rule of system intialization according to the analysis of music; Simultaneously, select to have the figure of playing the hall and make up the scene tabulation; And determine that each role's corresponding action makes up the behavior act tabulation, as commanding action, the action of beating a drum, playing wind instruments action etc.Can be the variation of chord among the above-mentioned music analysis result is corresponding with the background color variation according to the rule of system intialization, for example give yellow stage background for the steady I chord; Give red stage background etc. for unsettled V chord.Can also be provided with according to the parameter of user's input, as carry out the selection of figure according to the scale of performance band, the background color in performance hall etc.At last, carry out corresponding with element in the action lists element in the role tabulation: conductor and commander move corresponding; The drummer is corresponding with the action of beating a drum; The trumpeter is with to play wind instruments action corresponding etc.
In addition, can also set other animated element flexibly according to the music analysis result, for example play the lighting effects of stage, suppose to obtain by the analysis of track, the last period, the melody of music was releived, and light is set is the soft yellow of expression; The melody of middle one section music is cheerful and light-hearted, light is set is the fierce redness of expression, and the melody of final stage music is quiet, and the color that light then is set is for blue.
Step 103 is combined into animation according to described time attribute with each animated element and corresponding relation thereof.
The time definite according to note, for every segment music, determine the time of occurrence of different role and its corresponding behavior in the scene, a certain role's appearance can be corresponded on the time of a certain appointment note, perhaps that a certain role's behavior act is corresponding with the time of another appointment note.This step is set the time that different role occurs according to time attribute, when for example beginning, according to the time of first first note of phrase, the animation that band plays together occurs playing in playing the hall scene; Afterwards, the time according to second first note of phrase, cartoon role is replaced with the conductor, the animation that picture conversion conducts orchestra for the conductor; Then, the time according to the 3rd first note of phrase, cartoon role is replaced with the drummer, the cartoon scene that picture conversion is beaten a drum for the drummer finally makes the reproduction time of music consistent with the reproduction time of animation.At last,, set the pilot route of transition, the transformation of each role, scene is connected by the holistic approach of MIDI music.
The embodiment of the invention is carried out the analysis of music structure to the MIDI music, for the music that does not have the lyrics, by the parameter of presetting rule or user's input, extract cartoon material with music expression characteristic, by each animated element and corresponding relation thereof it is combined into animation.This method can enough visually-perceptible music change information, by the MIDI music is combined with the animation of conversion, generate the MV animation, realized that the audiovisual of animation and music is bound, satisfy that the sense of hearing and vision are enjoyed simultaneously, mutual unified demand.
For the situation that comprises the lyrics in the MIDI music, except the analysis of music structure, can also analyze the lyrics, make up corresponding animated element according to the analysis result of the lyrics, the performance that makes animation is corresponding with the content that the lyrics are expressed.
With reference to Fig. 2, show a kind of process flow diagram that the MIDI music is generated the cartoon method preferred embodiment of the present invention.With song " let us has swung two oars " is example:
Choose one section MIDI music, as shown in Figure 4, be the music score synoptic diagram of the described one section MIDI music correspondence of the inventive method preferred embodiment, its corresponding lyrics are: " let us has swung two oars; canoe is pushed wave open, and beautiful White Tower is being reflected on the sea, surrounded by the red wall of greenery.Canoe drifts in water gently, has head-on blown nice and cool wind." above-mentioned MIDI music of being furnished with the lyrics is generated animation.Describe the preferred embodiment of the present invention in detail according to above-mentioned music below, comprise step:
Step 201 is carried out the analysis of music structure to the MIDI music, obtains the time attribute of music analysis result and music;
The analysis of described music structure comprises: note analysis, syllable analysis, phrase analysis, period analysis, track analysis.The time that each note occurs is determined in analysis in whole M IDI music according to note, makes note corresponding with the time.The MIDI music is carried out the syllable analysis, normally analyze the melody rail, be i.e. that less rail of note overlap ratio.Each syllable is given one or more chord attributes according to the composition of note, gives a chord attribute to a syllable in the present embodiment.As syllable
Give VI chord,
Give III chord.Chord attribute to each syllable carries out the phrase analysis, obtains meeting the phrase of music rule, and the music rule is that chord carries out rule, as following several syllables:
Be that a VI-III-III-VI chord carries out, analyze being changed to of obtaining and revolve: stablize chord-unstable chord-unstable chord-stablize chord, the chord that is a rule carries out.In this step, can be to the analysis of music structure in conjunction with lyrics information, the punctuation mark by the lyrics carries out pre-service to the phrase of MIDI music.In the present embodiment, draw above-mentioned preceding four syllables by the punctuation mark analysis and form a reasonable phrase, the analysis classes of other phrase seemingly.
Roughly determine period according to the multiplicity of phrase and the multiplicity of the lyrics, period formed in several phrases.Whole song can be divided into three periods in this song, and present embodiment is only analyzed at previous period.In addition, the MIDI music not only comprises the melody rail, also comprises rhythm rail (drum rail, low track etc.), accompaniment rail etc. usually.Some note multiplicities are than higher in this class track, can obtain cadence information to the analysis of these tracks, for the structure of animated graphics provides reference frame.For the analysis of track, the representation style that obtains music is for releiving.In addition, comprised information such as speed, beat, musical instrument in the MIDI music usually, these information also are the bases of above each music structure analysis.
Step 202 is carried out the analysis of lyrics information, obtains lyrics analysis result;
The analysis of described lyrics information comprises: lemma analysis, grammatical analysis, statement analysis.A lyrics text is from see a character string of being made up of Chinese character (comprising punctuation mark etc.) in form.Can form lemma by word, can form sentence, and then form paragraph, chapters and sections by some sentences by lemma.
To the analysis of lemma, can utilize segmenting method based on string matching, according to certain strategy Chinese character string to be analyzed and the entry that presets in the dictionary are mated, if find certain character string in dictionary, then the match is successful, identifies a lemma; Also can utilize based on the segmenting method of understanding, allow the understanding of anthropomorphic distich of computer mould, its basic thought is to carry out sentence structure, semantic analysis in participle, utilizes syntactic information and semantic information to handle the ambiguity phenomenon, reaches the effect of identification speech; Can also utilize segmenting method based on statistics, because lemma is the combination of stable word, so the number of times that adjacent word occurs simultaneously is many more, just might constitute a speech more, utilize the frequency of word and the adjacent co-occurrence of word or the confidence level of the speech that probability reflects, frequency to the combination of each word of adjacent co-occurrence is added up, and calculates their information that appears alternatively, thereby carries out lemma identification.By the lemma analysis, obtain the implication that each lemma is expressed, whom for example is, what things, what behavior, what scene etc.
Grammatical analysis is to analyze by determining the part of speech that usage is used, the inflection of speech or other means and function and the relation of analysing word in sentence of expression mutual relationship.By the constituent of parsing sentence, determine attribute, the adverbial modifier, complement, subject, predicate, object, understand the relation between the lemma, thereby determine the meaning that sentence is expressed.
Statement is to be made of related one group of speech on a speech or the sentence structure, by the statement analysis, can draw opinion, hope or the artistic conception etc. of each minor sentence expression of the lyrics.Paragraph and chapters and sections are article thoughts when expressing because transfer, emphasize, the literal that situation caused pause such as intermittence.By the analysis of paragraph and chapters and sections, lyrics content is divided, determine contents such as each part emotion to be expressed, artistic conception.
Step 203 makes up the animated element that comprises role, behavior, sub-scene by note analysis, syllable analysis, melody analysis and lemma analysis, makes up the corresponding relation of above-mentioned each animated element by grammatical analysis;
Note in the MIDI music, phrase, period be word or lemma, statement, paragraph or the chapters and sections of the corresponding lyrics respectively.The speed that obtains in the music analysis, style information can be in conjunction with the emotion of the lyrics construction basis as the figure style.By " we, two oar, canoe, wave, sea, White Tower, greenery, Hong Qiang, water, wind ", these lemmas are analyzed, can from the cartoon material storehouse, choose corresponding people, thing, scape figures, Young Pioneer teenager for example, quant, canoe, weeping willow, red wall isogonism chromatic graph shape, the sub-scene figure of the blue water surface, green hill greenery further adds these figures in role's tabulation and the tabulation of sub-scene.By the analysis of " swung, push open, waft, blown " these lemmas, make up behavior tabulations such as rowing the boat, push open, blow.
By grammatical analysis, make up the corresponding relation of list element between role's tabulation, the tabulation of sub-scene, the behavior tabulation.Corresponding as Young Pioneer teenager, quant and the behavior of rowing the boat; Canoe, wave and the action of pushing open are corresponding; Wind is corresponding with the action of blowing; Canoe, White Tower are corresponding with the sub-scene of the blue water surface; Weeping willow, red wall are corresponding with the sub-scene of green hill greenery etc.
Step 204 makes up total scene of being made up of corresponding sub-scene by one or more combination in phrase analysis, period analysis and statement analysis, paragraph analysis, the chapters and sections analysis;
The cadence information that obtains in the music structure analysis can provide foundation for the tempo variation of figure.Analyze by each sentence the lyrics, obtain the situation of each expression, the lyrics section that provides in this example is analyzed, obtain the content that this paragraph is expressed, corresponding relation according to each lyrics statement and MIDI music phrase, in sub-scene tabulation, extract each sub-scene, corresponding relation according to lyrics paragraph and music period, each sub-scene is combined into a total scene, and this total scene has transformation angle according to the appearance of sub-scene: around the blue water surface-water surface-and green hill greenery-blue water surface.
Step 205 adds corresponding role, behavior and carries out integral body and synthesize in described total scene;
Join total scene with the character graphic of Young Pioneer teenager, quant is corresponding with the behavior of rowing the boat; Join total scene with the character graphic of canoe, wave is corresponding with the action of pushing open; Join in total scene the figure of wind is corresponding with the action of blowing.Other roles such as White Tower, weeping willow, red wall etc. join in total scene successively as static graphics.Integrate to form animation at last: several Young Pioneer teenagers that are seated in the canoe, hold quant in the juvenile hand and row the boat, the canoe wave that rises in the water surface that drifts; The water surface is reflecting White Tower, water around planting weeping willow, around red wall; Gentle breeze blows afloat, and canoe drifts in water, and Young Pioneer juvenile in the ship waves with the wind.
Step 206 is set the time that each animated element occurs according to time attribute, makes the reproduction time of animation and MIDI music synchronous;
According to the time that is provided with according to note,, determine the time of occurrence of different role and its corresponding behavior in the scene for every segment music.In the present embodiment,, determine the time of occurrence that Young Pioneer is juvenile and paddle is moved according to the time of second note bass 6 of first trifle; According to the time of second note 1 of the 5th trifle, determine the time of occurrence of canoe, according to the time of first note 5 of the 6th trifle, determine that wave and canoe push wave action open.The time of other roles, behavior, scene is provided with similar to the above.
Step 207 is set the visual angle route of transition, the visual angle between each animated element is changed mutually be connected.
This step is provided with the visual angle route of transition, determines the visual angle of each animated element and the excessive relation between the element, carries out processing, the optimization process of visual effect, makes the play smooth nature of animation.
Further, can also in the cartoon material storehouse, extract related words information, carry out joining in the animation after art is handled, realize to animation explanation, highlight effect such as content.Can also carry out literal according to lyrics information and extract, generate corresponding captions and show, the accompaniment rail in the MIDI music is added in the animation, form the Karaoke music file.
The embodiment of the invention for the music that the lyrics are arranged, makes up animated element and corresponding relation thereof by lyrics analysis, and the broadcast by animation demonstrates the content that the lyrics are expressed, and performing content is abundant.In addition, the animation of generation has increased the recreational of music, has improved user's Experience Degree.
With reference to Fig. 3, show that the present invention is a kind of to generate the synoptic diagram of the system embodiment of animation with the MIDI music, comprising:
Music analysis module 301 is used for the MIDI music is carried out the analysis of music structure, obtains the time attribute of music analysis result and music;
Element makes up module 302, is used for making up each animated element and corresponding relation thereof according to cartoon material storehouse of presetting and above-mentioned music analysis result by the parameter that presetting rule or user import;
Animation synthesis module 303 is used for according to described time attribute each animated element and corresponding relation thereof being combined into animation.
At first, the MIDI music that 301 pairs of music analysis modules will be changed is carried out the music structure analysis about note, syllable, phrase, period, track, and the reproduction time of definite note correspondence, obtain time attribute, then the music structure analysis result is input to element and makes up module 302; Element makes up module 302 and utilizes role, behavior, the scene of determining animation in music analysis result and the cartoon material storehouse by the parameter of presetting rule or user's input, generates animated element tabulation and corresponding relation thereof; At last, animation synthesis module 303 makes up each animated element and corresponding relation thereof according to the time attribute of music analysis module 301 acquisitions and the animated element tabulation and the corresponding relation thereof of element structure module 302 generations, finally forms animation.
In a preferred embodiment of the invention, described system also comprises:
Lyrics analysis module 304 is used for carrying out the analysis of lyrics information when described MIDI music has the lyrics, obtains lyrics analysis result;
Then lyrics analysis module 304 is input to described lyrics analysis result in the element structure module 302, and element makes up module 302 is carried out each animated element and corresponding relation thereof according to the cartoon material storehouse, music analysis result and the described lyrics analysis result that preset structure.
Further, making up module 302 at element described in the preferred embodiment of the present invention comprises:
Daughter element construction unit 3021 is used for making up the animated element that comprises role, behavior, sub-scene by one or more combination of note analysis, syllable analysis and lemma analysis, makes up the corresponding relation of above-mentioned each animated element by grammatical analysis;
Total scene construction unit 3022, one or more combination that is used for analyzing by phrase analysis, period analysis, track analysis and statement analysis, paragraph analysis, chapters and sections makes up total scene of being made up of corresponding sub-scene.
Preferably, described animation synthesis module 303 comprises:
Element integral unit 3031 is used for adding corresponding role, behavior and carrying out integral body and synthesize in described total scene;
Time synchronized unit 3032 is used for setting the time that each animated element occurs according to described time attribute, makes the reproduction time of animation and MIDI music synchronous.
Further, described animation synthesis module 303 also comprises:
Visual angle conversion unit 3033 is used to set the visual angle route of transition, the visual angle between each animated element is changed be connected.
Each embodiment in this instructions all adopts the mode of going forward one by one to describe, and what each embodiment stressed all is and the difference of other embodiment that identical similar part is mutually referring to getting final product between each embodiment.For system embodiment, because it is similar substantially to method embodiment, so description is fairly simple, relevant part gets final product referring to the part explanation of method embodiment.
More than a kind of the MIDI music is generated cartoon method and system to provided by the present invention, be described in detail, used specific case herein principle of the present invention and embodiment are set forth, the explanation of above embodiment just is used for helping to understand method of the present invention and core concept thereof; Simultaneously, for one of ordinary skill in the art, according to thought of the present invention, the part that all can change in specific embodiments and applications, in sum, this description should not be construed as limitation of the present invention.
Claims (12)
1. one kind generates cartoon method with the MIDI music, it is characterized in that, comprising:
The MIDI music is carried out the analysis of music structure, obtain the time attribute of music analysis result and music;
Make up each animated element and corresponding relation thereof according to cartoon material storehouse of presetting and above-mentioned music analysis result by the parameter that presetting rule or user import;
According to described time attribute each animated element and corresponding relation thereof are combined into animation.
2. method according to claim 1 is characterized in that, the analysis of described music structure comprises: one or more during note analysis, syllable analysis, phrase analysis, period analysis, track are analyzed.
3. method according to claim 2 is characterized in that, when in the described MIDI music lyrics being arranged, described method also comprises:
Carry out the analysis of lyrics information, obtain lyrics analysis result;
Described lyrics analysis result is incorporated in the structure of each animated element and corresponding relation thereof.
4. method according to claim 3 is characterized in that, the analysis of described lyrics information comprises: one or more during lemma analysis, grammatical analysis, statement analysis, paragraph analysis, chapters and sections are analyzed.
5. method according to claim 4 is characterized in that, each animated element of described structure and corresponding relation thereof specifically comprise:
Make up the animated element that comprises role, behavior, sub-scene by one or more combination in note analysis, syllable analysis and the lemma analysis, make up the corresponding relation of above-mentioned each animated element by grammatical analysis;
Make up total scene of forming by corresponding sub-scene by one or more combination in phrase analysis, period analysis, track analysis and statement analysis, paragraph analysis, the chapters and sections analysis.
6. method according to claim 5 is characterized in that, describedly each animated element and corresponding relation thereof are combined into animation specifically comprise:
In described total scene, add corresponding role, behavior and carry out integral body and synthesize;
Set the time that each animated element occurs according to described time attribute, make the reproduction time of animation and MIDI music synchronous.
7. method according to claim 6 is characterized in that, describedly each animated element and corresponding relation thereof are combined into animation specifically also comprise:
Set the visual angle route of transition, the transformation of the visual angle between each animated element is connected.
8. the system with MIDI music generation animation is characterized in that, comprising:
The music analysis module is used for the MIDI music is carried out the analysis of music structure, obtains the time attribute of music analysis result and music;
Element makes up module, is used for making up each animated element and corresponding relation thereof according to cartoon material storehouse of presetting and above-mentioned music analysis result by the parameter that presetting rule or user import;
The animation synthesis module is used for according to described time attribute each animated element and corresponding relation thereof being combined into animation.
9. system according to claim 8 is characterized in that, described system also comprises:
Lyrics analysis module is used for carrying out the analysis of lyrics information when described MIDI music has the lyrics, obtains lyrics analysis result;
Then lyrics analysis module is input to described lyrics analysis result in the element structure module, and element makes up module is carried out each animated element and corresponding relation thereof according to the cartoon material storehouse, music analysis result and the described lyrics analysis result that preset structure.
10. system according to claim 9 is characterized in that, described element makes up module and comprises:
The daughter element construction unit is used for making up the animated element that comprises role, behavior, sub-scene by one or more combination of note analysis, syllable analysis and lemma analysis, makes up the corresponding relation of above-mentioned each animated element by grammatical analysis;
Total scene construction unit, one or more combination that is used for analyzing by phrase analysis, period analysis, track analysis and statement analysis, paragraph analysis, chapters and sections makes up total scene of being made up of corresponding sub-scene.
11. system according to claim 10 is characterized in that, described animation synthesis module comprises:
The element integral unit is used for adding corresponding role, behavior and carrying out integral body and synthesize in described total scene;
The time synchronized unit is used for setting the time that each animated element occurs according to described time attribute, makes the reproduction time of animation and MIDI music synchronous.
12. system according to claim 11 is characterized in that, described animation synthesis module also comprises: the visual angle conversion unit, be used to set the visual angle route of transition, and the transformation of the visual angle between each animated element is connected.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201010136575.8A CN101853668B (en) | 2010-03-29 | 2010-03-29 | Method and system for transforming MIDI music into cartoon |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201010136575.8A CN101853668B (en) | 2010-03-29 | 2010-03-29 | Method and system for transforming MIDI music into cartoon |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN101853668A true CN101853668A (en) | 2010-10-06 |
| CN101853668B CN101853668B (en) | 2014-10-29 |
Family
ID=42805123
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201010136575.8A Expired - Fee Related CN101853668B (en) | 2010-03-29 | 2010-03-29 | Method and system for transforming MIDI music into cartoon |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN101853668B (en) |
Cited By (14)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN104320889A (en) * | 2014-11-10 | 2015-01-28 | 苏州乐聚一堂电子科技有限公司 | Method for changing basic brightness level through action induction |
| CN104392729A (en) * | 2013-11-04 | 2015-03-04 | 贵阳朗玛信息技术股份有限公司 | Animation content providing method and device |
| CN105355193A (en) * | 2015-10-30 | 2016-02-24 | 百度在线网络技术（北京）有限公司 | Speech synthesis method and device |
| CN106571149A (en) * | 2015-10-07 | 2017-04-19 | 三星电子株式会社 | Electronic device and music content visualization method thereof |
| CN107507629A (en) * | 2017-08-16 | 2017-12-22 | 重庆科技学院 | Hot tactile Music perception system and its control method |
| CN108174498A (en) * | 2017-12-28 | 2018-06-15 | 福建海媚数码科技有限公司 | A kind of control method and system of the scene lamp based on intelligent Matching |
| CN109615682A (en) * | 2018-12-07 | 2019-04-12 | 北京微播视界科技有限公司 | Animation producing method, device, electronic equipment and computer readable storage medium |
| CN110753245A (en) * | 2019-09-30 | 2020-02-04 | 深圳市嘀哒知经科技有限责任公司 | Audio and animation synchronous coordinated playing method and system and terminal equipment |
| CN110766443A (en) * | 2019-09-09 | 2020-02-07 | 浙江大搜车软件技术有限公司 | Material acquisition method and device, computer equipment and storage medium |
| CN111630573A (en) * | 2018-02-06 | 2020-09-04 | 雅马哈株式会社 | Information processing method |
| CN111770375A (en) * | 2020-06-05 | 2020-10-13 | 百度在线网络技术（北京）有限公司 | Video processing method and device, electronic equipment and storage medium |
| CN114363698A (en) * | 2022-01-14 | 2022-04-15 | 北京华亿创新信息技术股份有限公司 | Sports event admission ceremony type sound and picture generation method, device, equipment and storage medium |
| CN114446323A (en) * | 2022-01-25 | 2022-05-06 | 电子科技大学 | Dynamic multi-dimensional music emotion analysis method and system |
| CN116386659A (en) * | 2023-02-02 | 2023-07-04 | 北京达佳互联信息技术有限公司 | A music video generation method, device, electronic equipment and storage medium |
Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2006126687A1 (en) * | 2005-05-27 | 2006-11-30 | Matsushita Electric Industrial Co., Ltd. | Display device |
| CN1885976A (en) * | 2005-06-24 | 2006-12-27 | 英华达(上海)电子有限公司 | Method for making sound graphic display and playing on mobile phone display screen |
| CN101141603A (en) * | 2006-09-06 | 2008-03-12 | 富士胶片株式会社 | Method, program and apparatus for generating scenario for music-and-image-synchronized motion picture |
| CN101546587A (en) * | 2008-03-25 | 2009-09-30 | 国际商业机器公司 | Method and device for automatically displaying visual elements in song-playing process |
-
2010
- 2010-03-29 CN CN201010136575.8A patent/CN101853668B/en not_active Expired - Fee Related
Patent Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2006126687A1 (en) * | 2005-05-27 | 2006-11-30 | Matsushita Electric Industrial Co., Ltd. | Display device |
| CN1885976A (en) * | 2005-06-24 | 2006-12-27 | 英华达(上海)电子有限公司 | Method for making sound graphic display and playing on mobile phone display screen |
| CN101141603A (en) * | 2006-09-06 | 2008-03-12 | 富士胶片株式会社 | Method, program and apparatus for generating scenario for music-and-image-synchronized motion picture |
| CN101546587A (en) * | 2008-03-25 | 2009-09-30 | 国际商业机器公司 | Method and device for automatically displaying visual elements in song-playing process |
Cited By (20)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN104392729A (en) * | 2013-11-04 | 2015-03-04 | 贵阳朗玛信息技术股份有限公司 | Animation content providing method and device |
| CN104320889A (en) * | 2014-11-10 | 2015-01-28 | 苏州乐聚一堂电子科技有限公司 | Method for changing basic brightness level through action induction |
| CN106571149A (en) * | 2015-10-07 | 2017-04-19 | 三星电子株式会社 | Electronic device and music content visualization method thereof |
| US11812232B2 (en) | 2015-10-07 | 2023-11-07 | Samsung Electronics Co., Ltd. | Electronic device and music visualization method thereof |
| CN106571149B (en) * | 2015-10-07 | 2022-08-30 | 三星电子株式会社 | Electronic device and music content visualization method thereof |
| US11128970B2 (en) | 2015-10-07 | 2021-09-21 | Samsung Electronics Co., Ltd. | Electronic device and music visualization method thereof |
| CN105355193A (en) * | 2015-10-30 | 2016-02-24 | 百度在线网络技术（北京）有限公司 | Speech synthesis method and device |
| CN107507629B (en) * | 2017-08-16 | 2020-08-25 | 重庆科技学院 | Thermal tactile music perception system and its control method |
| CN107507629A (en) * | 2017-08-16 | 2017-12-22 | 重庆科技学院 | Hot tactile Music perception system and its control method |
| CN108174498A (en) * | 2017-12-28 | 2018-06-15 | 福建海媚数码科技有限公司 | A kind of control method and system of the scene lamp based on intelligent Matching |
| CN111630573A (en) * | 2018-02-06 | 2020-09-04 | 雅马哈株式会社 | Information processing method |
| CN111630573B (en) * | 2018-02-06 | 2023-11-03 | 雅马哈株式会社 | Information processing method |
| CN109615682A (en) * | 2018-12-07 | 2019-04-12 | 北京微播视界科技有限公司 | Animation producing method, device, electronic equipment and computer readable storage medium |
| CN110766443A (en) * | 2019-09-09 | 2020-02-07 | 浙江大搜车软件技术有限公司 | Material acquisition method and device, computer equipment and storage medium |
| CN110753245A (en) * | 2019-09-30 | 2020-02-04 | 深圳市嘀哒知经科技有限责任公司 | Audio and animation synchronous coordinated playing method and system and terminal equipment |
| CN111770375A (en) * | 2020-06-05 | 2020-10-13 | 百度在线网络技术（北京）有限公司 | Video processing method and device, electronic equipment and storage medium |
| US11800042B2 (en) | 2020-06-05 | 2023-10-24 | Baidu Online Network Technology (Beijing) Co., Ltd. | Video processing method, electronic device and storage medium thereof |
| CN114363698A (en) * | 2022-01-14 | 2022-04-15 | 北京华亿创新信息技术股份有限公司 | Sports event admission ceremony type sound and picture generation method, device, equipment and storage medium |
| CN114446323A (en) * | 2022-01-25 | 2022-05-06 | 电子科技大学 | Dynamic multi-dimensional music emotion analysis method and system |
| CN116386659A (en) * | 2023-02-02 | 2023-07-04 | 北京达佳互联信息技术有限公司 | A music video generation method, device, electronic equipment and storage medium |
Also Published As
| Publication number | Publication date |
|---|---|
| CN101853668B (en) | 2014-10-29 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN101853668B (en) | Method and system for transforming MIDI music into cartoon | |
| CN101901595B (en) | Method and system for generating animation according to audio music | |
| Webb | Music analysis down the (You) tube? Exploring the potential of cross-media listening for the music classroom | |
| Berman | Prokofiev's piano sonatas: a guide for the listener and the performer | |
| Cooke | Pat Metheny: The ECM Years, 1975-1984 | |
| MacFarlane | The Beatles and McLuhan: understanding the electric age | |
| Washburne | Salsa Romántica: an analysis of style | |
| Rogers | The musical script: Norman McLaren, animated sound, and audiovisuality | |
| MacFarlane | The Beatles' Abbey Road Medley: Extended Forms in Popular Music | |
| Franke | South African orchestral music: Five exponents | |
| Jiafang | A Diachronic Study of Jingju Yangbanxi Model Peking Opera Music | |
| Kapilow | All you have to do is listen: Music from the inside out | |
| Lee | The Beginnings of Korean Pop: Popular Music during the Japanese Occupation Era (1910–45) | |
| Fuzai | Synesthesia of Music and Image | |
| Heazlewood-Dale | Nintendian Jazz: Centering Jazz in Nintendo’s Approach to Ludic Scoring Practices | |
| Zak | Rock on Record | |
| Theisen | A multifaceted approach to analyzing form in Elliott Carter's Boston Concerto | |
| Peck | Structure in the Music of Andrew Norman | |
| O'Reilly | Who we be: the musical and social aesthetics of grime in London | |
| Mamidipudi et al. | Raga and the Problem of Ownership: Knowledge and Culture in Carnatic Music | |
| Howell et al. | Telling the Time: Communication and temporality in Nordic new music | |
| Shelley | ‘Play the Rain Down’: Prince, Paul Morton, and the Idea of Black Ecstasy | |
| Eakle | Flute Phonics Using Vowel Shapes to Color Tone | |
| Gluck | Pat Metheny: Stories beyond Words | |
| Jarvis | Jazz Interpretations of Classical Musical Works |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| C14 | Grant of patent or utility model | ||
| GR01 | Patent grant | ||
| C41 | Transfer of patent application or patent right or utility model | ||
| TR01 | Transfer of patent right |
Effective date of registration: 20151218 Address after: 519031 Guangdong city of Zhuhai province Hengqin Baohua Road No. 6, room 105 -478 Patentee after: Guangdong Zhongxing Electronics Co.,Ltd. Address before: 100083 Haidian District, Xueyuan Road, No. 35, the world building, the second floor of the building on the ground floor, No. 16 Patentee before: VIMICRO Corp. |
|
| CF01 | Termination of patent right due to non-payment of annual fee | ||
| CF01 | Termination of patent right due to non-payment of annual fee |
Granted publication date: 20141029 |