KR101846023B1 - Apparatus and Method for interworking between cycle animation and music based on MIDI information - Google Patents

Abstract

The present invention relates to an apparatus for interworking between cycle animation and music based on midi information. The apparatus includes a midi information input part for generating MIDI information and inputting the MIDI information to a MIDI music performance part and a cycle animation reproducing part, a MIDI music playing part for playing music according to the input MIDI information, and a cycle animation reproducing part for reproducing a frame mapped according to the inputted MIDI information among the frames constituting the cycle animation for a predetermined reproduction time. Music creators and animators can complete works through complete division of labor.

Description

TECHNICAL FIELD [0001] The present invention relates to an apparatus and a method for interleaving animation based on MIDI information,

BACKGROUND OF THE INVENTION 1. Field of the Invention [0002] The present invention relates to MIDI, and more particularly, to a technique of interlinking music with cycle animation using MIDI information.

Musical Instrument Digital Interface (MIDI) is a universal communication standard for music equipment. But also refers to electronic musical instruments, music files, and sound sources that are produced in accordance with the above standards, which generally conform to these communication standards.

Cycle animation, on the other hand, refers to an animation that can be played back constantly while looping. Although often written in the form of GIF animations (.gif files) that can greatly reduce the file's capacity for use on the Web, iterative animations are not limited to GIF animations. In other words, the way in which files are stored, such as movies or image bundles, can vary.

However, when producing repetitive animation contents including music, it is natural that music and animation should be linked in order to prevent awkwardness of city hall. For this purpose, it is necessary to adjust the start time and playback speed of the animation while synchronizing the finished music and the animation at the same time, and synchronize them. In this way, in addition to music and animation production work, additional work is required to complete the final contents while adjusting the animation to the music, thereby increasing workload and work time. Also, the animation thus generated is difficult to reuse.

The present invention provides a repeating animation based on MIDI information and an apparatus and method for interlocking music, which enable a music producer and an animation producer to completely separate and complete an operation.

The present invention provides a repeating animation based on MIDI information and a musical apparatus and method for ensuring reusability of the generated animation.

The present invention relates to a MIDI information-based repetition animation and a music interlocking device, comprising: a MIDI information input unit for generating MIDI information and inputting the generated MIDI information to a MIDI music player and a repeating animation player; And a repeating animation reproducing unit for reproducing a frame mapped according to the inputted MIDI information among the frames constituting the repeated animation for a predetermined reproduction time.

According to the present invention, there is provided a method for reproducing an animation based on MIDI information, comprising the steps of: mapping a frame in accordance with input MIDI information among frames constituting an iteration animation, And reproducing the frame for the determined reproduction time.

According to the present invention, an environment can be provided in which the music producer and the animation producer can completely separate and complete their respective works. It also enables reusability of the animation used.

FIG. 1 is a block diagram of a repeating animation based on MIDI information and a music interlocking apparatus according to an embodiment of the present invention.
2 is a block diagram of a repetitive animation reproducing unit according to an embodiment of the present invention.
Fig. 3 is a graph showing the relationship between the note number and the animation frame number.
4 is a flowchart illustrating a method of repeating animation based on MIDI information and music in accordance with an embodiment of the present invention.
FIG. 5 is a flowchart illustrating a process of mapping a frame according to an exemplary embodiment of the present invention. Referring to FIG.
6 is a flowchart for explaining a step of reproducing a frame according to an embodiment of the present invention.

BRIEF DESCRIPTION OF THE DRAWINGS The advantages and features of the present invention, and the manner of achieving them, will be apparent from and elucidated with reference to the embodiments described hereinafter in conjunction with the accompanying drawings. The present invention may, however, be embodied in many different forms and should not be construed as being limited to the embodiments set forth herein. Rather, these embodiments are provided so that this disclosure will be thorough and complete, and will fully convey the scope of the invention to those skilled in the art. Is provided to fully convey the scope of the invention to those skilled in the art, and the invention is only defined by the scope of the claims. Like reference numerals refer to like elements throughout the specification.

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS In the following description of the present invention, detailed description of known functions and configurations incorporated herein will be omitted when it may make the subject matter of the present invention rather unclear. , Which may vary depending on the intention or custom of the user, the operator, and the like. Therefore, the definition should be based on the contents throughout this specification.

Each block of the accompanying block diagrams and combinations of steps of the flowcharts may be performed by computer program instructions (execution engines), which may be stored in a general-purpose computer, special purpose computer, or other processor of a programmable data processing apparatus The instructions that are executed through the processor of the computer or other programmable data processing equipment will generate means for performing the functions described in each block or flowchart of the block diagram.

These computer program instructions may also be stored in a computer usable or computer readable memory capable of directing a computer or other programmable data processing apparatus to implement the functionality in a particular manner so that the computer usable or computer readable memory It is also possible for the instructions stored in the block diagram to produce an article of manufacture containing instruction means for performing the functions described in each block or flowchart of the flowchart.

And computer program instructions may be loaded onto a computer or other programmable data processing equipment so that a series of operating steps may be performed on a computer or other programmable data processing equipment to create a computer- It is also possible that the instructions that perform the data processing equipment provide the steps for executing the functions described in each block of the block diagram and at each step of the flowchart.

Also, each block or step may represent a portion of a module, segment, or code that includes one or more executable instructions for executing the specified logical functions, and in some alternative embodiments, It should be noted that functions may occur out of order. For example, two successive blocks or steps may actually be performed substantially concurrently, and it is also possible that the blocks or steps are performed in the reverse order of the function as needed.

Hereinafter, embodiments of the present invention will be described in detail with reference to the accompanying drawings. However, the following embodiments of the present invention may be modified into various other forms, and the scope of the present invention is not limited to the embodiments described below. The embodiments of the present invention are provided to enable those skilled in the art to more fully understand the present invention.

FIG. 1 is a block diagram of a repeating animation based on MIDI information and a music interlocking apparatus according to an embodiment of the present invention.

Referring to FIG. 1, a MIDI information-based repeat animation and a music linking device (hereinafter referred to as "device") include a MIDI information input unit 110, a MIDI music player 120, and a repeating animation player 130 .

The MIDI information input unit 110 transmits the MIDI information required for playing the sound to the MIDI music performance unit 120 and the repetitive animation playback unit 130. Here, the MIDI information is performance information required to reproduce music in accordance with the MIDI standard, and is a set of instructions clearly specified in the programming language by a music producer for playing music (score). Each note is programmed In order to do this, you need to group information about the type of note (note number) that indicates which note to play, the strength of the note indicating how hard the note will be played, and the duration of the note One note must be defined. Therefore, it is generally interpreted as "MIDI = score".

The MIDI programming method depends on the operating system or the library API. For convenience of explanation, the MIDI programming method will be described based on the method provided by the Windows API, but the present invention is not limited thereto. In other words, it helps to understand MIDI programming using Windows API and describes how to specify the kind of sound, the strength of sound, and the duration of sound in the program.

The Microsoft Windows API for MIDI programming provides the following functions defined in the MMSystem.h header file.

MMRESULT midiOutShortMsg (HmidiOUT hmo, DWORD dwMsg)

Here, the function return type MMRESULT is defined to return the processing result of the function, which is the same as unsigned int. The parameter HmidiOUT hmo designates a device to be used for MIDI output, and DWORD dwMsg designates a message Lt; / RTI > The detailed description of the function and the parameter (parameter) will be omitted because it may obscure the gist of the present invention.

The type of the specified note, the strength of the note, and the duration of the note are programmed in the form of a message using the above function. To do this, the following 4-byte message is generated and input to the DWORD dwMsg parameter of the function.

 The following is an example of the structure of a 4-byte message, and is described in hexadecimal.

00 90 3C 40

In the message structure, the first byte (00) always writes 00 as an unused area. The second byte (9 #) is called a status byte. The first number indicates a channel message and the second number indicates a channel number. Cannel message 9 indicates a note on event, and channel message 8 indicates a note off event. Channel number specifies the type of sound source to be used to play the note. The default value is 0 (Channel 1). The third byte 3C and the fourth byte 40 are data bytes, and the first two numbers are note numbers denoted by 7 bits and correspond to numbers identifying negative types. The range of note numbers is from 0 to 127, and has 12 values per octave. In general, the 4 octave degree (DO) used as a reference tone in music corresponds to 3C. The fourth byte is called Velocity and is represented by 7 bits. This indicates the strength of the note in the case of the note on event, and the note in the note off event. However, this value is not supported because there are a lot of unsupported, meaning is not often used in a meaningful.

In a Little Endian operating system such as Windows (an environment in which the byte arrays are written in the reverse order) in order to output a 4-octave DO sound for 1 second by inputting the message of the above structure to the above function, Can be programmed. The parameter hmo pointing to the device is omitted and "... ".

midiOutShortMsg (..., 0x7F3C90);

Sleep (1000);

midiOutShortMsg (..., 0x7F3C90);

Sleep (1000) indicates an interval between 1000ms (1 second), which corresponds to a negative duration.

The MIDI music player 120 receives MIDI information from the MIDI information input unit 110 and generates a program code for reproducing the MIDI music. The MIDI music player 120 reads the program code to reproduce the MIDI music, ≪ / RTI > In other words, it plays the role of generating program code (command) by receiving the performance information and providing it from the operating system and library API, playing it through the output device (speaker, etc.) using the sound source held by the system, It is a common practice for programmers to play music in accordance with. The MIDI music performance unit 120 can select whether to play a piano or a violin using MIDI information, which is a score necessary for playing a musical instrument.

In other words, the note number designated at the time of MIDI programming is a setting value provided for the user to specify by dividing the note to be played into 128 steps from 0 to 127. When the note is played according to the note number, Is determined by the sound source. A sound source is a built-in or external sound source, such as a piano sound or a violin sound, and a sound source file required to play a sound is called a sound font. When the "3C, 3D, 3E" is input, the sound source that matches the sound is played back by the speaker. do.

Therefore, the MIDI music playing unit 120 will play the piano music if the type of the sound source is a piano sound, or violin music if it is a violin sound, and use a sound artificially produced / processed by a person other than the sound of the specific musical instrument It is possible.

The MIDI musical performance unit 120 is a MIDI synthesizer that is a S / W or H / W device having such MIDI sound sources. For example, the source code programmed using the Windows API is connected to a MIDI synthesizer built in Windows And the music created by the MIDI program is reproduced.

Similarly, the MIDI music playing unit 120 may include electronic musical instruments such as electronic pianos, and if there is a MIDI input terminal capable of receiving input from outside, the inputted musical score information may be stored in the electronic musical instrument It can be played as one. The sound source can be extended additionally via S / W installation or H / W connection, and it is also possible to designate which of the usable sound sources are to be designated by the programming.

The repeating animation reproducing unit 130 receives the MIDI information from the MIDI information input unit 110 and reproduces the mapped frame according to the input MIDI information among a plurality of image frames constituting the repeated animation for a predetermined reproduction time. Here, the repeating animation is intended to have no directionality and branching points. The directionality of an animation means a property that must be reproduced only in a specific direction. An example of a directional animation is one that reminds us of a lightning strike. The lightning should strike down only from top to bottom, and if this animation is played in the opposite direction, it will give the animated viewers some awkwardness. On the other hand, the bifurcation point of an animation means a specific point at which the nature of the animation can be distinguished in adjusting the reproduction timing and reproduction time of the animation in order to be linked with music. An example of an animation with a divergence is reminiscent of the movements from kendo sword (drawing knife from sheath) to lead sword (knife sword inserted into knife). In order to show natural animations to viewers, the pedometer should be played fast and the pendulum should be slow and smooth. Here, it is possible to designate the end of the pantoscopic operation (= start of the pincushion operation) as a branch point. By reproducing such a bifurcation in accordance with the rhythm of the music, it is possible to produce a more natural connection between music and animation. An example of an animation that does not have directionality and bifurcation is reminiscent of playing a violin. Assuming that each of the frame images composing the animation contains a scene in which the violin is turned on from a low note to a high note, the animation does not have directionality, so that the violin string is shifted from a low sound position to a high sound position On the other hand, playing back moving from a high sound position to a low sound position does not give an uncomfortable feeling to an animation viewer. Of course, the playback direction may be changed frequently. In addition, since there is no bifurcation point, the reproduction time interval between all the frame images constituting the animation is the same. Due to this characteristic, a method of mapping each sound position for playing each frame and MIDI music constituting animation Animation and music can be linked.

FIG. 2 is a block diagram of a repetitive animation reproducing unit according to an embodiment of the present invention, and FIG. 3 is a graph of a relationship between a note number and an animation frame number.

Referring to FIG. 2, the repeating animation reproducing unit 130 includes a frame mapping unit 110 and a frame reproducing unit 120.

The frame mapping unit 110 maps a frame number, which is identification information of an animation frame to be reproduced together with a note corresponding to a note type (note number) in the inputted MIDI performance information. This will be described in more detail with reference to FIG.

)로, 미디 연주 정보 중 음의 종류의 식별 번호에 해당하며, 미디 표준에 의해 0부터 127 사이의 범위(

)로 한정된다. 3, the horizontal axis represents the note number (

), Which corresponds to the identification number of the sound type in the MIDI performance information, and is a range from 0 to 127

).

) 및 최대 노트 번호(

)를 설정한다. 따라서, 노트 번호

는

의 값으로 다시 맵핑된다. However, since there is almost no case in which all notes are used in music, the frame mapping unit 110 sets a minimum note number (for example,

) And maximum note number (

). Therefore,

The

Lt; / RTI >

개의 이미지 프레임들로 구성된다. 따라서, 프레임 번호

는

의 값을 갖는다.Referring again to FIG. 3, the vertical axis is a frame number for identifying each of the image frames constituting the animation. Repeat animation

Image frames. Therefore,

The

Lt; / RTI >

보다 작을 경우, 매핑되는 프레임 번호를 상기 프레임 번호 범위의 최소값으로 결정한다. 예컨대, 노트 번호가 '0'일 경우, 프레임 번호를

으로 설정한다. 그리고, 프레임 매핑부(110)는 노트 번호가

보다 클 경우, 매핑되는 프레임 번호를 상기 프레임 번호 범위의 최대값으로 결정한다. 예컨대, 노트 번호가 '127'일 경우, 프레임 번호를

으로 설정한다.The frame mapping unit 110 receives the note number

The frame number to be mapped is determined as the minimum value of the frame number range. For example, when the note number is '0'

. Then, the frame mapping unit 110 stores the note number

The frame number to be mapped is determined as the maximum value of the frame number range. For example, when the note number is '127'

.

범위의 노트 번호

각각에 대해 재생되어야 할 프레임 번호

를 매핑한다. Next, the frame mapping unit 110

Note number of range

Frame number to be played for each

.

At this time, the frame mapping unit 110 determines a frame number to be mapped to the note number so that a frame interval for each note interval mapped between two consecutive note numbers within the set note number range becomes constant.

는 0 또는 자연수가 되어야 하므로, 어떤 노트 번호

가 입력되었을 때 재생되어야 할 프레임 번호

를 찾기 위해 계산식을 작성할 경우, 상기 결정된 프레임 번호가 정수가 아닐 경우, 근접한 정수를 상기 입력된 노트 번호에 상응하는 프레임 번호로 결정한다. 즉, 계산의 마지막에 올림, 버림 또는 반올림 중 하나의 연산을 수행하는 것을 고려하여 계산식을 유도할 필요가 있다. In addition, the frame mapping unit 110 stores the frame number

Must be 0 or a natural number,

Frame number to be played back

When the calculated frame number is not an integer, a close integer is determined as a frame number corresponding to the inputted note number. That is, it is necessary to derive the formula considering the calculation of one of the rounding, rounding, or rounding at the end of the calculation.

범위의 노트 번호

가 입력될 때 매핑될 프레임 번호

를 구하는 식은 다음과 같이 유도될 수 있다. 우선, 각 프레임 번호마다 매핑되는 노트 번호의 비율이 가능한 한 동일하도록, 다음과 같은 <수학식 1>을 작성한다.then,

Note number of range

The frame number to be mapped

Can be derived as follows. First, the following Equation (1) is prepared so that the ratio of the note numbers mapped to each frame number is as equal as possible.

는 노트 번호의 비율을 고려한

에 매핑되는 프레임 번호로, <수학식 1>을 <수학식 2>로 유도한 후, <수학식 2>로부터

에 대한 <수학식 3>이 산출될 수 있다. In Equation (1)

Taking into account the ratio of note numbers

(1) is derived to Equation (2), and Equation (2) is derived from Equation

&Quot; (3) &quot;

는 0 또는 자연수가 아닐 수 있으므로, <수학식 4>와 같이

에 대해 올림 함수(ceil())를 사용하여 정수 값

를 산출한다. 그런데, 올림 함수(ceil())를 사용하는 것은 일 실시 예로 본 발명은 이에 한정되지 않는다. 즉, 올림 함수(ceil()) 이외에도 버림 함수(floor()) 또는 반올림 함수(round())가 사용될 수 있다.However, in Equation (3)

May not be 0 or a natural number, and therefore, as shown in Equation (4)

(Ceil ()) for an integer value

. However, the use of the up function (ceil ()) is an embodiment, and the present invention is not limited thereto. In other words, a discard function (floor ()) or a rounding function (round ()) can be used in addition to the rounding function (ceil ()).

는 하기의 <수학식 5>와 같이 유도될 수 있다.From Equation (4)

Can be derived as Equation (5) below.

를 구하였을 경우, 이를 자연스럽게 재생하여야 한다. 예컨대, 현재 재생중인 프레임 번호가 1이고, 프레임 매핑부(110)로부터 출력된 다음 재생할 프레임 번호가 4라면, 프레임 재생부(120)는 1에서 4로 곧바로 장면을 전환하는 것이 아니라 1, 2, 3, 4의 순서대로 장면을 전환한다. 이를 통해 시청자에게 위화감을 주지 않을 것이다. Next, the frame playback unit 120 generates a frame number

, It should be reproduced naturally. For example, if the currently playing frame number is 1 and the frame number to be reproduced next from the frame mapping unit 110 is 4, the frame playback unit 120 does not directly switch scenes from 1 to 4, 3, and 4, respectively. This will not give viewers any discomfort.

를 구하기 위한 음의 종류(노트 번호) 뿐 아니라, 음의 지속 시간을 필요로 한다. Therefore, the frame playback unit 120 determines how much the playback time per frame is to be designated in switching the scene of the animation in accordance with the change of the sound. For this purpose, among the input MIDI information,

(Notation number) to obtain a sound, as well as a negative duration.

로 표기하고,

번째 음에 대한 노트 번호

를

으로 표기한다. 예컨대, 미디 정보가 4 옥타브의 “도레미”의 순서로 시작한다면, 1번째, 2번째, 3번째 음에 대한 노트 번호는 각각

,

,

로 표기될 수 있다. First, for each note indicated by the input MIDI information, the notes are numbered in the order in which they are input

Respectively,

Note number for the first note

To

. For example, if the MIDI information starts in the order of "octave" of four octaves, note numbers for the first, second and third notes are

,

,

. &Lt; / RTI &gt;

번째 음의 지속 시간을

으로 표기하고, 그 단위는 밀리세크(ms)로 한다. 예컨대, 4 옥타브의 “도레미”의 순서로 연주될 때, 도가 1초, 레가 2초, 미가 3초간 연주되어진다면,

,

,

가 된다to the next,

The duration of the

, And the unit is expressed in milliseconds (ms). For example, when playing in the order of 4 octaves of "Doremi", if the degrees are played for 1 second, lega for 2 seconds, and beauty for 3 seconds,

,

,

Become

번째 음의 노트 번호

에 대해 매핑되는 프레임 번호를

라 하고, 줄여서

으로 표기한다. 즉,

에서

로 장면이 전환되는 데에

의 시간이 주어지게 된다.Also,

Note number of the first note

The frame number mapped to

And shortly,

. In other words,

in

To switch scenes into

Of time.

와

이 입력되는 경우에 대해,

이 연주되는

의 시간 동안, 동시에 재생되어야 하는 애니메이션의 장면 전환을 구현하기 위해,

의 시간 동안 재생될 각각의 프레임 번호

와 프레임별 재생 시간

를 산출한다.Some notes

Wow

For example,

Is played

In order to implement the transition of the animation which must be played simultaneously,

Each frame number to be reproduced

And frame-by-frame playback time

.

)을 m번째 매핑된 프레임 번호(

)에서 m+1번째 매핑된 프레임 번호(

)까지의 사이에 존재하는 프레임 번호들의 갯수(

-

+1)만큼 분할하여 각 프레임별 재생 시간(

)을 계산하고, 계산된 프레임별 재생 시간에 따라 m번째 매핑된 프레임 번호(

)에서 m+1번째 매핑된 프레임 번호(

)까지 번호 순서대로 프레임들을 재생한다.That is, the frame playback unit 120 determines the duration of the sound of the m &lt; th &gt;

) To the m-th mapped frame number (

) To (m + 1) -th mapped frame number

The number of frame numbers existing between

-

+1), and the playback time of each frame

), And calculates an m-th mapped frame number (

) To (m + 1) -th mapped frame number

) In order of the number of frames.

)와 m+1번째 매핑된 프레임 번호(

)가 동일할 경우, m번째 매핑된 프레임 번호(

)에 해당하는 프레임을 m번째 입력되는 미디 정보의 음의 지속 시간(

) 동안 재생한다.The frame playback unit 120 receives the m-th mapped frame number (

) And (m + 1) -th mapped frame number

) Are the same, the m &lt; th &gt; mapped frame number (

) Is a negative duration of the m-th input MIDI information (

).

)가 m+1번째 매핑된 프레임 번호(

)보다 작을 경우, m번째 매핑된 프레임 번호(

)에 해당하는 프레임부터 그 번호를 증가시켜가면서 계산된 프레임별 재생 시간(

)만큼 프레임들 각각을 재생한다.The frame playback unit 120 receives the m-th mapped frame number (

) Is m + 1-th mapped frame number (

), The m-th mapped frame number (

) From the frame corresponding to the calculated frame-by-frame playback time

) Of each frame.

)보다 클 경우, m번째 매핑된 프레임 번호(

)에 해당하는 프레임부터 그 번호를 감소시켜가면서 계산된 프레임별 재생 시간(

)만큼 프레임들 각각을 재생한다.The frame playback unit 120 receives the m-th mapped frame number ( ) Is m + 1-th mapped frame number (

), The m-th mapped frame number (

) From the frame corresponding to the calculated frame-by-frame playback time

) Of each frame.

4 is a flowchart illustrating a method of repeating animation based on MIDI information and music in accordance with an embodiment of the present invention.

Referring to FIG. 4, a method of reproducing an animation repeatedly linked to MIDI information-based music includes a step S410 (FIG. 5) of mapping a frame according to inputted MIDI information among frames constituting an iteration animation, Determining a playback time according to the information, and reproducing the mapped frame for the determined playback time (S420, E6).

FIG. 5 is a flowchart illustrating a process of mapping a frame according to an exemplary embodiment of the present invention. Referring to FIG.

) 및 최대 노트 번호(

)를 설정한다(S411). 따라서, 노트 번호

는

의 값으로 다시 맵핑된다. Referring to FIG. 5, the frame mapping unit 110 maps a frame number, which is identification information of an animation frame, to be played along with a note corresponding to a note type (note number) in the inputted MIDI performance information. However, since there is almost no case in which all notes are used in music, the frame mapping unit 110 sets a minimum note number (for example,

) And maximum note number (

(S411). Therefore,

The

Lt; / RTI &gt;

보다 작을 경우(S412), 매핑되는 프레임 번호를 프레임 번호 범위의 최소값으로 결정한다(S413). 예컨대, 노트 번호가 '0'일 경우, 프레임 번호를

으로 설정한다. 그리고, 프레임 매핑부(110)는 노트 번호가

보다 클 경우(S414), 매핑되는 프레임 번호를 프레임 번호 범위의 최대값으로 결정한다(S415). 예컨대, 노트 번호가 '127'일 경우, 프레임 번호를

으로 설정한다.The frame mapping unit 110 receives the note number

(S412), the frame number to be mapped is determined as the minimum value of the frame number range (S413). For example, when the note number is '0'

. Then, the frame mapping unit 110 stores the note number

(S414), the frame number to be mapped is determined as the maximum value of the frame number range (S415). For example, when the note number is '127'

.

범위의 노트 번호

각각에 대해 재생되어야 할 프레임 번호

를 매핑한다. 이때, 프레임 매핑부(110)는 설정된 노트 번호의 범위 내에서 연속하는 두 개의 노트 번호들 사이에 매핑되는 노트 구간별 프레임 구간이 일정해지도록 상기 노트 번호에 매핑되는 프레임 번호를 결정한다(S416).Next, the frame mapping unit 110

Note number of range

Frame number to be played for each

. At this time, the frame mapping unit 110 determines a frame number mapped to the note number so that a frame interval for each note interval mapped between two consecutive note numbers within a set note number range is constant (S416) .

는 0 또는 자연수가 되어야 하므로, 어떤 노트 번호

가 입력되었을 때 재생되어야 할 프레임 번호

를 찾기 위해 계산식을 작성할 경우, 결정된 프레임 번호가 정수가 아닐 경우(S417), 근접한 정수를 상기 입력된 노트 번호에 상응하는 프레임 번호로 결정한다(S418). 즉, 계산의 마지막에 올림, 버림 또는 반올림 중 하나의 연산을 수행하는 것을 고려하여 계산식을 유도할 필요가 있다. In addition, the frame mapping unit 110 stores the frame number

Must be 0 or a natural number,

Frame number to be played back

If the determined frame number is not an integer number (S417), the adjacent integer is determined as a frame number corresponding to the inputted note number (S418). That is, it is necessary to derive the formula considering the calculation of one of the rounding, rounding, or rounding at the end of the calculation.

6 is a flowchart for explaining a step of reproducing a frame according to an embodiment of the present invention.

와

이 입력되는 경우에 대해,

이 연주되는

의 시간 동안, 동시에 재생되어야 하는 애니메이션의 장면 전환을 구현하기 위해,

의 시간 동안 재생될 각각의 프레임 번호

와 프레임별 재생 시간

를 산출한다(S421). 즉, 프레임 재생부(120)는 m번째 입력되는 미디 정보의 음의 지속 시간(

)을 m번째 매핑된 프레임 번호(

)에서 m+1번째 매핑된 프레임 번호(

)까지의 사이에 존재하는 프레임 번호들의 갯수(

-

+1)만큼 분할하여 각 프레임별 재생 시간(

)을 계산하고, 계산된 프레임별 재생 시간에 따라 m번째 매핑된 프레임 번호(

)에서 m+1번째 매핑된 프레임 번호(

)까지 번호 순서대로 프레임들을 재생한다.Referring to FIG. 6, the frame playback unit 120 receives a certain note number

Wow

For example,

Is played

In order to implement the transition of the animation which must be played simultaneously,

Each frame number to be reproduced

And frame-by-frame playback time

(S421). That is, the frame playback unit 120 determines the duration of the sound of the m &lt; th &gt;

) To the m-th mapped frame number (

) To (m + 1) -th mapped frame number

The number of frame numbers existing between

-

+1), and the playback time of each frame

), And calculates an m-th mapped frame number (

) To (m + 1) -th mapped frame number

) In order of the number of frames.

)와 m+1번째 매핑된 프레임 번호(

)가 동일할 경우(S423), a를 '0'으로 설정(S423)하고, m번째 매핑된 프레임 번호(

)가 m+1번째 매핑된 프레임 번호(

)보다 작을 경우(S424), a를 '1'으로 설정하고(S425), m번째 매핑된 프레임 번호(

)가 m+1번째 매핑된 프레임 번호(

) 보다 클 경우(S423), a를 '-1'으로 설정한다(S426).To reproduce the frames in order of the number, the frame regeneration unit 120 sets the frame number variation variable a (S422 to S426). That is, the frame regeneration unit 120 generates the m-th mapped frame number (

) And (m + 1) -th mapped frame number

(S423), a is set to '0' (S423), and the m-th mapped frame number (

) Is m + 1-th mapped frame number (

(S424), a is set to '1' (S425), and the m-th mapped frame number (

) Is m + 1-th mapped frame number (

(S423), a is set to '-1' (S426).

를 프레임별 재생 시간

동안 재생한(S427) 후,

를 a만큼 증가시킨다(S428). 프레임 재생부(120)는

가

과 동일(S428)해질 때까지 S427 내지 S428을 반복 수행한다. Then, the frame playback unit 120 generates a frame

Frame playback time

(S427), and then,

Is increased by a (S428). The frame playback unit 120

end

S427 to S428 are repeated until the same as S427 (S428).

)와 m+1번째 매핑된 프레임 번호(

)가 동일할 경우, 프레임 재생부(120)는 미디 정보의 음의 지속 시간 m번째 매핑된 프레임 번호(

)에 해당하는 프레임을 m번째 입력되는 미디 정보의 음의 지속 시간(

) 동안 재생하게 된다. 또한, m번째 매핑된 프레임 번호(

)가 m+1번째 매핑된 프레임 번호(

)보다 작을 경우(S424), 프레임 재생부(120)는 m번째 매핑된 프레임 번호(

)에 해당하는 프레임부터 그 번호를 증가시켜가면서 계산된 프레임별 재생 시간(

)만큼 프레임들 각각을 재생한다. 그리고, m번째 매핑된 프레임 번호(

)가 m+1번째 매핑된 프레임 번호(

)보다 클 경우(S424), 프레임 재생부(120)는 m번째 매핑된 프레임 번호(

)에 해당하는 프레임부터 그 번호를 감소시켜가면서 계산된 프레임별 재생 시간(

)만큼 프레임들 각각을 재생한다.As a result, the m-th mapped frame number (

) And (m + 1) -th mapped frame number

) Is the same, the frame playback unit 120 outputs the negative duration m-th mapped frame number (

) Is a negative duration of the m-th input MIDI information (

). Also, the m-th mapped frame number (

) Is m + 1-th mapped frame number (

(S424), the frame regeneration unit 120 outputs the m-th mapped frame number (

) From the frame corresponding to the calculated frame-by-frame playback time

) Of each frame. Then, the m-th mapped frame number (

) Is m + 1-th mapped frame number (

(S424), the frame regeneration unit 120 sets the m-th mapped frame number (

) From the frame corresponding to the calculated frame-by-frame playback time

) Of each frame.

Claims (17)

A MIDI information input unit for generating MIDI information and inputting the MIDI information to the MIDI music performance unit and the repeat animation playback unit,
A MIDI music player for playing music according to the input MIDI information,
And a repeating animation reproducing unit for reproducing a frame mapped according to the input MIDI information among the frames constituting the repeating animation for a predetermined reproduction time,
The MIDI information
A note number which is identification information of a note to be played,
The repeating animation reproducing unit
And a frame mapping unit for mapping a frame number, which is identification information of a frame to be reproduced together with a note corresponding to the note number,
The frame mapping unit
The range of the note number is set according to the music. When the note number of the inputted MIDI information is smaller than the minimum note number of the set note number range, the frame number to be mapped is determined as the minimum value of the frame number range, Wherein the frame number to be mapped is determined to be a maximum value of the frame number range when the note number of the note number is greater than the maximum note number of the set note number range.
delete delete 2. The apparatus of claim 1, wherein the frame mapping unit
Determining a frame number to be mapped to the note number so that a frame interval for each note interval mapped between two consecutive note numbers within the set note number range is fixed; Interlocking device.
5. The apparatus of claim 4, wherein the frame mapping unit
If the determined frame number is not an integer, determining a close integer to be a frame number corresponding to the inputted note number.
6. The apparatus of claim 5, wherein the frame mapping unit
And performs rounding, rounding, or rounding operation to obtain a close integer.
The method of claim 1,
Further comprising negative duration information,
The repeating animation reproducing unit
dividing the duration of the sound of the m-th input MIDI information by the number of frame numbers existing between the m-th mapped frame number and the (m + 1) -th mapped frame number to calculate a play time for each frame, And a frame playback unit for playing back the frames in order from the m-th mapped frame number to the (m + 1) -th mapped frame number according to the calculated frame-based playback time. .
8. The apparatus of claim 7, wherein the frame regenerating unit
and the frame corresponding to the m-th mapped frame number is reproduced for the negative duration of the m-th input MIDI information when the m-th mapped frame number is equal to the m + 1-th mapped frame number MIDI information based repetitive animation and music interlocking device. 8. The apparatus of claim 7, wherein the frame regenerating unit
If the m-th mapped frame number is smaller than the (m + 1) -th mapped frame number, each of the frames is reproduced by the calculated frame-by-frame playback time while increasing the number from the frame corresponding to the m- Wherein the MIDI information-based repetition animation and music interlocking device are characterized by:
8. The apparatus of claim 7, wherein the frame regenerating unit
If the m-th mapped frame number is greater than the (m + 1) -th mapped frame number, the frames are reproduced by the calculated frame-by-frame playback time while reducing the number from the frame corresponding to the m-th mapped frame number Wherein the MIDI information-based repetition animation and music interlocking device are characterized by:
12. A method of interlaced MIDI information-based repetitive animation of a MIDI information-based repeating animation and a music interlock device, the method comprising:
Mapping a frame according to inputted MIDI information among frames constituting an iteration animation,
Determining a reproduction time according to the input MIDI information and reproducing the mapped frame for the determined reproduction time,
The MIDI information
A note number which is identification information of a note to be played,
The mapping step
A frame number which is identification information of a frame to be reproduced together with a note corresponding to the note number,
The mapping step
Setting a range of note numbers according to music;
Determining a frame number to be mapped as a minimum value of the frame number range when the note number of the input MIDI information is smaller than the minimum note number of the set note number range;
And determining a frame number to be mapped as a maximum value of the frame number range when the note number of the inputted MIDI information is larger than the maximum note number of the set note number range. Interworking method.
delete delete 12. The method of claim 11, wherein the mapping further comprises:
Determining a frame number to be mapped to the note number so that a frame interval for each note interval mapped between two consecutive note numbers within the set note number range is fixed; Interworking method.
15. The method of claim 14, wherein the mapping further comprises:
Further comprising the step of, when the determined frame number is not an integer, determining a close integer to be a frame number corresponding to the inputted note number.
16. The method of claim 15, wherein the mapping step
A rounding, a rounding, or a rounding operation is performed to obtain close integers.
12. The method of claim 11, wherein the MIDI information
Further comprising negative duration information,
The reproducing step
dividing a duration of a sound of m-th input MIDI information by the number of frame numbers existing between the m-th mapped frame number and the (m + 1) -th mapped frame number to calculate a playback time of each frame; ,
And reproducing the frames in order from the m-th mapped frame number to the (m + 1) -th mapped frame number according to the calculated per-frame playback time.

Images