KR20180012398A - Management system and method for digital sound source, device and method of playing digital sound source - Google Patents

Abstract

The present invention provides a system and a method for managing a digital sound source, and a device and a method for playing a digital sound source. The device for playing a digital sound source comprises: a storage unit to store tempo information by beat and tempo information by time, and store a digital sound source and score information including a score and beat information corresponding to the digital sound source; a display unit to display the score; a play unit to play the digital sound source; an input unit to receive a tempo change of at least a portion of the digital sound source; and a control unit to incorporate the tempo change to generate changed tempo information by beat or changed tempo information by time, allow the score to be displayed based on the changed tempo information by beat, and allow the digital sound source to be played based on the changed tempo information by time to synchronize the score and the digital sound source.

Description

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to a digital sound source management system and method,

The present invention relates to a digital sound source management system and method, and a digital sound source playback apparatus and method.

With a digital sound source as an accompaniment, a performer (instrumental or vocalist) can practice playing. The digital sound source reproducing apparatus reproduces the digital sound source irrespective of the player's performance (pitch, tempo) (i.e., not interactively). Therefore, the player can not change the pitch or tempo to reflect his or her feelings, and can only play in accordance with the digital sound source.

Korea Registered Patent KR10-1628330 (2016.06.01)

A problem to be solved by the present invention is to provide a digital sound source reproducing apparatus and method for automatically recognizing performance data of musical instrument or vocal player and outputting accompaniment (digital sound source).

Another object of the present invention is to provide a digital sound source reproducing apparatus and method capable of minimizing sound distortion even if the tempo and pitch of an accompaniment (digital sound source) are adjusted.

Another object of the present invention is to provide a digital sound source reproducing apparatus and method in which synchronization of an accompaniment and a score (image file) is well performed even if the tempo of an accompaniment (digital sound source) is not constant.

Another object of the present invention is to provide a digital sound source management system and method capable of providing various data to the digital sound source playback apparatus for the operation of the digital sound source playback apparatus.

The problems to be solved by the present invention are not limited to the above-mentioned problems, and other matters not mentioned can be clearly understood by those skilled in the art from the following description.

According to an aspect of the present invention, there is provided a digital sound source management system comprising: a storage module for storing a digital sound source; A score generating module for generating score information corresponding to the digital sound source and score information including bit information of the digital sound source; A bit management module for generating beat information and bit-by-bit tempo information corresponding to the digital sound source; And a time management module for generating time-based tempo information using the beat-specific beat information and the bit-by-bit tempo information.

Wherein the musical score generating module generates a whole musical score corresponding to the digital sound source and divides the whole musical score into a plurality of nodal units to generate a plurality of nodal musical scores, and the musical score information includes a plurality of nodal musical scores, And a plurality of bit information corresponding to the bit information.

The score information further includes bar length information of the plurality of bar scores.

The method of claim 1, wherein generating the plurality of tune marks comprises: scanning the first axis direction to identify the position of the horizontal line, scanning the second axis direction different from the first axis to identify the position of the tune line candidate, The line candidate is determined as a line by checking whether the line candidate is a stem of the note.

The digital sound source includes a first digital sound source having a first pitch for one song and a second digital sound source having a second pitch different from the first pitch.

The bit management module further generates bit-by-bit note information corresponding to the digital sound source, and the time management module further generates time note information using the bit-by-bit note information and the bit-by-bit tempo information.

The temporal tempo information includes a tempo value and a start time at which the tempo value begins to be applied.

The temporal tempo information further includes a start bit at which the tempo value begins to be applied.

The storage module further receives and stores performance information changed by the user, and the performance information includes at least one of changed bit-by-bit tempo information, changed time-based tempo information, changed pitch information, and changed score information.

According to an aspect of the present invention, there is provided a digital sound source management method for generating score information corresponding to a digital sound source and score information including bit information of the digital sound source, Generating star beat information, generating bit-by-bit tempo information corresponding to the digital sound source, and generating time-based tempo information using the beat-specific beat information and the bit-by-bit tempo information.

The temporal tempo information includes a tempo value and a start time at which the tempo value begins to be applied.

The temporal tempo information further includes a start bit at which the tempo value begins to be applied.

According to an aspect of the present invention, there is provided a digital sound source reproducing apparatus for storing bit-by-bit or tempo-by-bit information, a digital sound source and score information, A storage unit including score information and bit information; A display unit for displaying the score; A reproducing unit for reproducing the digital sound source; An input unit for receiving a tempo change of at least a part of the digital sound source; And generating the changed tempo information or the changed tempo information based on the changed tempo information, displaying the modified score on the basis of the modified per-bit tempo information, and based on the changed time- So that the musical score and the digital sound source are synchronized with each other.

The input of the tempo change includes a user playing according to the digital sound source and sensing the performance of the user.

Wherein the digital sound source comprises a first region of successive first tempos and a second region of a second tempo wherein the user plays according to the digital sound source, , The control unit reproduces the second area at the fourth tempo instead of the second tempo.

The input of the tempo change includes directly inputting the degree of tempo change for each node by the user.

A tempo line representing the tempo of the digital sound source is shown on the score, and the user changes the tempo by drawing the tempo line.

At least one of the digital sound source, the score information, the bit-by-bit tempo information, or the time-based tempo information is provided from the digital sound source management system.

And transmitting the changed bit-by-bit tempo information or the changed time-based tempo information to the digital sound source management system.

According to another aspect of the present invention, there is provided a digital sound source reproducing apparatus comprising: a first storage unit for storing a digital sound source including a first region and a second region; A first reproducing unit for reproducing the digital sound source with the first region at a first tempo; A second reproducing unit for reproducing the digital sound source at a second tempo different from the first tempo; And controlling the first playback unit and the second playback unit so that the release portion of the last note in the first region and the attack portion of the first note in the second region overlap each other And a control unit for controlling the control unit. The second reproduction unit reproduces the digital sound source in the background, and also in the first region at the second tempo. The first region and the second region are adjacent to each other.

One aspect of the digital sound source reproducing method of the present invention for solving the above problems is to provide a first digital sound source having a first pitch for one music and a second digital sound source having a second pitch different from the first pitch A pitch change request is received from the user, and whether the pitch requested by the user is close to the first pitch or close to the second pitch is checked. If the pitch is close to the first pitch, the first digital sound source is changed in pitch and output If the second pitch is close to the second pitch, the second digital sound source is changed in pitch and output.

Wherein the first pitch is an original pitch of the tune, and after receiving the pitch change request, it is checked whether the pitch requested by the user is equal to the second pitch, and when the second pitch is equal to the second pitch, do.

Other specific details of the invention are included in the detailed description and drawings.

1 is a conceptual diagram illustrating a digital sound source management system and a digital sound source playback apparatus according to some embodiments of the present invention.
2 is an exemplary block diagram of a digital sound resource management system in accordance with some embodiments of the present invention.
3 is a diagram for explaining a plurality of digital sound sources having different pitches for one piece of music.
FIGS. 4 to 7 are diagrams for explaining a method of generating nodal score and score information.
FIG. 8 is timing information for each beat, FIG. 9 is information for each bit, and FIG. 10 is a diagram for explaining note information per bit.
11 is a diagram for explaining tempo information by time, and FIG. 12 is a diagram for explaining note information by time.
13 is an exemplary block diagram of a digital sound source reproducing apparatus according to some embodiments of the present invention.
14 is a diagram for explaining a cancellation operation of noise that may occur when a digital sound source is reproduced.
15 is a diagram for explaining an operation for adjusting the pitch of a digital sound source.
FIG. 16 is a diagram for explaining an operation for adjusting the pitch.
17 and 18 are diagrams for explaining a method of changing the tempo of at least a part of the digital sound source.
19 is a diagram for explaining an intelligent accompaniment solution.

BRIEF DESCRIPTION OF THE DRAWINGS The advantages and features of the present invention, and the manner of achieving them, will be apparent from and elucidated with reference to the embodiments described hereinafter in conjunction with the accompanying drawings. The present invention may, however, be embodied in many different forms and should not be construed as being limited to the embodiments set forth herein. Rather, these embodiments are provided so that this disclosure will be thorough and complete, and will fully convey the scope of the invention to those skilled in the art. Is provided to fully convey the scope of the invention to those skilled in the art, and the invention is only defined by the scope of the claims. Like reference numerals refer to like elements throughout the specification.

One element is referred to as being "connected to " or" coupled to "another element, either directly connected or coupled to another element, One case. On the other hand, when one element is referred to as being "directly connected to" or "directly coupled to " another element, it does not intervene another element in the middle. Like reference numerals refer to like elements throughout the specification. "And / or" include each and every combination of one or more of the mentioned items.

Although the first, second, etc. are used to describe various elements, components and / or sections, it is needless to say that these elements, components and / or sections are not limited by these terms. These terms are only used to distinguish one element, element or section from another element, element or section. Therefore, it goes without saying that the first element, the first element or the first section mentioned below may be the second element, the second element or the second section within the technical spirit of the present invention.

The terminology used herein is for the purpose of illustrating embodiments and is not intended to be limiting of the present invention. In the present specification, the singular form includes plural forms unless otherwise specified in the specification. It is noted that the terms "comprises" and / or "comprising" used in the specification are intended to be inclusive in a manner similar to the components, steps, operations, and / Or additions. "A or B" means A, B, A and B.

Unless defined otherwise, all terms (including technical and scientific terms) used herein may be used in a sense commonly understood by one of ordinary skill in the art to which this invention belongs. Also, commonly used predefined terms are not ideally or excessively interpreted unless explicitly defined otherwise.

1 is a conceptual diagram illustrating a digital sound source management system and a digital sound source playback apparatus according to some embodiments of the present invention.

Referring to FIG. 1, at least one digital sound source management system 10 and at least one digital sound source playback device 20 are connected through a network 30.

The digital sound source management system 10 generates and stores a plurality of digital sound sources. It also generates various information / data related to the generated digital sound source. As will be described later in detail, for example, information related to the digital sound source generates score information, beat information per beat, tempo information per bit, note information per bit, tempo information per time, note information per time, and the like.

Such a digital sound resource management system 10 may be implemented by at least one computing device. The digital sound source management system 10 may be physically implemented as a plurality of servers or as a single server. Functionally, it can be implemented in the form of a web server, a database server, a proxy server, or the like. Multiple servers may be located in physically separate regions (e.g., different countries) from each other.

The digital sound source reproduction apparatus 20 can receive various information / data from the digital sound source management system 10 and reproduce the digital sound source. The reproduced digital sound source may be for accompaniment of instrumental or vocal player's performance, or for listening.

As will be described later, the digital sound source reproducing apparatus 20 may automatically adjust the tempo of the digital sound source by recognizing the player's performance data (referred to as "intelligent accompaniment solution"). The adjusted tempo may be stored in the digital sound source playback device 20 or the digital sound source management system 10. [ Therefore, even in the future, or in a digital sound source reproducing apparatus different from the currently used digital sound source reproducing apparatus 20, the player can listen to the digital sound source at a tempo suitable for his / her own taste. Further, the digital sound source reproducing apparatus 20 can minimize sound distortion even if the tempo and pitch of the digital sound source are adjusted. In addition, even if the tempo is not constant, the digital sound source reproducing apparatus 20 can synchronize the accompaniment and the score (image file) well.

The digital sound source reproducing apparatus 20 can be any electronic apparatus capable of reproducing a digital sound source. For example, the digital music player 20 may be a smart phone, a portable terminal, a mobile terminal, a personal digital assistant (PDA), a portable multimedia player (PMP) A portable terminal, a telematics terminal, a navigation terminal, a personal computer, a notebook computer, a slate PC, a tablet PC, an ultrabook, a wearable device, For example, a smartwatch, a smart glass, and a head mounted display (HMD)), a wibro terminal, an internet protocol television (IPTV) terminal, a smart TV, The present invention can be applied to all electronic products capable of transmitting and / or receiving in a wired / wireless environment such as an AVN (Audio Video Navigation) terminal, an A / V (Audio / Video) system and a flexible terminal.

The network 30 may be any type of network. The network 30 may be a wireless network such as a wireless LAN (WLAN), a Digital Living Network Alliance (DLNA), a Wireless Broadband (WIBRO), a World Interoperability for Microwave Access (WIMAX) Mobile communication, Code Division Multi Access (CDMA), Code Division Multi Access (CDMA2000), Enhanced Voice-Data Optimized or Enhanced Voice-Only (EV-DO), Wideband CDMA (WCDMA), High Speed Downlink Packet Access, High Speed Uplink Packet Access (HSUPA), IEEE 802.16, Long Term Evolution (LTE), Long Term Evolution-Advanced (LTE-A), Wireless Mobile Broadband Service (WMBS) , Bluetooth, Radio Frequency Identification (RFID), Infrared Data Association (IrDA), Ultra Wideband (UWB), ZigBee, Near Field Communication (NFC), Ultra Sound Communication: USC, Visible Light Communication (VLC), and Pie (Wi-Fi), Wi Fi Direct (Wi-Fi Direct) can be.

2 is an exemplary block diagram of a digital sound resource management system in accordance with some embodiments of the present invention. 3 is a diagram for explaining a plurality of digital sound sources having different pitches for one piece of music. FIGS. 4 to 7 are diagrams for explaining a method of generating nodal score and score information. FIG. 8 is timing information for each beat, FIG. 9 is information for each bit, and FIG. 10 is a diagram for explaining note information per bit. 11 is a diagram for explaining tempo information by time, and FIG. 12 is a diagram for explaining note information by time.

Referring to FIG. 2, a digital sound source management system 10 according to some embodiments of the present invention includes a control module 110, a digital sound source generation module 115, a storage module 120, a score generation module 130, A bit management module 140, a time management module 150, a communication module 160, and the like. Here, each module 110, 115, 120, 130, 140, 150, 160 is a functional division. Thus, a practical implementation may be implemented by combining several modules into one program, or one module may be divided into a plurality of programs, or each module may be separately implemented.

The control module 110 controls operations of the digital sound source generation module 115, the storage module 120, the score generation module 130, the bit management module 140, the time management module 150, and the communication module 160 do.

The digital sound source generation module 115 may generate a digital sound source based on, for example, MIDI (Musical Instrument Digital Interface) files.

A MIDI file is data obtained by digitizing data such as pitch (pitch height), length, and volume, and can be connected to a sound box to produce various timbres. MIDI files can be created using a sequencing program (eg, Cubase). Concretely, a player can directly play a keyboard connected to a computer, or draw a MIDI file directly through an input device (keyboard / mouse) or the like in a sequencing program. The sequencing program can convert a MIDI file to a digital sound source and output it.

The digital sound source can be any format that can be reproduced by the digital sound source reproduction apparatus 20. [ For example, WAV (or WAVE), MP3, AAC, FLAC, ALAC, WMA, and the like. Also, the digital sound source includes time information.

Waveform audio format (WAV) files are Microsoft and IBM audio file format standards that play audio on personal computers. It's a change from the RIFF bitstream format for storing chunks of data, very close to the IFIF used for Amiga and the AIFF format used for Macintosh computers. It is the default format used for Windows systems for raw audio.

An MP3 (MPEG-1 Audio Layer-3) file is a lossy compression format developed with an audio standard of MPEG-1. MP1 and MP2, and is considered to be the most popular music file format. PCM audio, such as a computer disk, can be compressed to generally acceptable sound quality, reducing the size to 1/10. MPEG-2 also has Audio Layer-3, which is also called MP3.

The Advanced Audio Coding (AAC) file is a new audio codec adopted by the MPEG-4 standard. It is more efficient than MP3 and has a sound quality similar to that of a CD. Dolby, Frauhofer (FhG), AT & T, Sony and Nokia have been involved in developing AAC audio codecs. AAC is able to sample up to 96 kHz (CD quality 44.1 kHz) with high resolution due to its improved compression technology, providing better sound quality even at small file sizes.

The Free Lossless Audio Codec (FLAC) file has no loss of sound source compared to the original audio. This is because MP3 reduces the file size by deleting the sound of the frequency range that people can not hear, and FLAC reduces the capacity by compressing only the file without erasing the original sound source.

The Apple Lossless Audio Codec (ALAC) is a lossless compressed audio codec for digital music developed by Apple.

WMA (Window Media Audio) files are known to provide audio quality equivalent to the 128kbps format of MP3 at a lower 65kbps format than MP3. In terms of capacity, it is a format format that provides about the same amount of MP3 while consuming about half of MP3. 320bit MP3 files usually have a capacity of 10MB. If you convert this file to WMA, you can convert it to 96bit, which gives almost the same sound as an MP3 file, but it is about 1 ~ 3MB.

On the other hand, the digital sound source generation module 115 may generate one or more digital sound sources based on one MIDI file. That is, for one piece of music, it may include a first digital sound source having a first pitch and a second digital sound source having a second pitch different from the first pitch.

Referring to FIG. 3, a plurality of digital sound sources 201, 202, and 203 having different pitches can be generated for one piece of music. The first digital sound source 201 of the first pitch (for example, wave F) is generated if the first MIDI file is directly converted into a digital sound source. The digital sound source generation module 115 generates a digital sound source by using a second digital sound source 202 of a second pitch higher than the first pitch (e.g., time B) or a third pitch (e.g., C) of the third digital sound source 203 can be generated.

The reason why the digital sound sources 201, 202, and 203 having a plurality of different pitches are generated will be described in detail later. However, when the digital sound source reproducing apparatus 20 changes the pitch of the digital sound source, (See Figs. 15 and 16).

Referring again to FIG. 2, the storage module 120 stores a digital sound source. As described above, the storage module 120 may have a plurality of digital sound sources (201, 202, 203 in FIG. 3) for one piece of music.

In addition, the storage module 120 may store beat-specific tone information, bit-by-bit tempo information, time-based tempo information, score information, bit-by-bit note information,

In addition, the storage module 120 may further receive the performance information changed by the user. The performance information may include at least one of changed bit-by-bit tempo information, changed time-based tempo information, changed pitch information, and changed score information. That is, if there is a change in the tempo / pitch of the digital sound source on the digital sound source reproducing apparatus 20 side, the performance information according to the change is stored in the digital sound source management system 10.

The score creation module 130 generates score information corresponding to a digital sound source and bit information of a digital sound source. The score information may be, for example, a plurality of note scores and a plurality of bit information corresponding to a plurality of note scores, respectively. In addition, the score information may further include a measure length information of a plurality of measure scores.

First, the score creation module 130 generates the entire score corresponding to the digital sound source. The score creation module 130 can generate the entire score using a news program (e.g., Sibelius software). The Sabo program extracts a score image (for example, a jpg file) using a MIDI file.

Then, the score creation module 130 divides the entire score into units of a bar, and generates a plurality of bar scores.

Here, referring to FIG. 4, in order to generate a plurality of nodal notes, first, the position of the horizontal line of the score is confirmed by scanning in the direction of the first axis S1. Check the position of the five horizontal lines of the score.

Then, the position of the node line candidates (C0, C1, C2, C3) is confirmed by scanning in the direction of the second axis S2 different from the first axis S1. The node line candidate (C0, C1, C2, C3) can be a vertical line that crosses (or connects) five horizontal lines. However, it is necessary to check whether the node line candidates (C0, C1, C2, C3) are node lines or stem of a knot. To do this, it is necessary to check at least one side immediately adjacent to the node line candidate (C0, C1, C2, C3).

Referring to Fig. 5, there is nothing on both sides C11 and C12 of the node line candidate (for example, C1).

6, there is nothing on one side CF1 of the node line candidate (CF), but on the other side CF2, four note heads and a flag (or a tail (for example, tail ").

Therefore, the nodal line candidate C1 of Fig. 5 is determined as a nodal line, and the nodal line candidate CF of Fig. 6 is not recognized as a nodal line.

Referring again to FIG. 4, in the score creation module 130, it is possible to manually generate a position (high position, low position), a key, and a time signature. In other words, the user can see the first bar, and can directly input the coordinates, marks, and time signature. Alternatively, you can use the scan method to automatically recognize the placemark, keypad, and time signature on the first bar. Alternatively, a manual / automatic input method may be used in combination. For example, some of the placemarks, keyframes, and time signature (for example, keyframes, timeframes) may be entered manually, and the keys may be recognized automatically.

Referring to FIG. 7, the score creation module 130 may further generate a plurality of pieces of bit information corresponding to a plurality of bars.

As shown in FIG. 7, the bit information may be a bit corresponding to each nodal score. Here, the number of "bits" is counted from "the initial start bit of the song". Further, as shown, the bit information may be the start bit of each tune score. Specifically, for example, in the case of a 4/4 beat song, the start bit of the first measure is 1, the start bit of the second measure is 5, and the start bit of the third measure is 9. For example, in the case of a 2/4 beat song, as shown in FIG. 4, the start bit of the first measure may be 1, and the start bit of the second measure may be 3.

Of course, if necessary, the bit information may include a plurality of bits belonging to each node. For example, in the case of a 4/4 beat song, the bit information of the first measure may be 1 or 3.

Also, if necessary, the bit information does not indicate only the start bit, and the bit period (for example, the bit information corresponding to the first node may be represented by "bits 1 to 4").

In addition, the score creation module 130 may further generate bar length information L1 to L4 of a plurality of bar scores. The digital sound source reproducing apparatus 20 can calculate the speed of the nodal score using the nodal length information L1 to L4 and the time-based tempo information. In consideration of the calculated speed, it is possible to synchronize the digital sound source (accompaniment) and the score (image file). For example, if the lengths of L1 to L4 are all the same, depending on the tempo of each segment, for example, the first segment may move slowly and the second segment may move the segment more quickly. Further, the nodal score itself may move, or a certain indication (for example, a line indicating the performance position) may move on the nodal score.

Referring again to FIG. 2, the bit management module 140 generates beat information and bit-by-bit tempo information corresponding to a digital sound source. In addition, the bit management module 140 may further generate bit-by-bit note information corresponding to the digital sound source. That is, the bit management module 140 arranges beat information, tempo information, and note information based on a bit.

Meanwhile, the bit management module 140 may be implemented as one program or as a different program. For example, the beat-specific beat information and the bit-by-bit tempo information may be implemented by different programs. In addition, the beat-specific beat information and the bit-by-bit note information may be implemented by a single program.

Here, referring to FIG. 8, the beat information per bit includes bit information and a time signature. As shown in FIG. 8, the bit information can be represented by a bit interval. 4/4 beats in the b1 ~ b20 bit interval, and 3/4 beats in the b21 ~ b40 beat interval. Unlike what is displayed, bit information can be represented by a start bit. In this case, the beat information for each bit in FIG. 8 will be displayed as (b1, 4/4 time), (b21, 3/4 time).

Referring to FIG. 9, the bit-by-bit tempo information includes bit information and a tempo value (for example, bpm). As shown in FIG. 9, the bit information can be represented by a bit interval. a tempo of 120 bpm in the b1 to b2 bit interval, a tempo of 130 bpm in the b3 to b4 bit interval, a 140 bpm of the b5 to b6 bit interval and a 120 bpm of the b7 to b8 bit interval. Here, bpm is the beat per minute, which means the number of bits per minute. If it is 120 bpm, it means the speed at which 120 bits are played per minute. Unlike what is displayed, bit information can be represented by a start bit. In this case, the bit-by-bit tempo information in FIG. 9 will be represented by (b1, 120 bpm), (b3, 130 bpm), (b5, 140 bpm), and (b7, 120 bpm).

In the case of a digital sound source produced through performance, even if the time signature is constant, the tempo (speed) may be changed according to the expression of the performer. That is, even if the song is a 4/4 time, the section that the performer wants to perform quickly can be played at a tempo of 140 to 160 bpm, and the section the performer wants to perform slowly can be performed at a tempo of 100 bpm or less. Therefore, for accurate accom- plishment, bit-by-bit tempo information is indispensable.

Referring to FIG. 10, bit-by-bit note information includes bit information and note information (for example, pitch). As shown in FIG. 10, the bit information can be represented by a bit interval. 4C in the b1 to b11 bit interval, 4D in the b12 to b13 bit interval, 4E in the b14 to b15 bit interval, and 5C in the b16 to b2 bit interval. Here, 4C, 4D, and 4E denote degrees, raises and lows of four octaves, respectively, and 5C denotes a degree of five octaves. Unlike what is displayed, bit information can be represented by a start bit. In this case, the bit-by-bit note information in FIG. 10 will be indicated by (b1, 4C), (b12, 4D), (b14, 4E), (b16, 5C).

Referring back to FIG. 2, the time management module 150 receives beat-specific beat information and beat-specific tempo information from the bit management module 140, and generates time-based tempo information. In addition, the time management module 150 may receive bit-by-bit note information and bit-by-bit tempo information from the bit management module 140, and may further generate note information by time.

Here, referring to FIG. 11, the time-based tempo information includes time information and tempo information (i.e., tempo value). As shown in Fig. 11, the time information can be displayed as a time interval. a tempo of 120 bpm in the time period t1 to t2, a tempo of 130 bpm in the time period t3 to t4, a tempo of 140 bpm in the time period t5 to t6, and a tempo of 120 bpm in the time period t7 to t8. Additionally, the temporal tempo information may further include bit information. Here, the bit information can be represented by a start bit. In this case, the temporal tempo information may be represented by (bit information, time information, tempo value). Unlike what is displayed, the time information can be displayed as a start time. In this case, the tempo information for the time of FIG. 11 will be expressed as (b1, t1, 120 bpm), (b3, t3, 130 bpm), (b5, t5, 140 bpm), (b7, t7, 120 bpm).

Specifically, the temporal tempo information can be calculated as follows. Referring to the beat information for each bit, it can be seen that 0 to 16 bits are 4/4 time. Referring to the bit-by-bit tempo information, 0 to 4 bits are 120 bpm, 5 bits to 8 bits are 130 bpm, Suppose that the 12 bits are 150 bpm and the 13 bits to 16 bits are 100 bpm.

Then, 120 bpm should play 120 bits per minute, so the interval between the bits is 0.5 seconds. Thus, from 1 to 4 bits (i.e., the first measure) must be played in 2 seconds.

Since 130bpm should play 130 bits per minute, the interval between the bits is about 0.46 seconds. Thus, from 5 bits to 8 bits (i.e., the second measure) should be played in about 1.84 seconds.

Since 150 bpm is required to play 150 bits per minute, the interval between the bits is about 0.4 seconds. Thus, from 9 bits to 12 bits (i.e., the third node) must be played in about 1.6 seconds.

Since 100 bpm must play 100 bits per minute, the interval between the bits is about 0.6 seconds. Thus, from 13 bits to 16 bits (i.e., the fourth node) should be played only about 2.4 seconds.

In summary, the tempo information of the above example can be displayed as shown in [Table 1].

As will be described in greater detail below, in some embodiments of the present invention, the digital sound source stored in the storage module 120 has time information rather than bit information. Therefore, if you want to know the playing status of a digital sound source or to change the playing point of a digital sound source, you need to know the time information. The score also has bit information. Therefore, in order to synchronize the digital sound source and the score, data for matching time information and bit information with each other is required. Temporal tempo information serves as this matching data.

Referring to FIG. 12, time-based note information includes time information and note information (e.g., pitch). As shown in Fig. 12, the time information can be displayed in a time interval. 4C can be played in the time interval t1 to t11, 4D can be played in the time interval t12 to t13, 4E can be played in the time interval t14 to t15, and 5C can be played in the time interval t16 to t2. Additionally, the time-based note information may further include bit information. Here, the bit information can be represented by a start bit. In such a case, the temporal tempo information may be expressed by (bit information, time information, note information). Unlike what is displayed, the time information can be displayed as a start time. In this case, the tempo-specific tempo information of FIG. 12 will be indicated by (b1, t1, 4C), (b3, t3, 4D), (b5, t5, 4E), (b7, t7, 5C).

As will be described in detail below, in some embodiments of the present invention, note-by-time information may be used to recognize the performance speed of the performer.

Referring again to FIG. 2, the communication module 160 transmits a digital sound source, time-based tempo information (including bit information), time information (including bit information), and musical note information to the digital sound source generation module 115.

If the bit information is not included in the time-based tempo information and the time-based note information, the communication module 160 also transmits the bit-by-bit tempo information to the digital sound source generation module 115.

The communication module 160 receives the changed performance information (for example, the changed tempo information for each bit, at least one of the changed tempo information and the changed pitch information) from the digital tone generator module 115, 120). When requested by the digital sound source generation module 115, the changed performance information may be transmitted to the digital sound source generation module 115 again.

13 is an exemplary block diagram of a digital sound source reproducing apparatus according to some embodiments of the present invention.

13, a digital sound source reproduction apparatus 20 according to some embodiments of the present invention includes a control unit 210, a storage unit 220, a reproduction unit 230, a display unit 240, an output unit 250 An input unit 255, a communication unit 260, a sensing unit 270, and the like. Here, each unit 210, 220, 230, 240, 250, 255, 260, 270 is a functional division. Thus, a practical implementation may be implemented in such a way that several units are combined into one device / mechanism / program, one unit may be divided into multiple devices / mechanisms / programs, or each unit may be implemented separately.

The control unit 210 controls the operation of the storage unit 220, the reproduction unit 230, the display unit 240, the output unit 250, the input unit 255, the communication unit 260 and the sensing unit 270 .

The communication unit 260 is supplied with various data (for example, a digital sound source, time tempo information (including bit information), time note information (including bit information), musical note information, etc.) from the digital sound source management system 10. Specifically, for one piece of music, a plurality of digital sound sources having different pitches are provided. Temporal tempo information may include time information and tempo information (tempo value), and may additionally include bit information. The note information by time may include time information and note information, and bit information may be additionally included. If bit information is not included in the time-based tempo information and the time-based note information, the communication unit 260 is also provided with bit-by-bit tempo information from the digital sound source management system 10. [

The storage unit 220 stores various data provided from the digital sound source management system 10. [ Also, it is possible to store performance information changed by the user (for example, at least one of changed bit rate information, changed time rate information, and changed pitch information).

The reproduction unit 230 reproduces the digital sound source under the control of the control unit 210. [ The playback unit 230 may be any player capable of playing a digital sound source. The control unit 210 can adjust the playback speed of the digital sound source using the time-based tempo information, time-based note information, and the like. The digital sound source is output through an output unit 250 (e.g., a speaker).

The display unit 240 displays the score image according to the control of the control unit 210. [ The control unit 210 can adjust the speed of the score to be displayed using the tempo information and the score information.

The input unit 255 may be a variety of input tools such as, for example, a microphone, a keypad, a touch pad, and an electronic pen. A plurality of input units 255 (for example, a microphone and a touch pad) may be provided in the digital sound source reproducing apparatus 20. [

Meanwhile, a display (in other words, a touch panel) capable of touch input simultaneously serves as the display unit 240 and the input unit 255.

The output unit 250 may be, for example, a speaker.

On the other hand, the control unit 210 compares the note information of the time with the performance note of the user to check whether or not the user is playing the correct note.

The user can also change the tempo of at least a portion of the digital sound source. For example, the degree of tempo change can be directly inputted for each reference area (for example, each node) predetermined by the user (see FIGS. 17 and 18). Or the digital sound source, and the tempo can be changed by sensing the performance of the user (performance tempo, performance note, etc.) in the sensing unit 270 and analyzing it in the control unit 210 (see FIG. 19) .

When the tempo is changed according to the user's request, the control unit 210 generates new (or changed) time-based tempo information (including bit information). If there is no bit information in the hourly tempo information, the control unit 210 generates new (or changed) hourly tempo information and new (or changed) bitwise tempo information. Also, the control unit 210 generates new score information including new bit information, based on the new bit-by-bit tempo information.

The control unit 210 causes the score to be displayed based on the new score information and causes the digital sound source to be played based on the new time-based tempo information to synchronize the score and the digital sound source.

The newly generated score information, time-based tempo information, or per-bit-tempo information is stored in the storage unit 220. If the user desires to use the changed score information, time-based tempo information, or per-bit-based tempo information also (for example, the user presses a predetermined key), the changed information is stored in the digital sound source management system 10 And stored in the storage module 120. The user can also use the changed information by calling the playback apparatus other than the currently used digital sound reproduction apparatus.

On the other hand, the living noise can be removed using the note information by time.

When a user plays a musical instrument along a digital sound source, life noise may be a problem. This can be solved by blocking or compressing some frequency regions within a range that does not damage the performance data of the user.

For example, when the user's instrument is a bass-reversed musical instrument, the frequency band of the bass-reversed musical instrument may be, for example, 87 Hz to 523 Hz. In order to remove the living noise, when compressing the frequency band, it may be frustrating or distorted into a sound at a long distance. Therefore, if the sound of the frequency band is amplified and the sound of the other frequency band is compressed, the living noise can be removed.

If the user's musical instrument is a high-range musical instrument, the frequency band of the high-range musical instrument may be, for example, 164 Hz to 932 Hz. Similarly, the sound of the frequency band can be amplified, and the sound of the other frequency band can be compressed.

14 is a diagram for explaining a cancellation operation of noise that may occur when a digital sound source is reproduced.

Referring to Fig. 14, as described above, the digital sound source reproducing apparatus 20 can be any electronic device capable of reproducing a digital sound source. In the case of a small-sized digital sound reproducing apparatus 20 (for example, a smart phone, a portable terminal), an output unit 250 (for example, a speaker) and an input unit 255 ) Is very close. In this case, the sound of the digital sound source from the speaker becomes a micro-direct input, so that the digital sound source itself may act as a noise.

In order to prevent this, the control unit 210 generates the anti-phase sound source 320 having the wavelength of the value accurately reversed with the sound source 310. Accordingly, when the sound source 310 and the anti-phase sound source 320 are output in real time and combined, the noise canceled sound source 330 can be generated.

15 is a diagram for explaining an operation for adjusting the pitch of a digital sound source.

15, as described above, the digital sound source generation module 115 of the digital sound source management system 10 includes a plurality of digital sound sources (201, 202, 203). The first digital sound source 201 of the first pitch (for example, wave F) is generated if the first MIDI file is directly converted into a digital sound source. The digital sound source generation module 115 generates a digital sound source based on the second digital sound source 202 of a second pitch (e.g., time B) higher than the first pitch and / or a third pitch (e.g., The third digital sound source 203 of FIG.

Let's consider if the user wants to raise the pitch (ie, if you want to raise from a wave (F) to a solo (G), a (A), or a poem (B)). If it is desired to raise up to the already created pitch (i.e., the poem B), the second digital sound source 202 already made is used. Since the second digital sound source 202 is a sound source made using the first MIDI file, the sound output is not distorted at all, despite the user desiring to raise the third sound. Further, when the user desires to raise the first note (that is, until the sole G), the digital sound source 201a which has raised one note from the first digital sound source 201 is output (refer to U1). On the other hand, if the user desires to raise the second note (that is, up to (A)), the digital sound source 202a outputting one note from the second digital sound source 202 is output (refer to D2). That is, although the user desires to raise the second note, since only one note is output using the second digital sound source 202, the output sound is hardly distorted.

On the other hand, when the user desires to raise the fourth note (that is, up to FIG. C), the second digital sound source 202 outputs one note by raising one note. When the user desires to raise the fifth note (that is, up to the level D), the second digital sound source 202 can raise the second note and output it.

Let's consider if the user wishes to lower the pitch (ie, if you want to raise from F (F) to M (E), L (D), or C). If it is desired to lower the already created pitch (i.e., the pitch C), the third digital sound source 203 already made is used. Since the third digital sound source 203 is a sound source made by using the first MIDI file, the sound outputted from the third digital sound source 203 is not distorted even though the user desires to make a third sound. Further, when the user desires to reduce the first note (that is, until the end E), the digital sound source 201b which outputs one note from the first digital sound source 201 is output (refer to D1). On the other hand, if the user desires to lower the second note (i.e., up to the level D), the digital sound source 203a that has raised one note from the third digital sound source 203 is output (refer to U2). That is, although the user desires to reduce the second note, since only one note is raised by using the third digital sound source 203, the output sound is hardly distorted.

On the other hand, when the user desires to reduce the fourth note (that is, up to the time B), the third digital sound source 203 outputs one note. The third digital sound source 203 can output a second sound even when the user desires to reduce the sound to five (i.e., up to (A)).

On the other hand, the pitch information changed by the user in this way is stored in the storage unit 220. [ When the user wants to use the changed pitch information next (e.g., the user presses a predetermined key), the changed pitch information is transmitted to the digital sound source management system 10 and stored in the storage module 120 . The user can also use the changed pitch information in a playback apparatus other than the currently used digital sound source playback apparatus.

FIG. 16 is a diagram for explaining an operation for adjusting the pitch.

Referring to FIG. 16, the control unit 210 may adjust the pitch through the following exemplary determination process.

Suppose there is a first digital sound source of the first pitch and a second digital sound source of the second pitch different from the first pitch, for one piece of music. Let the first pitch be the original pitch of the song. When receiving the pitch change request from the user, the user checks whether the pitch requested by the user is the second pitch. If it is the second pitch, it outputs the second digital sound source of the second pitch already prepared. If it is not the second pitch, it is checked whether the pitch requested by the user is close to the first pitch or close to the second pitch. When the first digital sound source is close to the first pitch, the first digital sound source is changed in pitch and output. When the second digital sound source is close to the second pitch, the second digital sound source is changed in pitch and output.

The case where there are digital sound sources of three different pitches will be described with reference to Fig.

The user checks whether the desired pitch is equal to the first pitch (for example, wave F) (S410).

If it is the same as the first pitch, the first digital sound source 201 of the first pitch is directly output (S412).

If it is not the same as the first pitch, it is confirmed whether it is desired to raise or lower (S420).

If it is desired to raise, the user checks whether the desired pitch is equal to the second pitch (S430).

If it is the same as the second pitch, the second digital sound source 202 of the second pitch is directly output (S432).

If it is not the same as the second pitch, the user checks whether the desired pitch is close to the first pitch (S440).

If it is close to the first pitch, the pitch is output from the first digital sound source 201 of the first pitch and outputted (S442).

If it is close to the second pitch, the pitch is outputted from the first digital sound source 202 of the second pitch and outputted (S444).

On the other hand, if it is desired to lower the pitch in step S420, the user checks whether the desired pitch is equal to the third pitch (S450).

If it is the same as the third pitch, the third digital sound source 203 of the third pitch is output as it is (S452).

If it is not the same as the third pitch, the user checks whether the desired pitch is close to the first pitch (S460).

If it is close to the first pitch, the pitch is outputted from the first digital sound source 201 of the first pitch and outputted (S462).

If it is close to the third pitch, the pitch is output from the third digital sound source 203 of the third pitch.

By using a plurality of digital sound sources having different pitches for one music, distortion of sound can be minimized even if the pitch is changed a lot.

17 and 18 are diagrams for explaining a method of changing the tempo of at least a part of the digital sound source.

First, referring to FIG. 17, a score is displayed on a display (touch panel) capable of touch input. Here, the touch panel also serves as a display unit for displaying a score and also serves as an input unit for receiving a user's tempo change instruction.

Above the score, a tempo line 510 representing the tempo of the digital sound source is shown. The user can adjust the tempo of the digital sound source partly by changing the tempo line 510 by hand. Specifically, for example, the user increases the playing tempo of the first node (see reference symbol SP1). The user decreases the playing tempo of the second and third nodes (see SP2). The user increases the playing tempo of the fourth bar (see SP3). For example, the first digital sound source is set to play all the bars of FIG. 17 at 120 bpm, but the first bar may be set to play at 130 bpm, the second bar, the third bar at 100 bpm, and the fourth bar at 140 bpm have.

The amount of change in the tempo is determined according to the degree to which the tempo line 510 is drawn in a specific direction. For example, depending on the degree to which the tempo line 510 is raised in the upward direction, the acceleration of the performance tempo is determined. Conversely, depending on the degree of downward movement of the tempo line 510, the slowing of the performance tempo is determined.

On the other hand, the unit area in which the tempo can be changed may be different from the above description. That is, in FIG. 17, it is described that the tempo can be changed for each node, but the present invention is not limited thereto. For example, a word can be divided into a plurality of tempo change areas. Alternatively, a plurality of nodes (for example, four nodes) may be grouped to change the tempo on a group basis.

There are various ways of receiving the user's tempo change instruction. For example, you can enter the number of degrees you want to change the tempo (for example, percent) directly.

17 and 18, even if the tempo of a part of the digital sound source is changed, the distortion of the sound can be minimized through the following method. Hereinafter, the case where the tempo of the digital sound source is changed in the area 520 of FIG. 17 will be described as an example.

According to some embodiments of the present invention, the control unit 210 utilizes a plurality of playback units 230. The first playback unit 230 plays the digital sound source at a first tempo (for example, at 100 bpm). The second playback unit 230 plays the digital sound source at a second tempo different from the first speed (for example, at 140 bpm). In the second and third nodes, only the reproduction of the first reproduction unit 230 is output, and the reproduction of the second reproduction unit 230 is not output. That is, the reproduction of the second reproduction unit 230 proceeds in the background. The output of the first reproduction unit 230 is faded out and the output of the second reproduction unit 230 is fade-in, at the boundary or boundary between the third and fourth nodes. In the fourth node, only the reproduction of the second reproduction unit 230 is output, and the reproduction of the first reproduction unit 230 is not output.

In particular, the control unit 210 causes the release portion RL1 of the last note 521 in the third section and the attack portion AT2 of the first note 522 in the fourth section to overlap each other . In this overlap region, the output of the first reproduction unit 230 is faded out, and the output of the second reproduction unit 230 is faded. If the release portion RL1 of the note 521 seems to be interrupted by the user, the user judges that sound reproduction is not good. Therefore, the attack portion AT2 of the next note 522 can cover the fade-out of the release portion RL1 of the previous note 521 because of the loud sound. Therefore, it is possible to make the tempo change of the digital sound source natural. As with the prior art, when using a single playback unit to speed up and slow down the tempo of a digital sound source, sound distortion may occur.

On the other hand, the section in which the tempo is changed is described as a "measure" unit, but is not limited thereto. Depending on the design, there may be a first region and a second region which are continuous, and when the tempos of the first region and the second region are different, the above-described method using a plurality of reproduction units can be used.

19 is a diagram for explaining an intelligent accompaniment solution.

Referring to FIG. 19, in some embodiments of the present invention, a digital sound source may be accompanied by a player to perform a performance, and the tempo of the digital sound source may be automatically adjusted by sensing the performance of the user ("intelligent accompaniment solution").

Here, the tempo bpm1 is the tempo information of the digital sound source currently being accompanied. The tempo bpm2 is the tempo information that the user plays. The tempo bpm3 is the tempo information to be stored in the storage unit 220 (or the storage module 120) at a later time.

Specifically, in the three bars 601, 602, and 603, the digital sound sources are played at 120 bpm, 130 bpm, and 140 bpm. By the way, the user can play at 132 bpm, 143 bpm, and 154 bpm faster than a digital sound source (accompaniment). That is, the user plays about 10% faster than the accompaniment.

The sensing unit 270 senses the performance tempo of the user. The control unit 210 adjusts the tempo of the digital sound source based on the note information per time and the sensed performance tempo. The control unit 210 can review the previous three bars 601, 602, 603 at what tempo the user is playing, and adjust the tempo of the bar afterwards. Here, the three words are merely illustrative, and may be four or more words, or two words. In addition, the tempo of the digital sound source at the next measure can be determined by averaging (or weighted average) the performance tempo of the user in the previous three measures. Here, the average (or weighted average) is merely an example, and the tempo determination method may be different.

To summarize, the digital sound source may include a first region (e.g., 603) of a first tempo (e.g., 140 bpm) and a second region of a second tempo (e.g., 120 bpm) 604). If the user plays according to a digital sound source and the user plays the first area at a third tempo (e.g., 154 bpm) instead of the first tempo (140 bpm), the control unit controls the second area to the second tempo (120 bpm) (E.g., 132 bpm) instead of the fourth tempo.

Thus, at the fourth node 604, the digital sound source is played at 132 bpm, 10% faster than the original tempo of 120 bpm (see 611).

The sensing unit 270 confirms that the user is playing at 132 bpm, 10% faster than 120 bpm.

Thus, even at the fifth measure 605, the digital sound source is played at 132 bpm, which is 10% faster than the original tempo of 120 bpm (see 612)

The sensing unit 270 confirms that the user plays at 108 bpm, which is 10% slower than the original tempo of 120 bpm.

Thus, at the sixth node 606, the digital sound source is played at 134 bpm, about 3% faster than 10% (see 613). This is because the user plays the fourth bar, the fifth bar is 10% faster, and the sixth bar is 10% slower than the original speed.

The sensing unit 270 confirms that the user plays at the original tempo of 130 bpm.

In this way, the speed of the digital sound source (accompaniment) can be adjusted by reflecting the tempo of the user's performance in real time.

Further, the sensed user's performance speed (i.e., bpm3) may be stored in the storage unit 220 or stored in the storage module 120 of the digital sound source management system 10. [ Therefore, the user can also use the changed information by using the changed information in the reproducing apparatus other than the digital sound source reproducing apparatus currently used.

While the present invention has been described in connection with what is presently considered to be practical exemplary embodiments, it is to be understood that the invention is not limited to the disclosed embodiments, but, on the contrary, You will understand. It is therefore to be understood that the above-described embodiments are illustrative in all aspects and not restrictive.

10: Digital sound source management system 20: Digital sound source reproduction device
30: network 110: control module
115: digital sound source generation module 120: storage module
130: score creation module 140: bit management module
150: time management module 160: communication module
210: control unit 220: storage unit
230: reproduction unit 240: display unit
250: output unit 255: input unit
260: communication unit 270: sensing unit

Claims (12)

Bit-by-bit tempo information or tempo-based tempo information, and stores the digital sound source and the score information, wherein the score information includes a score and bit information corresponding to the digital sound source;
A display unit for displaying the score;
A reproducing unit for reproducing the digital sound source;
An input unit for receiving a tempo change of at least a part of the digital sound source; And
And generating the changed tempo information or the modified time-based tempo information by reflecting the tempo change, displaying the score on the basis of the changed per-bit tempo information, and reproducing the digital sound source based on the changed time- And a control unit for synchronizing the musical score and the digital sound source. The method according to claim 1,
Wherein the receiving of the tempo change includes playing a user according to the digital sound source and sensing performance of the user. 3. The method according to claim 1 or 2,
The digital sound source comprising a first region of successive first tempos and a second region of a second tempo,
When the user plays the first area at a third tempo instead of the first tempo,
Wherein the control unit reproduces the second region at a fourth tempo instead of the second tempo. The method according to claim 1,
Wherein the input of the tempo change includes directly inputting a degree of tempo change for each node by the user. 5. The method of claim 4,
A tempo line indicating the tempo of the digital sound source is shown on the score,
And the user changes the tempo by attracting the tempo line. 6. The method of claim 5,
At least one of the digital sound source, the score information, the bit-by-bit tempo information, or the time-based tempo information is provided from a digital sound source management system. The method according to claim 1,
Further comprising a communication unit for transmitting the changed bit-by-bit tempo information or the changed time-based tempo information to the digital sound source management system. A first storage unit for storing a digital sound source including successive first and second regions;
A first reproducing unit for reproducing the digital sound source with the first region at a first tempo;
A second reproducing unit for reproducing the digital sound source at a second tempo different from the first tempo; And
The control unit controls the first playback unit and the second playback unit so that the release portion of the last note in the first area and the attack portion of the first note in the second area overlap each other And a control unit for controlling the digital sound source. 9. The method of claim 8,
Wherein the second reproduction unit reproduces the digital sound source in the background and the first region also at the second tempo. 9. The method of claim 8,
Wherein the first region and the second region are immediately adjacent to each other. Providing a first digital sound source having a first pitch for one song and a second digital sound source having a second pitch different from the first pitch,
A pitch change request is received from the user,
Whether the pitch requested by the user is close to the first pitch or close to the second pitch,
If the first digital sound source is close to the first pitch, the first digital sound source is changed in pitch and output,
And changing the pitch of the second digital sound source when the second digital sound source is close to the second pitch. 12. The method of claim 11,
Wherein the first pitch is an original pitch of the song,
After receiving the pitch change request, it is checked whether the pitch requested by the user is identical to the second pitch,
And outputs the second digital sound source when the second digital sound source is the same as the second sound source.

Images