KR102020341B1

KR102020341B1 - System for realizing score and replaying sound source, and method thereof

Info

Publication number: KR102020341B1
Application number: KR1020150162008A
Authority: KR
Inventors: 김준호; 황정빈; 김동삼; 박종원; 윤창호
Original assignee: (주)주스
Priority date: 2015-11-18
Filing date: 2015-11-18
Publication date: 2019-09-11
Also published as: KR20170058504A

Abstract

The present invention relates to a music score implementation and sound source reproduction system and method thereof.
In accordance with another aspect of the present invention, a sheet music implementation and sound source reproducing method includes: selecting a sheet music by accessing a homepage of a sheet music providing service company by a user terminal; Selecting a function such as ear or separate in relation to the selected sheet music; Requesting the selected sheet music and functions to the main server; Providing sheet music information on which the corresponding function is implemented according to the sheet music and the function requested by the main server to the user terminal; And converting the sheet music information provided from the main server by the user terminal into the sheet music or playing back a speech-related file as a speech.
According to the present invention as described above, by providing the sheet music information to which the user selects a two-part or separate function using the sheet music editing and providing module, there is an advantage that can provide a customized automated sheet music according to the user set value.

Description

System for realizing score and reproducing sound source and method thereof {System for realizing score and replaying sound source, and method}

The present invention relates to a sheet music implementation and sound source reproduction system and method, and more particularly, to a sheet music implementation and sound source playback system and method capable of providing customized automated sheet music according to user set values.

In general, the score is divided into two types: a full-length bullet and a part-beam regarding the musical instruments constituting the bullet.

Conventionally, even when constructing a sheet music, it was necessary to work a partbo on a musical instrument after the bulletin. Or if there is bulletin content but no partbo content (in this case, about 70% of the score content market), the user had to make a hand-made partbo again.

In addition, conventionally, in order to provide a sheet music suitable for a user's range, the sheet music had to be bought again. And when users aren't just singing when they're in contact with popular music, they'll have to change the pitch or set the composition of their vocals to the instrument they can play. This is because the sheet music provided on the Internet is in the form of an image file, and thus additional functions cannot be set. In general, content set in the form of a JPG or PDF file is a file format based on an image, and thus editing is not possible according to a user setting value. Accordingly, a user cannot provide a sound source of the content. That is, it is possible to provide Mp3 files along with JPG or PDF files, but there are limitations in providing various functions according to user requirements.

Korean Patent Laid-Open Publication No. 10-2012-0047037 (Patent Document 1) includes an extraction unit for analyzing an image (music score image) for a score and extracting an image (symbol image) and score lines for symbols existing in the score. ; A symbol recognition unit configured to set a plurality of recognition lines on symbol images, measure pixel values of the symbol images along the plurality of recognition lines, and recognize meanings of the symbols by using the measured change of the pixel values. Wow; A performance information generator for generating performance information on the score using at least one of the positions of the extracted score lines and the meanings of the recognized symbols; And a reproducing unit for reproducing the sheet music as music according to the generated performance information, and the "music reproduction apparatus and method using a sheet music image" capable of analyzing the image of the sheet music and playing the music according to the sheet music is disclosed. .

Further, Japanese Patent Laid-Open No. 10-2005-0046719 (Patent Document 2) includes a tone data memory having a limited capacity for storing tone data; A sheet music data memory for storing sheet music data representing a piece of music; A sound source set with tone data stored in the tone data memory and pronunciation parameters derived from the note data memory and the stored note data to generate music notes of the tune; And a performance controller for setting the sound source with the pronunciation parameters in accordance with the stored sheet music data so that the sound source synthesizes the musical notes of the musical piece represented by the sheet music data and the tone data. Disclosed is a "music reproducing apparatus" capable of reproducing music with various tones even when the memory for storing and the memory for storing the musical score data each have a small storage capacity.

However, in the case of Patent Document 1, by extracting the image (symbol image) and the score line for the symbols present in the sheet music to generate the performance information, by reproducing the sheet music as the music in accordance with the performance information, through the score image While it's easy to understand the pitch and time of the written music, it doesn't provide customized automated scores based on user settings.

Further, in the case of Patent Document 2, although the memory for storing the tone data and the memory for storing the score data each have the advantage that music can be reproduced in various tones, but user setting is similar. It does not provide customized automated sheet music for value.

Publication No. 10-2012-0047037 (2012.05.11.) Publication No. 10-2005-0046719 (2005.05.18.)

The present invention was created to improve the problems of the prior art as described above, by using the sheet music editing and providing module to provide sheet music information to which the user selects the duo or separate function, to customize the customized sheet music according to the user setting value It is an object of the present invention to provide a sheet music implementation and a sound source reproduction system and a method thereof that can be provided.

In order to achieve the above object, the music score implementation and sound source reproduction system according to the present invention,

A user terminal which accesses a related site and inputs information or commands necessary for implementing or obtaining sheet music in order to implement or obtain sheet music desired by a user;

A main server that processes information or commands input from the user terminal and provides sheet music on which a function corresponding to a user request is implemented; And

It stores the music data files related to the musical score implementation and sound source playback, and when providing a service by the main server, includes a file server that provides it to the main server,

The main server provides a sheet music in which a function corresponding to a user request is implemented, and has a feature of providing a customized sheet music according to a user set value.

Here, the main server parses the "xml" according to the information or command input from the user terminal, implements functions such as Izo and separate, and converts the computer language to the sheet music so that the sheet music can be provided. An "xml" file and a "midi" file are generated and provided to the user terminal as an intermediate process.

In addition, the main server is equipped with a sheet music editing and providing module as a tool for sheet music providing service.

Further, it is preferable to further include various information and data related to musical scores, data related to generation of xml files and midi files by the main server, URL address information of music data, and a database (DB) for storing customer information. It may include.

In addition, the music score implementation and sound source reproduction method according to the present invention in order to achieve the above object,

a) accessing a homepage of a music providing service company by a user terminal;

b) selecting and clicking a music score providing menu on a menu bar of the homepage screen of the music score providing service company displayed on the screen by a user terminal;

c) selecting a music score to be provided from a music score-related window opened on a screen by a user terminal;

d) selecting, by the user terminal, a function such as ear or separate with respect to the selected sheet music;

e) when the music score and the function selection are completed, requesting the music score and the function selected by the user terminal to the main server;

f) providing, by the main server, sheet music information on which the corresponding function is implemented according to the requested sheet music and the function to the user terminal; And

g) converting the sheet music information provided from the main server by the user terminal to the sheet music or reproducing a speech-related file as a voice.

Here, in the step f), the music information edited by the main server is converted into web-based music data and provided to the user terminal.

According to the present invention as described above, by providing the sheet music information to which the user selects a two-part or separate function using the sheet music editing and providing module, there is an advantage that can provide a customized automated sheet music according to the user set value.

1 is a diagram schematically showing the configuration of a music score and sound source playback system according to an embodiment of the present invention.
2 is a view showing a relationship between the operation of the music implementation between the user terminal side and the main server side of the music implementation and sound source playback system according to the present invention.
3 is a flowchart illustrating a process of implementing a music score and sound source reproducing method according to an embodiment of the present invention.
FIG. 4 is a diagram illustrating each process of xml parsing, partbo implementation, and duplex by operation of the Music XML player employed in the present invention.
FIG. 5 is a diagram illustrating each process of musical instrument conversion and node selection by code of the operation of the Music XML player employed in the present invention.
FIG. 6 is a diagram illustrating a process of reproducing a sound source by an operation of a music XML player employed in the present invention.
FIG. 7 is a diagram illustrating a sheet music implemented through a process of implementing a sheet music, a pairing, a musical instrument change, a node selection, and the like according to the music score and sound source reproducing method according to the present invention.

The terms or words used in this specification and claims are not to be construed as being limited to the common or dictionary meanings, and the inventors may properly define the concept of terms in order to best explain their invention in the best way. Based on the principle, it should be interpreted as meaning and concept corresponding to the technical idea of the present invention.

Throughout the specification, when a part is said to "include" a certain component, it means that it may further include other components, except to exclude other components unless specifically stated otherwise. In addition, the terms “… unit”, “… unit”, “module”, “device”, and the like described in the specification mean a unit that processes at least one function or operation, which is hardware or software or a combination of hardware and software. It can be implemented as.

Hereinafter, exemplary embodiments of the present invention will be described in detail with reference to the accompanying drawings.

1 is a diagram schematically showing the configuration of a music score and sound source playback system according to an embodiment of the present invention.

Referring to FIG. 1, the sheet music realization and sound source reproducing system 100 according to the present invention includes a user terminal 110, a main server 120, and a file server 130.

The user terminal 110 accesses a relevant site (for example, a homepage of a music providing service company) and inputs information or commands necessary for implementing or obtaining sheet music in order to implement or obtain sheet music desired by a user. In other words, the user inputs the necessary information or command by accessing the site using his terminal in a manner of generally accessing the site through the Internet in order to implement or obtain the desired sheet music. This user terminal 110 is a kind of application (application) for receiving the sheet music information provided from the main server 120 to be described later as a sheet music visualization library and a kind of sound for receiving the sound-related files to play as a sound source A sound source playback library is mounted as an app. Such an app may be provided from a music service provider, or the user may directly download and access the related site.

In this case, the user terminal 110 is connected to the wired / wireless Internet, such as a general desktop PC 111, smart phone 112, notebook computer 113, etc. to input some information or commands, and the corresponding results Any device that can output (display) can be used.

The main server 120 processes the information or command input from the user terminal 110, and provides a sheet music in which a function (for example, a duplex function, a separate function, etc.) corresponding to a user request is implemented. The main server 120 is equipped with a sheet music editing and providing module as a tool for the sheet music providing service. In addition, the main server 120 parses the "xml" according to the information or command input from the user terminal 110, implements functions such as Izo or separate, computer language to provide music scores Generates an "xml" file and a "midi" file as intermediate processes for converting the score into a score, and provides the same to the user terminal 110. In addition, the main server 120 may provide a sheet music in which a function corresponding to a user request is implemented, and may provide customized sheet music according to a user set value.

The file server 130 stores music data files related to the music notation and sound source reproduction. When the file server 130 provides a service by the main server 120, the file server 130 provides the music data files to the main server 120. The file server 130 may be integrated with the main server 120 in some cases. That is, the main server 120 may be configured to serve as a function of the file server 130.

Here, preferably, the sheet music implementation and sound source reproducing system 100 according to the present invention having the above-described configuration is related to the generation of various information and data related to the sheet music, the xml file and the midi file by the main server 120. The database may further include a database (DB) 121 that stores data, URL address information of music data, and customer information.

FIG. 2 is a diagram illustrating a relationship between a musical instrument implementation and a music server implementation related operation between a user terminal side and a main server side of the sheet music implementation and sound source reproduction system according to the present invention having the configuration described above.

Referring to FIG. 2, when a function such as Izo and a separate is input to the user terminal, the main server side loads the corresponding xml file to perform xml parsing and implements functions such as Izo and separate. In addition, based on the xml parsing and the implementation of functions such as Izo and Separation, it outputs Vexflow json (a kind of sheet music information) related to sheet music implementation and outputs Midi file related to sound (sound source) playback. The output Vexflow json and Midi files are transmitted to the user terminal, and the user terminal receives Vexflow json and Midi files, respectively, and converts the Vexflow json into a score and plays a voice (sound source) based on the Midi file.

Next, the music score implementation and sound source playback method using the music score implementation and sound source reproduction system according to the present invention having the configuration and operation mechanism as described above will be described.

3 is a flowchart illustrating a process of implementing a music score and sound source reproducing method according to an embodiment of the present invention.

Referring to FIG. 3, in accordance with the method of implementing sheet music and reproducing a sound source according to the present invention, the user terminal 110 first accesses the homepage of a music providing service company (step S301). That is, the user accesses the homepage of the music providing service company through the Internet using his terminal, for example, the desktop PC 111 or the smartphone 112.

Thereafter, the user terminal 110 selects and clicks the music score providing menu on the menu bar of the homepage screen of the music score providing service company displayed on the screen (step S302). At this time, if the homepage of the music providing service provider is configured to provide sheet music only to the members, the user enters the ID and password immediately if the member is an existing member. After registering, enter your ID and password and proceed.

In this way, when a new window (screen) is opened by selecting and clicking the music score providing menu, the music score to be provided is selected from the music score providing window opened on the screen by the user terminal 110 (step S303). In this case, an input window for inputting a title of a song may be displayed on the screen, or an input window for searching for a desired song by a user may be displayed. The user can select the sheet music desired by the user (ie, to be provided) by filling in the corresponding content in the input window displayed on the user's terminal.

After the user selects the desired sheet music through his terminal, the user terminal 110 selects a function such as pairing or separate in relation to the selected sheet music (step S304). Then, the music score and function selected by the user terminal 110 is requested to the main server 120 (step S305). Then, the main server 120 provides the sheet music information in which the corresponding function is implemented according to the requested sheet music and the function to the user terminal 110 (step S306). That is, when a user clicks a button such as two-tone (adjustment of pitch) and a separate (eg, part-bo for general bulletin) through his terminal, the main server 120 sends the corresponding MusicXML to the file server 130. Read it. At this time, such a series of processes are shown in the code according to the sheet music editing and provision module employed in the present invention as follows.

import music21

s = music21.converter.parseURL (MusicXML file path)

Next, apply the function to the read file. This is also coded as follows:

s.flat.transpose ('tillion degree')

s = s.parts [desired part number]

Thereafter, the sheet music information edited by the main server 110 is converted into sheet music data based on the web, and provided to the user terminal 110.

Here is the code:

data = music21.vexflow.toMusic21j.fromObject (s, mode = 'json')

return HttpResponse (data)

When the sheet music information implementing the corresponding function is provided to the user terminal 110, the sheet music information provided from the main server 120 by the user terminal 110 is converted into sheet music or a voice related file is reproduced by voice ( Step S307). At this time, the user converts the json provided by using music21j to the canvas through his terminal.

Here is the code:

require (['music21'], function () {

var pickleIn = 'json content';

var jpc = new music21.fromPython.Converter ();

streamObj = jpc.run (pickleIn);

streamObj.renderOptions.events.resize = "reflow";

streamObj.appendNewCanvas ();

});

At this time, in the case of voice, the main server 120 outputs a midi file, and the user terminal 110 reproduces the file using “midijs library”.

Here is the code:

s.write ('midi', 'filename')

On the other hand, Figures 4 to 6 show the processing of music notation and sound source reproduction by the operation of the Music XML player employed in the present invention as a code, Figure 4 shows each process of xml parsing, partbo implementation, two groups 5 is a diagram illustrating each process of instrument change and measure selection, and FIG. 6 is a diagram illustrating a process of sound source reproduction.

Referring to FIG. 4, as described above, when a function such as dual, separate, or the like is input by the user terminal 110, the main server 120 retrieves the corresponding xml file from the file server 130 and parses the xml. It implements functions such as izo and separate (partbo). This will be explained in detail for each part.

As shown in FIG. 4A, the main server 120 loads an xml file and retrieves "xml information from DB", "reference url address of xml", "read xml contents", and "parse into score object". Parsing tasks include creating an xml file for drawing music and creating a midi file to play music.

Referring to Fig. 4B, the music score object is composed of an array of Part objects, and each element of the array has information of each part. Therefore, the main server 120 outputs only the information about the part or the musical instrument to be implemented as a partbo in the sheet music object corresponding to the input value, in midi file and xml file format.

Then, the user terminal 110 expresses the part music xml as the music score using the music score visualization library, and reproduces the part music sound source using the sound source reproduction library.

<Izo>

Referring to FIG. 4C, in the sheet music object corresponding to the value input by the main server 120, the pitch values of all the note objects defined inside the sheet music object may be collectively modified.

When the modification is completed according to the user input, the main server 120 outputs xml, midi files, the user terminal 110 implements the score using the music score visualization library, and plays the sound source using the sound source playback library do.

Referring to FIG. 5A, the sheet music object is internally composed of an array of part objects, and inside the part object, there is an instrument object containing instrument information.

The main server 120 converts the instrument information of the object into the value of the received instrument (for example, violin, plot, etc.), and then outputs an xml file and a midi file, and the user terminal 110 visualizes the score and reproduces the sound source. Use the library to implement the score and play the sound source.

Referring to FIG. 5B, the main server 120 creates a new sheet music object and inserts information corresponding to the node received from the existing sheet music object into the new sheet music object. The music object is composed of only the selected node and outputs the xml and midi files, and the user terminal 110 implements the music using the music visualization and the sound source reproduction library and plays the sound source.

Referring to FIG. 6, the main server 120 reads an xml file from the file server 130 and generates a music score object.

The created score object is then output to the midi file format using the score editing module. Then, the user terminal 110 reproduces the output midi file using the sound source reproduction library as a sound source.

FIG. 7 is a diagram illustrating a music score implemented through the process of parsing Xml, implementing partbo, lysing, instrument conversion, and node selection.

As shown in Fig. 7, the sheet music implemented is almost similar to the normal sheet music. The only difference is that the user's selected features are implemented in the score (Partbo, Izo, etc.). As described above, the user can easily obtain the sheet music he / she wants by implementing the sheet music having the function, that is, the customized automated sheet music according to the user setting value.

As described above, the sheet music embodying and sound source reproducing system and method thereof according to the present invention provide sheet music information to which a user selects a two-part or separate function by using a sheet music editing and providing module, thereby customizing automated sheet music according to user setting values. There is an advantage to provide.

In addition, the service provider side provides the music information applied by user's choice of two or separate functions, which is not provided in the JPG or PDF file format. Will be able to reap the effect.

As mentioned above, the present invention has been described in detail through the preferred embodiments, but the present invention is not limited thereto, and various changes and applications may be made without departing from the technical spirit of the present invention. Self-explanatory Therefore, the true protection scope of the present invention should be interpreted by the following claims, and all technical ideas within the equivalent scope should be construed as being included in the scope of the present invention.

110: user terminal 120: main server
121: Database 130: File Server

Claims

A user terminal which accesses a related site and inputs information or commands necessary for implementing or obtaining sheet music in order to implement or obtain sheet music desired by a user;
A main server that processes information or commands input from the user terminal and provides sheet music on which a function corresponding to a user request is implemented; And
It stores files related to the music notation and sound source playback, and includes a file server for providing a service to the main server, when providing the service by the main server,
The main server provides a sheet music in which a function corresponding to a user request is implemented, and provides a customized sheet music in which a function selected by a user is implemented in the sheet music,
The main server outputs in the format of midi file and xml file leaving only information on the part or instrument for implementing as a partbo in the sheet music object corresponding to the input value in the partbo implementation as a function implementation.
The main server is a dual-implementation as a function implementation, in the music object corresponding to the value input by the main server to modify the pitch value of all the note objects defined inside the music object in a batch, and to modify according to the user input When done, it prints out an xml file, a midi file,
In the instrument conversion as a function implementation, the main server converts the instrument information of the object to the value of the received instrument, and outputs an xml file and a midi file,
The main server parses the "xml" according to the information or command input from the user terminal, implements functions such as Izo or separate, and converts the computer language into sheet music so that the sheet music can be provided. A music score implementation and sound source reproducing system for generating an " xml " file and a " midi " file as provided to the user terminal.

delete

The method of claim 1,
The sheet music implementation and sound source reproducing system, wherein the main server is equipped with a sheet music editing and providing module as a tool for sheet music providing service.

The method of claim 1,
The user terminal includes a sheet music visualization library as an application for receiving sheet music information provided from the main server and implemented as sheet music, and a sound source playing library as a kind of app for receiving voice-related files and playing them as a sound source. Sheet music implementation and sound source playback system.

The method of claim 1,
Music score implementation further comprising a database (DB) storing various information and data related to the score, data related to the generation of xml files and midi files by the main server, URL address information of the music data, and customer information; Sound source playback system.

a) accessing a homepage of a music providing service company by a user terminal;
b) selecting and clicking a music score providing menu on a menu bar of the homepage screen of the music score providing service company displayed on the screen by a user terminal;
c) selecting a music score to be provided from a music score-related window opened on a screen by a user terminal;
d) selecting, by the user terminal, a function such as ear or separate with respect to the selected sheet music;
e) when the music score and the function selection are completed, requesting the music score and the function selected by the user terminal to the main server;
f) providing, by the main server, sheet music information on which the corresponding function is implemented according to the requested sheet music and the function to the user terminal; And
g) converting, by the user terminal, the sheet music information provided from the main server into sheet music or playing back a speech-related file as speech;
The main server outputs in the format of midi file and xml file leaving only information on the part or instrument for implementing as a partbo in the sheet music object corresponding to the input value in the partbo implementation as a function implementation.
The main server is a dual-implementation as a function implementation, in the music object corresponding to the value input by the main server to modify the pitch value of all the note objects defined inside the music object in a batch, and to modify according to the user input When done, it prints out an xml file, a midi file,
In the instrument conversion as a function implementation, the main server converts the instrument information of the object to the value of the received instrument, and outputs an xml file and a midi file,
The main server parses the "xml" according to the information or command input from the user terminal, implements functions such as Izo or separate, and converts the computer language into sheet music so that the sheet music can be provided. A music playing and sound source reproducing method, characterized in that to generate a "xml" file and a "midi" file as the user terminal.

delete