KR101446903B1 - Interactive system for performing musical note - Google Patents

Abstract

The present invention relates to a system which identifies the information of a musical note module attached to a music score board, converts the information into a music score, and plays the music score. The system comprises: a musical note module which is detachably attached to a music score board on which staves are printed; a control device which communicates with the musical note module, reads image information collected by a camera, and converts the information into a playable signal; an operation panel which communicates with the control device and plays the signal; and an output device which amplifies the signal converted by the control device and outputs music through a speaker. According to the present invention, the system plays a music score by verifying the order, position, and type of musical note modules, to which a unique ID is assigned, through the camera, infrared communications, and image analysis. As a result, a user interacts with the system like exchanging conversations and utilizes three (auditory, visual, and tactile) senses at the same time, and therefore the system attracts the interest and participation of a learner and enables effective musical education without pressure. Also, a composer can practice composition by intuitively using the musical note modules without actually playing an instrument. In addition, the system facilitates revising and editing of a music score by enabling the musical note module to be easily attached to or detached from the board. The system can be widely utilized for the education of composition and playing.

Description

[0001] INTERACTIVE SYSTEM FOR PERFORMING MUSICAL NOTE [0002]

The present invention relates to a system for automatically playing musical notation, and more particularly, to an interactive musical note performance system for identifying information of a note module attached to a musical score board and generating and reproducing the musical score as a musical score.

In general, a visualized musical score is used to play music. The musical score is displayed by plotting or printing a musical note on the line, thereby displaying the height and length of the musical sound. Thus, the musical sound can be visually confirmed.

However, such a musical score is easily perceived by a player through a medium such as a paper or the like, and therefore, the musical instrument is easily played. Therefore, there is a problem in that it is not easy to edit or edit in composition or learning.

In particular, it is difficult for a novice learner to see the musical score at a glance and understand it correctly, and it is also difficult to learn the exact pitch of the musical score by listening to the sound of the teacher's voice on the contrary, There are a lot of problems when it takes time to give up learning in the middle.

In order to compensate for this, there is a technique of inputting and playing music on a computer using software, and these techniques have some merits that can be easily corrected or edited. However, The sound of the sound can not be transmitted vividly as it is, and it is inconvenient because it is complicated to use, takes a lot of time for mastery, and is difficult to be used easily by the novice learner.

The present invention has been devised to solve all of the problems described above, and it is an object of the present invention to provide an apparatus and method for recognizing the order, position, and type of note modules to which a unique identification ID is assigned through image analysis processing using a camera and infrared communication , The user interacts with the system as if it were a dialogue, and the three senses of auditory, visual, and tactile senses are used at the same time, thereby inducing the interest and participation of the learner, By using the module intuitively, you can practice composition without playing the notes of the instrument directly, and you can easily attach or remove the note module to the board, making it easy to edit and edit the score. And to provide a suitable interactive musical score playing system.

In order to solve the above-described problems, the present invention provides a musical instrument comprising: a note module detachably attached to a scoreboard on which a leaderboard is drawn; And a controller communicating with the note module and reading the image information collected by the camera and converting the read image information into a playable signal; An operation panel communicating with the control device to perform performance; And an output device for amplifying a signal converted by the control device and outputting music through a speaker, wherein the note module comprises: a battery; an infrared communication module for communicating with an infrared signal; an infrared LED; And a microprocessor for analyzing the identification ID signal received by the infrared communication module and for illuminating the infrared LED if the infrared ID is the same, wherein the control device is connected to the infrared communication module An infrared communication unit for communicating with an infrared signal and transmitting an identification ID signal, a camera unit for photographing the score board, and an x, y coordinate generator for generating x and y coordinates of the melody module received by receiving the image information collected through the camera unit, A controller that automatically analyzes the order, position, and type of the note module and converts it into a playable signal. It provides an interactive system for playing music.

At this time, the note module is also characterized in that the body is made of a magnet or a magnet is attached to the body and is attached to the score board by the magnetic force.

In addition, the note module is also characterized in that a red LED for indicating an operation state is provided.

The control unit may include an image information receiving unit for collecting image information photographed by the camera unit, a coordinate generating unit for generating x and y coordinates of the lighted note module included in the image information, An image analysis unit for automatically analyzing the order, position, and type of the note module through coordinates to generate score information, a signal conversion unit for converting the score information into a signal capable of playing, and a device control unit ; And the like.

Furthermore, the operation panel is also characterized in that it performs wireless communication with the control section to perform performance.

In addition, the operation panel also includes a playback button for performing performance, a repeat button for repeatedly playing the performance, and a musical instrument selection button for selecting the type of musical instrument.

The output device may further include an amplifier for amplifying the converted signal, and a speaker connected to the amplifier for outputting music.

According to the present invention, it is possible to grasp the order, position, and type of the note modules to which the unique identification ID is assigned through the image analysis processing using the camera and the infrared communication, and to play the score, It is possible to make music education effective by inducing the interest and participation of the learners because it uses the three senses of auditory, visual, and tactile at the same time, and the composer can intuitively use the note module, It is possible to practice the composition without directly playing the music, and also the note module can be easily attached to or removed from the board, so that it is easy to edit and edit the music, and it can be widely used for education for music composition and performance.

BRIEF DESCRIPTION OF THE DRAWINGS FIG. 1 is a schematic diagram showing the overall configuration of an interactive music score performance system according to an embodiment of the present invention; FIG.
BACKGROUND OF THE INVENTION 1. Field of the Invention [0002] The present invention relates to an interactive musical score playing system,
FIGS. 3A and 3B are diagrams illustrating a configuration of a note module and a scoreboard according to an embodiment of the present invention; FIG.
4 is an operational flowchart of a note module according to an embodiment of the present invention;
5 is an overall flowchart of an interactive musical score playing system according to an embodiment of the present invention.
FIG. 6 is a flowchart showing an example of use of an interactive musical score playing system according to an embodiment of the present invention in performance or composition; FIG.
FIG. 7 is a use state diagram of an interactive music score playing system according to an embodiment of the present invention; FIG.

Hereinafter, the configuration of the present invention will be described in detail with reference to the drawings with reference to the drawings.

The present invention relates to a system for automatically playing musical notation, in which musical notes are automatically played by grasping the order, position and type of note modules to which a unique identification ID is assigned through image analysis processing using a camera and infrared communication It is an interactive musical score playing system that allows the user and the system to interact as if they were talking, and to use three senses, auditory, visual, and tactile.

First, as shown in FIG. 1, the present invention includes a note module 100 detachably attached to a score board B on which a line is drawn; A controller 200 communicating with the note module 100 and reading the image information collected by the camera and converting the read image information into a playable signal; An operation panel 300 for performing performance by communicating with the control device 200, and an output device 400 for amplifying a signal converted by the control device and outputting music through a speaker.

At this time, the note module 100 is in the form of a note. The note module 100 has various types of notes indicating a predetermined note length such as a full note, a half note, a quarter note, an eighth note, a sixteenth note, And various kinds of comma representing a predetermined pause length such as a comma, a 2-minute comma, a 4-minute comma, an 8-minute comma, a 16-minute comma and a 32-minute comma, And the like.

Also, it is preferable that the note module 100 is attached to the score board B by a magnetic force or a magnet attached to the body.

The note module 100 includes a battery 110, an infrared communication module 120, an infrared LED 130, a microprocessor 140, and a red LED 150 as shown in FIGS. 2 to 3B .

For example, the battery 110 may be installed in a column of the note module 100 in the case of a note, but it may be installed in a head or a tail. It is acceptable.

The infrared communication module 120 is a module for performing infrared communication with the infrared communication unit 210 of the control device 200 using an infrared signal and is provided with auxiliary means for reading a unique identification ID assigned to the note module 100 to be.

The infrared LED 130 may be installed on the head of the note module 100 to recognize the order in which the note module 100 is laid on the stand of the scoreboard B, 120 receives a signal identical to the identification ID of the note module 100 transmitted from the infrared communication unit 210, the infrared LED 130 is turned on by an instruction from the microprocessor 140. [

Here, the infrared ray is an electromagnetic wave having a wavelength of about 750 nm or more on the outside of the spectrum of the visible light ray and is not in the range of the visible light ray, The learner does not perceive the luminescence even if the luminescent light 130 is lit. However, the learner recognizes the luminescence of the note module 100 by the photographing of the camera unit 220 of the controller 200 and the analysis of the controller 230,

The microprocessor 140 is operated by a power source applied from the battery 110 and loads a unique identification ID assigned to each of the note modules 100 and transmits the identification ID The infrared LED 130 is turned on.

The red LED 150 is a power lamp indicating the operation state of the note module 100 and is preferably an LED lamp and is turned on or off according to a command from the microprocessor 140 The red LED 150 may be turned on or off according to the order of the microprocessor 140 in synchronization with the performance.

2, the control device 200 includes an infrared communication unit 210, a camera unit 220, and a control unit 230. As shown in FIG.

The infrared communication unit 210 communicates with the infrared communication module 120 with an infrared signal and transmits a signal having a unique identification ID assigned to each of the note modules 100. The infrared communication module 120, After receiving the signal of the identification ID, it is analyzed whether the microprocessor 140 is the same as the unique ID assigned to the note module 100, and if it is the same, the infrared LED 130 is turned on.

The camera unit 220 is installed toward the score board B and photographs the score board B. It is preferable to use an infrared camera so that the infrared LED lights together with the image information The control unit 230 can read the order, position, and type of the plurality of note modules 100 placed on the seating line of the scoreboard B,

The control unit 230 receives the image information collected through the camera unit 220 and determines the order of the lighted note module 100 by driving the analysis software built in the control unit 230, The x and y coordinates of the module 100 are generated and read, and the type of the note module 100 is analyzed to read the negative length and the like.

After automatically analyzing the order, position, and type of the plurality of note modules 100 attached to the scoreboard B, the score information generated is converted into a performance-capable signal and transmitted to the output device 400 to perform performance do.

The control unit 230 includes an image information receiving unit 231, a coordinate generating unit 232, an image analyzing unit 233, a signal converting unit 234, and a device controlling unit 235.

The image information receiving unit 231 collects image information photographed by the infrared communication unit 210 and the camera unit 220.

The coordinate generating unit 232 generates and stores the position of the lighted note module 100 included in the received image information as x and y coordinates. For example, the coordinate generating unit 232 generates a setting range The position of the head of the note module 100 lit up in a state in which the range of the zone is subdivided by adding a horizontal line and a vertical line is generated and stored as x and y coordinates.

The image analyzing unit 233 analyzes the order, position, and type of the note module 100 through the image information captured by the camera unit 220 and the coordinates generated by the coordinate generating unit 232 And automatically generates score information.

That is, the image analyzing unit 233 receives the image information collected through the camera unit 220 from the image information receiving unit 231 and drives the built-in analysis software so that the infrared LED 130 is turned on And the x and y coordinates of the note module 100 attached to the score board B included in the image information are generated to calculate the x and y coordinates of the score module 100, And the score information is read by reading the position of the music piece on the line, analyzing the type of the note module 100 through the image information, and reading the negative length and the like.

The signal conversion unit 234 converts the score information generated by the analysis of the image analysis unit 233 into a playable signal.

The device control unit 235 controls the operation of each unit of the control device, and controls the operation of the infrared communication unit 210 and the camera unit 220, for example.

The operation panel 300 is a panel operated by communicating with the control unit 230 of the control device 200 to perform performance and generate sound, and it is preferable that the control panel 230 wirelessly communicates with the control unit 230 to perform performance At this time, the operation panel 300 may be separately provided in the interactive musical score performance system. However, if the software for operation is installed, the operation panel 300 may be performed using a mobile device such as a notebook, a smart phone, a tablet PC, and a slate PC will be.

In addition, the operation panel 300 includes a playback button 310 for performing performance, a repeat button 320 for repeatedly playing the performance, an instrument 320 for selecting a type of musical instrument and outputting the sound of the musical instrument And a selection button 330.

The output unit 400 amplifies the signal converted by the signal conversion unit 234 of the control unit 230 and outputs music to the outside through a speaker. The output unit 400 includes an amplifier 410 for amplifying the converted signal, And a speaker 420 connected to the amplifier 410 for outputting music.

Hereinafter, an operation example of an interactive music score playing system according to the present invention will be described in detail with reference to the drawings.

4, the device control unit 235 of the control device 200 operates the infrared communication unit 210 to operate the note module 200. In this case, When the infrared communication module 120 incorporated in the note module 100 receives the signal of the identification ID and the microprocessor 140 receives the signal of the identification ID assigned to each of the note modules 100 0.0 > ID < / RTI >

If the same signal is input, the microprocessor 140 turns on the infrared LED 130 and turns on the red LED, if necessary.

However, if it is not the same signal, the infrared communication module 120 repeats the same process while receiving the infrared signal of the infrared communication unit 210 continuously.

5, when the signal of the identification ID transmitted by the infrared communication unit 210 is analyzed to be the same as the signal of the identification ID unique to the corresponding note module 100, the infrared LED 130 is turned on , The device control unit 235 of the control device 200 photographs the camera unit 220 by operating the camera unit 220, and the infrared LED is turned on together with the image information.

The image analysis unit 233 of the control unit 230 receives the image information from the image information receiving unit 231 and analyzes the image information to generate the x and y coordinates of the note module 100. The value of R is converted into a score If the value of R is equal to or greater than the number of the note modules 100 attached to the scoreboard B, the process proceeds to the next step I will go.

Next, the built-in analysis software is driven to determine the order of the front and back of the note module 100 in which the infrared LEDs 130 are lit, to arrange them in order, the corresponding positions on the lining board of the score board B are respectively read with respect to the y coordinate and the type of each note module 100 is analyzed through the image information to read the negative length etc., ) Is included.

At this time, when the user clicks the play button 310 or the repeat button 320 of the operation panel, a command is transmitted to the controller 230 of the controller 200, and the performance signal is output to the outside through the output device 400 will be. Of course, you can also click on the Select Instrument button to output sounds from various instruments.

In addition, as shown in FIG. 6, the tutor attaches the note module 100 to the scoreboard B and can start training for the swayings immediately and is easy to learn, and the composer intuitively uses the note module, The user can practice composition without playing the note of the note directly, and the note module can be easily attached or removed on the board, so that it is easy to edit and edit the score.

Accordingly, as shown in FIG. 7, the interactive musical score performance system 1 according to the present invention interacts with a user as if the dialogue is a dialogue, and uses three senses such as auditory, visual, This can lead to effective music education without any inconveniences.

The present invention is not limited to the above-described embodiments. Anything having substantially the same constitution as the technical idea described in the claims of the present invention and achieving the same operational effect is included in the technical scope of the present invention.

1. Interactive score playing system B. score board
100. Note module 110. Battery
120. Infrared communication module 130. Infrared LED
140. Microprocessor 150. Red LED
200. Control device 210. Infrared communication part
220. Camera section 230. Control section
231. Image information receiving unit 232. Coordinate generating unit
233. Image analysis unit 234. Signal conversion unit
235. Device control 300. Control panel
310. Play button 320. Repeat button
330. Instrument selection button 400. Output device
410. Amplifier 420. Speaker

Claims (7)

A note module detachably attached to a scoreboard on which a leader is drawn; And a controller communicating with the note module and reading the image information collected by the camera and converting the read image information into a playable signal; An operation panel communicating with the control device to perform performance; And an output device for amplifying the signal converted by the control device to output music through a speaker,
The note module may include a battery, an infrared communication module for communicating with an infrared signal, and an infrared communication module for receiving a signal identical to the identification ID of the corresponding note module transmitted from the infrared communication unit, An infrared LED for enabling the identification of the order placed on the liner of the board, a unique identification ID that is operated and allocated by a power source applied from the battery, loads the identification ID signal received by the infrared communication module, A microprocessor for turning on an infrared LED, and a red LED for indicating an operation state and being turned on or blinking in synchronization with a performance by an instruction of the microprocessor,
The control device includes an infrared communication unit for communicating with the infrared communication module with an infrared signal and transmitting an identification ID signal, a camera unit having an infrared camera for photographing the music board and recognizing the lighting of the infrared LED, The infrared ray LEDs collected through the infrared camera are illuminated and the recognized image information is received and the built-in analysis software is driven to determine the order of the lighted note modules, and the x and y coordinates of the note module are generated And a controller for analyzing the type of the note module and converting the type of the note module into a playable signal by reading the length of the note.
The method according to claim 1,
Wherein the note module is formed of a magnet body or a magnet attached to the body, and is attached to the score board by a magnetic force.
delete The method according to claim 1,
The control unit includes an image information receiving unit for collecting image information captured by the infrared communication unit and the camera unit, a coordinate generating unit for generating x and y coordinates of the lighted note module included in the image information, An image analysis unit for automatically analyzing the order, position, and type of the note module through coordinates to generate score information, a signal conversion unit for converting the score information into a signal capable of playing, and a device control unit An interactive musical score playing system.
The method according to claim 1,
Wherein the operation panel performs wireless communication with the control section to perform performance.
The method according to claim 1,
Wherein the operation panel includes a playback button for performing performance, a repeat button for repeatedly playing the performance, and a musical instrument selection button for selecting the type of musical instrument.
The method according to claim 1,
Wherein the output device includes an amplifier for amplifying the converted signal, and a speaker connected to the amplifier for outputting music.

Images