KR20110107496A - Realizing technology of electronic samulnori and electronic daegeum(traditional korean musical instruments) using input mode of touch screen(multi touch, gesture)and signal of accelerometer/processing of a sound source and simultaneous performance using wire or wireless communications between server and client /emission technology and game - Google Patents

Abstract

Electronic Samulnori using touch screen input method (multi-touch, gesture) and sensing signal of acceleration sensor in electronic devices including smartphones, technology for implementing electronic bills and processing of sound sources and distances using wired / wireless communication between clients and clients It is related to the ensemble, transmission technology, and server client operation method in the game. The user's motion and method in the analog playing method are processed by using gestures such as acceleration sensor, multi-touch, drag, and so on. You can easily experience and learn Korea's representative national musical instrument on mobile devices including mobile phones and Windows mobile phones, and it is invented to enjoy through games and long ensemble.

Description

Electronic Samulnori using touch screen input method (multi-touch, gesture) and sensing signal of acceleration sensor in electronic devices including smartphones, technology for implementing electronic bills and processing of sound sources and distances using wired / wireless communication between clients and clients Realizing technology of electronic Samulnori and electronic Daegeum (Traditional Korean musical instruments) using input mode of touch screen (multi touch, gesture) and signal of accelerometer / Processing of a sound source and simultaneous performance using wire or wireless communications between server and client / Emission technology and game}

The present invention provides an electronic samulnori using a touch screen input method (multi-touch, gesture) and a sensing signal of an acceleration sensor in an electronic device such as a smart phone, an implementation technology of electronic bill and a sound source using a wired / wireless communication between a client and a client. It is about processing and remote ensemble, transmission technology and game. Unlike analog Samulnori and Daegeum using traditional Korean musical instruments, anyone can learn and play easily with portable electronic musical instrument, and ensemble and game are possible. .

Samulnori is a representative cultural symbol of Korean culture, but it is difficult for the general public to easily obtain or experience musical instruments, and there are restrictions on performance and practice space due to noise problems. In addition, there is a problem that it is difficult to tune the range and the size of the sound even when used in conjunction with other instruments. The same applies to the price.

As the interface of electronic devices has been advanced and the equipment equipped with sensors that can detect user's motion has been introduced, various user input signals required for playing Samulnori can be received from electronic products. It is possible to implement the techniques of detecting motion, shaking hands, and playing samulnori, for example, gang choking, blocking, tweaking, scratching, etc. The input technology for the implementation of Grow, and its implementation is possible.

The present invention is a method for processing the software input signal for making the analog gugak (janggu, gongguri, gong, drum, Daegeum) into a digital instrument as described above, and the various analogue playing methods that are possible in the analog gugakguk each instrument (jangguk) It is the main task to implement it as a major task, and it is an area that analog instruments cannot perform by accommodating parts that are not possible in analog instruments such as adjusting the sound size and playing keys of each instrument. To expand the use of the The expansion of the area is related to the recording, processing, storage and transmission technology of ensemble and ensemble sound sources using games, learning and telecommunications.

In order to achieve the above object, according to one aspect of the present invention, the percussion instruments such as janggu, gongri, gong, drum, and the volume and the adjustment of the playing key can be set in each performance program, and receive the performance of the client through wired / wireless telecommunications. On one server the adjustments are made available on the program configuration screen.

According to another aspect of the present invention, the adjustment of the strength and weakness due to the percussion of the percussion instruments such as janggu, gongri, gong, drum, etc. is controlled by the number of touches of the finger by the player in the display supporting multi-touch, There are five levels of strength and weakness by receiving up to five inputs, each with one finger (weak), two fingers (weak), three fingers (middle), four fingers (strong), and five fingers (strong). Is processed. Or depending on the setting, you can use five levels of sound intensity depending on how close you are to the center of the instrument.

According to another aspect of the present invention, in the case of a dull sound (tuck) of the playing technique of the gongguri gongguri is a sound that changes depending on the degree of horizontal lying on the ground and receives a signal from the acceleration sensor of the mobile device Make the sound dull, depending on how much the device is lying flat on the ground (less than 45 degrees of inclination). At this time, the ground angle may be changed in consideration of the performance characteristics of the user.

According to yet another aspect of the present invention, in the digital implementation of the method of playing the drum (wood) of the drum down from the bottom of the drum using the drum pole of the drum technique of the drum, the acceleration sensor of the mobile device Can detect the movement of the device vertically in a short time due to external shocks, and can use the signal received from it to reproduce the sound hitting the drum pole of the drum.

According to another aspect of the present invention, the sound of the bow and the piece of the Janggu playing techniques are different, and both tapping and tapping on one side are possible from the reception of a display capable of multi-touch recognition, and the ball at the designated place on the screen You can separate and process each signal by placing and.

According to another aspect of the present invention, in the case of the choirdan (dunk) that simultaneously hits the arch and the chaff among the playing techniques of the Janggu, the left and right sides of the actual django are input at the same time as the input points of the arch and the chaff respectively on the multi-touch screen. When it is done, it processes the sound of the palace and the sound of the chalice respectively.

According to another aspect of the present invention, when playing the ball in the playing technique of the Janggu process by playing the sound of the pre-recorded ball from the input point of the ball.

According to another aspect of the present invention, when playing a piece of the Janggu playing technique is processed by reproducing the sound of the pre-recorded piece from the input point of the ball.

According to another aspect of the present invention, the mining (depending) of the playing technique of the Janggu is a light hitting the piece several times with ten fingers of the right hand to touch the piece portion more than three times on the multi-touch screen or touch the finger on the piece portion If you make a circle gesture, the pre-recorded sound will be played.

According to another aspect of the present invention, the overlapping (virtual) of the Janggu playing technique is a playing company that overlaps the piece twice with the heat of the right hand, in the half touch finger after touching the piece with the finger on the multi-touch screen When the user inputs a gesture of dragging a word or a gesture of dragging after touching the English letter S, a pre-recorded sound is played.

According to yet another aspect of the present invention, the act of blocking the ringing plate with the fingers of the hand holding the ear is no less important than playing with the ear. Even in the same type of rhythm, the difference in musical feeling is large depending on the timing or the state of blocking the sounding plate, and even when the sounding type is short and long, the timing or the number of times of the sounding plate is different depending on the speed. In other words, when you play the same type of beats fast enough to accommodate the speed of the number of times less than slow hitting, which depends on the musical breathing. The signal of the acceleration sensor is used to implement this in an electronic instrument. At this time, the accelerometer signal is instantaneously inclined by 5 ~ 10 degrees to the device, which is close to the ground, and receives the signal coming back to block the sounding plate, and the previously played sound source is stopped. . Sound source that needs to be blocked such as Jan, Gang, Gan (○), Jijan, Ji-Gang, Grange (◎, o ○), Gye, Dog (●), Ja-S, Ga-S (◑) Used in conjunction with

According to still another aspect of the present invention, in a jingle performance, 재 ル ル ... In the case of a roll that is expressed as a gare ... (oｏｏｏｏ), when the user inputs a gesture of dragging the smartphone without touching the instrument part and then touching the instrument part (drag), the recorded sound is played.

According to yet another aspect of the present invention, there is a method of crying and beating in a gong's performance, and there is a method of catching and crying. To this end, if the device's acceleration sensor is shaken back and forth on the vertical axis, the sound is caught. If the crying is held, the sound sensor is reproduced by adjusting the acceleration sensor so that the screen looks at the sky and playing each sound source.

According to another aspect of the invention, the volume of the sound reproduced in the playing of the price is configured to operate in accordance with the sound of the wind blowing the user through the microphone of the smartphone.

According to another aspect of the present invention, in the performance of the price of the sound tremor effect is processed by receiving the signal from the acceleration sensor of the device and processing to process the trembling sound to be played by monitoring the shake up and down, left and right.

According to another aspect of the present invention, in the Samulnori performance, the code according to the performance is provided for each instrument, and the sign is expressed as (○, ●, o, ◑, o ○, oｏｏｏｏ…). By using this code to provide a corresponding code on the screen, any user who has learned the basic method can provide the following method of playing so that anyone can play various rhythms of Samulnori. The game can be played using the timing and accuracy according to the provided punctuation code, and the score of the game can be published in conjunction with SNS such as Twitter or Facebook.

According to another aspect of the present invention, in the Samulnori performance, it is possible to ensemble between a plurality of mobile devices connected to the Internet network and a single server, and the start point of the sound and the playing sound of the opponent for the ensemble are checked and received from the server. It is configured to be.

According to another aspect of the present invention, in the Samulnori performance shows the words of the rhythm or vinari sing together as the sound of people other than playing the instrument on the screen of the device or plays the pre-recorded vinari sound in accordance with the rhythm of the performance .

According to the present invention, the present invention is to enable the performance of the conventional analog national musical instruments (things, money) as described above in digital instruments (multi-touch, devices such as smart phones with acceleration sensors), the general public To make it easy for them to see the playing experience of Daegeum and Samulnori, and to learn the performance and rhythm through the use of alternative codes, and to enjoy it through the game, anyone in the world can easily learn Samulnori and Daegeumung, the representatives of Korean cultural icons. You can play it. In addition, it becomes an ensemble with modern musical instruments including Western instruments, making it easy to perform the performance without difficulty in preparing a place and a musical instrument.

1 relates to a spot area and a real program of a basket.
Figure 2 relates to an illustration of virtue among the RBI and playing technique of the Jang.
3 is excessive to the RBI area of the gong.
4 relates to a method of hitting the hit using the RBI of the drum and the acceleration sensor.
5 relates to a method in which one person can play all four musical instruments in samulnori.
FIG. 6 is a portion of the Samulnori musical instrument that divides the distance between the center RBI and the edge of the RBI area in five stages in the musical instruments of Jing, Tong-Gi, and Drum, and divides the signal of sound intensity.
7 is a part of receiving and processing a signal of strength and weakness using multi-touch in a musical instrument before samulnori in five stages.
8 is a diagram illustrating a method of using an acceleration sensor for the processing of a sound-blocking playing method, such as gongs and gongs, of a samulnori musical instrument.
9 is a diagram illustrating a method of utilizing an acceleration sensor of a device for playing a trembling sound of the price playing method.
FIG. 10 illustrates a method using a microphone and a screen touch in a method of playing.
11 is for explaining the remote ensemble function through mutual communication with the server program.
12 is for explaining the self-learning game method of the playing technique through the game of samulnori.
13 is for explaining a method of enjoying a game while playing all the instruments of the object.

Hereinafter, the configuration of the present invention will be described in detail with reference to the accompanying drawings.

According to another aspect of the present invention, a dull sound (탁) of the playing technique

In the case of a tricky playing technique, the sound may vary depending on the level of the ground.

When the mobile device receives a signal from the acceleration sensor of the mobile device, the mobile device

Depending on the degree of wind (below 45 degrees of inclination), let the sound dull. At this time

The ground angle can be changed in consideration of the user's playing characteristics, and can be processed by judging the state of the device (depending on the erect) according to the amount of change per hour and the gravity of the axis of the acceleration sensor as shown in FIG. In addition, it can handle the technique of blocking the sound to kill when the previous blow sound occurs, and the same operation in the gong and gong. Stopping technique is to stop playback of previous hitting sound. If it exceeds the designated angle (default 45 degrees), stop the sound, or shake it lightly as if throwing the device by thinking of Jing's actual playing technique. And blocking can be implemented according to the user's intention.

According to another aspect of the present invention, the drum using the drum pole of the drum playing technique

In the digital implementation of the way of playing (just, ●)

Uh, in the acceleration sensor of a mobile device, the device

It can detect the movement, and using the signal received from the tree part of the drum

It was invented to reproduce the sound hitting the drumstick, as shown in [Fig. 4] -400, the axis information of the acceleration sensor is the same as the gong, 꽹 guri of [Fig. 8].

As shown in [Fig. 2], the sound of the bow and the piece of the Janggu playing techniques are different, and both tapping and tapping on one side are possible from the reception of the display capable of multi-touch recognition, and the hook and the designated part on the screen (200 The invention is invented so that each signal can be distinguished and processed. In the case of choongdan (dunk), which plays both the arch and the chalice at the same time, the left and right sides of the actual django are set as the input points of the arch and (200) chapels on the multi-touch screen. This is done by reproducing the sound of the palace and the sound of the chalice. In addition, the overlapping technique of Janggu is a performance company that overlaps the piece twice with the heat of the right hand.The gesture of turning off the word about half a finger after touching the piece with the finger on the multi-touch screen (230 When a user inputs a gesture of playing the pre-recorded sound or touching the English letter S and dragging the pre-recorded sound, the pre-recorded sound is played. Mining technique (depends on the Janggu playing technique) is to hit the piece several times weakly with the right hand tenths.If you touch the piece more than three times quickly on the multi-touch screen or if you touch the finger on the piece and draw a circle, The pre-recorded sound source is played.

According to another aspect of the present invention, in the gong playing performance is no less than hitting

It is important to block the ringing plate with the finger of the hand holding the ear. Same type

Differences in musical feeling depending on when the sound is blocked or when the sound is blocked

Is large, and even if it is the same type of rhythm,

The number of times is different. In other words, if you play the same type of beat quickly and accept the speed

This is because the number of blockages is slower than when you play slowly, which is followed by musical breathing.

In order to implement this in an electronic musical instrument, a signal of an acceleration sensor is used, which will be described in FIG. 8. At this time, the accelerometer signal is instantaneously inclined 5 to 10 degrees to the device that is at right angles to the ground, and receives a return signal to handle the operation of blocking the sound board, and the previously played sound source is stopped. Sound sources that need to be blocked such as Jan, Gang, Gan, Gyan, Ji, Grange (◎, o ○), Gye, Cane, Jae-s and Ga-s Used in conjunction.

According to yet another aspect of the present invention, in the jingle playing jirul ...,

In the case of a roll that is represented by Garre ... (oｏｏｏｏ), touch the instrument part with your smartphone.

Recording when user inputs gesture of dragging (drag) without touching the touched finger

Sound source is played.

According to another aspect of the present invention, in the performance of the gong crying and hitting (

●) and there is also a way to catch and cry. For this purpose

When the device's acceleration sensor shakes back and forth on the vertical axis (bounces), the sound is caught. If the sound is held, the sound sensor is played by adjusting the acceleration sensor so that the screen looks at the sky.

According to another aspect of the present invention, the loudness of the sound reproduced in the performance of the price

The user is configured to operate according to the wind sound of the mouth blowing through the microphone of the smartphone (1000), which is represented in Figure 10, and adjusts the scale by blocking the wind hole of the finger with the finger (1010).

According to yet another aspect of the present invention, the effect of shaking the sound in playing the price

Receives the signal from the acceleration sensor of the device and processes it.

Process the processed sound to tremble. This is processed according to the acceleration sensor axis shown in FIG.

According to yet another aspect of the present invention, in the Samulnori performance to play each instrument

A sign according to the above is provided and the sign is expressed as (○, ●, o, ◑, o ○, oｏｏｏｏ ...).

A user who has learned the basic method by providing the code on the screen using this code.

So that anyone can play the various rhythms of samulnori,

Can provide. Using the timing and accuracy of the provided alternative code,

The score of the game can be published in conjunction with SNS, such as Twitter or Facebook. This is represented in [Fig. 12] and [Fig. 13], and in each drawing, the stroke code falls from top to bottom to match the performance, and the user touches the stroke code at a certain point or uses the electronic playing method described above according to the stroke code. Play games or learn how to play. In the system, 100 points of correspondence between the rhythm of the original song and the value of the other method and the value input by the user are converted to give feedback to the user after the learning and the game. In addition, in the case of a remote ensemble to determine the music piece to be provided for each part to provide the user as shown in Figure 12.

According to another aspect of the invention, wired and wireless in the Internet network in the Samulnori performance

It is possible to merge between multiple mobile devices connected to one server and one server.

Configured to check the starting point of the player and the sound of the opponent from the server

All. This is represented in [FIG. 11]. The server program can be installed and operated on a PC-class computer that can be connected to an output speaker, or on a wired or wireless LAN-enabled device such as another iPhone or iPod Touch.

According to another aspect of the present invention, four other than playing the instrument in Samulnori performance

Through the screen of the instrument, the words of rhythm or vinari that we sing together as the sound of the ram

Show or play pre-recorded vinari sounds to match your playing rhythm.

100: RBI field of view, 120: Real photograph of the 꽹 Kori program, 200: The ball RBI station, 230: The trick play of virtue performance by drag gesture

Claims (4)

Electronic Samulnori using touch screen input method (multi-touch, gesture) and sensing signal of acceleration sensor in electronic devices including smartphones, technology for implementing electronic bills and processing of sound sources and distances using wired / wireless communication between clients and clients User's multi-touch, gestures, and motions as electronic methods of ensemble, play technique, and samulnori in game. Electronic Samulnori using touch screen input method (multi-touch, gesture) and sensing signal of acceleration sensor in electronic devices including smartphones, technology for implementing electronic bills and processing of sound sources and distances using wired / wireless communication between clients and clients Representation of scale using touch to electronic playing method of ensemble, play technology and game, control of strength and weakness of microphone, and playing of tremor using acceleration sensor Electronic Samulnori using touch screen input method (multi-touch, gesture) and sensing signal of acceleration sensor in electronic devices including smartphones, technology for implementing electronic bills and processing of sound sources and distances using wired / wireless communication between clients and clients How to operate server client in ensemble, play technology and game Electronic Samulnori using touch screen input method (multi-touch, gesture) and sensing signal of acceleration sensor in electronic devices including smartphones, technology for implementing electronic bills and processing of sound sources and distances using wired / wireless communication between clients and clients How to synchronize game and remote performance using ensemble, play technique, and Samulnori batting symbol in game

Images