KR100703362B1 - Method and apparatus playing a musical instruments game in portable terminal - Google Patents

Abstract

The present invention relates to a method and apparatus for providing an instrument playing service through a portable terminal. The present invention relates to projecting and displaying a musical instrument pattern registered with a finger board according to a user's instrument playing game content setting selected by a user, and corresponding to the instrument playing game content. Playing a basic sound source related to music, displaying the fingerboard input pattern according to the basic music reproduction on a display device, recognizing a user operation on the projected displayed instrument pattern, and receiving sound source information corresponding to the recognized user operation. Read and play along with the basic performance sound source, output the result, and compare the recognized user operation with the fingerboard input pattern to determine whether the user input is normal or not according to whether the user input is within a predetermined error range. It is characterized by providing.

Instrument pattern projection, fingerboard input pattern, instrument playing games

Description

METHOD AND APPARATUS PLAYING A MUSICAL INSTRUMENTS GAME IN PORTABLE TERMINAL}

1 is a view showing the configuration of a portable terminal to which the present invention is applied;

2A and 2B illustrate an example of projecting and displaying an instrument pattern according to an embodiment of the present invention;

3 is an operation flowchart of a portable terminal according to a musical instrument playing game setting process according to an embodiment of the present invention;

4 is a view showing a menu screen according to the instrument playing game setting process according to an embodiment of the present invention;

5 is an operation flowchart of a portable terminal according to an instrument playing game execution process according to an embodiment of the present invention;

Figure 6 is a view showing the instrument pattern projection and the display screen when the instrument research game running according to an embodiment of the present invention.

The present invention relates to a portable terminal, and more particularly, to a method and apparatus for providing an instrument playing service through a portable terminal.

With the development of technology, various high quality functions have begun to be added to portable terminals such as mobile communication terminals and PDAs.

In response to this trend, the portable terminal has been provided with an extended performance service from a function of editing a melody or bell usable for various purposes.

For example, Patent Application No. 10-2002-66875, entitled "Mobile Phone with Melody Play Function," by the Korean Intellectual Property Office, incorporates a melody chip to allow a user to play the melody by operating a keypad. A keypad having a number key (0-9) for dialing a telephone number and a * key and a # key used as a function key. A melody selection control signal for distinguishing the key signal by recognizing a key pressed from the keypad. Control unit for generating a melody chip for generating a variety of melody frequency by the melody selection control signal of the control unit filtering the melody frequency and converting to have a tone to output and amplifying the melody tone output from the filtering unit to a predetermined level Mobile phone with a melody playing function, including an amplifier for transmitting through the speaker Initiate.

As described above, since the performance service is provided through a keypad of a portable terminal that is completely different from the shape of the musical instrument, a user who is familiar with musical instrument operation cannot naturally play the portable terminal.

In addition, since the number of keys provided in the keypad of the portable terminal is very limited, it is not possible to provide a performance service for various sound ranges.

In addition, since it is difficult to shorten the time required to press a key, it was difficult to naturally play percussion instruments such as drums through the portable terminal.

Moreover, there was no application to the game using this.

Accordingly, in the related art, the development of a technique for enabling natural musical instrument performance even in a portable terminal and applying it to a game by expanding it is urgently desired.

Accordingly, an object of the present invention is to provide a method and apparatus for providing a musical instrument playing game of a portable terminal, which enables various musical instruments to be played naturally and conveniently in accordance with a game.

In addition, another object of the present invention is to play a musical instrument of a portable terminal that detects the user's operation on the projection-displayed instrument pattern and outputs an audio signal according to the user's operation in order to enable the playing game through the instrument pattern of the user familiar form The present invention provides a method and apparatus for providing a game.

According to an aspect of the present invention, there is provided a process of projecting and displaying a musical instrument pattern registered with a fingerboard according to a user setting of a musical instrument game content selected by a user, and reproducing a basic sound source associated with music corresponding to the musical instrument game contents. Displaying the finger board input pattern according to the basic music reproduction on a display device; recognizing a user operation on the projected and displayed musical instrument pattern; and reading sound source information corresponding to the recognized user operation. The process of reproducing and outputting along with a performance sound source and comparing the recognized user operation with the finger board input pattern to determine whether the user input is normal or not and provide a result according to whether the user operation is recognized within a predetermined error range. It is characterized by including.

Hereinafter, exemplary embodiments of the present invention will be described in detail with reference to the accompanying drawings. Note that the same components in the drawings are represented by the same reference numerals and symbols as much as possible even though they are shown in different drawings. In addition, in describing the present invention, when it is determined that a detailed description of a related known function or configuration may unnecessarily obscure the subject matter of the present invention, the detailed description thereof will be omitted.

The configuration of a portable terminal according to a preferred embodiment of the present invention will be described with reference to FIG.

The controller 100 of the portable terminal not only controls the portable terminal as a whole, but also controls each unit of FIG. 1 to provide an instrument playing service according to a preferred embodiment of the present invention.

To describe the operation of the control unit 100 in more detail, the control unit 100 plays a basic sound source for music corresponding to the musical instrument playing game content according to the user's selection when the musical instrument playing game is executed, and displays a fingerboard input pattern. Displayed on device 120 and projecting the pattern for the selected instrument. The controller 100 controls the user interface unit 102 for musical instrument performance to recognize a user operation on the projected and displayed musical instrument pattern. According to the above control, if the user interface unit 102 for playing a musical instrument recognizes a user operation on a projected and displayed musical instrument pattern and provides a recognition result, the controller 100 may be configured to detect the fingerboard input pattern according to the music playing game content. In preparation for the user operation, it is determined whether the user operation is input within a predetermined error, and the result is converted into a score. The controller 100 detects sound source information corresponding to the user operation and controls the sound source chip 116 to output an audio signal according to the sound source information. Under the control of the controller 100, the sound source chip 116 outputs the audio signal according to the sound source information through the speaker 112 in real time together with the basic performance. Thus, the musical instrument playing game according to the present invention is implemented.

In addition, when the sheet music service is requested by the user while providing the playing service, the controller 100 reads out the sheet music information stored in the memory unit 124 and displays the score information on the display device 120. The sheet music information display method may be provided in various ways, and the controller 100 selects one of the various types of sheet music information display methods from a user and displays the sheet music information in a manner according to the selection.

In addition, when the image pickup is requested by the user while providing the performance service, the controller 100 captures a scene of the user through the second image pickup device 126 and displays the captured scene on the display 120. Also played through.

The memory unit 124 stores various information including a processing program of the controller 100. In particular, according to a preferred embodiment of the present invention, a plurality of instrument playing game content information, a basic sound source consisting of a basic performance for a plurality of music used in the instrument playing game, a plurality of fingerboard input patterns according to each instrument playing game content, A plurality of musical instrument pattern information, sound source information corresponding to a plurality of musical instrument patterns, detailed setting item setting information for each of the plurality of musical instruments, a plurality of performance information, a plurality of sheet music information, performance scene imaging information, and the like are stored.

The musical instrument pattern information is information on musical instrument patterns corresponding to a plurality of musical instruments, and may include, for example, a piano, a sex phone, an electronic drum pad, and the like. The finger board input pattern is a performance pattern for inducing the performance of a musical instrument selected by a user during a musical instrument playing game, and is a pattern representing a performance time and a performance form of the musical instrument. For example, if the instrument selected by the user is a piano, the instrument represents a time point when the user should play the piano and a pattern for the sound source to be played in the musical instrument game. The finger board input pattern is configured to match the performance of the instrument to the basic sound source of the song, and is displayed on the display device 120 when the game is executed. The displayed form may be configured such that an image indicating the type of sound source to be input by the user is displayed separately, and the image corresponding to the sound source blinks at the time when each sound source is to be input. Or by displaying a basic image indicating the type of sound source to be input by the user at the bottom of the display screen, and displaying an image corresponding to the sound source to be input as the game progresses to move in a direction from the top to the bottom of the display screen, It may also be configured to display such that it fully matches the base image already displayed at the time of input. This example is shown in FIG. 6 is a view showing the instrument pattern projection and the display screen when the instrument research game according to an embodiment of the present invention.

Here, the sound source information corresponding to the musical instrument pattern will be briefly described as an example of playing the piano.

In the portable terminal, the musical instrument user interface 102 of the present invention can display and display a pattern for the piano keyboard and recognize a user operation on the projected piano keyboard pattern.

The controller 100 receives a result of recognizing information about a user manipulation position on the projection-displayed piano keyboard pattern from the musical instrument user interface 102.

When the recognition result of the user manipulation position is provided, the control unit 100 controls the sound source chip 116 to output audio corresponding to the user manipulation position on the piano keyboard pattern to the user manipulation position on the piano keyboard pattern. Corresponding sound source information should be obtained.

To this end, the memory unit 124 stores a table in which the sound source information corresponding to the user's operation position on the piano keyboard pattern is matched with the name "sound source information corresponding to the musical instrument pattern".

Accordingly, the controller 100 may obtain sound source information corresponding to the user operation position on the piano keyboard pattern, and provide the obtained sound source information to the sound source chip 116 to output audio corresponding to the user operation. To be able.

The musical instrument user interface 102 includes a first imaging device 104, a motion recognition unit 106, a projection display device 108, and a first video signal processing and output unit 110.

The first video signal processing and output unit 110 transforms the musical instrument pattern information provided by the controller 100 into a signal for projecting display and provides the converted display device to the projection display device 108. The projection display device 108 projects and displays an instrument pattern according to the output signal of the first video signal processing and output unit 110. Here, the user plays the instrument according to the projection-displayed instrument pattern, the movement of the hand for playing the instrument is picked up by the first imaging device (104).

The first imaging device 104 captures the movement of the user's hand on the projected and displayed musical instrument pattern, and provides the captured information to the motion recognition unit 106. The motion recognition unit 106 detects a change in the position of the user's hand on the musical instrument pattern through the sensing information, and provides the detection information to the control unit 100. As a result, the control unit 100 can obtain information on the user's operation state on the projection-displayed musical instrument pattern.

The description of this user interface is evident from the modification of Carnesta's Virtual Keyboard. The Kanesta's virtual keyboard is a technology for projecting and displaying a keyboard pattern and recognizing user manipulation on the projected keyboard. The Kanesta's virtual keyboard is transformed into a variety of forms, that is, musical instrument patterns. By further expanding the field, the user interface unit of the present invention can be implemented. However, due to the miniaturization of the projection display device and the development of various types of motion recognition technologies, the user interface unit 102 for playing musical instruments is implemented to read pattern projection and information suitable for the portable terminal for playing musical instruments of the present invention. It is not limited to STAR's virtual keyboard.

An example of the musical instrument projection display of the portable terminal according to the preferred embodiment of the present invention described above will be described with reference to FIGS. 2A and 2B.

FIG. 2A illustrates an example in which the portable terminal projects and displays a piano pattern, and FIG. 2B illustrates an example in which the portable terminal projects and displays a drum pattern. As such, the present invention projects and displays patterns for various instruments, and recognizes user operations on the projected and displayed instrument patterns, and outputs audio accordingly, so that the user can play through an instrument pattern similar to the shape of a real instrument. do.

The audio signal processing and output unit 114 processes voice data for a call and outputs the same through the speaker 112 under the control of the controller 100.

The sound source chip 116 generates an analog audio signal corresponding to the sound source information provided by the controller 110 and outputs it through the speaker 112. In particular, the sound source chip 116 reproduces the original sound of the piano, guitar, drums, etc. in order to enable the performance for a variety of musical instruments according to the present invention, and of high quality that can modulate the sound for each instrument A sound source chip may be employed.

The speaker 112 outputs audio according to the output of the audio signal processing and output unit 114 and the sound source chip 16.

The second video signal processing and output unit 118 processes image information or graphic information provided by the control unit 100 and displays the same through the display device 120. Here, the image information includes a performance scene photographed by the second imaging device 126 and the graphic information according to a user's request, and includes the music score information for various music services, various menus, and the like.

The display device 120 outputs an image or graphic according to the output of the second video signal processing and output unit 118.

The keypad 122 includes a plurality of keys to provide a key input signal from the user to the controller 100, thereby interfacing between the user and the controller 100.

The second imaging device 126 is a general imaging device provided in the portable terminal, and performs imaging under the control of the control unit 100.

The process of providing a musical instrument playing service in the portable terminal is as follows. When the user of the portable terminal commands the entry of the instrument playing service included in the main menu through the keypad 122, the controller 100 guides the playable instruments and selects one of the guided instruments. The user is guided through the display device 120. When the user selects any one of the guided instruments, the controller 100 reads out an instrument pattern corresponding to the selected instrument from the memory unit 124 to process the first video signal processing and output unit 110 and the projection display. Display through the device 108. In addition to projecting and displaying the musical instrument pattern as described above, the controller 100 detects a user manipulation on the projected and displayed musical instrument pattern through the first imaging device 104 and the motion recognition unit 106. When the user manipulation on the musical instrument pattern is detected, the controller 100 reads sound source information corresponding to the detected user manipulation from the memory unit 124 and provides the read sound source information to the sound source chip 116. The sound source chip 116 outputs the audio signal according to the sound source information to the speaker 112, thereby performing the performance through the projection-displayed instrument pattern. Whenever the user outputs an audio signal played by the user through the projected musical instrument pattern, the control unit 100 temporarily stores the corresponding sound source information as performance information sequentially, and if the user requests a storage, Stores the sound source information stored temporarily.

Next, a process of providing a musical instrument playing game service according to the present invention by a portable terminal providing a musical instrument playing service as described above will be described. First, the process of setting the service of the instrument playing game and the details of the instrument playing game according to an embodiment of the present invention will be described with reference to FIG. 3 is an operation flowchart of a portable terminal according to a musical instrument playing game setting process according to an embodiment of the present invention.

The portable terminal includes a plurality of menus, and according to a preferred embodiment of the present invention, the main menu includes a plurality of menu items embodied by graphic icons, and among the plurality of menu items, commands for entering an instrument playing game service. Menu items to include are included.

Referring to FIG. 4, which shows a menu item for instructing the user to enter the instrument playing game service, the main menu displayed on the display device 120 includes a mobile phone management menu item A, like the first screen 301. The wireless Internet access menu item (B), the phone book menu item (C), the message management menu item (E), and other items (F) include menu items (D) for instructing entry into the instrument playing game service. It is. Referring to FIG. 3, when the user of the portable terminal commands an entry of an instrument playing game service included in the main menu through the keypad 122 in step 201, the controller 100 proceeds to step 203. In step 203, the controller 100 guides the musical instrument playing game content and proceeds to step 205. The musical instrument playing game content may be classified according to the music to be played at the time of the game or according to the difficulty of the game. In step 205, if there is an input for selecting an arbitrary musical instrument playing game content from the user, the controller 100 proceeds to step 207. In operation 207, the controller 100 displays the musical instrument that can be played in the selected instrument playing game content as graphic icons G, H, and I corresponding to a plurality of musical instruments as shown in the second screen 303 of FIG. 4. Display on the screen and proceed to step 209. In step 209, if there is a musical instrument selection from the user, the controller 100 proceeds to step 211. In step 211, the control unit 100 registers the selected instrument as an instrument playing fingerboard and proceeds to step 213. In step 213, the control unit 100 determines the detailed setting item, the music service service method, and whether to shoot the video according to the user's request, sets the details of the game content, and proceeds to step 215.

Here, the portable terminal of the present invention provides a detailed menu for setting details of a musical instrument playing game. A display example of the detailed menu will be described with reference to FIG. 4, and the configuration of the detailed menu can be variously modified in consideration of ease of use.

The third screen 305 of FIG. 4 is a screen showing a detailed menu for setting the overall options of the selected instrument playing game contents, and the user selects the overall settings of the songs in accordance with the rhythm and arrangement of the songs corresponding to the selected instrument playing game contents. A manual item (J) to be set according to the above, a setting item (K) for setting a rhythm of a song corresponding to the selected instrument playing game content, a method of arranging the arrangement method, etc. to a setting value selected by a user from among a plurality of preset values Performance game content type (K);

In operation 209, a menu for setting a playing style of the instrument selected by the user is provided. For example, when a selected instrument is called a piano, detailed settings of the piano include a jazz piano (M), a classic piano (N), and an electric (as shown in the fourth screen 307 of FIG. 4). electric) Piano (O) and the like, the user can select any one of the above-described detailed setting items to command to modify the tone of the output piano.

In addition, referring to the fifth screen 309 of FIG. 4, the detailed menu includes a graphic icon S for commanding to store temporarily stored performance information as a ringtone, and a graphic icon for commanding on / off of the bass enhancement effect. (R), a graphic icon (T) for commanding multiple selections, a graphic icon (P) for commanding imaging of a performance scene, a graphic icon (Q) for commanding to store temporarily stored performance information as a background, and the like. do. Through such a detailed menu, the user can input by operating the pattern and storage type of the projected instrument. In addition, it is also possible to set whether or not to provide music scores.

Setting the detailed items of the musical instrument playing game content through the above detailed item menu is made as follows. When the user requests the change of the setting state of any one detailed setting item through the keypad 122, the control unit 100 changes the setting state of the corresponding detailed setting item according to the change request as described above and changes the setting state to the changed setting state. Information is stored in the memory unit 124. In addition, the user may request a music service through the keypad 122. Here, the sheet music service is a function for outputting the sheet music to be referred to at the time of playing through the display device 120, such that the sheet music is displayed in a line-by-line unit, and the sheet music is displayed in page units. Can be. That is, the controller 100 checks whether the user requests a sheet music service through the keypad 122, and when the user requests the sheet music service, guides the various sheet music services that can be serviced, and also selects one of the various sheet music services. A graphic or the like for guiding selection is displayed on the display device 120. When the user selects any one of the various sheet music services through the keypad 122 according to the above guide, the controller 100 provides a plurality of sheet music previously stored in the memory unit 124 when the musical instrument playing game is executed. In addition to the guidance, a graphic or the like for guiding a user to select one of the music scores is displayed on the display device 120.

In addition, the user may request the photographing of the playing scene through the keypad 122 while playing by manipulating the displayed musical instrument pattern or setting the details of the musical instrument playing game contents. Accordingly, the controller 100 checks whether the user requests imaging of the playing scene through the keypad 122 while providing the playing service through the projected musical instrument pattern. When the user requests the imaging of the playing scene, the controller 100 controls the second imaging device 126 to capture the playing scene of the user for a predetermined time, and uses the captured image data as the playing scene imaging information. Stored in the memory unit 124. As described above, the stored scene image information may be reproduced at the request of the user through the keypad 122.

Returning to FIG. 3, after executing step 213, in step 215, the controller 100 checks whether there is a request for playing a musical instrument playing game from the user, and if there is a request for execution, proceeds to A and proceeds to step 231 of FIG. If no, go to Step 217. In step 217, the controller 100 checks whether there is a request for changing the instrument playing game setting, and if there is a request for changing the setting, returns to step 207 to change the details of the selected instrument playing game content according to the user's selection, and if there is no request for changing the setting, Proceed to step 219. In step 219, the controller 100 determines whether there is a request for changing the musical instrument playing game content, and if there is a change request, the controller 100 proceeds to step 203 to change the playing game content by performing the above-described operation. In step 221, the controller 100 terminates the musical instrument playing game service if the musical instrument playing game ends.

A process of executing the instrument playing game according to the details of the instrument playing game content set by the user according to the above process will be described with reference to FIG. 5 is an operation flowchart of a portable terminal according to a musical instrument playing game execution process according to an embodiment of the present invention.

In step 215, the control unit 100 displays the musical instrument pattern registered as the instrument playing finger board in step 231 of FIG. 5 through the projection display device 108 according to the request for executing the instrument playing game, and is set in the display device 120. The basic screen according to the details of the game content is displayed and the process proceeds to step 253. In step 235, the control unit 100 starts a musical instrument playing game after a predetermined time passes and proceeds to step 235. In step 235, the controller 100 plays the basic sound source according to the details of the preset game content, displays the fingerboard input pattern according to the music playback on the display device 120, and proceeds to step 237. In step 237, the controller 100 determines whether a user operation on the projected musical instrument pattern is recognized, and when the user operation is recognized, the controller 100 proceeds to step 239. In step 239, the control unit 100 compares the recognized user operation with the finger board input pattern, determines whether the normal input is performed according to whether it is recognized within an error range, and converts the score into a score, and the audio signal of the sound source information corresponding to the recognized user operation. Output to step 241. At this time, the controller 100 outputs the sound source information corresponding to the user operation and the basic sound source together. In other words, in step 239, the control unit 100 checks whether the user's manipulation on the musical instrument pattern corresponding to the sound source to be input according to the finger board input pattern is input at the time when the input is required. For example, if the user's operation on the piano corresponding to the sound source currently being “mi” is input in the finger board input pattern, it is to check whether the user operation on the piano detected at the input time is “mi”. At this time, the controller 100 determines whether the input is successful within a predetermined error range, and converts and displays the score according to the result. In addition, the controller 100 may output a voice for guiding success. The predetermined error range includes a time range in which a user operation on the instrument can be recognized as an input, and an operation range according to a simultaneous generation allowance range of a user operation corresponding to another sound source in addition to a sound source to be input. However, there may be a plurality of sound sources to be input at the same time.

In step 241, the control unit 100 temporarily stores the output basic music and the audio signal of the sound source information in combination, and proceeds to step 243. In step 243, the controller 100 checks whether the music playing game is completed, that is, whether the playing of the corresponding song is completed, and if so, proceeds to step 245 and displays the final score. Thereafter, in step 247, the controller 100 proceeds to step 248 if there is a request for storing temporarily stored information from the user, and proceeds to step 253 if there is no request for storing the temporarily stored information. In step 253, the controller 100 deletes the temporarily stored performance information and proceeds to step B to step 215 of FIG.

In step 247, the controller 100 notifies the type of storage in step 248 according to a user's request for storing temporarily stored information, and proceeds to step 249. In step 249, the controller 100 stores the temporarily stored tone information corresponding to the selected storage type, and proceeds to step B, and proceeds to step 215 of FIG. Although a process of receiving input of the temporarily stored sound source information from the user at steps 247 to 215 is shown again, it may be stored as a storage type set when setting the instrument playing game details according to the process shown in FIG. 3. The various types of storage may include storage as a ringtone, storage as a background sound, an alarm, and the like.

As described above, the present invention installs a projection display device on a portable terminal to project and display a musical instrument pattern, and compares a predetermined finger board input pattern with a user operation on the projection displayed musical instrument pattern for any music, and compares the same. By converting the score according to the result and outputting an audio signal, it is possible to play a musical instrument and play a game.

In the above description of the present invention, specific embodiments have been described, but various modifications may be made without departing from the scope of the present invention. Therefore, the scope of the present invention should not be defined by the described embodiments, but should be determined by the equivalent of claims and claims.

As described above, the present invention installs a projection display device on a portable terminal to project and display a musical instrument pattern, and guides and projects a predetermined finger board input pattern that induces a performance that matches the reproduced music while reproducing arbitrary music. Induce user operation on the displayed instrument pattern, compare the fingerboard input pattern with the user operation, convert the score according to the comparison result, and output an audio signal so that the user can play the instrument and play the game. It can be enjoyable to the user.

Claims (13)

In the method of providing a musical instrument playing game of the portable terminal, The process of projecting and displaying the instrument pattern registered with the finger board according to the instrument performance game content setting selected by the user; Playing a basic playing sound source associated with music corresponding to the musical instrument playing game content, and displaying a finger board input pattern according to the basic music playing on a display device; Recognizing a user operation on the projected displayed instrument pattern; The sound source information corresponding to the recognized user operation is read and reproduced together with the basic performance sound source, and the user operation is recognized within a predetermined error range by comparing the recognized user operation with the finger board input pattern. The method of providing a musical instrument playing game, comprising the step of determining whether or not the normal input according to whether or not. The method of claim 1, further comprising: storing the basic playing sound source and an audio signal according to a reproduction output of the sound source information according to a storage type selected by a user. The method of claim 1, further comprising: capturing a user operation on the projected and displayed musical instrument pattern and storing it as performance scene imaging information when a performance imaging request is requested. The instrument playing apparatus according to claim 1, wherein the finger board input pattern is a performance pattern representing a plurality of sound sources to be input and an input time point of each sound source to induce the performance of the projection-displayed instrument matching the music to be reproduced. How to deliver the game. According to claim 4, The finger board input pattern is characterized in that the image indicating the type of sound source to be input by the user is displayed separately, the image corresponding to the sound source is changed and displayed at the time when each sound source is to be input To play a musical instrument game. The method of claim 5, wherein the predetermined error range is an allowable error range for the time difference between the input time point of the sound source to be input and the time when the user operation on the projected musical instrument pattern is recognized, and the input error range should be input. And an error range for an acceptable recognition range for user manipulation on the projected instrument pattern corresponding to a sound source other than a sound source. The method of claim 6, wherein the result of determining whether the input is normal is provided by converting the result into a score. The method of claim 7, wherein the musical instrument game content is divided according to different types of music and difficulty levels, and detailed setting items of the musical instrument game contents are transmitted to the finger board during the rhythm, arrangement, and musical instrument game of the corresponding music. A performance game providing method comprising a musical instrument to be registered and a playing format of the musical instrument. In the musical instrument playing game providing device of the portable terminal, A user interface section for musical instrument performance which projects and displays an instrument pattern and detects user operations on the projected displayed instrument pattern; A memory unit for storing musical instrument pattern information, sound source information corresponding to a user operation on the musical instrument pattern, music playing game contents, and a plurality of fingerboard input patterns; A sound source chip which receives sound source information and outputs an audio signal, A speaker for receiving and outputting an audio signal output from the sound source chip; Projecting and displaying a musical instrument pattern registered with a finger board according to the instrument playing game content setting selected by the user, playing a basic playing sound source associated with music corresponding to the instrument playing game content, and playing the finger board according to playing the basic sound source If an input pattern is displayed on a display device, and a user operation on the projected and displayed musical instrument pattern is recognized, the sound source information corresponding to the recognized user operation is read, reproduced and output together with the basic performance sound source, and the recognized user operation and the And a controller configured to compare a finger board input pattern and determine whether the user input is normal based on whether the user manipulation is recognized within a predetermined error range and to provide a result. 10. The instrument performance according to claim 9, wherein the finger board input pattern is a performance pattern representing a plurality of sound sources to be input in order to induce the performance of the projection-displayed instrument that matches the music to be reproduced, and an input time point of each sound source. Game provision device. 11. The method of claim 10, wherein the finger board input pattern is characterized in that the image indicating the type of sound source to be input by the user is displayed separately, the image corresponding to the sound source is changed and displayed at the time when each sound source is to be input Instrument playing game providing device. 12. The apparatus of claim 11, wherein the predetermined error range is an allowable error range for a time difference between the input time point of the sound source to be input and the time when a user operation on the projected musical instrument pattern is recognized. And an error range for an acceptable recognition range for user manipulation on the projected instrument pattern corresponding to a sound source other than a sound source. The method of claim 12, wherein the musical instrument game content is divided according to different types of music and difficulty, and detailed setting items of the musical instrument game content are directed to the finger board during the rhythm, arrangement, and musical instrument game of the corresponding music. And a musical instrument to be registered, and a performance form of the musical instrument.

Images