JP2014130237A - Musical piece performance device - Google Patents

Abstract

PROBLEM TO BE SOLVED: To adequately teach a string pressing state of a stringed instrument to a player.SOLUTION: Musical piece performance processing executes: a performance process for displaying performance information of the specified musical piece information on a performance means; and a pressing state display process for reading pressing state image information corresponding to pressing state information synchronizing with progress of the performance process, for preparing reversal imaging information by horizontally flipping the imaging information imaged by imaging means and, for displaying the read pressing state image information superimposed to the reversal imaging information on display means.

Description

  The present invention relates to a music performance device for performing music based on performance information included in music information. In particular, the present invention relates to a music performance device capable of playing a stringed instrument in accordance with the music to be played.

  Conventionally, in karaoke apparatuses installed in night stores such as karaoke boxes and snacks, singing is performed in accordance with the performance of music. Patent Document 1 proposes a karaoke apparatus that can enjoy not only singing but also playing musical instruments. The karaoke apparatus disclosed in Patent Document 1 displays a part that can be muted (muted) among parts played karaoke, and mutes the part instructed by the user to enjoy the minus one performance of the part. Can do. Furthermore, in the karaoke apparatus disclosed in Patent Document 1, the chord name is displayed on the screen, the player is instructed which chord should be played, and the performance can be enjoyed without using a paper score. Is possible

  As an apparatus for assisting musical instrument performance, Patent Document 2 generates a fingering instruction image including a musical instrument image representing a musical instrument and a transparent image representing a finger in a posture of performing the musical instrument, and displays the generated fingering instruction image on a display unit. A fingering pointing device is disclosed. In the fingering instruction apparatus disclosed in Patent Document 2, since the image representing the finger is displayed in a transparent state, the user can clearly check the instrument image even if the fingering image overlaps the front of the instrument image. It becomes possible to do.

Japanese Patent Laid-Open No. 2001-100771 JP 2005-241877 A

  The fingering instruction image displayed by the fingering instruction device disclosed in Patent Literature 2 is generated by generating a model fingering state together with a musical instrument image. Therefore, when performing a musical instrument performance in Patent Document 2, a user who is a performer determines his / her fingering state while comparing the fingering instruction image displayed on the fingering instruction device with the musical instrument to be played. There is a need. Therefore, the user needs to perform the performance while confirming the fingering instruction image and the musical instrument to be played many times, and there is a problem that the fingering state cannot be determined intuitively. Such a problem is particularly noticeable for musical instrument beginners who have to visually recognize their fingering state on the musical instrument.

  For this reason, in the configuration of Patent Document 1, when a user connects a musical instrument such as a guitar and displays an image on the display screen as in Patent Document 2 as the music performance progresses, the user visually recognizes the fingering state one by one. There is a need to. If you take your eyes off the display screen to see the fingering state, the performance will stop, and the next time you look at the display screen, the image on the display screen will progress to the next fingering, It becomes difficult to continue playing the guitar.

Therefore, the music performance device according to the present invention is
In a music performance device that plays music based on music information,
A performance means for performing based on performance information;
Control means capable of performing a performance process and a string display process executed in synchronization with the performance process,
The music information is configured to include the performance information and string information synchronized with the progress of the performance information,
The performance processing causes the performance means to display the performance information of the specified music information,
The string display process reads the string image information corresponding to the string information in synchronism with the progress of the performance process, reverses the imaging information captured by the imaging unit to form inverted imaging information, and forms the inverted imaging information. On the other hand, the read string image information is superimposed and displayed on the display means.

Furthermore, in the music performance device according to the present invention,
The string display processing is characterized in that the string image information corresponding to the next string information is displayed as the performance process proceeds.

Furthermore, in the music performance device according to the present invention,
The pressed string display process displays the pressed string image information corresponding to the current pressed string information as the performance process progresses.

Furthermore, in the music performance device according to the present invention,
The string-pressing image information includes at least one of the shape of the hand that presses the string and the position where the string is pressed.

Furthermore, the music performance device according to the present invention is:
Before starting the performance process, a position alignment process for aligning the position of the stringed instrument imaged by the imaging unit and the display position of the string image information is performed.

Furthermore, the music performance device according to the present invention is:
During the execution of the string display process, a position tracking process for aligning the position of the stringed instrument imaged by the imaging unit and the display position of the string image information is performed.

  According to the music performance device according to the present invention, how the user performs fingering by reading the string image information in synchronization with the performance and displaying it on the stringed instrument imaged by the imaging means. It becomes possible to confirm whether it is good. In particular, since the stringed instrument imaged by the imaging means is displayed flipped to the left and right, it is possible to suppress the uncomfortable feeling felt by the user and confirm how to carry it intuitively.

  Furthermore, according to the music performance device according to the present invention, in the progress of the performance process, the state of the string to be pressed next is displayed as the string image information, so that the user can operate with respect to the current string state. It becomes possible to confirm whether it should be pointed.

  Furthermore, according to the music performance device according to the present invention, in the progress of the performance process, the state of the string that should be pressed is displayed as the pressed string image information, so that the user can confirm how the string should be pressed at present. It becomes possible to do.

  Furthermore, according to the music performance device according to the present invention, the string-pressed image information includes at least one of the shape of the hand that presses the string or the position where the string is pressed. By adopting the shape of the hand that presses the string, the user can confirm how the shape of his / her hand should be compared with the displayed reverse imaging information. In addition, by displaying the depressed position of the string, it is possible to accurately convey to the user the position of the string and the depressed position that may be hidden by the user's hand in the inverted imaging information.

  Furthermore, according to the music performance device according to the present invention, the position of the stringed instrument imaged by the imaging unit and the display position of the pressed string image information are aligned in advance before the performance processing (positioning processing). Thus, it is possible to appropriately display the string image information on the captured stringed instrument in the imaging information.

  Furthermore, according to the music performance device according to the present invention, during the performance processing, by aligning the position of the stringed instrument imaged by the imaging means and the display position of the pressed string image information (position tracking process), Even when the position of the stringed instrument changes during performance, it is possible to appropriately display the string image information on the captured stringed instrument.

The figure which shows the structure of the karaoke system which concerns on embodiment of this invention. The flowchart which shows the music performance process which concerns on embodiment of this invention The flowchart which shows the performance preparation process for musical instruments which concerns on embodiment of this invention The flowchart which shows the performance process for musical instruments which concerns on embodiment of this invention The flowchart which shows the display correction process which concerns on embodiment of this invention The figure which shows the mode of the positioning image display which concerns on embodiment of this invention The figure which shows the mode of the display in the performance process for musical instruments which concerns on embodiment of this invention.

  Then, the case where it applies to a karaoke system is demonstrated about the music performance apparatus which concerns on embodiment of this invention as an example. FIG. 1 is a diagram showing a configuration of a karaoke system according to an embodiment of the present invention. The karaoke system in the present embodiment is composed of a karaoke device 2 and remote control devices 1a and 1b, which are connected to each other via a LAN 100 so that they can communicate wirelessly and wiredly. The karaoke device 2 functions as a music performance device that displays a fingering model (string image) on a monitor device for a musical instrument player. The display output destination by the karaoke device 2 may be the remote control device 1 instead of the monitor device 41.

  The karaoke device 2 installed in the store can accept various instructions from the user by the remote control device 1 (for example, 1a, 1b). In addition, the remote control device 1 includes a touch panel display screen in which the display unit 11 and the operation unit 17 are shared, and can provide various information to the user. The remote control device 1 is wirelessly connected to the karaoke device 2 via an access point 110 installed on the LAN 100. As shown in the figure, for example, the karaoke device 2 is associated with remote control devices 1 a and 1 b, and can transmit and receive information via the LAN 100. In addition, the remote control device 1 and the karaoke device 2 can perform short-range communication using infrared rays or the like.

  Furthermore, in the karaoke system of the present embodiment, a karaoke host 5 (server device) is provided via the Internet to provide various services to the user, and the storage unit 51 has various services such as music information and user information. The information necessary for is stored. And it is comprised so that various information can be transmitted / received with the karaoke apparatus 2 or the remote control apparatus 1 through the router 120. FIG.

  The karaoke apparatus 2 as a music performance apparatus according to the embodiment of the present invention functions mainly with the control unit 30 that performs overall control, and performs a music performance process for executing a music performance as a main function. A hard disk (HDD) 32 serving as a storage means stores music information used in music performance processing.

In the present embodiment, the external musical instrument 44 c can be connected to the karaoke apparatus 2. The external musical instrument 44c uses various stringed instruments (guitar, bass, violin, etc.) that output electrical acoustic signals (performance sound information) and can assist performance by displaying fingering examples (stringed images). Is possible. The input performance sound information is mixed with performance information played by the acoustic control unit 70 and emitted from the speaker 42. In addition, a musical instrument such as a MIDI guitar that can output MIDI signals may be used as the external musical instrument 44c, and the MIDI sound source in the sound control unit 70 may be controlled to perform the performance. In addition, an acoustic instrument that does not have an electrical sound output may be employed. In that case, it is conceivable that the instrument sound picked up by the microphone is input to the sound control unit 70 or the sound emitted from the instrument itself without using the speaker 42 is used.

  The music information is prepared as music for practicing the performance of an external musical instrument (musical instrument practice music), performance information composed of MIDI information, background video designation information for designating a background video, performance Lyric information for displaying lyrics in synchronism with the string, and string pressing information for displaying the string image in synchronization with the performance. When the music is designated, the performance information included in the music information is played by the sound control unit 70, and the monitor device 41 displays lyrics displayed in synchronism with the performance and the string-pressed image display.

  The string-pressing information is associated with the progress of the performance, and includes string-pressing image identification information that identifies the string-image information to be displayed in synchronization with the performance. The control unit 30 causes the monitor device 41 to display the string image (string image information) by reading the string image information corresponding to the string image identification information that is read as the performance progresses.

  Furthermore, the karaoke apparatus 2 is connected to a camera 43 and can capture image information captured by the camera 43. In the present embodiment, the imaging information captured by the camera 43 is displayed on a display unit such as the monitor 41 together with the string image, thereby instructing the fingering of the stringed instrument to the performer.

  Then, the music performance process performed with the karaoke apparatus 2 of this embodiment is demonstrated. FIG. 2 is a flowchart showing music performance processing according to the embodiment of the present invention. When the performance processing is started after the karaoke device 2 is turned on, the karaoke device 2 checks the reservation table (S101), and determines whether there is a song to be played next (S102). If it is determined in the reservation table that there is a music to be played next (1202: Yes), it is determined whether or not the reserved music is a musical instrument practice music (S103). When it is not a musical instrument practice music (S103: No), the performance process according to the said music is performed. Here, it is assumed that the normal performance process (S104) is executed assuming that the music other than the musical instrument practice music is a normal music.

  On the other hand, when it is determined that the reserved music is a musical instrument practice music (S103: Yes), a musical instrument performance process (S300) is executed following the musical instrument performance preparation process (S200). The musical instrument performance preparation process (S200) is a process for positioning the stringed instrument held by the performer with respect to the imaging position of the camera 43. In the musical instrument performance process (S300), the acoustic control unit 70 serving as a performance means performs the performance information, and at the same time the string information of the stringed instrument indicating the stringed state of the stringed instrument is displayed with respect to the imaged information captured by the camera 43. In this process, the image control unit 31 superimposes the image on a display unit such as the monitor 41. The video processing unit 31 has an overlay function for displaying one image (front image) superimposed on the other image (rear image). The front image is weighted with a transparent color to be translucent. It can be superimposed on the front of the image. The degree of translucency is set in advance. Alternatively, when the front image is a stringed image or a positioning image) that is a line-drawn image (computer graphic), the image is superimposed and displayed on the imaging information image that is the rear image without using a transparent color. You can also

  First, musical instrument performance preparation processing (positioning processing) will be described. FIG. 3 is a flowchart showing the musical instrument performance preparation process. When this process is started, a positioning image for aligning the imaging range of the camera 43 and the musical instrument is displayed on the monitor device 41 (S201). FIG. 6 shows how the positioning image is displayed on the monitor 41. FIG. 6 is an example of a positioning image when a guitar is used, and a positioning image of the neck portion of the guitar is displayed superimposed on imaging information obtained by the camera 43. This positioning image shows the fret position (1 to 4 fret), the position of the string, and the position of the fingerboard for the neck portion. In the present embodiment, a fret, a string, and a fingerboard are used as the positioning image. However, the alignment can be performed only at the position of the fret. When the musical instrument to be played is determined, the shape is expected to be substantially the same, so that the imaging position and the musical instrument can be aligned to the extent that the fret alignment is performed.

  The karaoke apparatus 2 starts imaging by the camera 43 (S202), and causes the monitor 41 to display the imaging information obtained by imaging on the monitor 41 in a horizontally reversed manner (S203). Therefore, as shown in FIG. 6, the monitor 41 displays the positioning image superimposed on the left-right inverted imaging information. A player who has a musical instrument matches the position of the musical instrument (guitar) with the positioning image while looking at the monitor 41. In the present embodiment, since the imaging information is reversed left and right on the monitor 41, the performer can perform positioning while looking at the mirror.

  In the karaoke apparatus 2, it acquires by image-recognizing a fret, a string, and a fingerboard in imaging information. For example, it is possible to recognize the position by pattern matching the configuration of the musical instrument to be recognized. Based on the alignment by the performer, the position adjustment of the imaging position of the instrument and the camera 43 is completed on the condition that the fret, the string, and the fingerboard are at predetermined positions (S205: Yes). As described above, the position adjustment process may be determined based only on the fret position of the stringed instrument in the imaging information.

  After completion of the alignment of the imaging position and the musical instrument in the musical instrument performance preparation process (S200), the musical instrument performance process (S300) is started. FIG. 4 is a flowchart showing the musical instrument performance process. In this musical instrument performance process, first, image information captured by the camera 43 is displayed on a display means such as the monitor 41 (S301). FIG. 7 is a diagram showing a display screen of the monitor 41 in the musical instrument performance process. As shown in this figure, in this embodiment, imaging information captured by the camera 43 is displayed in a plurality of (two) windows. The imaged information displayed in each window is displayed with a string image superimposed thereon. The window displayed on the left side is a window for instructing the current fingering, and the current string image is superimposed and displayed on the imaging information. On the other hand, the window displayed small on the right is a window for instructing the next fingering operation, and the next string image is superimposed and displayed on the imaging information. In the present embodiment, two windows for instructing the current fingering and the next fingering are used. However, further windows may be provided to further instruct the next fingering. In addition, the imaging information displayed in these windows is in a horizontally inverted state, and the player can check his / her fingering state without feeling uncomfortable while looking in the mirror. It has become.

  Further, in this musical instrument performance process, information indicating the progress of performance is displayed under the two fingering instruction windows. In this embodiment, the progress of the performance is expressed by the progress of the bar. The lyrics of the music are displayed at the bottom of the bar, and the chord information is displayed at the top of the bar. Further, code information corresponding to the fingering is displayed at the upper part of each fingering instruction window.

At the beginning of the performance, the window for instructing the current fingering (the window on the left side of FIG. 7) is displayed with the first string image superimposed on the imaging information, and the next fingering is displayed. In the instructing window (the window on the right side in FIG. 7), the second pressed string image is displayed superimposed on the imaging information. Here, the pressed string image is an image for instructing the player to perform fingering, and is an image displayed based on the pressed string image information.

  In each window of FIG. 7, for the imaging information shown in the photograph, the pressed string image (fret number, the shape of the hand to be pressed (contour) indicated by the white outline, and the chord indicated by the hatched portion is displayed. (Pressed position) is superimposed. In this embodiment, since the musical instrument is positioned with respect to the imaging position in the musical instrument performance preparation process, the string image is displayed at a predetermined position of the captured instrument by displaying these string images at predetermined positions in the imaging range. Can be located. The shape of the hand displayed as the string-pressed image is displayed as an outline, but may be displayed in a translucent state. The performer can confirm fingering by comparing with the shape of his / her hand in the imaging information. In this embodiment, the fret number, the hand shape, and the pressed position of the string are shown as the pressed string image. However, by displaying at least one of the hand shape and the pressed position of the string, the player is in a fingering state. It is possible to confirm.

  In this embodiment, the string image is displayed for the window for instructing the current fingering (left side in FIG. 7) and the window for instructing the next fingering (right side in FIG. 7). Then, how to move next to the current fingering state is important. Therefore, the display of the fingering state may be such that only the next fingering instruction is displayed. The performer can confirm in advance how to move next with respect to the current fingering state displayed in the imaging information, and can perform smooth fingering (musical instrument performance). Become.

  With such a screen configuration, the performer can perform while confirming fingering. After the screen for fingering instruction is displayed (S302), the performance of the performance information is started by the acoustic control unit 70 as a performance means (S303). In the present embodiment, after the performance is started, the position tracking process (S350) is executed to superimpose the string image on the imaging information at an appropriate position. It is conceivable that the position of the musical instrument imaged by the camera 43 moves during the period in which the string-pressed image is displayed. Therefore, by performing this position tracking process (S350), the position of the musical instrument and the position of the string-pressed image are appropriately maintained even when the position of the musical instrument is moved. Details will be described later.

  Moreover, the karaoke apparatus 2 monitors the period (code period) in which the chord information is changed based on the string-pressing information in the music information, and executes the subsequent processing every time one chord period ends (S304: Yes). To do. When one chord period has ended (S304: Yes), the string-pressed image is deleted (S306), and a new string-pressed image is displayed (S307). In the example of FIG. 7, the string image displayed in the window for instructing the current fingering (left side in FIG. 7) is deleted, and the window for instructing the next fingering (in the right side in FIG. 7) is displayed in the window. The displayed string image is displayed. In the window for instructing the next fingering (on the right side in FIG. 7), a new string-pressed image is displayed. By repeatedly executing such processing until the end of the final chord period (S305: Yes), it is possible to display a string-pressing image instructing fingering appropriately in each window. When the final chord period has ended (S305: Yes), the acquisition of imaging information from the camera 43 is ended (S308), and the musical instrument performance process is ended.

  FIG. 5 is a flowchart showing this position tracking process. In the position follow-up process of the present embodiment, the instrument is adjusted so that the position of the instrument becomes an appropriate position within the imaging range of the camera 43 by detecting the tilt, size, and movement of the instrument, and the string is pushed with respect to the position of the instrument. The images are matched.

In this position follow-up process, the position of the musical instrument is detected by recognizing the imaging information (S351). Processing for detecting the position of a musical instrument (here, the position of a fret, a string, and a fingerboard) will be described in order. Since the frets, the strings, and the fingerboards (fingerboards) including them are substantially orthogonal or parallel straight lines, the intersecting shape is a grid-like rectangular shape (see, for example, FIG. 7). . If the inclination of the rectangle is extracted, the determination processing (specifying the inclination of the instrument) described later in S352 can be executed. In addition, the image size is determined as a plurality of parallel long-side linear shapes as chords and a plurality of parallel short-side linear shapes as frets in the imaging information, and the interval between the frets is a predetermined interval. If it is determined, determination processing in S356 (specification of size is specified), which will be described later, can be executed. Further, whether the position is shifted is displayed as a reference position display of, for example, 1 fret at a predetermined position in the display image of the display unit 11 (for example, refer to “1” in FIG. 7), and sequentially from the reference position. Since it suffices to determine whether the positions 2-6 match the frets, the determination process in S360 described later can also be executed. Since a technique for identifying and recognizing a two-dimensional image shape (for example, a technique for specifying an article shape or a position on a production line or the like) is well known, it will not be described in detail.

  As described above, in this embodiment, the position of the fret, the string, and the fingerboard is used as the position of the musical instrument. However, if the pressed image can be superimposed on the appropriate position of the musical instrument, the position of the appropriate configuration of the musical instrument Can be used. In S352, it is determined whether or not the detected position (tilt) of the musical instrument matches a predetermined tilt. If the inclinations of the instruments do not match, the inclination adjustment for the string-pressed image shown in S353 to S355 is executed. When the instrument is tilted to the right (S353: Yes), the tilt of the string image is matched with the instrument in the imaging information by tilting the string image to the right. On the other hand, when the instrument is tilted to the left (S353: No), the tilt of the string image is matched with the instrument in the imaging information by tilting the string image to the left.

  When it is determined that the detected instrument size is not the predetermined size (S356: No), the instrument size to be imaged in the imaging information is changed to the predetermined size by changing the zoom ratio of the camera 43. maintain. If the instrument size in the imaging information is smaller than the predetermined size in S357 (S357: Yes), the camera 43 is changed to a predetermined size by zooming in (S358). On the other hand, when the instrument size in the imaging information is larger than the predetermined size (S357: No), the camera 43 is changed to a predetermined size by zooming out (S359).

  In S360, detection of the positional deviation of the musical instrument in the imaging information is performed. When the position of the musical instrument is not a predetermined position (S360: No), the instrument 43 in the imaging information is adjusted to an appropriate position by changing the imaging range of the camera 43. In addition to changing the imaging direction of the camera 43 itself, when extracting a portion to be displayed in the imaging information, it is conceivable to change the extraction range. It is also conceivable that the position of the instrument is out of the imaging range. In such a case, a display for prompting attention to put the instrument in the imaging range or to be positioned at a predetermined position in the imaging range may be displayed on the monitor 41.

  In the present embodiment, the position of the string image and the instrument is optimized by adjusting the tilt of the string image for the inclination of the instrument and by changing the imaging range for the size and position deviation of the instrument. .

  As described above, according to the music performance device of the present embodiment, the user can confirm how to perform fingering by displaying the string musical instrument captured by the camera 43 in a semi-transparent state. Become. In particular, since the stringed instrument imaged by the camera 43 is reversed and displayed on the left and right, it is possible to suppress a sense of discomfort felt by the user and confirm how to carry it intuitively.

Note that the present invention is not limited to these embodiments, and embodiments configured by appropriately combining the configurations of the respective embodiments also fall within the scope of the present invention. In the present embodiment, the setting of the overlay of the video control unit 31 (the relationship before and after the image is superimposed) has been described using the front image as a string image and a positioning image, and the rear image as an image of imaging information. Another overlay setting for the video control unit 31 is to set the front image as a semi-transparent imaging information image, the rear image as a string image and a positioning image, and the contrast of the rear image to be sufficiently high. For example, the user can confirm his / her fingering from the monitor device 41 while playing the musical instrument while the music performance is in progress.

DESCRIPTION OF SYMBOLS 1a, 1b ... Remote control device, 11 ... Display part, 12 ... Video RAM, 13 ... Image | video control part, 14 ... Memory, 15 ... Control part, 16 ... Wireless LAN communication part, 17 ... Operation part, 18 ... Operation processing part, DESCRIPTION OF SYMBOLS 19 ... Infrared communication part, 2 ... Karaoke apparatus, 21 ... Operation part, 22 ... Operation processing part, 23 ... Infrared communication part, 24 ... Interface part, 27 ... Memory, 28 ... Video RAM, 29 ... Image | video performance part, 30 ... Control unit, 31 ... Video control unit, 32 ... Hard disk, 41 ... Monitor device, 42 ... Speaker, 44a ... Singing microphone, 44b-44d ... External musical instrument, 100 ... LAN, 110 ... Access point, 120 ... Router, 5 ... Karaoke host, 51 ... storage section, 52 ... transmission / reception means, 53 ... server side control means, 54 ... music performance section, 541 ... performance means, 542 ... performance means, 543 ... performance Volume adjustment volume, 544 ... mixing section, 545 ... performance volume adjustment volume, 546 ... compression means, 70 ... acoustic control section, 71 ... A / D converter, 72 ... output volume adjustment volume, 73 ... D / A converter, 74 ... Music performance section, 741 ... Performance means, 742 ... Performance means, 743 ... Performance volume adjustment volume, 744 ... Mixing section, 75 ... Performance volume adjustment volume, 76 ... D / A converter, 77 ... Mixing section

Claims (6)

In a music performance device that plays music based on music information,
A performance means for performing based on performance information;
Control means capable of performing a performance process and a string display process executed in synchronization with the performance process,
The music information is configured to include the performance information and string information synchronized with the progress of the performance information,
The performance processing causes the performance means to display the performance information of the specified music information,
The string display process reads the string image information corresponding to the string information in synchronism with the progress of the performance process, reverses the imaging information captured by the imaging unit to form inverted imaging information, and forms the inverted imaging information. On the other hand, the read musical string image information is superimposed and displayed on the display means. The music performance device according to claim 1, wherein the string display process displays the string image information corresponding to the next string information as the performance process progresses. The music performance device according to claim 1, wherein the string display process displays the string image information corresponding to the current string information as the performance process progresses. The music performance device according to any one of claims 1 to 3, wherein the string image information includes at least one of a shape of a hand to press a string and a position where the string is pressed. . The alignment process for aligning the position of the stringed instrument imaged by the imaging unit and the display position of the pressed string image information is executed before the start of the performance process. 5. The music performance device according to any one of 4 above. The position tracking process for aligning the position of the stringed instrument imaged by the imaging unit and the display position of the stringed image information is performed during the string pressing display process. The music performance device according to any one of 5.