JP7254290B2 - Performance support device, performance support method, computer program - Google Patents

Description

Application of Article 30, Paragraph 2 of the Patent Law Posting date: February 28, 2019, https://www. youtube. com/watch? v=4UX9kRtLLz0 Publication date: March 1, 2019, https://www. ufret. jp/

TECHNICAL FIELD The present invention relates to technology for assisting performance of a musical instrument in time with a piece of music.

2. Description of the Related Art Conventionally, there are various techniques for supporting performance of a musical instrument in time with music (Patent Document 1).

JP 2000-148168

SUMMARY OF THE INVENTION An object of the present invention is to provide performance support so that a musical instrument can be played at more appropriate timing in accordance with the reproduction of music.

In order to solve the above-mentioned problems, a first aspect of the present invention is a musical performance support device for displaying chords of musical instruments played in a piece of music in accordance with reproduction of the piece of music, wherein chord information indicating the chords to be played is displayed. storage means for storing, first display means for displaying a plurality of areas associated with reproduction times when the music is reproduced, arranged in a line in chronological order based on the reproduction times; and second display means for displaying the code information stored in the storage means in association with the area corresponding to the reproduction time displayed by the first display means; the chord information stored in the storage means to be played at the time is displayed in a position different from the display position of the chord information displayed in association with the area in association with the lyric portion sung at the reproduction time. a third display means for displaying a currently reproduced time area of the plurality of areas in a manner different from that of other areas when the music is reproduced, and when the music is reproduced; a display processing means for making a display mode of chord information corresponding to a lyric portion sung at a time currently reproduced differ from a display mode of chord information corresponding to a lyric portion other than the said lyric portion. .

In the second aspect of the present invention, it is preferable that the plurality of areas are associated with each reproduction time at a preset time interval when the music is reproduced.

In the third aspect of the present invention, it is preferable that the plurality of areas are associated with each reproduction time at intervals of one beat when the music is reproduced.

In a fourth aspect of the present invention, the plurality of areas are rectangular areas having the same width in the arrangement direction of the plurality of areas, and the second display means displays code information in the areas. is preferred.

In the fifth aspect of the present invention, it is preferable that the first display means displays a preset number of areas corresponding to the current reproduction time and times before and after the current time .

In the sixth aspect of the present invention, it is preferable that the chord information is information in which the manner of pressing the musical instrument corresponding to the chord of the musical instrument is graphically represented.

In order to solve the above-mentioned problems, a seventh aspect of the present invention provides a musical performance support apparatus that displays chords of musical instruments played in a musical piece in accordance with reproduction of the musical piece, by a musical performance assistance device having display means and display processing means. In the method, the display means arranges and displays a plurality of areas associated with a reproduction time when the music is reproduced in a line in chronological order based on the reproduction time, and performs the music at the reproduction time. The chord information played at the playback time is displayed in association with the area corresponding to the playback time, and the chord information stored in the storage means played at the playback time while displaying the lyrics of the music is displayed in correspondence with the area. a display step of displaying the lyric portion sung at the reproduction time at a position different from the display position of the chord information displayed in association with the display processing means; When the music is played back, the area of the currently playing time is made different from the display mode of the other areas, and when the song is played, the song is displayed at the time that is currently being played. a display processing step of making the display mode of the chord information corresponding to the lyric portion to be displayed different from the display mode of the chord information corresponding to the lyric portion other than the relevant lyric portion.

In order to solve the above-mentioned problems, an eighth aspect of the present invention is a computer program for causing a computer to display chords of an instrument played in a piece of music in accordance with reproduction of the piece of music, wherein display means comprises: A plurality of areas associated with the reproduction time when the music is reproduced are arranged in a line in chronological order based on the reproduction time, and chord information to be played at the reproduction time is associated with the reproduction time. The display position of the chord information displayed in association with the area and the chord information stored in the storage means to be played at the reproduction time while displaying the lyrics of the music piece in association with the area. a display step of displaying at a position different from the above in association with the lyric portion sung at the playback time; In addition, the display mode of the area of the time currently being reproduced is different from the display mode of other areas, and the display mode of the chord information corresponding to the lyrics part sung at the time of the current playback when the song is played is changed. and a display processing step of changing the display mode of chord information corresponding to a lyric portion other than the lyric portion.

According to the first aspect of the present invention, the musical performance support device arranges a plurality of areas in a line in chronological order based on the reproduction time corresponding to the reproduction time when reproducing the music, and displays the reproduction time. The chords of the musical instrument played at the time are displayed in association with each area corresponding to the playback time. It is displayed differently from the display mode. As a result, the area corresponding to the time currently being reproduced is displayed differently from the area corresponding to the time when the reproduction has already finished and the area corresponding to the time to be reproduced.

As a result, the user of the musical performance support target using the musical performance support device can confirm the chords to be played along with the reproduction from the display of the chord information associated with the regions in advance, and change the display mode of each region. Based on the difference, it is possible to know the arrival time of the playing timing of the chord with respect to the current playing time.

According to the second aspect of the present invention, the user of the musical performance support target who uses the musical performance support device can determine the arrival time of the performance timing of the chord with respect to the time currently being reproduced in units of preset time. can know As a result, the user can play the musical instrument at more appropriate timing in accordance with the reproduction of the music.

According to the third aspect of the present invention, the user of the musical performance assistance target who uses the musical performance assistance device can know the arrival time of the performance timing of the chord with respect to the current playback time in units of one beat. can. As a result, the user can play the musical instrument at more appropriate timing in accordance with the reproduction of the music.

According to the fourth aspect of the present invention, each region is easily formed.

According to the fifth aspect of the present invention, the musical performance support device can display a plurality of areas in a number suitable for musical performance support, just in number.

According to the sixth aspect of the present invention, the user can play the musical instrument while confirming how to hold down the chord information.

According to the seventh aspect of the present invention, the musical performance support method arranges a plurality of areas in a line in chronological order based on the reproduction time corresponding to the reproduction time when the music is reproduced, and displays the reproduction time. The chords of the musical instrument played at the time are displayed in association with each area corresponding to the playback time. It is displayed differently from the display mode. As a result, the area corresponding to the time currently being reproduced is displayed differently from the area corresponding to the time when the reproduction has already finished and the area corresponding to the time to be reproduced.

As a result, the user to whom the performance assistance is provided by the performance assistance method can check the chords to be played along with the playback from the display of the chord information associated with the regions in advance, and can recognize the difference in the display mode of each region. Based on this, it is possible to know the arrival time of the playing timing of the chord with respect to the current playing time.

According to the eighth aspect of the present invention, the computer program arranges a plurality of areas in a line in chronological order based on the reproduction time corresponding to the reproduction time when the music is reproduced, and displays the reproduction time. The chords of the musical instrument played at the time are displayed in association with each area corresponding to the playback time. It is displayed differently from the display mode. As a result, the area corresponding to the time currently being reproduced is displayed differently from the area corresponding to the time when the reproduction has already finished and the area corresponding to the time to be reproduced.

As a result, the user to whom the computer program assists the performance can check the chords to be played along with the playback from the display of the chord information associated with the regions in advance, and the difference in the display mode of each region. , it is possible to know the arrival time of the playing timing of the chord with respect to the current playing time.

FIG. 1 is a diagram showing an example of the configuration of a musical performance support system. FIG. 2 is a block diagram showing a configuration example of a processing terminal. FIG. 3 is a diagram showing an example of a performance support screen. FIG. 4 is a block diagram showing a configuration example of a management server. FIG. 5 is a block diagram showing a configuration example of a database stored in the storage unit of the management server. FIG. 6 is a diagram showing an example of a code image database. FIG. 7 is a diagram illustrating a configuration example of a server processing unit; FIG. 8 is a flowchart illustrating an example of setting information acquisition processing. FIG. 9 is a diagram showing an example in which the pressing method setting section is turned ON or OFF. FIG. 10 is a diagram showing an example in which the type of musical instrument can be set in the musical instrument setting section. FIG. 11 is a diagram showing an example in which keys can be set in the key setting section. FIG. 12 is a diagram showing an example in which the reproduction speed can be set by the reproduction speed setting section. FIG. 13 is a flowchart illustrating an example of display processing. FIG. 14 is a diagram illustrating an example of how the actual reproduction display area moves to the one adjacent to the right in a plurality of code image individual display areas arranged in the horizontal direction. FIG. 15 is a diagram illustrating an example of how the actual reproduction display area moves to the one adjacent to the right in a plurality of code image individual display areas arranged in the horizontal direction. FIG. 16 is a diagram illustrating an example of how the actual reproduction display area moves to the adjacent one on the right in a plurality of code image individual display areas arranged in the horizontal direction. FIG. 17 is a diagram illustrating an example of how the actual reproduction display area moves to the one adjacent to the right in a plurality of code image individual display areas arranged in the horizontal direction. FIG. 18 is a diagram illustrating an example of how the actual reproduction display area moves to the one adjacent to the right in a plurality of code image individual display areas arranged in the horizontal direction. FIG. 19 is a diagram illustrating an example of how the actual reproduction display area moves to the adjacent one on the right in a plurality of code image individual display areas arranged in the horizontal direction. FIG. 20 is an example diagram for explaining how the actual reproduction display area moves to the adjacent one on the right in a plurality of code image individual display areas arranged in the horizontal direction. FIG. 21 is a diagram illustrating an example of how the actual reproduction display area moves to the adjacent one on the right in a plurality of code image individual display areas arranged in the horizontal direction. FIG. 22 is an example diagram for explaining how the actual reproduction display area moves to the one adjacent to the right in a plurality of code image individual display areas arranged in the horizontal direction. FIG. 23 is a diagram illustrating an example of how the code image individual display area as a whole slides leftward together with the code image. FIG. 24 is a diagram illustrating an example of how the code image individual display area as a whole slides leftward together with the code image. FIG. 25 is a diagram showing a display example of the performance support screen when the pressing method is "OFF". FIG. 26 is a diagram showing a display example of the performance support screen when the musical instrument is "piano". FIG. 27 is a diagram showing a display example of the performance support screen when the instrument is "guitar" and the chord is "-3 (Capo3)". FIG. 28 is a diagram showing a display example of the performance support screen when the musical instrument is "guitar" and the dominant hand is the left hand.

An embodiment of the present invention will be described with reference to the drawings.
In this embodiment, a performance support system is mentioned.

(composition)
FIG. 1 is a diagram showing an example of the configuration of a performance support system 1. As shown in FIG.

As shown in FIG. 1, the performance support system 1 has a plurality of processing terminals 10 and a management server 100. FIG. Each processing terminal 10 and the management server 100 can communicate with each other via communication means 200 . Here, the communication means 200 is an internet line or the like connected by wire or wirelessly. Below, the communication means 200 is demonstrated as an internet line.

The processing terminal 10 is, for example, a stationary personal computer, a tablet PC, a smart phone, or the like. In this embodiment, a case where the processing terminal 10 is a tablet PC will be described.

FIG. 2 is a block diagram showing a configuration example of the processing terminal 10. As shown in FIG.

As shown in FIG. 2 , the processing terminal 10 has a communication section 11 , a touch panel section 12 , a storage section 13 , and a processing section (hereinafter referred to as terminal processing section) 14 . Here, the communication unit 11 performs wired or wireless communication with devices such as the management server 100 via an Internet line or the like. The touch panel section 12 has an image display section that performs an image display function and a contact detection section that performs an information input function. The storage unit 13 is, for example, ROM, RAM, or the like. The terminal processing unit 14 executes various processes in the processing terminal 10 . The terminal processing unit 14 includes, for example, a microcomputer and its peripheral circuits, and is composed of, for example, a CPU, a ROM, a RAM, and the like. One or more programs are stored in the ROM. The CPU executes various processes according to one or more programs stored in the ROM. Then, the terminal processing unit 14 executes various processes according to various data and various programs stored in the storage unit 13 as necessary.

When the processing terminal 10 is connected to the management server 100 , a performance support screen (hereinafter referred to as a performance support screen) including information about music is displayed on the touch panel section 12 .

FIG. 3 is a diagram showing an example of the performance support screen 300. As shown in FIG.

As shown in FIG. 3, the music performance support screen 300 includes a music title (music title, singer name, lyricist name, composer name, etc.) 301, music video 302, first and second chord display portions 350, 400 and output setting sections 450 and 460 are displayed.

Here, in the first and second chord display sections 350 and 400, chords for playing musical instruments are displayed in synchronization with the reproduction of music. The output setting section 450 also has a pressing method setting section 451 , a musical instrument setting section 452 , a key setting section 453 , and a music playback speed setting section 454 . Also, the output setting section 460 is composed of a dominant hand setting section 460 .

The pressing method setting unit 451 allows the user to set (select) the display state of how to press or play the chords of the musical instrument (hereinafter simply referred to as the pressing method) on the first and second chord display units 350 and 400. It displays a state (ON) in which the manner of pressing chords and the chord name of the finally set musical instrument is displayed, or a state (OFF) in which only the chord name is displayed. The musical instrument setting section 452 allows the user to set (select) the type of musical instrument for the chords displayed in the first and second chord display sections 350 and 400, and the final selection state of the musical instrument type. display. The key setting section 453 allows the user to set (select) the height of the musical instrument chord keys displayed in the first and second chord display sections 350 and 400. Shows the final height selection. The music reproduction speed setting unit 454 allows the user to set (select) the music reproduction speed, that is, the display speed of musical instrument chords on the music video 302 and the first and second chord display units 350 and 400 . , and displays the final selected state of the playback speed of the song. The dominant hand setting unit 460 allows the user to set (select) the display state of how to hold the musical instrument chords displayed on the first and second chord display units 350 and 400 according to the dominant hand. and displays the final choice of handedness.

The processing terminal 10 transmits the setting information set (selected) by the various setting sections 451 to 454 and 460 on the performance support screen 300 to the management server 100 in this manner.

FIG. 4 is a block diagram showing a configuration example of the management server 100. As shown in FIG.

As shown in FIG. 4 , the management server 100 has an Internet communication section 101 , a storage section 110 and a processing section (hereinafter referred to as a server processing section) 120 . Here, the Internet communication unit 101 communicates with other devices such as the processing terminal 10 via the communication means 200 . The storage unit 110 is an HDD or the like, and stores various data and various programs. The server processing unit 120 executes various processes in the management server 100 . The server processing unit 120 includes, for example, a microcomputer and its peripheral circuits, and is configured by, for example, a CPU, a ROM, a RAM, and the like. One or more programs are stored in the ROM. The CPU executes various processes according to one or more programs stored in the ROM. Then, the server processing unit 120 executes various processes according to various data and various programs stored in the storage unit 110 as necessary.

FIG. 5 is a block diagram showing a configuration example of a database stored in the storage unit 110 of the management server 100. As shown in FIG.

As shown in FIG. 5, the storage unit 110 has a setting information database 111 and a code image database 112 . Here, the setting information database 111 stores various setting information to be used when playing music, which are set in various setting sections 451 to 454 and 460 of the performance support screen 300 . The setting information includes the pressing method setting information set in the pressing method setting section 451 , the musical instrument setting information set in the musical instrument setting section 452 , the key setting information set in the key setting section 453 , and the music playback speed setting section 454 . They are set playback speed setting information and dominant hand setting information set by the dominant hand setting unit 460 . The setting information database 111 stores these setting information as the latest information. The code image database 112 also stores information of the code images displayed on the first and second code display portions 350 and 400 .

FIG. 6 is a diagram showing an example of the code image database 112. As shown in FIG.

As shown in FIG. 6, the chord image database 112 includes musical instrument, key, dominant hand, playback time of music, chord name image, and pressing method image, and these information are associated with each other. Here, the chord name image is an image of the chord name of the musical instrument. For example, the codename image is an image of characters such as "C", "Cm", "C7". The pressing method image is a graphic image representing the pressing method of the musical instrument corresponding to the chord name of the musical instrument. Here, the image of how to hold down the same musical instrument is an image in which the way of holding is different for different keys or different dominant hands. In this example, the pressing method image includes characters of the code name of the pressing method in addition to the figure representing the pressing method.

In this way, in the chord image database 112, while being associated with the reproduction time of the music, it is also associated with the musical instrument, the key, and the dominant hand. image is stored. For example, the chord image database 112 can be prepared as individual databases for each musical instrument, each key, and each dominant hand.

In the following description, either the code name image or the pressing method image will be referred to as the code image unless they are specified.

FIG. 7 is a diagram showing a configuration example of the server processing unit 120. As shown in FIG.

As shown in FIG. 7 , the server processing section 120 has a setting information acquisition section 121 and a display processing section 122 . Here, the setting information acquisition unit 121 executes setting information acquisition processing for acquiring various kinds of setting information used when playing music. The display processing unit 122 executes display processing for processing the display of the performance support screen 300 based on the setting information and the like acquired by the setting information acquisition unit 121 . The server processing unit 120 concurrently executes the setting information acquisition process and the display process. Specifically, each process is as follows.

FIG. 8 is a flowchart illustrating an example of setting information acquisition processing.

As shown in FIG. 8, first, as the process of step S1, the setting information acquisition unit 121 acquires various types of setting information. The setting information includes pressing method setting information, musical instrument setting information, key setting information, reproduction speed setting information, and dominant hand setting information.

FIG. 9 is a diagram showing an example in which the pressing method setting section 451 is turned ON or OFF.

As shown in (A) in FIG. 9, the user turns on the display of the pressing method in the pressing method setting section 451, or as shown in (B) in FIG. At 451, the display of the pressing method can be turned off. The performance support screen 300 shown in FIG. 3 is an example in which the display of the pressing method is finally set to “ON” in the pressing method setting section 451 . The setting information acquisition unit 121 acquires ON or OFF information set by the pressing method setting unit 451 from the operation information of the processing terminal 10 as the pressing method setting information.

FIG. 10 is a diagram showing an example in which the type of musical instrument can be set in the musical instrument setting section 452. As shown in FIG.

As shown in FIG. 10, in this example, the user can set any one of "guitar", "ukulele", "piano", "bass", and "power chord". The performance support screen 300 shown in FIG. 3 is an example in which "guitar" is finally set. The setting information acquisition unit 121 acquires information on the set musical instrument from the operation information on the processing terminal 10 as musical instrument setting information.

FIG. 11 is a diagram showing an example in which keys can be set in the key setting section 453. As shown in FIG.

As shown in FIG. 11, a key setting section 453 is displayed in a pull-down so that the user can set the key. In this example, "+2 (1 step down tuning)", "+1 (half step down tuning)", "±0 (original song key)", "-1 (Capo1)", "-2 (Capo2)", " -3 (Capo3)", "-4 (Capo4)", "-5 (Capo5)", "-6 (Capo6)", "-7 (Capo7)", "-8 (Capo8)", "-9 (Capo 9)" can be set by the user. The performance support screen 300 shown in FIG. 3 is an example in which "±0 (original music key)" is finally set. The setting information acquisition unit 121 acquires information on the set keys from the operation information on the processing terminal 10 as key setting information.

FIG. 12 is a diagram showing an example in which the reproduction speed setting section 454 can set the reproduction speed.

As shown in FIG. 12, a playback speed setting section 454 is pull-down displayed so that the user can set the playback speed. In this example, "0.25 times", "0.5 times", "0.75 times", "playback speed (standard)" (standard playback speed), "1.25 times", "1.5 times" The user can set any one of "times", "1.75 times", and "2 times". The performance support screen 300 shown in FIG. 3 is an example in which "reproduction speed (standard)" is finally set. The setting information acquisition unit 121 acquires information on the set playback speed from the operation information on the processing terminal 10 as playback speed setting information.

Further, the setting information acquisition unit 121 acquires the selected dominant hand information from the operation information of the processing terminal 10 for the dominant hand setting unit 460 displayed on the performance support screen 300 as shown in FIG. to get as The performance support screen 300 shown in FIG. 3 is an example in which the right handedness is finally selected as the dominant hand.

As the subsequent process of step S2, the setting information acquisition unit 121 stores the various setting information acquired in the process of step S1 in the setting information database 111. FIG.

Through the setting information acquisition process described above, the setting information acquisition unit 121 acquires various types of setting information used when playing music from the operation information for the performance support screen 300, and stores the acquired various types of setting information in the setting information database 111. Remember. As a result, the setting information database 111 is updated with the latest setting information.

FIG. 13 is a flowchart illustrating an example of display processing.

As shown in FIG. 13, first, as the process of step S21, the display processing unit 122 determines whether or not a song has been selected. For example, on the performance support screen 300, a plurality of musical pieces are displayed in a selectable manner while being classified according to genres, etc. determine whether or not When the display processing unit 122 determines that a song has been selected, the process proceeds to step S22.

As the process of step S<b>22 , the display processing unit 122 performs initial screen display (still screen display) of the performance support screen 300 . Specifically, the display processing unit 122 performs the following various types of processing.

The display processing unit 122 displays the title 301 and moving image 302 of the music selected in the process of step S21 in the performance support screen 300, as shown in FIG. Based on the setting information stored in the setting information database 111, the display processing unit 122 also displays the selected pressing method (ON or OFF), musical instrument, key, playback speed, and dominant hand performance support screen 300. are displayed in the output setting units 450 and 460 of the . Further, the display processing unit 122 refers to the chord image database 112 to acquire the code image corresponding to the music piece selected in the process of step S21, and displays the acquired code image on the first and second screens of the performance support screen 300. It is displayed in the code display section 350,400.

Here, in the first code display section 350, a plurality of rectangular code image individual display areas 351 are displayed adjacent to each other in the horizontal direction, and each code image individual display area 351 is associated with the playback time of the music. It is Here, each code image individual display area 351 is associated with the playback time of a piece of music in units of the length of one beat. That is, the code image individual display areas 351 on both sides sandwiching the three code image individual display areas 351 have a gap of three beats. Further, the code image individual display area 351 becomes a code image individual display area in which the reproduction time of the music is later as it goes to the right side. Also, the code image individual display areas 351 are displayed on the first code display section 350 by the number set in advance. In this example, 14 code image individual display areas 351 are displayed in the first code display section 350 . Based on the latest setting information stored in the setting information database 111, the display processing unit 122 identifies the selected pressing method (ON or OFF), musical instrument, chord, and dominant hand, and displays the chord image. The database 112 is referred to, and in each code image individual display area 351 associated with the playback time of the song, a code image 352 corresponding to the playback time of the song, the specified pressing method, the instrument, the chord, and the dominant hand is displayed. display. In this example, the background color of the code image individual display area 351 is white, and the code image 352 is displayed in black.

Furthermore, the display processing unit 122 changes the display mode of the code image individual display area 351 (hereinafter referred to as the actual reproduction display area 351a) when the actual reproduction timing comes when the music is reproduced according to the reproduction time. (the code image individual display area 351 at the reproduction time already reproduced and the code image individual display area 351 at the reproduction time to be reproduced). Specifically, the display processing unit 122 makes the background color of the actual reproduction display area 351 a different from the background color of the other code image individual display areas 351 . In this example, the display processing unit 122 reverses the background color of the actual playback display area 351a to black.

In addition, in the second code display section 400, an entire code image display area 401 is secured in which a plurality of code images 402 can be displayed. Based on the latest setting information stored in the setting information database 111, the display processing unit 122 identifies the selected pressing method (ON or OFF), musical instrument, chord, and dominant hand, and displays the chord image database 112. , and a chord image 402 corresponding to the specified pressing method, musical instrument, chord, and dominant hand is displayed in the entire chord image display area 401 . At this time, the display processing unit 122 encodes the code image 402 in the order of the reproduction time with which the code image is associated so as to include at least the code image 402a at the reproduction timing (hereinafter referred to as the actual reproduction code image) 402a. It is displayed in the entire image display area 401 . In this example, the code images 402 are horizontally arranged in a row in the order of playback time to the right, and the row is expanded downward with a line feed. In this example, the background color of the entire code image display area 401 is white, and the code image 402 is displayed in black.

Further, when the music has lyrics, the display processing unit 122 also displays the lyrics 403 under the corresponding code image 402 in the entire code image display area 401 .

Then, the display processing unit 122 makes the display mode of the actually reproduced code image 402 a among the plurality of code images 402 displayed in the code image whole display area 401 different from the other code image individual display areas 351 . Specifically, the display processing unit 122 changes the background color of the actual reproduction code image 402a to the background color of the other code images 402 (the code image 402 at the reproduction time already reproduced and the code image 402 at the reproduction time to be reproduced). Make the color different. In this example, the display processing unit 122 reverse-displays the background color of the actual reproduction code image to yellow (gray on the drawing).

Note that the display processing unit 122 displays the moving image 302 of the musical composition on the performance support screen 300 and the first and second chord display units 350 and 400 in accordance with the reproduction progress of the musical piece in subsequent processing (processing after step S23). The display of is changed, but it is also possible to pause the playback of that song. Therefore, when the reproduction of the music is paused, the display processing unit 122 acquires the information of the reproduction end position where the reproduction of the music ended as the information of the reproduction start position as the processing of step S32, as will be described later. ing. In response to this, in the process of step S22, the display processing unit 122 generates and displays an initial screen display (still screen display) of the performance support screen 300 based on the information on the reproduction start position. That is, the display processing unit 122 displays the moving image 302 of the music, the first and second chord display portions 350 and 400, etc. based on the information at the time when the reproduction of the music was paused. display at the point in time. Note that the initial information of the playback start position information is the information of the performance start position of the music, and the display processing unit 122 displays the music video 302, the first and second The chord display portions 350, 400, etc. are displayed corresponding to the performance start position of the music piece.

As the processing of subsequent step S23, the display processing unit 122 determines whether or not to start playing the music. For example, a play button is displayed in the display area of the moving image 302 of the performance support screen 300, and the display processing unit 122 determines to start playing the music when the play button is pressed by the user. When the display processing unit 122 determines to start playing music, the display processing unit 122 proceeds to the process of step S24.

As the process of step S24, the display processing unit 122 reproduces the moving image 302 of the music. As a result, when the reproduction of the music progresses, the moving image 302 of the music is reproduced in synchronization with the reproduction of the music. In the initial settings, the playback start position of the music video 302 is the performance start position of the music. to start playing.

As the processing of subsequent step S25, the display processing unit 122 changes one of the code image individual display areas 351 of the first code display unit 350 to the actual reproduction display area 351a according to the reproduction progress. will change to That is, the display processing unit 122 converts only the code image individual display area 351 at the actual reproduction timing when the music is reproduced according to the reproduction time to the actual reproduction display area 351a with a black background color. keep changing. As a result, when the music is played back, the actual playback display area 351a (area with a black background) in the plurality of code image individual display areas 351 (areas with a white background) arranged in the horizontal direction is displayed for the playback time of the song. Synchronized with , each time it advances one beat, it will move to the next one on the right. In other words, as the music is reproduced, among the plurality of code image individual display areas 351 (areas with a white background color) arranged in the horizontal direction, the code image individual display area 351 adjacent to the right becomes the actual reproduction display area 351a (with a white background color). is replaced with a black area) every time one beat advances in synchronization with the playback time of the music.

As the processing of subsequent step S26, the display processing unit 122 determines whether or not the timing has come to slide all the code image individual display areas 351 currently displayed on the first code display unit 350 leftward. For example, when all the code image individual display areas 351 currently displayed on the first chord display section 350 have been slid leftward last time, the display processing section 122 reproduces a predetermined number of beats, It is determined that it is time to slide the code image individual display area 351 to the left. When the display processing unit 122 determines that it is time to slide all the code image individual display areas 351 currently displayed on the first code display unit 350 leftward, the process proceeds to step S27. On the other hand, when the display processing unit 122 determines that the timing for sliding all the code image individual display areas 351 currently displayed on the first code display unit 350 to the left has not come, the process proceeds to step S28.

As the process of step S27, the display processing unit 122 integrates all the code image individual display areas 351 currently displayed in the first code display unit 350, and displays the code displayed in the code image individual display area 351. It is slid leftward together with the image 352 . At this time, the display processing unit 122 performs all code image individual display including the currently displayed actual reproduction display area 351a so that at least the actual reproduction display area 351a is continuously displayed in the first code display unit 350. The area 351 as a whole is slid leftward together with the code image 352 displayed in the code image individual display area 351 . For example, the display processing unit 122 displays all the currently displayed code image individual display areas 351 as a whole in the code image individual display area 351 for the number of beats set in advance used in the process of step S26. slide to the left together with the code image 352 that is attached. As a result, the display processing unit 122 hides the code image individual display area 351 outside the first code display unit 350 at the reproduction time at which the reproduction timing has already passed and the reproduction has been completed. A real reproduction display area 351a is displayed at a leftward position. Furthermore, the display processing unit 122 has already displayed in the first code display unit 350 the code image individual display area 351 of the reproduction time scheduled to be reproduced from now on, which was not displayed because it was outside the first code display unit 350 . It is continuously displayed on the right side of the code image individual display area 351 . In this manner, the display processing unit 122 slides the entire plurality of code image individual display areas 351 in the first code display unit 350 to the left as a unit, and displays the predetermined number of images in the first code display unit 350 . code image individual display area 351 is always displayed. Then, the display processing unit 122 proceeds to the process of step S28.

As the process of step S28, the display processing unit 122 changes the one code image 402 displayed in the entire code image display area 401 of the second code display unit 400 to the actual reproduced code image 402a according to the reproduction progress. To go. That is, the display processing unit 122 changes only the code image 402 at the reproduction time when the music is reproduced according to the reproduction time to the actual reproduction code image 402a with a yellow background color. go. As a result, as the reproduction of the music progresses, the code images 402 (code images with a white background) displayed side by side in the entire code image display area 401 are replaced with the actual reproduction code images 402a (code images with a yellow background). ) will be replaced one after another in sync with the playback of the music.

As the processing of subsequent step S29, the display processing unit 122 determines whether or not the timing has come to slide all the code images 402 currently displayed in the entire code image display area 401 upward. For example, when all the code images 402 currently displayed in the entire code image display area 401 have been played back for a preset number of beats since the last time the code image 402 was slid upward, the code image It is determined that it is time to slide all the code images 402 currently displayed in the entire display area 401 upward. When the display processing unit 122 determines that it is time to slide all the code images 402 currently displayed in the entire code image display area 401 upward, the process proceeds to step S30. On the other hand, when the display processing unit 122 determines that it is not time to slide all the code images 402 currently displayed in the entire code image display area 401 upward, the process proceeds to step S31.

As the process of step S30, the display processing unit 122 slides upward all of the code images 402 currently displayed in the entire code image display area 401 as a unit. At this time, the display processing unit 122 displays the actual reproduced code image 402a (the code image 402 with a yellow background) so that the actual reproduced code image 402a (the code image 402 with a yellow background color) is continuously displayed within the entire code image display area 401. , the entire code image 402 is slid upward as a unit. As a result, the display processing unit 122 hides the code image 402 at the playback time when the playback timing has already passed and the playback is completed outside the entire code image display area 401 , and displays the code image 402 at the upper part of the entire code image display area 401 . A real reproduction code image 402a is displayed at the position. Further, the display processing unit 122 removes the code image 402 at the reproduction time scheduled to be reproduced from now on, which has not been displayed because it is outside the entire code image display area 401 , and replaces the code image 402 already displayed in the entire code image display area 401 with the code image 402 . to be displayed. In this example, the display processing unit 122 displays the code image 402 at the playback time scheduled to be played from now on in the row below the code image 402 already displayed in the entire code image display area 401 . Then, the display processing unit 122 proceeds to the process of step S31.

As the process of step S31, the display processing unit 122 determines whether or not to end the reproduction of the music. For example, a stop button is displayed in the display area of the moving image 302 on the performance support screen 300, and the display processing unit 122 determines to stop playing the music when the user presses the stop button. When the display processing unit 122 determines to end the reproduction of the music, the process proceeds to step S32. On the other hand, when the display processing unit 122 determines not to finish playing the music, the process proceeds to step S33.

As the process of step S32, the display processing unit 122 acquires the information of the reproduction end position where the reproduction of the music is finished as the information of the reproduction start position. Then, the display processing unit 122 executes the processing from step S22 again.

As the process of step S33, the display processing unit 122 determines whether or not to end the display of the music. For example, when the performance support screen 300 is switched to another screen or another song is selected from the song selection menu, the display processing unit 122 determines to end the display of the song. When the display processing unit 122 determines to end the display of the music, it ends the display processing. On the other hand, when the display processing unit 122 determines that the display of the music has not ended, the processing is executed again from step S24.

(action, effect, etc.)
Next, an example of the operation of the performance support system 1 and its effects will be described.

In the performance support system 1, the setting information acquisition unit 121 executes setting information acquisition processing to acquire various types of setting information used when playing music (step S1), and stores the acquired various types of setting information in the setting information database 111. Store (step S2). As a result, the setting information database 111 is updated with the latest setting information.

Then, the musical performance support system 1 causes the setting information acquisition section 121 to execute the setting information acquisition process, and concurrently causes the display processing section 122 to execute the display process.

In the display process, when a piece of music is selected, the display processing unit 122 performs initial screen display (still screen display) of the performance support screen 300 (steps S21 and S22). At this time, the display processing unit 122 displays the title 301 and moving image 302 of the selected music within the performance support screen 300 . In addition, the display processing unit 122 refers to the setting information database 111 to determine the selected pressing method (ON or OFF), musical instrument, key, playback speed, and output setting units 450 and 460 of the dominant hand performance support screen 300 . to display. Furthermore, the display processing section 122 displays the code images 352 and 402 corresponding to the selected piece of music in the first and second chord display sections 350 and 400 of the performance support screen 300 .

After that, when the user performs an operation to reproduce the music, the display processing unit 122 reproduces the moving image 302 of the music on the performance support screen 300 (steps S23 and S24), and One code image individual display area 351 of the plurality of code image individual display areas 351 of 350 is changed to the actual reproduction display area 351a in accordance with the progress of reproduction (step S25). As a result, when the music is played back, the actual playback display area 351a (the area with the black background) in the plurality of code image individual display areas 351 (the area with the white background) arranged in the horizontal direction becomes the playback of the song. Synchronized with the time, each time it advances one beat, it moves to the next one on the right.

Then, when it comes time to slide all the code image individual display areas 351 currently displayed on the first code display section 350 to the left, the display processing section 122 moves the code image individual display areas 351 as a whole. It is slid leftward together with the code image 352 (steps S26 and S27). As a result, the code image individual display area 351 at the playback time when the playback timing has already passed and the playback is completed is hidden outside the first code display section 350, and is positioned to the left of the first code display section 350. , the real playback display area 351a is displayed. Furthermore, the code image individual display area 351 of the reproduction time scheduled to be reproduced from now on, which has not been displayed because it is outside the first code display section 350, is replaced by the code image individual display area 351 which was already displayed in the first code display section 350. displayed on the right side of the

14 to 22 are diagrams illustrating an example of how the actual reproduction display area 351a moves to the adjacent one on the right in the plurality of code image individual display areas 351 arranged in the horizontal direction.

As shown as a change from FIG. 14 to FIG. 22, as the reproduction of the music progresses, the code image individual display area 351 with a white background is displayed with a black background each time the reproduction time advances by one beat. The region 351a moves to its right neighbor.

23 and 24 are diagrams illustrating an example of how the code image individual display area 351 as a whole slides leftward together with the code image 352. FIG.

For example, when the display is made as shown in FIG. 22, when all the code image individual display areas 351 are slid to the left, as shown in FIG. It slides to the left together with the code image 352 as a unit. As a result, the code image individual display area 351 at the playback time when the playback timing has already passed and the playback is completed is hidden outside the first code display section 350, and is positioned to the left of the first code display section 350. , the real playback display area 351a is displayed. Then, as shown in FIG. 24, as the reproduction of the music progresses, the actual reproduction display area 351a with a black background is displayed in the code image individual display area 351 with a white background each time the reproduction time advances by one beat. It will move to the next one on the right.

Furthermore, the display processing unit 122 changes the one code image 402 displayed in the entire code image display area 401 of the second code display unit 400 to the actual reproduced code image 402a according to the reproduction progress (step S28). As a result, as the reproduction of the music progresses, the code images 402 (code images with a white background) displayed side by side in the entire code image display area 401 are replaced with the actual reproduction code images 402a (code images with a yellow background). ) will be replaced one after another in sync with the playback of the music.

Then, when it comes time to slide all the code images 402 currently displayed in the entire code image display area 401 upward, the display processing unit 122 slides all the code images currently displayed in the entire code image display area 401 . The image 401 as a whole is slid upward (steps S29 and S30). As a result, the code image 402 at the reproduction time when the reproduction timing has already passed and the reproduction is completed is hidden outside the entire code image display area 401 , and is displayed at a position near the top of the entire code image display area 401 . A playback code image 402a is displayed. Further, the code image 402 at the reproduction time scheduled to be reproduced from now on, which has not been displayed because it is outside the entire code image display area 401, is displayed in the row below the code image 402 already displayed in the entire code image display area 401. be done.

Then, the display processing unit 122 continues to reproduce the music according to the reproduction time as described above until the user performs an operation to stop the music or an operation to end the display of the music. Only the code image individual display area 351 at the reproduction time when the actual reproduction timing has come is changed to the actual reproduction display area 351a with a black background every beat. Furthermore, the display processing unit 122 changes only the code image 402 at the reproduction time when the music is reproduced according to the reproduction time to the actual reproduction code image 402a with a yellow background color. To go. Then, the display processing unit 122 slides the entire code image individual display area 351 displayed on the first code display unit 350 to the left as a whole, or slides the code image at each preset timing. The entire code image 402 displayed in the entire display area 401 is slid upward as a unit.

Then, when the user performs an operation to stop the music, the display processing unit 122 acquires the information of the playback start position, and based on the acquired information of the playback start position, the display when the stop operation is performed is displayed. is displayed as a still screen (steps S31, S32, S22). Then, when the user performs an operation to reproduce music, the display processing unit 122 executes the above-described processing again.

Further, when the user performs an operation to end the display of the music, the display processing unit 122 ends the display processing (step S33).

25 to 28 are diagrams showing display examples of the performance support screen 300 with different setting information.

FIG. 25 is a diagram showing a display example of the performance support screen 300 when the pressing method is "OFF". FIG. 26 is a diagram showing a display example of the performance support screen 300 when the musical instrument is "piano". FIG. 27 is a diagram showing a display example of the performance support screen 300 when the instrument is "guitar" and the chord is "-3 (Capo3)". FIG. 28 is a diagram showing a display example of the performance support screen 300 when the musical instrument is "guitar" and the dominant hand is the left hand.

(Effects of this embodiment)
(1) In the processing terminal 10, the musical performance support system 1 arranges a plurality of code image individual display areas with a white background in a line in chronological order based on the reproduction times associated with the reproduction times when the music is reproduced. 351 is displayed, a chord image 352 of a musical instrument to be played at the playback time is displayed in each chord image individual display area 351 corresponding to the playback time.

Then, the musical performance support system 1 reverses the code image individual display area 351 at the current reproduction time in the individual code image display area 351 to display the actual reproduction when the music piece is reproduced. The area 351a is displayed in a manner different from that of the other code image individual display area 351. FIG.

As a result, the actual playback display area 351a corresponding to the current playback time can be replaced by the code image individual display area 351 corresponding to the time at which playback has already ended or the code image individual display area corresponding to the time to be played back. The display is different from 351.

As a result, the user of the musical performance support target who uses the musical performance support device can check the chords to be played on the musical instrument in accordance with the playback from the display of the chord images 352 in the chord image individual display area 351 in advance, and play each chord. Based on the difference in the display mode of the image individual display area 351, it is possible to know the arrival time of the performance timing of the code image 352 with respect to the current playback time. As a result, the user can play the musical instrument at more appropriate timing in accordance with the reproduction of the music.

(2) The user can know the arrival time of the performance timing of the chord with respect to the current playback time in units of one beat. As a result, the user can play the musical instrument at more appropriate timing in accordance with the reproduction of the music.

(3) Since the plurality of code image individual display areas 351 are rectangular areas having the same width in the arrangement direction of the plurality of code image individual display areas 351, each code image individual display area 351 can be easily formed. be. Furthermore, the user can intuitively know the arrival time of the playing timing of the chord with respect to the current playing time.

(4) The musical performance support system 1 can display the plurality of code image individual display areas 351 in a number suitable for musical performance support.

(5) Since the chord image 352 is graphically represented by how to press or play the musical instrument corresponding to the chord of the musical instrument, the user can play the musical instrument while confirming how to press or play the musical instrument with the code image 352 .

In the above-described embodiment, the musical performance support system 1 constitutes, for example, a musical performance support device. In addition, the storage unit 110 constitutes storage means, for example. Further, the display processing unit 122 constitutes, for example, first and second display means and display processing means. Also, the code image constitutes, for example, code information.

(Modified example of this embodiment, etc.)
As a modified example of the present embodiment, the difference in display mode between the actual reproduction display area 351a and the code image individual display area 351 is not limited to being realized by reversed black and white display, but may be realized by other methods. You can also For example, different representations can be achieved using other colors or different shapes.

Further, as a modification of the present embodiment, the code image 352 is not limited to being displayed in each code image individual display area 351 corresponding to the reproduction time. 351 can be used.

Moreover, as a modification of the present embodiment, the code image individual display area 351 is not limited to a square shape, and may be of another shape.

Further, as a modification of the present embodiment, the code image individual display areas 351 are not limited to being arranged in a row in the horizontal direction on the screen, but can be arranged in a row in the vertical direction or diagonal direction, for example. .

Further, as a modification of the present embodiment, the code image individual display area 351 is not limited to being associated with each reproduction time at intervals of one beat when music is reproduced. , three beats, or a preset time interval other than the number of beats may be associated with each playback time.

Further, as a modification of the present embodiment, the processing contents of the performance support system 1 described above can be completed only by the processing terminal 10 by having the processing terminal 10 have a program for realizing the same processing as that of the performance support system 1. can also be realized.

Further, in the above-described embodiment, the musical performance support method displays the chords of the musical instrument played in the musical composition in accordance with the reproduction of the musical composition, wherein a plurality of areas associated with the reproduction times when the musical composition is reproduced are displayed. a display step of arranging and displaying in a line in chronological order based on the reproduction time and displaying chord information to be played at the reproduction time in association with an area corresponding to the reproduction time; and a display processing step of changing the display mode of the area of the currently reproduced time from the display mode of the other areas when the music is being reproduced among the plurality of areas.

Further, in the above-described embodiment, the computer program causes a computer to display the chords of the musical instrument played in the music piece according to the reproduction of the piece of music, wherein the display means displays the chords of the musical instrument played in the piece of music. A display in which a plurality of areas associated with time are arranged in a line in chronological order based on the reproduction time, and chord information to be played at the reproduction time is displayed in association with the area corresponding to the reproduction time. and a display process in which the display processing means makes the area of the time currently being played out of the plurality of areas displayed in the display step different from the display mode of the other areas when the music is played. A computer program is implemented that causes a computer to perform the steps.

Also, although embodiments of the present invention have been disclosed, it will be apparent that modifications may be made by those skilled in the art without departing from the scope of the invention. All such modifications and equivalents are intended to be included in the following claims.

1 performance support system 10 processing terminal 100 management server 110 storage unit 120 processing unit 121 setting information acquisition unit 122 display processing unit 351 code image individual display area 351a actual reproduction display area 352 code image

Claims (8)

A performance support device that displays the chords of the musical instrument played in the music in accordance with the reproduction of the music,
storage means for storing chord information indicating chords to be played;
a first display means for arranging and displaying a plurality of areas associated with a reproduction time when the music is reproduced in a line in chronological order based on the reproduction time;
second display means for displaying the chord information stored in the storage means to be played at the reproduction time in association with the area corresponding to the reproduction time displayed by the first display means; and displaying the lyrics of the music. and the chord information to be played at the reproduction time and stored in the storage means is displayed at a position different from the display position of the chord information displayed in association with the area, and the lyric portion to be sung at the reproduction time. a third display means for displaying in association with
The area of the currently reproduced time when the music is reproduced among the plurality of areas is made different from the display mode of the other areas, and the currently reproduced time when the music is reproduced. display processing means for making the display mode of the chord information corresponding to the lyric part sung different from the display mode of the chord information corresponding to the lyric part other than the said lyric part;
A performance support device having 2. The musical performance support device according to claim 1, wherein the plurality of areas are associated with each reproduction time at a preset time interval when the music piece is reproduced. 3. The musical performance support device according to claim 1, wherein the plurality of areas are associated with each reproduction time at intervals of one beat when the music piece is reproduced. the plurality of regions are rectangular regions having the same width in the arrangement direction of the plurality of regions;
4. The musical performance support apparatus according to claim 1, wherein said second display means displays chord information in said area. 5. The first display device according to any one of claims 1 to 4, wherein said first display means displays a preset number of areas corresponding to said current reproduction time and times before and after said time. performance support device. 6. The musical performance support apparatus according to claim 1, wherein the chord information is information in which the manner of pressing the musical instrument corresponding to the chord of the musical instrument is graphically represented. A performance support method for displaying chords of a musical instrument played in a piece of music in accordance with reproduction of the piece of music by a performance support device having display means and display processing means,
The display means arranges and displays a plurality of areas associated with the reproduction time when the music is reproduced in a line in chronological order based on the reproduction time, and displays chord information to be played at the reproduction time. Displayed in association with an area corresponding to the reproduction time, and displaying the chord information stored in the storage means to be played at the reproduction time while displaying the lyrics of the music piece in association with the area. a display step of displaying at a position different from the display position of the chord information in association with the lyric portion sung at the playback time;
The display processing means makes the area of the time currently being played out of the plurality of areas displayed in the display step different from the display mode of the other areas when the music is reproduced, and the music is displayed. a display processing step of making the display mode of the chord information corresponding to the lyric part sung at the time of the currently replayed part different from the display mode of the chord information corresponding to the lyric part other than the said lyric part;
A performance support method having A computer program that causes a computer to display chords of an instrument played in a piece of music as the piece of music is played,
Display means arranges and displays a plurality of areas associated with a reproduction time when the music is reproduced in a line in chronological order based on the reproduction time, and displays chord information to be played at the reproduction time. The chord displayed in association with the area corresponding to the time, and the chord information stored in the storage means that is played at the reproduction time while displaying the lyrics of the music is displayed in association with the area. a display step of displaying at a position different from the display position of the information in association with the lyric portion sung at the reproduction time;
The display processing means makes the currently reproduced time area different from the display mode of the other areas when the music is reproduced from the plurality of areas displayed in the display step, and reproduces the music. a display processing step of making the display mode of the chord information corresponding to the lyric part sung at the time currently being played back different from the display mode of the chord information corresponding to the lyric part other than the said lyric part;
A computer program that causes a computer to execute

Images