JP2021110821A - Analyzer, performance supporting system, analysis method and program - Google Patents

Abstract

To provide an analyzer capable of efficiently adjusting performance timing among musical instruments when practicing.SOLUTION: An analyzer includes: calculation means for calculating a difference between timing of sound, which separates ensemble sound by a plurality of musical instruments into sounds for each musical instrument, and a reference of timing; and determination means for calculating statistics of the difference on the plurality of musical instruments and determining whether the difference which the calculation means calculates is within a range determined on the basis of the statistics.SELECTED DRAWING: Figure 7

Description

The present invention relates to an analyzer, a performance support system, an analysis method and a program.

In concerts that use multiple musical instruments such as orchestras, how to hear the ensemble sound in the audience seats differs depending on the venue, depending on the distance between the performer of each instrument and the audience seats, the shape of the venue, and so on. However, it is desirable that the way the ensemble sounds are heard in the audience seats is the same even if the venues are different.
Patent Document 1 discloses, as a related technique, a technique of calculating a part evaluation value of each of a right-hand part and a left-hand part, obtaining a comprehensive evaluation value from the calculated part evaluation value, and evaluating a performance.

International Publication No. 2019/092784

By the way, in order to make the way of hearing the ensemble sound in the audience seats as similar as possible in different venues, it is necessary to adjust the timing of playing each instrument in the practice at the time of rehearsal. However, the number of rehearsals is limited due to the usage time of the venue and the convenience of the performers.
Therefore, there is a demand for a technique that can efficiently adjust the performance timing between each instrument during practice.

Each aspect of the present invention aims to provide an analysis device, a performance support system, an analysis method, and a program capable of solving the above problems.

In order to achieve the above object, according to one aspect of the present invention, the analysis device, the performance support system, the analysis method and the program include the timing of the sound obtained by separating the ensemble sound of a plurality of musical instruments into the sound of each musical instrument, and the above. Whether the calculation means for calculating the difference from the timing reference and the statistic of the difference for the plurality of the musical instruments are calculated, and the difference calculated by the calculation means is within the range determined based on the statistic. It is provided with a determination means for determining whether or not it is present.

In order to achieve the above object, according to another aspect of the present invention, the performance support system includes the above-mentioned analysis device, performance support system, analysis method and program, and the above-mentioned analysis device, performance support system, analysis method and program. It is provided with a notification device for notifying the difference calculated by.

In order to achieve the above object, according to another aspect of the present invention, the analysis method calculates the difference between the timing of the sound obtained by separating the ensemble sound of a plurality of musical instruments into the sound of each musical instrument and the reference of the timing. This includes calculating the statistic of the difference for the plurality of the musical instruments, and determining whether or not the calculated difference is within a range determined based on the statistic.

In order to achieve the above object, according to another aspect of the present invention, the program tells the computer the difference between the timing of the sound obtained by separating the ensemble sound of a plurality of musical instruments into the sound of each musical instrument and the reference of the timing. And to calculate the statistic of the difference for a plurality of the musical instruments, and to determine whether or not the calculated difference is within a range determined based on the statistic. ..

According to each aspect of the present invention, the performance timing between each musical instrument can be efficiently adjusted during practice.

It is a figure which shows an example of the structure of the performance support system by one Embodiment of this invention. It is a figure which shows an example of the structure of the sound deviation analysis apparatus by one Embodiment of this invention. It is a figure for demonstrating the determination by the deviation determination part by one Embodiment of this invention. It is a figure which shows an example of the musical score which the notification device by one Embodiment of this invention notifies. It is a figure which shows an example of the processing flow of the performance support system by one Embodiment of this invention. It is a figure for demonstrating the determination by the deviation determination part by another embodiment of this invention. It is a figure which shows the minimum structure of the sound deviation analysis apparatus by embodiment of this invention. It is a figure which shows an example of the processing flow of the sound deviation analysis apparatus of the minimum structure by embodiment of this invention. It is a schematic block diagram which shows the structure of the computer which concerns on at least one Embodiment.

Hereinafter, embodiments will be described in detail with reference to the drawings.
<Embodiment>
The performance support system 1 according to an embodiment of the present invention collects ensemble sounds at the time of rehearsal of a concert performed by using a plurality of musical instruments, and analyzes the deviation between the timing and the reference of the sound of each musical instrument in the ensemble sound. This is a system that immediately notifies the performer of an instrument with a large deviation when the deviation is large. As shown in FIG. 1, the performance support system 1 includes a sound collecting device 10, a sound deviation analysis device 20 (an example of an analysis device), and a notification device 30.

The sound collecting device 10 is a device that collects ensemble sounds by a plurality of musical instruments in the audience seats. The sound collecting device 10 includes a microphone. The sound collecting device 10 is provided in the audience seats of, for example, a concert hall, and collects the ensemble sound in the audience seats at the time of rehearsal.

The sound deviation analysis device 20 is a device that separates the ensemble sounds collected by the sound collecting device 10 into sounds for each musical instrument and analyzes the timing of the separated sounds. As shown in FIG. 2, the sound deviation analysis device 20 includes a sound separation unit 201, a sound analysis unit 202 (an example of a calculation means), a deviation determination unit 203 (an example of a determination means), and a notification unit 204 (an example of a notification control means). ) Is provided.

The sound separation unit 201 separates the ensemble sound into sounds for each musical instrument.
For example, the sound separation unit 201 separates the ensemble sound collected by the sound collecting device 10 into sounds for each musical instrument by using the sound source separation method described in International Publication No. 2008/133097.

The sound analysis unit 202 analyzes the deviation between the timing of the rise of the sound for each instrument separated by the sound separation unit 201 and the timing reference. The timing reference according to the present embodiment is the timing of the sound of one of the musical instruments, which is arbitrarily determined. That is, the sound analysis unit 202 receives the designation of the reference musical instrument by the conductor or the like in advance, and among the sounds of each musical instrument separated by the sound separation unit 201, the timing of the sound of the designated musical instrument is used as the timing reference. To determine as. That is, the sound analysis unit 202 calculates the difference between the timing of the sound of one musical instrument arbitrarily determined and the timing of the sound of the other musical instruments.

The deviation determination unit 203 determines whether or not the timing of the sound of each musical instrument is within the allowable range of the deviation based on the analysis result by the sound analysis unit 202.
For example, the deviation determination unit 203 calculates the difference between the sound timing of each musical instrument and the timing reference for all the musical instruments played at the same timing on the score by using the analysis result by the sound analysis unit 202. Then, the deviation determination unit 203 calculates the average value of the differences calculated for each musical instrument (an example of the statistic), and sets the timing at which the average value of the calculated differences is added to the reference of the timing as the threshold value. The deviation determination unit 203 compares the timing of the sound of the musical instrument with the threshold value for each musical instrument. When the deviation determination unit 203 determines that the timing of the sound of the musical instrument is between the timing reference and the threshold value, the deviation determination unit 203 determines that the timing of the sound of the musical instrument is within the allowable range of the deviation. Further, when the deviation determination unit 203 determines that the timing of the sound of the musical instrument is not between the timing reference and the threshold value, the deviation determination unit 203 determines that the timing of the sound of the musical instrument is out of the allowable range of the deviation.

Here, the determination by the deviation determination unit 203 will be described with reference to FIG. The musical score in each embodiment of the present invention is an electronic musical score notified to the notification device 30, and is different from a general musical score in that the concept of time is introduced on the horizontal axis. Further, the musical instruments are a violin, a trumpet, and a clarinet, and the determination by the deviation determination unit 203 will be described assuming that these musical instruments are played according to the original musical score in FIG.
FIG. 3 is a diagram showing an example of the timing at which the played sounds of the violin, trumpet, and clarinet reach the audience seats.
The part (a) in FIG. 3 shows the notes o1, o2, and o3 in the original score. The part (b) in FIG. 3 shows the violin sound timings tv1, tv2, and tv3 among the analysis results by the sound analysis unit 202. The part (c) in FIG. 3 shows the trumpet sound timings tt1, tt2, and tt3 among the analysis results by the sound analysis unit 202. Further, the part (d) in FIG. 3 shows the timings tc1, tk2, and ct3 of the clarinet sound among the analysis results by the sound analysis unit 202. Each of the timings tv1, tt1, and tk1 is the timing corresponding to the note o1. Each of the timings tv2, tt2, and tk2 is the timing corresponding to the note o2. Each of the timings tv3, tt3, and tk3 is the timing corresponding to the note o3.
The musical instrument that serves as a reference for timing is a violin. The threshold value corresponding to the timing reference tv1 is tth1. The threshold value corresponding to the timing tv2 is tth2. The threshold value corresponding to the timing tv3 is tth3.
Further, as shown in FIG. 3, the difference between the timing tt1 and the timing reference tv1 is a1, the difference between the timing tk1 and the timing reference tv1 is b1, and the difference between the threshold value tth1 and the timing reference tv1 is c1. Then, the difference c1 can be expressed as (difference c1) = (difference a1 + difference b1) / 2.
Similarly, as shown in FIG. 3, the difference between the timing tt2 and the timing reference tv2 is −a2, the difference between the timing tk2 and the timing reference tv2 is b2, and the threshold value tth2 and the timing reference tv2. The difference is c2, the difference between the timing tt3 and the timing reference tv3 is a3, the difference between the timing tk3 and the timing reference tv3 is b3, and the difference between the threshold value tth3 and the timing reference tv3 is c3. In this case, the difference c2 can be expressed as (difference c2) = (difference −a2 + difference b2) ÷ 2, and the difference c3 can be expressed as (difference c3) = (difference a3 + difference b3) ÷ 2.

The deviation determination unit 203 determines whether or not the timing tt1 is between the timing tv1 and the timing tt1. When the deviation determination unit 203 determines that the timing tt1 is between the timing tv1 and the timing tth1, it determines that the deviation is within the allowable range of the deviation. Further, when the deviation determination unit 203 determines that the timing tt1 is not between the timing tv1 and the timing tw1, it determines that the deviation is out of the allowable range of the deviation. In the case of the note shown in the part (c) of FIG. 3, the deviation determination unit 203 determines that the timing tt1 is between the timing tv1 and the timing ttth1 and is within the allowable range of the deviation.
Similarly, the deviation determination unit 203 determines whether or not the timing tc1 is between the timing tv1 and the timing tth1. Further, the deviation determination unit 203 determines whether or not each of the timing tt2 and tk2 is between the timing tv2 and the timing tt2. Further, the deviation determination unit 203 determines whether or not each of the timing tt3 and tk3 is between the timing tv3 and the timing tt3.

The notification unit 204 notifies the performer of the musical instrument of the timing of the sound of the musical instrument via the notification device 30.
For example, the notification unit 204 performs wireless communication such as WiFi (registered trademark) or wired communication using a cable, and as shown in the parts (a) and (b) of FIG. 4, together with the original score. The notification device 30 displays an arrow having a length corresponding to the deviation from the timing reference, and notifies the performer of the deviation.
At this time, the notification unit 204 makes it easy to understand that the timing deviation of the sound determined by the deviation determination unit 203 to be outside the allowable deviation range is large, as shown in the portion (b) of FIG. , The notification device 30 is made to display a visually conspicuous display (that is, a display that is easy to recognize) such as coloring a note or blinking a note.

The notification device 30 is a device that notifies the deviation of the performance sound from the timing reference in the audience seat. The notification device 30 is provided at a position where the performer can see it.

Next, the processing performed by the performance support system 1 will be described. Here, the processing flow shown in FIG. 5 will be described.

The sound collecting device 10 repeatedly collects the sound of the ensemble sound for a certain period of time (for example, 0.1 second) (step S1).
The sound separation unit 201 separates the ensemble sounds collected by the sound collecting device 10 into sounds for each musical instrument (step S2).

The sound analysis unit 202 analyzes the deviation between the timing of the sound for each musical instrument separated by the sound separation unit 201 and the timing reference.
For example, the sound analysis unit 202 calculates the difference between the timing of the sound of one musical instrument and the timing of the sound of the other musical instruments, which are arbitrarily determined, after associating the rise of the sound with the notes in the score. (Step S3).

The deviation determination unit 203 determines whether or not the timing of the sound of each musical instrument is within the allowable range of the deviation based on the analysis result by the sound analysis unit 202.
For example, the deviation determination unit 203 calculates the difference between the sound timing of each musical instrument and the timing reference for all the musical instruments played at the same timing on the score by using the analysis result by the sound analysis unit 202. Then, the deviation determination unit 203 calculates the average value of the differences calculated for each musical instrument (step S4), and sets the timing at which the average value of the calculated differences is added to the reference of the timing as the threshold value. The deviation determination unit 203 compares the timing of the sound of the musical instrument with the threshold value for each musical instrument. Then, the deviation determination unit 203 determines whether or not the timing of the sound of each musical instrument is within the allowable range of the deviation based on the analysis result by the sound analysis unit 202 (step S5).

When the deviation determination unit 203 determines that the timing of the sound of the musical instrument is within the allowable range of the deviation (YES in step S5), the notification unit 204 causes the notification device 30 to display the deviation from the timing reference (step). S6).
Further, when the deviation determination unit 203 determines that the timing of the sound of the musical instrument is out of the allowable deviation range (NO in step S5), the notification unit 204 notices the deviation from the timing reference 30. Is displayed (step S7).
The processes of steps S1 to S7 are repeatedly executed until the performance is completed.

The performance support system 1 according to the embodiment has been described above.
In the performance support system 1, the sound analysis unit 202 calculates the difference between the timing of the sound obtained by separating the ensemble sounds of a plurality of musical instruments into the sounds of each musical instrument and the reference of the timing. The deviation determination unit 203 calculates the average value of the differences for the plurality of the musical instruments, and determines whether or not the difference calculated by the sound analysis unit 202 is within a range determined based on the average value.
By doing so, the performance support system 1 can calculate the difference in sound between the musical instruments. Then, when the performer knows the deviation, the performance timing between each instrument can be efficiently adjusted during practice.
In addition, when the performer plays in consideration of the deviation, even if the conductor conducts at a tempo different from that specified in the score, the ensemble sound in which the sounds of each instrument are aligned is reproduced in the audience seat.

In the above-described embodiment, the average value is used as the threshold value, but the threshold value is not limited to this, and the threshold value may be determined based on the median value or the standard deviation.
In the above-described embodiment, the performance support system 1 has been described by taking as an example a case where any one musical instrument is used as a timing reference and the deviation of the sound of another musical instrument is calculated with respect to the reference. On the other hand, in another embodiment, the performance support system 1 may be based on the average timing of the timings of a plurality of musical instruments. Further, in another embodiment of the present invention, the performance support system 1 may use the original musical score as a timing reference and calculate the deviation of the sound of each musical instrument with respect to the reference.
The following is an example of processing when the original score is used as the timing reference.

The sound analysis unit 202 uses each note in the original score as a timing reference, and calculates the difference between the reference and the sound timing of each musical instrument.
Then, the deviation determination unit 203 may determine whether or not the timing of the sound of each musical instrument is within the allowable range of the deviation based on the analysis result by the sound analysis unit 202.
Here, as shown in FIG. 6, the difference between the timing of the original score and the timing of the violin sound is a4, the difference between the timing of the original score and the timing of the trumpet sound is b4, and the timing of the original score. Let c4 be the difference from the timing of the clarinet sound. In this case, the deviation determination unit 203 calculates the average value d4 of the deviation of the sound of each of the three musical instruments from the timing of the original score as d4 = (a4 + b4 + c4) ÷ 3, and the calculated average value is used as described above. The same determination as in the embodiment may be made.
By doing so, unlike the performance support system 1 according to the embodiment of the present application, even if a certain musical instrument (for example, the violin which is the reference of the timing in the embodiment of the present application) is not played, the performance in this case is performed. The support system 1 can easily calculate the difference in the timing of the sounds of each musical instrument.

In another embodiment of the present invention, the notification device 30 may be an LED (Light Emitting Diode) or a wristband. In this case, the misalignment determination unit 203 notifies the performer of the misalignment of the sound of the musical instrument by blinking the LED possessed by the performer or vibrating the wristband worn by the performer. It may be something to do.

FIG. 7 is a diagram showing the minimum configuration of the sound deviation analysis device 20 according to the embodiment of the present invention.
The sound deviation analysis device 20 includes a calculation means 20a and a determination means 20b.
The calculation means 20a calculates the difference between the timing of the sound obtained by separating the ensemble sounds of a plurality of musical instruments into the sounds of each musical instrument and the reference of the timing.
The determination means 20b calculates the average value of the differences for the plurality of the musical instruments, and determines whether or not the difference calculated by the calculation means 20a is within a range determined based on the average value.

Next, the processing by the sound deviation analysis device 20 having the minimum configuration according to the embodiment of the present invention will be described.
Here, the processing flow shown in FIG. 8 will be described.
The calculation means 20a calculates the difference between the timing of the sound obtained by separating the ensemble sounds of a plurality of musical instruments into the sounds of each musical instrument and the reference of the timing (step S11).
The determination means 20b calculates the average value of the differences for the plurality of the musical instruments, and determines whether or not the difference calculated by the calculation means 20a is within a range determined based on the average value (step S12). ).

The sound deviation analysis device 20 having the minimum configuration according to the embodiment of the present invention has been described above.
With this sound deviation analysis device 20, the performance timing between each instrument can be efficiently adjusted during practice.

In the processing according to the embodiment of the present invention, the order of the processing may be changed as long as the appropriate processing is performed.

Each of the storage unit, the storage device, and other storage devices (including registers and latches) in the embodiment of the present invention may be provided anywhere as long as appropriate information is transmitted and received. Further, each of the storage unit, the storage device, and the other storage devices in the embodiment of the present invention may exist in a plurality of storage devices within a range in which appropriate information is transmitted and received, and the data may be distributed and stored.

Although the embodiment of the present invention has been described, the above-mentioned performance support system 1, sound collecting device 10, sound deviation analysis device 20, control device included in the notification device 30, and other control devices have a computer system inside. You may. The process of the above-mentioned processing is stored in a computer-readable recording medium in the form of a program, and the above-mentioned processing is performed by the computer reading and executing this program. A specific example of a computer is shown below.
FIG. 9 is a schematic block diagram showing the configuration of a computer according to at least one embodiment.
As shown in FIG. 9, the computer 5 includes a CPU 6, a main memory 7, a storage 8, and an interface 9.
For example, each of the above-mentioned performance support system 1, sound collecting device 10, sound deviation analysis device 20, control device included in the notification device 30, and other control devices is mounted on the computer 5. The operation of each processing unit described above is stored in the storage 8 in the form of a program. The CPU 6 reads the program from the storage 8, expands it into the main memory 7, and executes the above processing according to the program. Further, the CPU 6 secures a storage area corresponding to each of the above-mentioned storage units in the main memory 7 according to the program.

Examples of the storage 8 include HDD (Hard Disk Drive), SSD (Solid State Drive), magnetic disk, optical magnetic disk, CD-ROM (Compact Disk Read Only Memory), DVD-ROM (Digital Versatile Disk Read). , Semiconductor memory and the like. The storage 8 may be internal media directly connected to the bus of computer 5, or external media connected to computer 5 via an interface 9 or a communication line. When this program is distributed to the computer 5 via a communication line, the distributed computer 5 may expand the program in the main memory 7 and execute the above processing. In at least one embodiment, the storage 8 is a non-temporary tangible storage medium.

Further, the above program may realize a part of the above-mentioned functions. Further, the program may be a file that can realize the above-mentioned functions in combination with a program already recorded in the computer system, that is, a so-called difference file (difference program).

Although some embodiments of the present invention have been described, these embodiments are examples and do not limit the scope of the invention. Various additions, omissions, replacements, and changes may be made to these embodiments without departing from the gist of the invention.

1 ... Performance support system 5 ... Computer 6 ... CPU
7 ... Main memory 8 ... Storage 9 ... Interface 10 ... Sound collecting device 20 ... Sound deviation analysis device 20a ... Calculation means 20b ... Judgment means 30 ... Notification device 201・ ・ ・ Sound separation unit 202 ・ ・ ・ Sound analysis unit 203 ・ ・ ・ Misalignment judgment unit 204 ・ ・ ・ Notification unit

Claims (10)

A calculation means for calculating the difference between the timing of the sound obtained by separating the ensemble sound of a plurality of musical instruments into the sound of each musical instrument and the reference of the timing.
A determination means for calculating the statistic of the difference for the plurality of the musical instruments and determining whether or not the difference calculated by the calculation means is within a range determined based on the statistic.
An analyzer equipped with. The statistic is the average of the differences.
The analyzer according to claim 1. A determinant that determines the timing criteria based on the separated sounds of each instrument.
The analysis apparatus according to claim 1 or 2. The criteria are
The timing of the sound played by any one instrument in the plurality of musical instruments.
The analysis device according to any one of claims 1 to 3. The criteria are
The timing is defined by the original score played by the plurality of instruments.
The analysis device according to any one of claims 1 to 3. Notification control means for notifying the difference by determining the position of the note in the horizontal axis direction based on the difference in the score indicating the actual rising timing of the sound related to the note by the position of the note in the horizontal axis direction. ,
The analysis apparatus according to any one of claims 1 to 5. The notification control means
The difference determined by the determination means to be outside the range and the difference determined to be within the range are notified in different modes.
The analyzer according to claim 6. The analyzer according to any one of claims 1 to 7,
A notification device for notifying the difference calculated by the analysis device, and
Performance support system equipped with. To calculate the difference between the timing of the sound obtained by separating the ensemble sounds of multiple musical instruments into the sounds of each musical instrument and the reference of the timing, and
The statistic of the difference for the plurality of the musical instruments is calculated, and it is determined whether or not the calculated difference is within the range determined based on the statistic.
Analysis method including. On the computer
To calculate the difference between the timing of the sound obtained by separating the ensemble sounds of multiple musical instruments into the sounds of each musical instrument and the reference of the timing, and
The statistic of the difference for the plurality of the musical instruments is calculated, and it is determined whether or not the calculated difference is within the range determined based on the statistic.
A program that executes.

Images