WO2018207936A1 - 譜面自動検出方法および装置 - Google Patents
譜面自動検出方法および装置 Download PDFInfo
- Publication number
- WO2018207936A1 WO2018207936A1 PCT/JP2018/018426 JP2018018426W WO2018207936A1 WO 2018207936 A1 WO2018207936 A1 WO 2018207936A1 JP 2018018426 W JP2018018426 W JP 2018018426W WO 2018207936 A1 WO2018207936 A1 WO 2018207936A1
- Authority
- WO
- WIPO (PCT)
- Prior art keywords
- data
- musical score
- performance
- score
- musical
- Prior art date
Links
Images
Classifications
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10G—REPRESENTATION OF MUSIC; RECORDING MUSIC IN NOTATION FORM; ACCESSORIES FOR MUSIC OR MUSICAL INSTRUMENTS NOT OTHERWISE PROVIDED FOR, e.g. SUPPORTS
- G10G1/00—Means for the representation of music
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10H—ELECTROPHONIC MUSICAL INSTRUMENTS; INSTRUMENTS IN WHICH THE TONES ARE GENERATED BY ELECTROMECHANICAL MEANS OR ELECTRONIC GENERATORS, OR IN WHICH THE TONES ARE SYNTHESISED FROM A DATA STORE
- G10H1/00—Details of electrophonic musical instruments
-
- G—PHYSICS
- G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
- G09B—EDUCATIONAL OR DEMONSTRATION APPLIANCES; APPLIANCES FOR TEACHING, OR COMMUNICATING WITH, THE BLIND, DEAF OR MUTE; MODELS; PLANETARIA; GLOBES; MAPS; DIAGRAMS
- G09B15/00—Teaching music
Definitions
- the present invention relates to a musical score automatic detection method and apparatus, and more specifically, to a musical score automatic detection method and apparatus that can automatically detect which position of a musical score is being played based on performance data.
- the conventional electronic music stand and the electronic musical score display method only display the prepared score and turn the page, and the player must step on the foot pedal to inform it. There is a problem that only a feeling of use that is not much different from the score can be obtained.
- the present invention has been made in view of the above-mentioned conventional problems. Since the playback code included in the electronic score is used to synchronize with the performance of the performer, it is possible to specify which position on the musical score is currently being played. can do. Thus, the next musical score is automatically displayed at the timing when the performance reaches the last stage of the musical score, so that the musical score can be automatically turned without receiving a special instruction from the performer.
- the invention according to claim 1 is a musical score synchronization method for synchronizing musical score data and performance data, which is reproduction data when a musical piece indicated by musical score data is reproduced, and a predetermined unit of musical score data
- a spectrum calculation step for calculating the power spectrum of the associated reproduction data and performance data for each predetermined time interval frame, calculating the similarity between the power spectrum of the performance data and the power spectrum of the reproduction data, Based on the frame specifying step for specifying the corresponding time interval frame and the correspondence between the score data and the playback data, the correspondence between the performance data and the score data is specified by the specified time interval frame, and the musical score of the performance data
- a performance position acquisition step for acquiring the upper performance position.
- the invention according to claim 2 is characterized in that, in the musical score synchronization method according to claim 1, the reproduction data is acquired using a reproduction code included in the musical score data together with the musical score data.
- the reproduction code is in the MIDI format, and the power spectrum is calculated for each time interval frame from the performance data or the PCM signal of the reproduction data.
- the invention according to claim 4 is the music score synchronization method according to any one of claims 1 to 3, wherein the similarity between the power spectra is calculated using a cosine distance.
- the performance time in the performance data of the music indicated by the musical score data included in the musical score data is acquired and the reproduction code is reproduced.
- the invention according to claim 6 is a musical score display method for displaying musical score data, the step of displaying a musical score of a predetermined page included in the musical score data, and reproduction data when the musical piece indicated by the musical score data is reproduced.
- the musical score synchronization method according to claim 1 wherein reproduction data associated with a predetermined unit of musical score data and performance data recorded in advance based on the musical score data are used. Then, based on the performance position on the musical score of the performance data obtained by specifying the corresponding time interval frame, the page turning step for displaying the musical score of the next page at the timing when the performance of the predetermined page ends. It is characterized by having.
- the invention according to claim 7 is a musical score display method for displaying musical score data, a display step of displaying a predetermined page of musical score data, and performance data of performance made based on the musical score displayed by the display step
- a performance recording step for recording the music, the reproduction data when the music indicated by the musical score data is reproduced, the reproduction data associated with a predetermined unit of the musical score data, and the performance data recorded by the performance recording step.
- the timing at which the performance of a predetermined page ends based on the performance position on the musical score of performance data obtained by specifying the corresponding time interval frame using the musical score synchronization method according to any one of claims 1 to 5.
- a page turning step for displaying the score of the next page.
- the page turning step includes the step of turning the last measure of the musical score on a predetermined page based on the performance position on the musical score of the acquired performance data. When the performance is finished, the musical score of the next page is displayed.
- the page turning step is performed based on the performance position on the musical score of the acquired performance data.
- the musical score of the next page is displayed a predetermined time before the performance ends.
- the page turning step is performed based on the performance position on the musical score of the acquired performance data.
- a musical score of the next page is displayed after a predetermined time after the performance is completed.
- the invention according to claim 11 is the musical score display method according to any one of claims 6 to 10, wherein the musical score of the next page is displayed a predetermined time before the performance of the last measure of the musical score of the predetermined page ends.
- a scheduled score display step for displaying the first level at the lower part of the set including the last measure is further provided.
- the invention according to claim 12 is characterized in that in the music score display method according to any of claims 6 to 11, the position on the music score being played is displayed in synchronization with the progress of the performance.
- the invention according to claim 13 is a musical score display device for displaying musical score data, which is reproduction data when the musical score data and the music indicated by the musical score data are reproduced, and is associated with a predetermined unit of the musical score data.
- Music score data recording means for storing the reproduced data
- performance data storage means for storing performance data recorded in advance based on the musical score data
- obtaining musical score data from the musical score data storage means to obtain musical score data
- Display means for displaying a musical score of a predetermined page included, and musical score data and performance data on the musical score performance data obtained by using the musical score synchronization method according to any one of claims 1 to 5 Based on the position, the musical score of the next page is displayed on the display means at the timing when the performance of the predetermined page ends.
- the invention described in claim 14 is a musical score display device for displaying musical score data, which is reproduction data when the musical score data and the music indicated by the musical score data are reproduced, and is associated with a predetermined unit of the musical score data.
- Music score data recording means for storing the reproduced data, musical score data from the musical score data storage means, display means for displaying a musical score of a predetermined page included in the musical score data, and a predetermined page displayed on the display means
- Performance recording means for recording performance data of performances performed on the basis of the musical score of the musical score, and musical performance data and performance data obtained by using the musical score synchronization method according to any one of claims 1 to 5
- the musical score of the next page is displayed on the display means based on the performance position on the musical score.
- the invention according to claim 15 is a musical score retrieval method for retrieving musical score data stored in a database, wherein a performance recording step of recording performance data of a performance of a part of a musical piece, musical score data and musical scores from the database
- the reproduction data when the music indicated by the data is reproduced, the reproduction data associated with a predetermined unit of the musical score data is read, and the reproduction data and the performance data recorded in the performance recording step are claimed.
- the invention described in claim 16 is a musical score search device for searching musical score data, which is reproduction data when the musical score data and the music indicated by the musical score data are reproduced, and is associated with a predetermined unit of the musical score data.
- a database storing the reproduction data, performance recording means for recording performance data of a part of the music, performance data recorded in the performance recording step by reading the reproduction data from the database, A similarity acquisition unit that calculates the similarity using the music score synchronization method described in any one of the above, and a most similar extraction unit that extracts the musical score data that has acquired the highest similarity in the similarity acquisition step.
- the reproduction data when the music indicated by the musical score data is reproduced, and the power spectrum of the reproduction data associated with the predetermined unit of the musical score data and the performance data is determined for each predetermined time interval frame.
- FIG. 1 is an overall system configuration diagram of an embodiment of the present invention. It is a functional block diagram of the server of one Embodiment of this invention. It is a figure for demonstrating the method to take the synchronization of the sound source of one Embodiment of this invention, and musical score data, and to produce a bar time conversion table. It is a figure of the bar time conversion table
- the musical score data of the electronic musical score and the performance based on the musical score data included in the musical score data are synchronized to specify which position on the musical score is currently being played, or a part of the performance
- a musical score or a total score is used, but the present invention is not limited to this. Any form can be used as long as the drawing can be displayed on the terminal.
- the electronic musical score can be used in various embodiments by synchronizing the musical score data and the performance, but in this embodiment, by specifying which position on the musical score is being played.
- An example of realizing automatic page turning will be described.
- performance data is acquired in advance, and a bar time conversion table showing the time correspondence with the musical score data included in the musical score data or the like is created, and on the musical score according to the performance.
- a method for turning a page by specifying the position of each measure (first embodiment), and obtaining a performance as audio data with a device such as a microphone, and creating a bar time conversion table or a group time conversion table in real time.
- the musical score data used in the present embodiment is MusicXML, and is basically stored in the data format of MusicXML in the server.
- the music score described in MusicXML can be sent to the terminal as it is and displayed on the browser, or can be displayed on the browser after being converted to another display format, for example PDF, by the server.
- MusicXML is used for the musical score data of the present embodiment, but is not limited thereto, and any format can be used as long as it can generate a musical score for display by performing some conversion or processing.
- musical score data for example, data in MusicXML format includes musical score data defined by note data for each measure.
- a staff score is displayed on the browser based on the musical score data, A score is drawn based on the note data of each measure.
- the musical score data generally includes a reproduction code such as MIDI for reproducing the sound when the musical score data is played, and can be actually reproduced as a sound.
- a playback code has various parameters, and various playback is possible depending on the playback environment and user preference. For example, the playback pitch can be changed.
- a predetermined code is used for synchronization. Use the value.
- the present invention can be implemented as long as it is data obtained by reproducing musical pieces of a musical score according to the musical score without using MusicXML format data, and corresponding to each unit of the musical score, for example, each measure. can do.
- the playback time is adjusted to some extent, but the playback time of the playback data is expanded and contracted by a method known in this technical field to match the performance time of the performance data. Can do.
- FIG. 1 is an overall system configuration diagram of an embodiment of the present invention.
- the system includes a score management server 101 and a sound source analysis server 102 that creates a bar time conversion table from performance data serving as a sound source for analysis as a server for distributing score data and controlling the entire system. Connected via the network 103.
- the terminal 111 that is a display device and a performance data acquisition device is basically wirelessly connected to the network 103, and can be, for example, a tablet terminal.
- the connection to the network 103 is a line of a mobile phone.
- a wireless network such as Wi-fi or BLUETOOTH (registered trademark).
- the terminal 111 can be a tablet terminal, a smartphone, a mobile personal computer, or the like, but basically receives musical score data from a server to display an image, and performs a certain input operation with a touch panel, mouse or keyboard. Any device such as a mobile or desktop personal computer or a dedicated terminal can be used.
- a microphone built in the terminal 111 can generally be used, or a performance data acquisition function is provided separately from the terminal device 111, and the sound source analysis is performed by connecting to a network. Any device that can connect to the server 102 can be used.
- FIG. 2 is a functional block diagram of a server according to an embodiment of the present invention.
- the score management server 101 receives and stores score data from a server or the like (not shown), a score data management module 201 that manages the score data, a score data transmission module 202 that performs the necessary processing on the received score data, and transmits it to the terminal, a score
- the data is transmitted to the sound source analysis server 102, a measure time conversion table based on the sound source is acquired as an analysis result, the synchronization management module 203 for managing the synchronization between the performance data and the score data, and the position on the musical score currently being played,
- a music score display module 204 is provided for calculating and displaying where the musical score displayed on the terminal corresponds, and turning the page to display the next page.
- the sound source analysis server 102 receives performance data obtained by recording a performance based on the score displayed on the terminal 111 with a microphone or the like, and receives score data from the score management server 101.
- the musical score data and performance data sent to the sound source analysis server 102 are associated with some additional data, etc., and the sound source analysis server 102 can appropriately perform sound source analysis by linking the two data. ing.
- performance data is added with a musical score data identification code indicating which musical score data is based on the performance data, and is transmitted along with the performance data.
- the score management server 101 basically manages the processing such as synchronous acquisition and turning pages according to the instructions of the performer and the operator via the score terminal 111, but the processing of this embodiment is not limited to this. If so, various system configurations such as adding another server or terminal, or integrating the sound source analysis server 102 into the score management server 101 can be adopted.
- the performance data and the score data of the present invention are synchronized in advance, and the automatic turning of the score is realized based on the result.
- the performance mode is different for each performance. Therefore, even if a page is turned in accordance with a certain performance, there is a possibility that the timing of the next performance will not be met.
- performances that normally require turning pages such as performances that have been practiced in advance, and the performance mode will be constant before the performance, so if you take the turning timing in the performance after practicing to a certain stage, The timing is not greatly shifted even in the actual performance.
- the performance is recorded in advance and the performance data is acquired before the performer performs at the actual performance, and the performance data and the score data used for the performance are synchronized. And automatically turn pages based on the synchronization.
- FIG. 3 is a diagram for explaining a method for creating a bar time conversion table by synchronizing the sound source and the musical score data according to the embodiment of the present invention.
- FIGS. It is a figure which shows correlation with the bar
- FIG. 5 is a flowchart showing a process for creating a measure time conversion table by synchronizing the sound source and the musical score data of the present embodiment.
- the musical score data transmission module 202 transmits the data in the MusicXML format to the terminal 111 and displays it on the browser (step 301), the player performs the performance by looking at the displayed musical score. Is recorded with a microphone, and the obtained performance data is sent to the sound source analysis server 102 together with other accompanying data (step 302), while the score management server 101 generates the score data corresponding to the performance data. A MIDI sound source and a bar time conversion table are transmitted (step 303). The sound source analysis server 102 analyzes the received data and creates a measure time conversion table for the recorded performance.
- the measure time conversion table associates the measure with the time progress of the performance or playback as in the measure time conversion table 401 or 402 shown in FIGS. 4A and 4B.
- the time is (t2-t1) or (t2'-t1 '), and the time to the fourth measure is (t5-t1) or (t5'-t1'). If these values are known for each musical score, it is possible to automatically turn the musical score based on the last measure for each musical score, and it is possible to turn the musical score with a feeling close to the actual performance of the performer.
- the playback time is a time to be played back by a playback code such as MIDI of the score data
- the performance time is a performance recorded by the player's performance.
- the musical score illustrated in FIG. 3 and the like is composed of four rows on one page and four bars on the first page, but this is merely an example, and more musical bars can be included, and a plurality of musical instruments for each musical instrument can be included. It is also possible to include music scores.
- the score terminal 111 receives score data from the score management server 101 and displays it.
- processing can be performed from a musical score on an arbitrary page.
- the musical score of the first page is transmitted to the musical score terminal 111, and the performer starts the performance by specifying the performance start position and sees the recorded musical score (step 501).
- the score terminal 111 sends the information related to the recorded sound source, that is, (c) the sound source of the microphone recording (from the start to the end of the performance) and (d) the recording start position (measure number (1)) to the sound source analysis server 102.
- the sound source analysis server 102 obtains (a) MIDI data obtained from the score data and (b) a bar time conversion table for the MIDI data from the score management server 101 (steps 502 and 503).
- the sound source analysis server 102 uses the data (a), (b), (c), and (d) to synchronize by the similarity detection process described later, and generates a measure unit conversion table based on the recorded sound source (step 504).
- the target of synchronization processing is MIDI playback data and pre-recorded performance data.
- both data are short-time in a time interval frame of a predetermined frequency.
- Fourier transform is performed to calculate a power spectrum. If the analysis window for short-time Fourier transform is performed under the conditions of sampling frequency 48 KHz, 8192 points and 50% overlap, the frame interval will be about 170 ms, but this is not restrictive, and the system environment, music composition, player type, etc. The optimal value can be used.
- the purpose of this synchronization acquisition process is to associate the performance data with the musical score by synchronizing the reproduction data with the performance data.
- the performance tempo and the progression of the music vary depending on the performer and, in some cases, the same performer.
- the tempo fluctuates from measure to measure as shown by the waveform 411 by the recording sound source.
- the sound source data obtained based on the same music basically has a power spectrum in an optimal time interval frame. Therefore, if the time interval frames having high similarities can be specified, the position on the musical score can be specified. That is, the waveform 411 of the performance data and the waveform 412 of the reproduction data shown in FIG. 4C are slightly different from each other in the height of the waveform, and the time axis varies depending on the performance pitch fluctuation by the performer. Since it is based on the sound source, it has a very similar shape as a whole.
- the similarity is determined by calculating the distance of the power spectrum using the “matching method by dynamic programming (abbreviation DP matching)” that is a representative method. The degree will be high.
- the cosine distance is used for calculating the specific distance of the power spectrum for each time interval frame, but the present invention is not limited to this, and any method known in this technical field can be used.
- the performance data waveform 411 and the reproduction data waveform 412 If a frame having a high similarity is searched, the corresponding frame can be specified.
- the waveforms 411 and 412 are different in the time axis direction, but F14-w of the time interval frame of the waveform 411 corresponds to F13-m of the waveform 412. -W and F13-m are maximized by calculating the similarity.
- the frame with the reproduction data corresponds to on the musical score can be specified by the musical score data like the reproduction data waveform 412 and the musical score data 421 in FIG. 4C, the frame with the performance data waveform 411 is. It is also possible to specify where the musical score corresponds. Based on the above principle, it is possible to specify which part of the performance data corresponds to how many bars on the musical score.
- each note is not associated with a waveform, and at least measures are taken.
- the correspondence is specified by the unit.
- the similarity calculation process becomes complicated if the frames to be compared spread over the entire music piece. Therefore, in this embodiment, a rough performance time of performance data is acquired and reproduced.
- the playback pitch of the chord is determined. That is, the above processing is executed using the waveform of the reproduction data when the performance data and the reproduction data are reproduced at a pitch that is approximately the same length as a whole, but the similarity calculation is not limited to this. Any method known in the art, such as processing or predicting the waveform in advance, can be used because it can be substantially executed.
- the waveform of the performance time t1 ′ to t2 ′ corresponds to the waveform of the reproduction time t1 to t2.
- the reproduction times t1 to t2 correspond to the measure (1) according to the reproduction data measure time conversion table 401, and therefore the measures corresponding to the performance times t1 ′ to t2 ′ become the measure (1).
- the measure time conversion table 402 of the sound source is created by taking measures corresponding to the entire musical score.
- the performance of one page of music and the performance data is calculated by calculating the similarity of each time interval frame between the playback data and the performance data, the performance can be synchronized with that. Then, the second page is started, and the similarity is calculated by comparing with the reproduction data when the reproduction code of the second page is reproduced.
- the performance data of all pages can be specified and turned, but it is not limited to this, the whole can be specified at once, and one page is divided into several bars or columns The corresponding frame can also be calculated.
- the principle of the present invention has been described in the case where the data in the MusicXML format is used. However, even if the data in the MusicXML format is not used, the music on the music score is reproduced in accordance with the music score,
- the present invention can be implemented if there is reproduction data that can be associated with each measure. At this time, the reproduction time of the reproduction data can be expanded / contracted by a method known in this technical field to match the performance data.
- FIG. 6 is a diagram for explaining the automatic turning process according to the embodiment of the present invention
- FIG. 7 is a flowchart showing the automatic turning process.
- the musical score data transmission module 202 transmits the data in the MusicXML format to the terminal 111 and is displayed on the browser (Step 601).
- the start position is sent to the score management server 101 (step 602).
- the score management server 101 is predicted using the measure time conversion table 402.
- the position of the musical score currently being played is displayed on the musical score terminal 111 from the performance time to be played (step 603).
- the musical score data of the next page is transmitted to the score terminal 111 based on this determination.
- the performer designates the performance start position (measure number) on the musical score 605, for example, as a finger 604 in FIG. (Step 701).
- the score management server 101 that has received the start position starts from the performance start position, and uses the measure data conversion table 402 based on the performance data and the timer of the score management server 101 to measure bars along the performance according to the elapsed time.
- Marks are displayed in order (step 702), and the performer performs using the marks as a guide (step 703). Although the mark can be highlighted, it is preferable that the mark be inconspicuous if it is a guideline for the performance and is an obstacle to the performance.
- the musical score management server 101 automatically turns the musical score by transmitting the musical score of the next page to the musical score terminal 111 and displaying the musical score on the musical score terminal 111 (step). 704).
- the musical score management server 101 can perform a page turning process simply by specifying a page turning or specifying a page.
- the player sets the turn of the page, that is, the next page display timing at the time when the last measure ends, a predetermined time before the end, and a predetermined time after the end. Can be done.
- the predetermined time can be changed. By doing this, it is suitable for performers who prefer to memorize the last measure and turn it early, or those who prefer to memorize the first measure and turn it later. Automatic page turning can be used to facilitate performance. Note that these timings and predetermined times can be set by a setting method known in this technical field.
- a part of the music on the next page for example, only the top level may be temporarily displayed below the bottom level, and after confirming the flow of the start of the music on the next page, the page may be turned. it can.
- the display of the musical score can be scrolled upwards as a whole to create a display space at the lower part and display the uppermost stage of the next page there, or can be reduced and displayed as a whole.
- the bar time conversion table of the present invention is automatically acquired, and the bar time conversion table is acquired by using the bar time conversion table. It can be used for various application fields.
- MusicXML format data is managed by the score management server 101, transmitted to the terminal 111, and displayed as a score on the browser. At this time, the position on the score corresponding to the image or music being played back can be highlighted on the terminal 111, so that the part of the performance currently being played can be known in measure units of the score. So it can be used for performance confirmation and practice.
- a measure time conversion table can be created, and using this, the terminal 111 uses the data in the MusicXML format. Is displayed on the browser and the playback position is specified, and the server is informed of the specified bar, so that the server calculates the playback position of the video or music corresponding to the bar, that is, the playback time. Video and music can be played from the position.
- the turning of the score displayed on the score terminal 111 during the performance is automatically performed.
- recording or the like is not performed in advance, and synchronization is performed in real time.
- the performance data and the score data are synchronized in advance, and the automatic turning of the musical score is realized based on the result, but in this embodiment, when the performance is started for a certain musical score, The performance is recorded and synchronized, and the end time is predicted and the page is automatically turned.
- automatic page turning can be performed in real time without recording in advance and analyzing the sound source, that is, without making a certain preparation.
- the automatic turning of the first embodiment creates a measure time conversion table in synchronization with each other in advance, so that, for example, when performed by a plurality of players such as orchestras, the performance is relatively stable. If you can't expect a stable performance with a small number of players, there is a possibility that the timing of turning pages will shift. On the other hand, the automatic page turning of this embodiment predicts from the progress of the performance to the middle of the score, so even if the timing may be shifted due to the character of the music, the performance tempo of the performer is real-time Because it matches, you can expect a more accurate turn depending on the combination of the performer and the song.
- FIG. 8 is a diagram for explaining an example in which the sound source and the score data of the present embodiment are synchronized.
- FIG. 9 is a diagram for explaining the automatic page turning method of the present embodiment.
- FIG. 10 is a flowchart showing the automatic turning process of the present embodiment.
- the musical score data transmission module 202 transmits data in the MusicXML format to the terminal 111 and displays it on the browser (step 801).
- the performance is performed and the microphone acquires it, the performance start position and other additional data are transmitted to the sound source analysis server 102 in real time or divided (step 802).
- the score management server 101 transmits the MIDI sound source generated from the score data corresponding to the performance data and its bar time conversion table (step 803).
- the sound source analysis server 102 analyzes the received data and creates a measure time conversion table or a group time conversion table for the recorded performance, which will be described in detail later.
- the automatic page turning process performs the page turning process at the timing when the performance is considered to have progressed to the last measure by determining the performance time while synchronizing the performance data and the score data in real time as described above.
- the method of synchronization is basically the same as in the above-described first embodiment, which is reproduced data (accurately, an audio waveform considered to be obtained when a reproduced code is reproduced, and does not need to be actually reproduced. ) And the performance data are synchronized by calculating the similarity of the waveforms and specifying the path with the highest similarity. Specific methods such as calculating the similarity between waveforms are described in this technical field. Any method known in can be used.
- synchronization is performed for each stage included in the score. Specifically, when the performer instructs the start of performance, the playback data when the first set is played back at a predetermined playback pitch is obtained, and the similarity with the performance data transmitted from the score terminal is calculated. Specify the correspondence between time interval frames.
- the predetermined reproduction pitch is determined by inputting a value expected by the performer in advance and using it, or by predicting by any method known in this technical field.
- the performance time for one page of the score is determined using a plurality of sets while synchronizing for each set.
- the synchronization acquisition method using the waveform similarity according to the present invention has a characteristic that accuracy increases as the number of samples increases. For example, it can be understood by looking at the waveform 411 of the performance data in FIG. 4C. Even if synchronization is taken for each measure, the fixed pitch cannot be specified because the fluctuation is large. However, if synchronization is performed using as many sets as possible, more accurate performance time can be determined. However, since the page turning process must be started after the performance time has been determined, the time required for the page turning process will be eliminated if synchronization is achieved until the last minute. It is determined in consideration of the balance of processing time.
- the score terminal 111 receives and displays the score data from the score management server 101, and the performer specifies the performance start position (measure number), and then uses the built-in microphone of the score terminal 111 or an external microphone. Recording of the performance is started (step 1001). Next, the score terminal 111 transmits the recorded sound source, that is, (c) the sound source of microphone recording (up to T1) and (d) the recording start position (measure number (1)) to the sound source analysis server 102 (step 1002). ).
- T1 only needs to have sufficient time for synchronization with respect to the first stage, for example, and can be determined in advance by the system.
- the sound source analysis server 102 obtains data (a) MIDI sound source and (b) multi-stage time conversion table obtained from the score data from the score management server 101 (step 1003).
- the sound source analysis server 102 obtains synchronization by the similarity detection process from the data (a) (b) (c) (d), and predicts the time to play the next set (step 1004).
- the performer determines whether or not to start playing the last stage of the page (step 1005). When it is determined that the performance enters the last stage (Yes), the synchronization acquisition process is terminated.
- the page turning process is started (step 1007).
- a bar time conversion table based on performance data may be created finally, and since synchronization is not performed in units of bars, the column time conversion of reproduction data is performed for each column.
- a similar conversion table can be created using a table. That is, after acquiring the correspondence between the waveform of the playback data and the waveform of the performance data for the stage, if the start time of the waveform of each stage of performance data (not shown) is specified, the waveform of each stage of the playback data Is used to specify how many sets it is, and a performance data set time conversion table is created.
- the sound source analysis server 102 acquires the data (c) (d) recorded at the next Tx time (step 1006), and reaches the final stage. Steps 1003 to 1005 are repeated. In this way, the first stage processing is completed at time T1, and the next stage 911 is estimated as shown in FIG. 9, and the next stage 912 is estimated from the performance data acquired at time T2. Is done. By repeating the above, the accuracy can be further improved.
- the process is executed.
- the specific process is matched to a player, a song, a system, and the like.
- Automatic page turning at various timings That is, also in this embodiment, the player can set the display timing of the next page at the time when the last assembly ends, a predetermined time before the end, and a predetermined time after the end. It is like that.
- the predetermined time can also be changed.
- a part of the score on the next page for example, only the top level is temporarily displayed below the bottom level, and after confirming the flow of the start of the next page, the page is turned. You can also At this time, the display of the musical score can be scrolled up to the whole, creating a display space at the bottom, and displaying the uppermost column of the next page there.
- synchronization is performed for each group.
- the present invention is not limited to this, and synchronization may be performed for each predetermined number of measures.
- this embodiment does not automatically turn pages, but similarly uses the method for synchronously acquiring performance data and reproduction data according to the present invention. That is, by using the synchronization acquisition method of the present invention, the musical score of the music is searched using a part of the performance, for example, the data of the first few bars. Specifically, the performance data obtained by recording a part of the performance and the score data stored in the score management server 101 are synchronized by the synchronization acquisition method of the present invention, and the score having the highest similarity is obtained. Output musical score data.
- FIG. 11 is a diagram for explaining an example of searching for music by synchronizing the sound source and score data according to the embodiment of the present invention
- FIG. 12 is a flowchart showing the music search processing of the present embodiment. It is.
- the performance data is transmitted to the sound source analysis server 102 together with the performance start position (Ste 1102).
- the score management server 101 transmits a MIDI sound source generated from the score data and its bar time conversion table to the sound source analysis server 102 for a plurality of score data to be searched (step 1103).
- the sound source analysis server 102 analyzes the received data and creates a bar time conversion table for the recorded performance.
- the similarity obtained by synchronizing a part of the performance data with each of the plurality of score data stored in the score management server 101 is used as an evaluation value, and there is a case where a predetermined threshold value is exceeded. If the music data of the performance data is specified, the search fails.
- the threshold value may be determined in advance as an optimal value depending on the music or system configuration, and can also be learned through such a search.
- the performer performs from the beginning of the music, and transmits the performance data recorded using the score terminal built-in microphone or the external microphone to the sound source analysis server 102 (step 1201).
- the sound source analysis server 102 extracts data for a predetermined time (T1) from the recorded data (step 1202).
- T1 may be a time sufficient to specify the music, and can be determined in advance by the system.
- the sound source analysis server 102 obtains data (a) MIDI data and (b) bar time conversion table obtained from the score data from the score management server 101 (step 1203).
- the sound source analysis server 102 performs synchronous acquisition by the similarity detection process from the data (a) (b) (c) (d), and generates an evaluation value for similarity detection (step 1204).
- the highest similarity obtained by the synchronization acquisition method of the present invention that is, data of a part of the music played by the performer and a predetermined score (for example, one of the scores A to Z in FIG. 11) in the database
- the highest degree of similarity when synchronized with the data is set as an evaluation value of predetermined musical score data. It is determined whether or not the evaluation value has exceeded the threshold (step 1205). If it is determined that the evaluation value has been exceeded (Yes), it is determined that the music has been correctly searched, the searched score is distributed to the score terminal, and the process ends. (Step 1206).
- step 1207 If it is determined that the threshold value is not exceeded (No), it is determined whether or not evaluation values have been calculated for all the songs stored in the score management server 101 (step 1207). (No), the evaluation value is similarly calculated for the next music piece (step 1208). If it is determined that the recording has been completed (Yes), data for a predetermined time (T1 + T2) is added from the recorded data (step 1209). ). If there is performance data, the process after step 1203 is performed in time T1 + T2, and the search process is executed. If an evaluation value exceeding the threshold is obtained, it is determined that the search is normally performed.
- a desired musical score can be obtained from the musical score management server 101 by playing only a part of the music, so that, for example, the start or part can be played, but if there is no musical score, the entire music cannot be played.
- a required musical score can be obtained and all the songs can be played on the spot.
- the present embodiment can be used in various scenes by directly searching for a musical score instead of searching for a song title.
Landscapes
- Physics & Mathematics (AREA)
- Engineering & Computer Science (AREA)
- Acoustics & Sound (AREA)
- Multimedia (AREA)
- Auxiliary Devices For Music (AREA)
Abstract
Description
間区間フレームごとに算出することを特徴とする。
することにより、自動譜めくりを実現する例を説明する。本実施形態の自動譜めくりは、事前に演奏データを取得しておいて、楽譜データ等に含まれる譜面データとの時間対応を示す小節時間変換表を作成しておき、演奏にあわせて譜面上の位置を例えば小節ごとに特定して譜めくりする方法(第1実施形態)、および演奏をマイクロフォンなどの機器で音声データとして取得し、リアルタイムで小節時間変換表あるいは組段時間変換表を作成して譜めくりタイミングを判定したり、演奏にあわせて譜面上の位置を表示したりする方法(第2実施形態)がある。
(システム構成)
本発明の一実施形態で用いる動画再生管理方法の具体的なシステムの動作及び処理を以下に説明する。図1は、本発明の一実施形態の全体のシステム構成図である。本システムでは、楽譜データを配信したり、システム全体を制御したりするためのサーバとして、楽譜管理サーバ101、および解析の音源となる演奏データから小節時間変換表を作成する音源解析サーバ102を備えており、ネットワーク103を介して接続されている。
ワーク103との接続は、携帯電話の回線や、Wi-fi、BLUETOOTH(登録商標)等の無線ネットワークにより行う。ここで端末111はタブレット端末のほか、スマートフォン、あるいはモバイルパソコン等とすることができるが、基本的に楽譜データ等をサーバから受信して画像を表示、およびタッチパネル、マウスまたはキーボードで一定の入力操作をすることができれば、モバイルあるいはデスクトップのパソコン、専用端末などいずれの装置を用いることができる。また、演奏データ取得装置としては、一般的に端末111に内蔵されたマイクロフォンを使用することができ、あるいは端末装置111とは別に演奏データ取得機能を有しており、ネットワークに接続して音源解析サーバ102に接続できるものであればいずれの装置も使用することができる。
本実施形態では、本発明の演奏データと楽譜データとの同期を予めとっておいて、その結果に基づき譜面の自動譜めくりを実現する。一般に、演奏者が同じでも演奏のたびに演奏態様は異なるから、ある演奏に合わせて譜めくりしても、次に演奏するときの譜めくりのタイミングには合わない可能性がある。しかし、通常譜めくりが必要な本番等の演奏は、事前に練習を重ねて本番前には演奏態様が一定してくるものだから、ある段階まで練習した後の演奏で譜めくりタイミングを取れば、本番の演奏でも大きくタイミングがずれることはない。
以下に、図3~図5を参照して本発明の同期取得処理を説明する。
図4Cを参照して、本発明の、同期取得処理を説明するが、先ず図13を参照して本実施形態における類似度の検出について説明する。
変換の分析窓をサンプリング周波数48KHz、8192点、50%オーバーラップという条件で行うと、フレームの間隔は約170msとなるが、これに限られず、システム環境、楽曲、演奏者のタイプなどで最適な数値を用いることができる。
ずれの方法も用いることができる。
以下に、まず図6~図7を参照して本発明の自動譜めくり処理を説明する。
で譜めくりする(ステップ704)。楽譜端末111に予め楽譜データまたは譜面データ全体を送信している場合には、楽譜管理サーバ101は譜めくりの指示、あるいはページの指定をするだけで、譜めくり処理をすることができる。
本実施形態では、上述の第1実施形態と同様に演奏中に楽譜端末111に表示した楽譜の譜めくりを自動で行うものであるが、本実施形態では予め録音等は行わず、リアルタイムで同期をとって自動譜めくりを実行する。すなわち、第1実施形態では演奏データと楽譜データとの同期を予めとっておいて、その結果に基づき譜面の自動譜めくりを実現したが、本実施形態ではある譜面について演奏が開始されると、その演奏を録音して同期を取りながら、終了時間を予測して自動譜めくりするというものである。これにより、予め録音して音源解析することなく、すなわち一定の準備をすることなくリアルタイムで自動譜めくりが可能となる。
図8は、本実施形態の音源と楽譜データとの同期をとる例を説明するための図であり、図9は、本実施形態の自動譜めくりの方法を説明するための図である。図10は、本実施形態の自動譜めくり処理を示すフローチャートである。
本実施形態では、上述の第1および2実施形態とは異なり、自動譜めくりを行うものではないが、同様に本発明の演奏データと再生データの同期取得方法を用いるものである。
すなわち、本発明の同期取得方法を用いて、演奏の一部、例えば冒頭の数小節のデータで、その楽曲の楽譜を検索する。具体的には、演奏の一部を録音して得られた演奏データと、楽譜管理サーバ101に格納された楽譜データとを本発明の同期取得方法により同期をとって、最も類似度が高い楽譜データの譜面データを出力する。
図11は、本発明の一実施形態の音源と楽譜データとの同期をとって、楽曲を検索する例を説明するための図であり、図12は、本実施形態の楽曲検索処理を示すフローチャートである。
Claims (16)
- 譜面データと、演奏データとの同期をとる譜面同期方法であって、
前記譜面データの示す楽曲を再生したときの再生データであって、前記譜面データの所定の単位と対応付けられた再生データと、前記演奏データとのパワースペクトルを所定の時間区間フレームごとに算出するスペクトル算出ステップと、
前記演奏データのパワースペクトルと、前記再生データのパワースペクトルとの類似度を算出して、対応する時間区間フレームを特定するフレーム特定ステップと、
前記譜面データと前記再生データとの対応関係に基づいて、前記特定された時間区間フレームにより前記演奏データと前記譜面データとの対応関係を特定して前記演奏データの譜面上の演奏位置を取得する演奏位置取得ステップと
を備えることを特徴とする譜面同期方法。 - 前記再生データは、前記譜面データとともに楽譜データに含まれる再生コード用いて取得することを特徴とする請求項1に記載の譜面同期方法。
- 前記再生コードはMIDI形式であり、前記パワースペクトルは、前記演奏データまたは前記再生データのPCM信号から前記時間区間フレームごとに算出することを特徴とする請求項2に記載の譜面同期方法。
- 前記パワースペクトル同士の類似度は、コサイン距離を用いて算出することを特徴とする請求項1ないし3のいずれかに記載の譜面同期方法。
- 前記楽譜データに含まれる前記譜面データの示す楽曲の、前記演奏データにおける演奏時間を取得し、前記再生コードを再生したときの再生データの再生時間が、略同一になるような再生ピッチを算出するピッチ算出ステップをさらに備え、
前記再生データは、前記再生コードを、前記算出されたピッチで再生したときのデータであることを特徴とする請求項2ないし4のいずれかに記載の譜面同期方法。 - 譜面データを表示する譜面表示方法であって、
前記譜面データに含まれる所定のページの譜面を表示するステップと、
前記譜面データの示す楽曲を再生したときの再生データであって、前記譜面データの所定の単位と対応付けられた再生データと、該譜面データに基づいて予めなされた演奏を記録した演奏データとを請求項1ないし5のいずれかに記載の譜面同期方法を用いて、対応する時間区間フレームを特定して取得した前記演奏データの譜面上の演奏位置に基づいて、前記所定のページの演奏が終了するタイミングで次のページの譜面を表示する譜めくりステップと
を備えたことを特徴とする譜面表示方法。 - 譜面データを表示する譜面表示方法であって、
譜面データの所定のページを表示する表示ステップと、
前記表示ステップにより表示された譜面に基づいてなされた演奏の演奏データを記録する演奏記録ステップと、
前記譜面データの示す楽曲を再生したときの再生データであって、前記譜面データの所定の単位と対応付けられた再生データと、前記演奏記録ステップにより記録された演奏データとを請求項1ないし5のいずれかに記載の譜面同期方法を用いて、対応する時間区間フレームを特定して取得した前記演奏データの譜面上の演奏位置に基づいて、前記所定のページの演奏が終了するタイミングで次のページの譜面を表示する譜めくりステップと
を備えたことを特徴とする譜面表示方法。 - 前記譜めくりステップは、前記取得した前記演奏データの譜面上の演奏位置に基づいて、前記所定のページの譜面の最終小節の演奏が終了すると、次のページの譜面を表示することを特徴とする請求項6または7に記載の譜面表示方法。
- 前記譜めくりステップは、前記取得した前記演奏データの譜面上の演奏位置に基づいて、前記所定のページの譜面の最終小節の演奏が終了する所定の時間前に、次のページの譜
面を表示することを特徴とする請求項6または7に記載の譜面表示方法。 - 前記譜めくりステップは、前記取得した前記演奏データの譜面上の演奏位置に基づいて、前記所定のページの譜面の最終小節の演奏が終了した後所定の時間後に、次のページの譜面を表示することを特徴とする請求項6または7に記載の譜面表示方法。
- 前記所定のページの譜面の最終小節の演奏が終了する所定の時間前に、次のページの譜面の第1段を、前記最終小節を含む組段の下部に表示する予定譜面表示ステップをさらに備えたことを特徴とする請求項6ないし10のいずれかに記載の譜面表示方法。
- 前記演奏の進行に同期して、演奏されている譜面上の位置を表示することを特徴とする請求項6ないし11のいずれかに記載の譜面表示方法。
- 譜面データを表示する譜面表示装置であって、
前記譜面データおよび前記譜面データの示す楽曲を再生したときの再生データであって、前記譜面データの所定の単位と対応付けられた再生データを記憶した譜面データ記録手段と、
前記譜面データに基づいて予めなされた演奏を記録した演奏データを記憶した演奏データ記憶手段と、
前記譜面データ記憶手段から前記譜面データを取得して、該譜面データに含まれる所定のページの譜面を表示する表示手段と
を備え
前記譜面データと、前記演奏データとを請求項1ないし5のいずれかに記載の譜面同期方法を用いて取得した前記演奏データの譜面上の演奏位置に基づいて、前記所定のページの演奏が終了するタイミングで次のページの譜面を前記表示手段に表示することを特徴とする譜面表示装置。 - 譜面データを表示する譜面表示装置であって、
前記譜面データおよび前記譜面データの示す楽曲を再生したときの再生データであって、前記譜面データの所定の単位と対応付けられた再生データを記憶した譜面データ記録手段と、
前記譜面データ記憶手段から前記譜面データを取得して、該譜面データに含まれる所定のページの譜面を表示する表示手段と、
前記表示手段に表示された所定のページの譜面に基づいてなされる演奏の演奏データを記録する演奏記録手段と
を備え、
前記譜面データと、前記演奏データとを請求項1ないし5のいずれかに記載の譜面同期方法を用いて取得した前記演奏データの譜面上の演奏位置に基づいて、次のページの譜面を前記表示手段に表示することを特徴とする譜面表示装置。 - データベースに格納された、譜面データを検索する譜面検索方法であって、
楽曲の一部の演奏の演奏データを記録する演奏記録ステップと、
前記データベースから前記譜面データおよび前記譜面データの示す楽曲を再生したときの再生データであって、前記譜面データの所定の単位と対応付けられた再生データを読み出して、該再生データと、前記演奏記録ステップで記録された演奏データとを請求項1ないし5のいずれかに記載の譜面同期方法を用いて類似度を算出する類似度取得ステップと、
前記類似度取得ステップにより、最も高い類似度を取得した譜面データを抽出する最類似抽出ステップと
を備えたことを特徴とする譜面検索方法。 - 譜面データを検索する譜面検索装置であって、
譜面データおよび前記譜面データの示す楽曲を再生したときの再生データであって、前記譜面データの所定の単位と対応付けられた再生データを格納したデータベースと、
楽曲の一部の演奏の演奏データを記録する演奏記録手段と、
前記データベースから再生データを読み出して、前記演奏記録ステップで記録された演奏データと請求項1ないし5のいずれかに記載の譜面同期方法を用いて類似度を算出する類似度取得手段と、
前記類似度取得ステップにより、最も高い類似度を取得した譜面データを抽出する最類似抽出手段と
を備えたことを特徴とする譜面検索装置。
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
JP2019517731A JPWO2018207936A1 (ja) | 2017-05-12 | 2018-05-11 | 譜面自動検出方法および装置 |
Applications Claiming Priority (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
JP2017-095194 | 2017-05-12 | ||
JP2017095194 | 2017-05-12 |
Publications (1)
Publication Number | Publication Date |
---|---|
WO2018207936A1 true WO2018207936A1 (ja) | 2018-11-15 |
Family
ID=64105308
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
PCT/JP2018/018426 WO2018207936A1 (ja) | 2017-05-12 | 2018-05-11 | 譜面自動検出方法および装置 |
Country Status (2)
Country | Link |
---|---|
JP (1) | JPWO2018207936A1 (ja) |
WO (1) | WO2018207936A1 (ja) |
Cited By (3)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JP2019113727A (ja) * | 2017-12-25 | 2019-07-11 | 株式会社デザインMプラス | 楽譜提供方法およびプログラム |
WO2022070392A1 (ja) * | 2020-10-01 | 2022-04-07 | AlphaTheta株式会社 | 楽曲解析装置、楽曲解析方法およびプログラム |
WO2023191322A1 (en) * | 2022-03-30 | 2023-10-05 | Samsung Electronics Co., Ltd. | Method and apparatus for implementing virtual performance partner |
Citations (4)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JPH0736455A (ja) * | 1993-07-22 | 1995-02-07 | Nec Corp | 音楽イベントインデックス作成装置 |
JP2000231379A (ja) * | 1999-02-12 | 2000-08-22 | Ntt Data Corp | 電子譜面台及び電子譜面の表示方法 |
JP2002006835A (ja) * | 2000-06-21 | 2002-01-11 | Yamaha Corp | データ表示方法およびデータ表示装置 |
JP2003223166A (ja) * | 2002-01-30 | 2003-08-08 | Yamaha Corp | 情報処理装置およびその楽譜頁変更方法、楽譜表示用プログラムおよび記録媒体 |
-
2018
- 2018-05-11 JP JP2019517731A patent/JPWO2018207936A1/ja active Pending
- 2018-05-11 WO PCT/JP2018/018426 patent/WO2018207936A1/ja active Application Filing
Patent Citations (4)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JPH0736455A (ja) * | 1993-07-22 | 1995-02-07 | Nec Corp | 音楽イベントインデックス作成装置 |
JP2000231379A (ja) * | 1999-02-12 | 2000-08-22 | Ntt Data Corp | 電子譜面台及び電子譜面の表示方法 |
JP2002006835A (ja) * | 2000-06-21 | 2002-01-11 | Yamaha Corp | データ表示方法およびデータ表示装置 |
JP2003223166A (ja) * | 2002-01-30 | 2003-08-08 | Yamaha Corp | 情報処理装置およびその楽譜頁変更方法、楽譜表示用プログラムおよび記録媒体 |
Non-Patent Citations (3)
Title |
---|
HU , N. ET AL.: "Polyphonic Audio Matching and Alignment for Music Retrieval", PROC. WASPAA ' 03, October 2003 (2003-10-01), pages 185 - 188, XP010697933 * |
SOULEZ, F. ET AL.: "Improving Polyphonic and Poly- Instrumental Music to Score Alignment", PROC. ISMIR 2003, October 2003 (2003-10-01), XP055186967 * |
TURETSKY, R. J. ET AL.: "Ground-Truth Transcriptions of Real Music from Force-Aligned MIDI Syntheses", PROC. ISMIR 2003, October 2003 (2003-10-01), XP055186954 * |
Cited By (4)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JP2019113727A (ja) * | 2017-12-25 | 2019-07-11 | 株式会社デザインMプラス | 楽譜提供方法およびプログラム |
WO2022070392A1 (ja) * | 2020-10-01 | 2022-04-07 | AlphaTheta株式会社 | 楽曲解析装置、楽曲解析方法およびプログラム |
JP7512406B2 (ja) | 2020-10-01 | 2024-07-08 | AlphaTheta株式会社 | 楽曲解析装置、楽曲解析方法およびプログラム |
WO2023191322A1 (en) * | 2022-03-30 | 2023-10-05 | Samsung Electronics Co., Ltd. | Method and apparatus for implementing virtual performance partner |
Also Published As
Publication number | Publication date |
---|---|
JPWO2018207936A1 (ja) | 2020-07-16 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
JP2007199306A (ja) | ビート抽出装置及びビート抽出方法 | |
CN1937462A (zh) | 内容偏好得分确定方法、内容重放装置及内容重放方法 | |
WO2018207936A1 (ja) | 譜面自動検出方法および装置 | |
JP2006195385A (ja) | 音楽再生装置および音楽再生プログラム | |
JP2009244789A (ja) | ガイドボーカル生成機能を備えるカラオケシステム | |
JP4479701B2 (ja) | 楽曲練習支援装置、動的時間整合モジュールおよびプログラム | |
JP5151245B2 (ja) | データ再生装置、データ再生方法およびプログラム | |
JP3996565B2 (ja) | カラオケ装置 | |
JP2004233698A (ja) | 音楽支援装置、音楽支援サーバ、音楽支援方法およびプログラム | |
JP4399958B2 (ja) | 演奏支援装置および演奏支援方法 | |
JP2007072023A (ja) | 情報処理装置及び情報処理方法 | |
JP5012263B2 (ja) | 演奏クロック生成装置、データ再生装置、演奏クロック生成方法、データ再生方法およびプログラム | |
JP5311069B2 (ja) | 歌唱評価装置及び歌唱評価プログラム | |
JP5092589B2 (ja) | 演奏クロック生成装置、データ再生装置、演奏クロック生成方法、データ再生方法およびプログラム | |
JP5109426B2 (ja) | 電子楽器及びプログラム | |
JPH1031495A (ja) | カラオケ装置 | |
JP2008003483A (ja) | カラオケ装置 | |
JP5338312B2 (ja) | 自動演奏同期装置、自動演奏鍵盤楽器およびプログラム | |
JP2008197269A (ja) | データ再生装置、データ再生方法およびプログラム | |
JP4048249B2 (ja) | カラオケ装置 | |
JP5969421B2 (ja) | 楽器音出力装置及び楽器音出力プログラム | |
KR101790998B1 (ko) | 악보전환방법 및 악보전환장치 | |
JP2005107332A (ja) | カラオケ装置 | |
JP2015060203A (ja) | 演奏データとオーディオデータの同期装置、方法、およびプログラム | |
JP6144593B2 (ja) | 歌唱採点システム |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
121 | Ep: the epo has been informed by wipo that ep was designated in this application |
Ref document number: 18798311 Country of ref document: EP Kind code of ref document: A1 |
|
NENP | Non-entry into the national phase |
Ref country code: DE |
|
ENP | Entry into the national phase |
Ref document number: 2019517731 Country of ref document: JP Kind code of ref document: A |
|
32PN | Ep: public notification in the ep bulletin as address of the adressee cannot be established |
Free format text: NOTING OF LOSS OF RIGHTS PURSUANT TO RULE 112(1) EPC (EPO FORM 1205 DATED 17/02/2020) |
|
122 | Ep: pct application non-entry in european phase |
Ref document number: 18798311 Country of ref document: EP Kind code of ref document: A1 |