JP2018105956A - Musical sound data processing method and musical sound data processor - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide a musical sound data processing method and a musical sound data processor, which can designate corresponding musical sound in musical sound data by using symbol data even if correspondence between a position in the musical sound data and a position indicated by the symbol data is not previously stored.SOLUTION: A musical sound data processing method specifies correspondence between respective positions of a plurality of symbols in symbol data S and positions of respective parts of a waveform of sound in musical sound data M by comparing melody or an array of chord progression corresponding to an array of a plurality of symbols indicated by the symbol data S of a music piece with melody or an array of chord progression corresponding to a waveform of sound indicated by the musical sound data M of a music piece, and specifies the position of the waveform of sound in the musical sound data M corresponding to a symbol position PS on the basis of the specified correspondence by designating the position of any symbol in the symbol data S as the symbol position PS by a user.SELECTED DRAWING: Figure 2

Description

  The present invention relates to a musical sound data processing method and a musical sound data processing apparatus.

  Conventionally, when a musical sound is reproduced based on performance sequence data in which musical sound data (performance data) and a symbol position on a musical score are associated in advance, an image showing the musical score is displayed on a display unit with a touch panel Thus, a technique is known in which a musical sound from a musical sound position corresponding to a touched bar position can be designated as a reproduction target by touching a bar position corresponding to an arbitrary symbol position (patent) Reference 1).

Japanese Patent Laying-Open No. 2015-184420

However, in the above-described prior art, the score displayed on the display unit with the touch panel is one in which the correspondence relationship of the bar position is stored in advance with the musical sound data, and the score in which such correspondence relationship is not stored. Based on this, it has been impossible to specify a musical sound corresponding to a musical sound position to be reproduced by a touch operation.
The present invention has been made in view of the above circumstances, and the musical sound position (position of each part of the sound waveform) in the musical sound data (sound waveform) and symbol data (arrangement of symbols such as a score and a chord score). A musical tone data processing method and musical tone data processing apparatus capable of designating a corresponding musical tone in musical tone data using symbol data even if the correspondence relationship with the symbol position (symbol position) indicated by is not stored in advance is provided. With the goal.

In order to achieve the above object, the present invention is grasped by the following configuration.
The musical sound data processing method and musical sound data processing apparatus according to the present invention include a melody corresponding to a sequence of a plurality of symbols indicated by symbol data relating to a musical piece or an arrangement of chord progressions, and a melody corresponding to a waveform of a sound indicated by musical tone data relating to the musical piece. Or, by comparing the sequence of chord progressions with each other, the correspondence between the position of each of the plurality of symbols in the symbol data and the position of each part of the waveform of the sound in the musical tone data is specified, and any symbol in the symbol data When the user designates the position of the sound as a symbol position, the position of the waveform of the sound in the musical sound data corresponding to the symbol position is specified as the musical sound position based on the specified correspondence relationship. .

  According to the present invention, even if the correspondence between the musical sound position in the musical sound data and the symbol position indicated by the symbol data is not stored in advance, the musical sound data that can specify the corresponding musical sound in the musical sound data using the symbol data. A processing method and a musical sound data processing apparatus can be provided.

It is a conceptual diagram of a musical sound data processing device. It is explanatory drawing explaining the image in which symbol data and musical tone data are converted. It is a flowchart of a display process. It is a flowchart of control by an operation instruction. It is a flowchart of a reproduction | regeneration process. It is a flowchart of a search process. It is a figure which shows the example of a display screen. It is a figure which shows the example of the display screen in the state as which chord progression was selected. It is a figure which shows the example of the display screen in the state by which the location of the chord progression and the chord progression similar to the selected chord progression were highlighted.

(Embodiment)
DESCRIPTION OF EMBODIMENTS Hereinafter, embodiments for carrying out the present invention (hereinafter referred to as embodiments) will be described in detail with reference to the drawings. Note that the same number is assigned to the same element throughout the description of the embodiment.

FIG. 1 is a conceptual diagram of the musical sound data processing apparatus 1.
FIG. 2 is an explanatory diagram for explaining an image in which the symbol data S and the musical sound data M are converted.

  The musical sound data processing device 1 is mounted on a device equipped with a touch panel, such as an electronic musical instrument, a smartphone, a tablet, or the like.

  As shown in FIG. 1, the musical sound data processing apparatus 1 includes a control unit 10, an operation input unit 20, a display unit 30, a storage unit 40, a sound generation unit 50, and a switch unit 60. Note that the musical sound data processing apparatus 1 separately reads the symbol data S into the storage unit 40, so that a recognition unit (not shown) such as a camera or the like for optical recognition (image recognition) of the symbol data S from the captured image or a keyboard ( (Not shown) may be provided.

(Control part)
The control unit 10 includes a general-purpose processor that executes various functions by executing programs stored in the ROM and processing various data stored in the RAM.

  As will be described in detail later, the control unit 10, as shown in FIG. 2, includes a sequence of a plurality of symbols indicated by the symbol data S related to the musical piece and a corresponding melody or chord progression arrangement, and a sound indicated by the musical tone data M related to the musical piece. By comparing the melody or chord progression arrangement corresponding to the waveform of the sound, the correspondence between the position of each of the plurality of symbols in the symbol data S and the position of each part of the sound waveform in the musical sound data M is specified, and the symbol data When the user designates the position of any symbol in S as the symbol position PS, the position of the waveform of the sound in the musical sound data M corresponding to the symbol position PS is set as the musical sound position PM based on the specified correspondence. Perform the specified process.

  The control unit 10 acquires the symbol data S and the musical sound data M, analyzes the arrangement of the symbols indicated by the acquired symbol data S, and generates and acquires the first analysis data S ′ indicating the melody or chord progression sequence. By analyzing the waveform of the sound indicated by the musical sound data M to generate second analysis data M ′ indicating the arrangement of melody or chord progression, and comparing the first analysis data S ′ and the second analysis data M ′, A process for specifying the correspondence between the positions of the plurality of symbols in the symbol data S and the positions of the respective portions of the sound waveform in the musical sound data M is performed.

  The control unit 10 displays the arrangement of symbols indicated by the symbol data S on the display screen 100 of the display unit 30 (see FIGS. 7 to 9), on the display screen 100 instructed by the user using the operation input unit 20. The position in the first analysis data S ′ corresponding to the bar position P, which is the display position of, is specified as the symbol position PS, and based on the symbol position PS, the first analysis data S ′ and the second analysis data M ′, the symbol A process of specifying the position in the musical sound data M corresponding to the position PS as the musical sound position PM is performed. In other words, the control unit 10 is specified in response to the user performing an operation of instructing the symbol position PS by the operation input unit 20 in a state where the symbol sequence indicated by the symbol data S is displayed on the display unit 30. Based on the correspondence, a process for specifying the musical tone position PM corresponding to the symbol position PS is performed.

  The generation of the first analysis data S ′ is performed, for example, by analyzing the arrangement of symbols indicated by the symbol data S by a method using image recognition. Thereby, the symbol data S can be input easily.

  The generation of the second analysis data M ′ is performed, for example, by analyzing the sound waveform indicated by the musical sound data M by a method using Fourier transform. Thereby, since the pitch is known from the waveform of the sound indicated by the musical sound data M, the second analysis data M ′ indicating the arrangement of melody or chord progression can be easily analyzed.

  The control unit 10 displays a musical score in which both the notes and chords related to the music are displayed on the display unit 30 as the symbol data S, and the symbol position PS designated by the user through the operation input unit 20 is the musical note. If the position of the note is instructed, the corresponding melody arrangement of the symbol indicated by the symbol data S and the waveform of the sound indicated by the musical tone data M are determined. By comparing the corresponding melody arrangements with each other, the correspondence between the position of each of the plurality of symbols in the symbol data S and the position of each part of the sound waveform in the musical sound data M is specified, and the chord position is instructed. If determined, the arrangement of chord progressions corresponding to the sequence of symbols indicated by the symbol data S is compared with the arrangement of chord progressions corresponding to the waveform of the sound indicated by the musical tone data M. More performs a process of specifying a correspondence relationship between the position of each part of the plurality of symbols each position and the waveform of sound in the tone data M in the symbol data S.

  In a state where the symbol data S is displayed on the display unit 30, the control unit 10 displays a symbol range (a range from the start bar position Pn to the end bar position Pn + k) in the symbol data S via the operation input unit 20. When the instruction operation is performed, the musical tone position (start musical sound position) and the end position (start musical position Pn) corresponding to the start position (starting bar position Pn) of the symbol range (the range from the starting bar position Pn to the end bar position Pn + k) are specified. A musical tone position (end musical tone position) corresponding to the end measure position Pn + k) is specified, and a musical tone position (end musical tone position) corresponding to the end position from the musical tone position (start musical position) corresponding to the specified starting position in the musical tone data M is specified. To play up to (position).

  In a state where the symbol data S is displayed on the display unit 30, the control unit 10 uses the operation input unit 20 to display a symbol range (a range from the start bar position Pn to the end bar position Pn + k) that is a range of symbols in the symbol data S. The musical tone range which is the range of the sound waveform in the corresponding musical tone data M of a plurality of symbols included in the designated symbol range (the range from the start bar position Pn to the end bar position Pn + k) is retrieved. Process.

(Operation input section)
The operation input unit 20 is used by the user to instruct the symbol position PS. For example, the operation input unit 20 is an input device such as a touch pad or a mouse.
It is preferable to combine the operation input unit 20 and the display unit 30 into a touch panel because an intuitive input operation can be performed on the displayed content.

(Display section)
The display unit 30 displays the arrangement of symbols indicated by the symbol data S, and is a display device such as a liquid crystal panel, for example, and has a display screen 100 (see FIGS. 7 to 9).
It is preferable to combine the operation input unit 20 and the display unit 30 into a touch panel because an intuitive input operation can be performed on the displayed content.

(Memory part)
The storage unit 40 stores symbol data S and musical tone data M. The storage unit 40 includes a ROM 41 and a RAM 42. The symbol data S is read from the storage unit 40 in response to a command from the control unit 10 and converted into first analysis data S ′. Similarly, the musical sound data M is read from the storage unit 40 according to a command from the control unit 10 and converted into second analysis data M ′. The first analysis data S ′ and the second analysis data M ′ are mainly temporarily stored in the RAM 42.

(Sounding part)
The sound generation unit 50 is, for example, a speaker, is an acoustic device that converts electric signal energy of the musical sound data M into sound waves and radiates the sound to the outside, and is controlled by a command from the control unit 10.

(Switch part)
The switch unit 60 includes a reproduction switch (not shown), a search switch (not shown), a power switch, and the like. The switch unit 60 is configured by, for example, a push button switch or a seesaw switch. A detection signal from the switch unit 60 is transmitted to the control unit 10. Note that a playback switch (not shown) or a search switch (not shown) may be omitted when provided on the display screen 100 of the display unit 30.

  Next, an image in which the symbol data S and the musical sound data M are converted will be described with reference to FIG.

  The symbol data S stored in the storage unit 40 is, for example, a chord score in which the arrangement of chords related to music such as F # m7, Bm, and G is written on the paper as shown in the upper left of FIG. . The symbol data S is not limited to a chord score, and may be a musical score in which a musical piece is represented by a symbol such as a performance symbol or a sign, such as a staff score or a tablature, and the lyrics 105 (FIG. 7) along the chord or note. To FIG. 9). Further, the symbol data S is not limited to the data written on the paper surface, and may be digital data such as image data or text data.

  On the other hand, the musical sound data M is, for example, audio data, audio data, or waveform data as shown in the upper right of FIG. Note that the musical sound data M may be digital data such as MIDI data, or analog data recorded directly from a microphone.

  Based on the symbol data S, the control unit 10 identifies a prelude, a melody (A melody, B melody, C melody, etc.), an interlude, etc., and a symbol position PS and code as shown in the middle left of FIG. First analysis data S ′ indicating chord progression associated with CS is generated. Similarly, based on the musical sound data M, the control unit 10 generates second analysis data M ′ indicating the chord progression in which the musical sound position PM and the chord CM are associated as shown in the middle right of FIG.

  Then, the control unit 10 compares the sequence of the code CS in the first analysis data S ′ with the sequence of the code CM in the second analysis data M ′, and represents the portion where the sequences match with the common code C, and the bar position P 2 is assigned to the data table T () in which the symbol position PS, the musical tone position PM, and the common code C are associated with the bar position P as shown in the lower part of FIG. 2).

(Operation)
Hereinafter, the content of the musical sound data processing method performed by the control unit 10 in the musical sound data processing apparatus 1 will be described with reference to FIGS. 2 to 9 based on the embodiment.
FIG. 3 is a flowchart of the display process. FIG. 4 is a flowchart of control based on an operation instruction. FIG. 5 is a flowchart of the reproduction process. FIG. 6 is a flowchart of the search process. FIG. 7 is a diagram illustrating an example of the display screen 100. FIG. 8 is a diagram illustrating an example of the display screen 100 in a state where the chord progression (Cn, Cn + k) is selected. FIG. 9 shows the display screen 100 in a state in which the chord progression (Cn, Cn + k) ′ matching the selected chord progression (Cn, Cn + k) and the similar chord progression (Cn, Cn + k) ″ are highlighted. It is a figure which shows an example.
In the following description, a chord score is used as the symbol data S. However, the present invention is not limited to the chord score. In the following description, audio data (MIDI data, audio data, waveform data, etc.) is used as the musical sound data M. However, the present invention is not limited to audio data. Further, the following description will be made on the assumption that the functions of the operation input unit 20 and the display unit 30 are integrated and a tablet having a touch panel capable of performing input by touching the screen with a fingertip or the like is used. The operation input unit 20 and the display unit 30 may be provided separately. In this case, the operation input unit 20 is a pointing device such as a mouse, and a pointer is displayed on the display unit 30 according to the movement of the pointing device. May be.
In the following, the first analysis data S ′ and the second analysis data M ′ indicate chord progression, but may be melody instead of chord progression.

(Display processing)
Display processing by the control unit 10 will be described mainly with reference to FIGS. 2, 3, and 7.
(A1) As shown in FIG. 3, first, the symbol data S such as a chord score including information on the symbol position PS and the code CS is read by means such as manual input, scanner, wired or wireless data transfer, and the like. 40 (step A1). Note that a flash memory such as an SD card or a USB memory may be directly connected to the control unit 10 and the flash memory may be used as the storage unit 40.
(A2) Similarly, the musical sound data M, which is audio data, is stored in the storage unit 40 (step A2).
(A3) Then, the control unit 10 performs an overall configuration analysis for analyzing the configuration of each of the symbol data S and the musical tone data M (step A3). Specifically, the control unit 10 identifies a prelude, a melody (A melody, B melody, C melody, etc.) or an interlude based on the symbol data S, and the symbol position PS and the code CS are associated with each other. First analysis data S ′ (see FIG. 2) indicating chord progression is generated. Similarly, based on the musical sound data M, the control unit 10 generates second analysis data M ′ (see FIG. 2) indicating the chord progression in which the musical sound position PM and the chord CM are associated with each other.
(A4) Next, the control unit 10 compares the first analysis data S ′ and the second analysis data M ′, and performs a synchronization process (step A4). Specifically, the code CS and the code CM are associated with a common bar position P. For example, a sequence of code CS and a sequence of code CM are compared, and a common code C in which both coincide with each other is assigned a common number indicating bar position P in time series, and bar position A data table T (see FIG. 2) in which a symbol position PS, a musical tone position PM, and a common code C are associated with P is created.
(A5) Then, as shown in FIG. 7, the control unit 10 displays a chord score indicating the relationship between the bar position P and the common chord C (chord progression 104) on the display screen 100 of the display unit 30 (step S104). A5).
In addition to the chord progression 104, a play button 101 and a search button 102 are displayed on the display screen 100.
Further, the lyrics 105 may be displayed on the display screen 100 along the chord progression 104.
Note that notes (not shown) may be displayed along the chord progression 104.
In this way, the control unit 10 performs display processing by controlling the display unit 30 based on the read symbol data S and musical tone data M.
Thereby, even if the correspondence relationship between the position in the musical sound data M and the position indicated by the symbol data S is not stored in advance, the position in the musical sound data M and the position indicated by the symbol data S can be related. Therefore, even if the correspondence between the position in the musical sound data M and the position indicated by the symbol data S is not stored in advance, the corresponding musical sound in the musical sound data M can be specified using the symbol data S.

(Operation instruction processing)
Next, operation instruction processing by the control unit 10 will be described mainly with reference to FIGS. 4, 7, 8, and 9. As a premise, the chord score as shown in FIG. 7 has already been displayed on the display unit 30 by the above display processing.
(B1) As shown in FIG. 4, first, the control unit 10 detects an operation of the touch panel by the user (step B1).
(B2) Here, the control unit 10 determines whether or not the detected operation is the first time (step B2), and if the detected operation is the first time (when the determination of step B2 is Yes), The process proceeds to step B3. Otherwise (if the determination in step B2 is No), the process proceeds to step B7.
(B3) The control unit 10 initializes the related RAM 42 (step B3), and proceeds to step B4.
(B4) The control unit 10 stores the initial touch position (step B4), and proceeds to step B5.
(B5) The control unit 10 updates the display, for example, by inverting the color of the location corresponding to the initial touch position on the display screen 100 of the display unit 30 (step B5), and proceeds to step B6.
(B6) The control unit 10 stores the bar position P closest to the initial touch position as the start bar position Pn (see FIG. 8) (step B6), and proceeds to step B1.
(B7) The control unit 10 determines whether or not a drag operation has been performed by the user (step B7). If a drag operation has been performed (if the determination in step B7 is Yes), the control unit 10 proceeds to step B8. Otherwise (if the determination in step B7 is No), the process proceeds to step B9.
(B8) After storing the drag position (range) in step B7, the control unit 10 updates the display, for example, by inverting the color of the location corresponding to the drag position (range) on the display unit 30 ( Step B8).
(B9) The control unit 10 determines whether or not the touch release is performed by the user (step B9). If the touch release is performed (when the determination of step B9 is Yes), the control unit 10 proceeds to step B10, and so on. If not (if the determination in step B9 is No), the process proceeds to step B12.
(B10) The control unit 10 stores the bar position P closest to the touch-released position as the end bar position Pn + k (see FIG. 8) (step B10), and proceeds to step B11.
(B11) The control unit 10 turns on the selection flag (step B11), and proceeds to step B1.
(B12) The control unit 10 performs a reproduction operation by the user by detecting, for example, a detection signal from a reproduction switch (not shown) in the switch unit 60 or a touch of the reproduction button 101 displayed on the screen. If the reproduction operation is performed (when the determination at Step B12 is Yes), the process proceeds to Step B13; otherwise (when the determination at Step B12 is No), the process proceeds to Step B13. The process proceeds to B14.
(B13) The control unit 10 performs a reproduction process to be described later (step B13) and ends the control.
(B14) The control unit 10 performs a search operation by the user by detecting, for example, a detection signal from a search switch (not shown) in the switch unit 60 or a touch of the search button 102 displayed on the screen. If the search operation is performed (when the determination at Step B14 is Yes), the process proceeds to Step B15; otherwise (when the determination at Step B14 is No), Transition to B1.
(B15) The control unit 10 performs a search process to be described later (step B15) and ends the control.

(Reproduction processing)
Next, reproduction processing by the control unit 10 will be described mainly with reference to FIGS. 5, 7, 8, and 9.
(C1) As shown in FIG. 5, the control unit 10 determines whether or not the selection flag (see Step B11) is ON (Step C1). If the selection flag is ON (Step C1 is determined). In the case of Yes), it transfers to step C2, and when that is not right (when determination of step C1 is No), it transfers to step C5.
(C2) The control unit 10 refers to the data table T (see step A4), obtains the start musical sound position PMn corresponding to the start bar position Pn (step C2), and proceeds to step C3.
(C3) The control unit 10 refers to the data table T (see step A4), obtains the end musical sound position PMn + k corresponding to the end bar position Pn + k (step C3), and proceeds to step C4.
(C4) The control unit 10 controls the sound generation unit 50 to reproduce the musical sound data M based on the specified musical sound position PM in the range from the starting musical sound position PMn to the ending musical sound position PMn + k (step C4). Exit. Note that the reproduction may be repeated so as to loop. Further, the control may be terminated after repeated reproduction for a predetermined time or a predetermined number of times.
(C5) The control unit 10 controls the sound generation unit 50 to reproduce the entire musical sound data M (step C5), and ends the control. Note that the reproduction may be repeated so as to loop. Further, the control may be terminated after repeated reproduction for a predetermined time or a predetermined number of times.

(Search process)
Next, search processing by the control unit 10 will be described mainly with reference to FIGS. 6, 7, 8, and 9. In the following description, chord progression (Cn, Cn + k), which is an arrangement of chords from chord Cn to chord Cn + k, corresponding to start bar position Pn to end bar position Pn + k, corresponds to a symbol range and a musical tone range.
(D1) As shown in FIG. 6, the control unit 10 determines whether or not the selection flag (see Step B11) is ON (Step D1). If the selection flag is ON (Step D1 is determined). In the case of Yes), it transfers to step D2, and when that is not right (when determination of step D1 is No), control is complete | finished.
(D2) The control unit 10 refers to the data table T (see step A4), and the chord progression (Cn, Cn, k) corresponding to the start bar position Pn to the end bar position Pn + k, from chord Cn to chord Cn + k. Cn + k) (see FIG. 9) is stored (step D2), and the process proceeds to step D3.
(D3) The control unit 10 refers to the data table T (see step A4), and the chord progression (Cn, Cn + k) ′ corresponding to the stored chord progression (Cn, Cn + k) or the corresponding chord progression (Cn, Cn + k) '' Is searched (step D3), and the process proceeds to step D4. Note that the corresponding chord progression (Cn, Cn + k) '' includes, for example, a transposed chord progression based on the stored chord progression.
(D4) The control unit 10 stores the chord progression (Cn, Cn + k) ′, (Cn, Cn + k) ″ searched and hit in step D3, and then, for example, chord progression (Cn, Cn + k) on the display unit 30. The display is updated by inverting the color corresponding to “, (Cn, Cn + k)” (see FIG. 9) or the like (step D4), and the control is terminated.

  The preferred embodiment of the present invention has been described in detail above, but the musical sound data processing apparatus 1 according to the present invention is not limited to the above-described embodiment, and the scope of the gist of the present invention described in the claims. Various modifications and changes can be made within.

  For example, in the above-described embodiment, a case has been described in which a musical sound is reproduced from a musical sound position PM corresponding to a bar position P instructed by the user on the display screen 100. However, the present invention is not limited thereto, and the bar position P and the symbol position PS are not limited thereto. And the musical sound position PM are associated with each other, for example, the measure position P corresponding to the musical sound position PM being reproduced is highlighted on the display screen 100 in accordance with the progress of the music. Can be identified and displayed. That is, the control unit 10 can identify and display the reproduction position on the display unit 30 during reproduction of the musical sound data M.

  For example, the control unit 10 can perform processing of identifying and displaying the position of the symbol corresponding to the reproduction position in the symbol data S displayed on the display unit 30 during the reproduction of the musical sound data M.

  Further, for example, the control unit 10 displays a score on which both notes and chord scores are displayed on the display unit 30, and the position designated by the user by the operation input unit 20 is either the note or the chord score. Can be determined by pattern recognition or the like, and the correspondence with the musical sound data M can be specified based on the determination result.

  For example, the control unit 10 performs the chord progression corresponding to the sequence of symbols indicated by the symbol data PS in the first analysis data S ′ or the second analysis data M ′, or the chord progression corresponding to the waveform of the sound indicated by the musical tone data M, When the pattern deviates from the prescribed chord progression pattern, information indicating an error may be output.

  For example, when the chord progression corresponding to the symbol indicated by the symbol data PS in the first analysis data S ′ or the second analysis data M ′ deviates from the prescribed chord progression pattern, the control unit 10 deviates from the pattern. The chord progression may be corrected to the most similar prescribed chord progression pattern.

For example, the control unit 10 acquires a plurality of musical tone data M corresponding to each of a plurality of musical pieces, and from among the plurality of acquired musical tone data M, the melody or chord progression arrangement of the symbol data S and the musical tone data M It is possible to specify the musical tone data M that matches the melody or chord progression sequence and specify the identified musical tone data M as a reproduction target.
Further, the control unit 10 can perform reproduction control based on the symbol position PS instructed to the symbol data S displayed on the display unit 30 for the musical sound data M designated as the reproduction target.

  For example, the control unit 10 acquires a plurality of symbol data S corresponding to each of a plurality of pieces of music, and from among the plurality of acquired symbol data S, the arrangement of the melody or chord progression of the musical sound data M and the symbol data S The symbol data S that matches the melody or chord progression sequence is specified, and the user is instructed to operate the symbol position PS by the operation input unit 20 in a state where the specified symbol data S is displayed on the display unit 30. It can be carried out.

  According to the musical sound data processing method and the musical sound data processing apparatus 1 of the present invention, the arrangement of the melody or chord progression 104 corresponding to the symbol represented by the symbol data S relating to the musical piece and the waveform of the sound indicated by the musical tone data M relating to the musical piece. Is compared with the arrangement of the melody or chord progression corresponding to the symbol data S, the correspondence relationship between the position of each of the plurality of symbols in the symbol data S and the position of each part of the sound waveform in the musical sound data M is specified. Since the position of the sound waveform in the musical sound data corresponding to the symbol position PS is specified as the musical sound position PM based on the specified correspondence by the user indicating the symbol position PS which is the position of the symbol, the musical sound data Even if the correspondence between the position in M and the position indicated by the symbol data S is not stored in advance, the musical sound using the symbol data S is used. You can specify the corresponding tone in the chromatography data M.

  According to the musical tone data processing method and musical tone data processing apparatus 1 of the present invention, the symbol data S and the musical tone data M are acquired, and the arrangement of the symbols indicated by the acquired symbol data S is analyzed to show the arrangement of melody or chord progression. The first analysis data S ′ is generated, the sound waveform indicated by the acquired musical sound data M is analyzed, and the second analysis data M ′ indicating the arrangement of the melody or chord progression is generated. The first analysis data S ′ and the first analysis data S ′ 2 By comparing the analysis data M ′ with each other, the correspondence between the position of each of the plurality of symbols in the symbol data S and the position of each part of the sound waveform in the musical sound data M is specified. The musical tone data M corresponding to the portion is reproduced, or the portion of the code that matches or corresponds to the code in the symbol data S is extracted from the symbol data S or the musical tone data M. Search and can be or. Therefore, the user wants to search for the range of the musical sound data M to be played back or looped by an intuitive operation on the display screen 100 on which the symbol data S such as a musical score is displayed, without specifying the time range of the musical sound data M to be reproduced. The chord progression can be specified, and the time and effort required for practicing instruments and copying ears can be reduced.

  According to the musical tone data processing method and musical tone data processing apparatus 1 of the present invention, the symbol data S is a chord score indicating the arrangement of chords related to the music, so that even if the melody cannot be directly recognized from the chord score, the symbol data S Based on the data S, the musical sound data M corresponding to the symbol data S is reproduced, and the melody can be recognized.

  According to the musical tone data processing method and musical tone data processing apparatus 1 of the present invention, the control unit 10 reproduces the musical tone data M based on the specified musical tone position PM, so that the position in the musical tone data M and the symbol data S The corresponding musical sound in the musical sound data M can be reproduced using the symbol data S even if the correspondence relationship with the position indicated by is not stored in advance.

  According to the musical sound data processing method and musical sound data processing apparatus 1 of the present invention, in the state where the arrangement of symbols indicated by the symbol data S is displayed on the display unit 30, the user performs an operation of instructing the symbol position PS by the operation input unit 20. Since the musical sound position PM corresponding to the symbol position PS is identified based on the identified correspondence according to what has been done, the user can intuitively operate the operation input unit 20 while viewing the display unit 30. .

  According to the musical sound data processing method and the musical sound data processing apparatus 1 of the present invention, the operation input unit is displayed with the musical score and the chord sequence related to the musical piece displayed on the display unit 30 as the symbol data S. 20, it is determined whether the symbol position PS instructed by the user is a note or a chord. If it is determined that the position of the note has been instructed, the sequence of symbols indicated by the symbol data S is changed. By comparing the arrangement and the arrangement of the melody corresponding to the sound waveform indicated by the musical sound data M, the correspondence between the position of each of the plurality of symbols in the symbol data S and the position of each part of the sound waveform in the musical sound data M If it is determined that the chord position has been instructed, the arrangement of the chord progression corresponding to the symbol indicated by the symbol data S and the sound indicated by the musical tone data M are determined. By comparing the chord progression arrangement corresponding to the shape, the correspondence between the position of each of the plurality of symbols in the symbol data S and the position of each part of the sound waveform in the musical sound data M is specified. Even if the chord score is mixed, the symbol data S and the musical sound data M can be appropriately related.

  According to the musical tone data processing method and musical tone data processing apparatus 1 of the present invention, the chord progression corresponding to the symbol sequence indicated by the symbol data S or the chord progression corresponding to the waveform of the sound indicated by the musical tone data is a prescribed chord progression. When the pattern deviates from the pattern, information indicating an error is output, so that the user can be prompted to correct or change the symbol data S or the musical sound data M.

  According to the musical tone data processing method and musical tone data processing apparatus 1 of the present invention, the chord progression corresponding to the sequence of symbols indicated by the symbol data S or the chord progression corresponding to the waveform of the sound indicated by the musical tone data M is a prescribed chord progression. Since the chord progression deviating from the pattern is corrected to the most similar prescribed chord progression pattern, the user can correct or change the obvious error in the symbol data S or the musical tone data M to the user. Is not imposed.

  According to the musical sound data processing method and musical sound data processing apparatus 1 of the present invention, the reproduction position is identified and displayed on the display unit 30 during reproduction of the musical sound data M, so that the user is currently reproducing it. It is possible to follow in real time which part the musical sound position PM is in the bar position P or the symbol position PS.

  According to the musical sound data processing method and musical data processing apparatus 1 of the present invention, the position of the symbol corresponding to the reproduction position in the symbol data S displayed on the display unit 30 is identified and displayed during reproduction of the musical sound data M. Therefore, the user can track in real time which part of the symbol position PS the musical sound position PM currently being reproduced is.

  According to the musical sound data processing method and musical sound data processing apparatus 1 of the present invention, a symbol range that is a symbol range in the symbol data S is displayed to the user by the operation input unit 20 in a state where the symbol data S is displayed on the display unit 30. When instructed, the musical sound position corresponding to the start position of the instructed symbol range and the musical sound position corresponding to the end position are specified, and the musical sound position corresponding to the specified start position in the musical sound data M is ended. Since the musical sound position corresponding to the position is reproduced, the user can intuitively operate the operation input unit 20 while looking at the display unit 30 to specify the range to be reproduced and reproduce the music.

  According to the musical sound data processing method and musical sound data processing apparatus 1 of the present invention, a symbol range which is a symbol range in the symbol data S is displayed to the user by the operation input unit 20 in a state where the symbol data S is displayed on the display unit 30. Since the musical tone range which is the range of the sound waveform in the corresponding musical tone data M of the plurality of symbols included in the designated symbol range is searched, the user inputs the operation input unit 20 while looking at the display unit 30. By intuitively operating, it is possible to search for the part of the music to be searched.

According to the musical tone data processing method and musical tone data processing apparatus 1 of the present invention, a plurality of musical tone data M corresponding to each of a plurality of musical pieces are acquired, and the melody of the symbol data S is obtained from the plurality of acquired musical tone data M. Alternatively, the musical tone data M in which the chord progression arrangement matches the melody of the musical tone data M or the chord progression arrangement is specified, and the specified musical tone data M is designated as a reproduction target. The music can be automatically selected from a plurality of music.
Further, since the musical tone data M designated as a reproduction target is targeted, reproduction control is performed based on the symbol position PS instructed to the symbol data S displayed on the display unit 30, so that it corresponds to one chord score or the like. The music to be played can be automatically selected from a plurality of music and played.

  According to the musical tone data processing method and musical tone data processing apparatus 1 of the present invention, a plurality of symbol data S corresponding to each of a plurality of musical pieces is acquired, and a melody of musical tone data M is acquired from the acquired plurality of symbol data S. Alternatively, the symbol input S is identified by the operation input unit 20 in a state where the sequence of chord progression and the melody of the chord data S or the sequence of chord progression S are identified and the identified symbol data S is displayed on the display unit 30. Since the position PS is instructed by the user, a chord score corresponding to one piece of music can be automatically selected from a plurality of chord scores and displayed.

  According to the musical sound data processing method and musical sound data processing apparatus 1 of the present invention, the operation input unit 20 and the display unit 30 are touch panels in which both are combined. It coincides with the symbol position PS displayed on the display screen 100 of the display unit 30, and it is easy to visually instruct the symbol position PS as the designated portion.

The invention described in the scope of claims attached to the application of this application will be added below. The item numbers of the claims described in the appendix are as in the scope of the claims initially attached to the application of this application.
<Claim 1>
By comparing the arrangement of a plurality of symbols indicated by the symbol data relating to the music and the corresponding melody or chord progression, and the arrangement of the melody or chord progression corresponding to the sound waveform indicated by the musical tone data relating to the music, the symbol Identify the correspondence between the position of each of a plurality of symbols in the data and the position of each part of the sound waveform in the musical sound data,
When the user designates the position of any symbol in the symbol data as a symbol position, the position of the waveform of the sound in the musical sound data corresponding to the symbol position is determined based on the specified correspondence. The musical sound data processing method characterized by specifying as follows.
<Claim 2>
Obtaining the symbol data and the musical sound data;
Analyzing the sequence of symbols indicated by the acquired symbol data to generate first analysis data indicating a melody or chord progression sequence;
Analyzing the waveform of the sound indicated by the acquired musical sound data to generate second analysis data indicating an arrangement of melody or chord progression;
By comparing the first analysis data and the second analysis data, the correspondence relationship between the position of each of the plurality of symbols in the symbol data and the position of each part of the sound waveform in the musical sound data is specified. The musical sound data processing method according to claim 1.
<Claim 3>
Analyzing a sequence of symbols indicated by the symbol data by a method using image recognition to generate first analysis data indicating an arrangement of melody or chord progression,
The waveform of the sound indicated by the musical sound data is analyzed by a method using Fourier transform to generate second analysis data indicating an arrangement of melody or chord progression. Music data processing method.
<Claim 4>
The music data processing method according to any one of claims 1 to 3, wherein the symbol data is a chord score indicating a sequence of chords related to music.
<Claim 5>
In a state where the arrangement of symbols indicated by the symbol data is displayed on the display unit, in response to the user performing an operation to instruct the symbol position using the operation input unit, the symbol position is set based on the specified correspondence. Identify the corresponding musical sound position,
5. The musical sound data processing method according to claim 1, wherein the musical sound data is reproduced based on the identified musical sound position. 6.
<Claim 6>
In a state where a musical score in which both the notes and chords related to the music are displayed on the display unit as the symbol data, whether the symbol position designated by the user by the operation input unit is a note or a chord If it is determined that the position of the note has been instructed, the arrangement of the melody corresponding to the sequence of symbols indicated by the symbol data and the arrangement of the melody corresponding to the waveform of the sound indicated by the musical tone data are compared. Thus, the correspondence relationship between the position of each of the plurality of symbols in the symbol data and the position of each part of the sound waveform in the musical sound data is specified, and when it is determined that the position of the chord has been instructed, By comparing the sequence of chord progressions corresponding to the sequence of symbols indicated by the symbol data with the sequence of chord progressions corresponding to the waveform of the sound indicated by the musical tone data, 6. The musical tone data according to claim 1, wherein a correspondence relationship between a position of each of a plurality of symbols in the signal data and a position of each part of a sound waveform in the musical tone data is specified. Processing method.
<Claim 7>
If the chord progression corresponding to the sequence of symbols indicated by the symbol data or the chord progression corresponding to the sound waveform indicated by the musical tone data deviates from the prescribed chord progression pattern, information indicating an error is output, or 7. The musical tone data processing method according to claim 1, wherein a chord progression deviating from the pattern is corrected to a most similar prescribed chord progression pattern.
<Claim 8>
The position of a symbol corresponding to a reproduction position in the symbol data displayed on a display unit is identified and displayed during reproduction of the musical sound data. The musical sound data processing method described in 1.
<Claim 9>
In a state where the symbol data is displayed on the display unit, when a symbol range that is a symbol range in the symbol data is instructed to the user by the operation input unit,
A musical sound position corresponding to a start position and a musical sound position corresponding to an end position of the designated symbol range are specified;
The musical sound data processing according to any one of claims 1 to 8, wherein a musical sound position corresponding to the specified start position in the musical sound data is reproduced from a musical sound position corresponding to an end position. Method.
<Claim 10>
In a state where the symbol data is displayed on the display unit, the user is instructed to operate the symbol range, which is a symbol range in the symbol data, by the operation input unit,
9. The musical tone range which is a range of sound waveforms in the musical tone data corresponding to a plurality of symbols included in the designated symbol range is searched. The musical sound data processing method described in 1.
<Claim 11>
Acquire multiple musical tone data corresponding to each of multiple songs,
From among the plurality of acquired musical sound data, specify musical data in which the melody or chord progression array of the symbol data matches the melody or chord progression arrangement of the musical sound data,
Designate the specified musical sound data as a playback target,
11. The reproduction control based on the symbol position instructed for the symbol data displayed on the display unit is performed on the musical sound data designated as the reproduction target. 2. A musical sound data processing method according to claim 1.
<Claim 12>
The operation input unit and the display unit are touch panels in which both are combined,
6. The musical sound data processing method according to claim 5, wherein the user is instructed to operate a symbol position by the operation input unit in a state where the specified symbol data is displayed on the display unit.
<Claim 13>
A control unit that executes the musical sound data processing method according to any one of claims 1 to 12,
A display unit for displaying a sequence of symbols indicated by the symbol data;
A musical sound data processing apparatus comprising: an operation input unit that performs an operation in which a user indicates the symbol position.

DESCRIPTION OF SYMBOLS 1 Musical sound data processing apparatus 10 Control part 20 Operation input part 30 Display part 40 Memory | storage part S Symbol data S '1st analysis data M Musical sound data M' 2nd analysis data PS Symbol position PM Musical sound position P Bar position C Code (common code) )
CS code CM code 100 Display screen 101 Play button 102 Search button 104 Code progression 105 Lyrics

Claims (13)

By comparing the arrangement of a plurality of symbols indicated by the symbol data relating to the music and the corresponding melody or chord progression, and the arrangement of the melody or chord progression corresponding to the sound waveform indicated by the musical tone data relating to the music, the symbol Identify the correspondence between the position of each of a plurality of symbols in the data and the position of each part of the sound waveform in the musical sound data,
When the user designates the position of any symbol in the symbol data as a symbol position, the position of the waveform of the sound in the musical sound data corresponding to the symbol position is determined based on the specified correspondence. The musical sound data processing method characterized by specifying as follows. Obtaining the symbol data and the musical sound data;
Analyzing the sequence of symbols indicated by the acquired symbol data to generate first analysis data indicating a melody or chord progression sequence;
Analyzing the waveform of the sound indicated by the acquired musical sound data to generate second analysis data indicating an arrangement of melody or chord progression;
By comparing the first analysis data and the second analysis data, the correspondence relationship between the position of each of the plurality of symbols in the symbol data and the position of each part of the sound waveform in the musical sound data is specified. The musical sound data processing method according to claim 1. Analyzing a sequence of symbols indicated by the symbol data by a method using image recognition to generate first analysis data indicating an arrangement of melody or chord progression,
The waveform of the sound indicated by the musical sound data is analyzed by a method using Fourier transform to generate second analysis data indicating an arrangement of melody or chord progression. Music data processing method. The music data processing method according to any one of claims 1 to 3, wherein the symbol data is a chord score indicating a sequence of chords related to music. In a state where the arrangement of symbols indicated by the symbol data is displayed on the display unit, in response to the user performing an operation to instruct the symbol position using the operation input unit, the symbol position is set based on the specified correspondence. Identify the corresponding musical sound position,
5. The musical sound data processing method according to claim 1, wherein the musical sound data is reproduced based on the identified musical sound position. 6. In a state where a musical score in which both the notes and chords related to the music are displayed on the display unit as the symbol data, whether the symbol position designated by the user by the operation input unit is a note or a chord If it is determined that the position of the note has been instructed, the arrangement of the melody corresponding to the sequence of symbols indicated by the symbol data and the arrangement of the melody corresponding to the waveform of the sound indicated by the musical tone data are compared. Thus, the correspondence relationship between the position of each of the plurality of symbols in the symbol data and the position of each part of the sound waveform in the musical sound data is specified, and when it is determined that the position of the chord has been instructed, By comparing the sequence of chord progressions corresponding to the sequence of symbols indicated by the symbol data with the sequence of chord progressions corresponding to the waveform of the sound indicated by the musical tone data, 6. The musical tone data according to claim 1, wherein a correspondence relationship between a position of each of a plurality of symbols in the signal data and a position of each part of a sound waveform in the musical tone data is specified. Processing method. If the chord progression corresponding to the sequence of symbols indicated by the symbol data or the chord progression corresponding to the sound waveform indicated by the musical tone data deviates from the prescribed chord progression pattern, information indicating an error is output, or 7. The musical tone data processing method according to claim 1, wherein a chord progression deviating from the pattern is corrected to a most similar prescribed chord progression pattern. The position of a symbol corresponding to a reproduction position in the symbol data displayed on a display unit is identified and displayed during reproduction of the musical sound data. The musical sound data processing method described in 1. In a state where the symbol data is displayed on the display unit, when a symbol range that is a symbol range in the symbol data is instructed to the user by the operation input unit,
A musical sound position corresponding to a start position and a musical sound position corresponding to an end position of the designated symbol range are specified;
The musical sound data processing according to any one of claims 1 to 8, wherein a musical sound position corresponding to the specified start position in the musical sound data is reproduced from a musical sound position corresponding to an end position. Method. In a state where the symbol data is displayed on the display unit, the user is instructed to operate the symbol range, which is a symbol range in the symbol data, by the operation input unit,
9. The musical tone range which is a range of sound waveforms in the musical tone data corresponding to a plurality of symbols included in the designated symbol range is searched. The musical sound data processing method described in 1. Acquire multiple musical tone data corresponding to each of multiple songs,
From among the plurality of acquired musical sound data, specify musical data in which the melody or chord progression array of the symbol data matches the melody or chord progression arrangement of the musical sound data,
Designate the specified musical sound data as a playback target,
11. The reproduction control based on the symbol position instructed for the symbol data displayed on the display unit is performed on the musical sound data designated as the reproduction target. 2. A musical sound data processing method according to claim 1. The operation input unit and the display unit are touch panels in which both are combined,
6. The musical sound data processing method according to claim 5, wherein the user is instructed to operate a symbol position by the operation input unit in a state where the specified symbol data is displayed on the display unit. A control unit that executes the musical sound data processing method according to any one of claims 1 to 12,
A display unit for displaying a sequence of symbols indicated by the symbol data;
A musical sound data processing apparatus comprising: an operation input unit that performs an operation in which a user indicates the symbol position.

Images