JP4241481B2 - Performance data editing program - Google Patents

Description

  The present invention relates to a performance data editing system for adding facial expressions to performance data composed of a plurality of parts.

If performance data such as MIDI data is composed only of note information, it becomes a mechanically expressionless performance, so various musical expressions for more natural performance, beautiful performance, live performance, etc. It is necessary to edit the performance data by adding the character of a musical instrument as control data. For this reason, conventionally, musical note sequences on performance data are analyzed to automatically express the performance data. For example, in Patent Document 1, expression data (pitch bend data or the like) corresponding to a performance style designated or selected mainly by analyzing the pitch sequence of performance data is added.
JP 2002-341867 A

In this case, there are several parameters for facial expression depending on the playing style, and the effect of facial expression changes depending on the parameter value. For example, as shown in Patent Document 2, vibrato has a “depth” parameter indicating a pitch change range, a “speed” parameter indicating a cycle, and the like. You can see a clear pitch change.
JP 2003-233374 A

  However, according to the prior art, expression is performed on the performance data in the part targeted for expression, so performance data of other parts that are not targeted and expression in other parts There is no care about the condition.

  In view of such circumstances, the present invention provides a performance data editing system that can perform an effective expression from the viewpoint of the entire performance data by giving an expression in consideration of the state of other parts. Objective.

  According to the main feature of the present invention, a data supply step (S1) for supplying performance data composed of a plurality of parts (PA, PB) and a facial expression target part to be subjected to facial expression are determined for the supplied performance data. A part determination step (S2), and a facial expression for performing facial expression on the performance data of the expression target part based on the determined performance data of the expression target part and performance data of other parts other than the expression target part A performance data editing program for causing a computer to execute the procedure consisting of steps (S3 to S13), wherein the expression adding step (S3 to S13) is performed on the performance data of the part to be expressed from the performance data of other parts. A step (S7) of extracting musical note data in a range corresponding to a facial expression range where facial expression is performed; Steps S8 to S11 are performed to control the expression in the expression range conservatively when the note data is extracted, and to emphasize the expression in the expression range when the note data is not extracted. ) Including a performance data editing program. Note that the parentheses are added with reference symbols and the like of the corresponding embodiments for the convenience of understanding, and the same applies to the following.

  In the performance data editing system according to the present invention, performance data composed of a plurality of parts (PA, PB) is supplied (S1), and when the part to be expressed is determined for the supplied performance data (S2), Expression is performed on the performance data of the part to be expressed based on the performance data of the part to be expressed and the performance data of other parts (S3 to S13). Therefore, according to the present invention, expression is made in consideration of the states of other parts, so that effective expression can be achieved in the entire performance data.

  Furthermore, with regard to facial expression (S3 to S13), with respect to the facial expression range (corresponding to the pronunciation time of the note data to which the facial expression is made) in the performance data of the facial expression target part (PB) to be facialized If the note data is present in the performance data of the other part (PA), the expression is conservatively controlled (S9), and the note data is present in the performance data of the other part (PA) with respect to the expression range. If not, the expression is strongly controlled (S10). When performing expression on a part in the performance data of a plurality of parts, the performance data of other parts is examined to determine the strength of expression. By controlling, it is possible to add a total and effective expression to the performance data.

〔System configuration〕
FIG. 1 shows a hardware configuration example of a performance data editing system according to an embodiment of the present invention. In this example of the performance data editing system, a general-purpose information processing device (computer) such as a personal computer is used as the performance data editing device, and performance input and tone generation functions are provided. An information processing apparatus (computer) dedicated to music may be used. This performance data editing device includes a central processing unit (CPU) 1, a random access memory (RAM) 2, a read only memory (ROM) 3, an external storage device 4, an input operation unit 5, a display unit 6, a sound source unit 7, a communication Elements such as an interface (communication I / F) 8 are provided, and these elements 1 to 8 are connected to each other via a bus 9.

  The CPU 1 that controls the entire apparatus executes various processes according to various control programs, and executes a facial expression process according to a performance data editing program included in the control program. The RAM 2 functions as a processing buffer for temporarily storing various information used in these processes. The ROM 3 stores various data such as various control programs, necessary control data, and performance data.

  The external storage device 4 is a hard disk (HD), a compact disk read only memory (CD-ROM), a flexible disk (FD), a magneto-optical (MO) disk, a digital multipurpose disk (DVD), a memory card, etc. Storage means using a storage medium. Various programs and data such as a performance data editing program and performance data can be stored not only in the ROM 3 but also in the external storage device 4.

  For example, when a control program such as a performance data editing program is not stored in the ROM 3, the control program is stored in the external storage device 4 such as an HD or a CD-ROM and read into the RAM 2. It is possible to cause the CPU 1 to perform the same operation as in the case of storing the control program, and it is possible to easily add a control program, upgrade the version, and the like. In addition, a desired performance data editing apparatus can be realized by installing a program used for the facial expression processing, necessary control parameters, and the like.

  The input operation unit 5 includes various panel operators (keys / buttons, mouse, etc.) for performing switch operations such as turning on / off the power, starting and stopping the facial expression processing, various settings, editing operations, etc. It comprises an operation unit including a performance operator and an operation detection circuit. The operation detection circuit detects the contents of a performance operation and panel operation by a user using these operation elements, and introduces corresponding input information into the system main body. .

  The display unit 6 controls the display content and lighting state of the display device 10 including a display (display such as CRT and LCD) connected thereto and various lamps and indicators in accordance with commands from the CPU 1, and the input operation unit 5. Provides display assistance for operations.

  The sound source unit 7 includes a sound source (including software) and an effect imparting DSP, and corresponds to actual performance information based on performance operation of the performance operator (5) and performance information in performance data such as the storage means 3 and 4. A sound system 11 that generates a musical sound signal and is connected to the sound source unit 7 includes a D / A conversion unit, an amplifier, and a speaker, and generates a musical sound based on the musical sound signal from the sound source unit 7.

  The communication I / F 8 shown in the figure collectively represents various interfaces connected to a local area network (LAN), a general communication network such as the Internet and a telephone line, or a MIDI network. Various information can be exchanged with various external devices 12 such as other computers and MIDI devices.

  For example, when no control program or data is stored in this apparatus, a control program or the like can be downloaded from another computer 12 via the communication I / F 8. In addition, actual performance information and various performance data can be captured from the communication I / F 8 using various MIDI devices including other performance information input devices (such as keyboard instruments) and performance data output devices.

[Outline of performance data editing]
In the performance data editing system according to one embodiment of the present invention, when automatically applying a facial expression to a certain part in the performance data, the facial expression is expressed according to the state of the other parts other than the target part to be facialized. adjust. That is, by evaluating the performance state of other parts and adjusting the expression of the target part in accordance with the evaluated state, it is possible to add a facial expression to the performance data effectively in total.

In this case, for example, there are rules for editing performance data such as the following (a) to (c):
(A) When there is no pronunciation of other parts, an emphasized characteristic expression is added.
(B) When there are many pronunciations of other parts, add a gentle and discreet expression.
(C) If there are movements of the same note in other parts, the expression is imitated.

  Expressions added here generally include volume, vibrato, staccato, trill, crescendo, decrescendo, etc. In the case of an instrument part such as a guitar, there are also choking and slides. Also, various other playing methods such as adding sounds of different pitches such as octaves can be applied. Then, a facial expression parameter (also referred to as “control parameter”) indicating the degree of the effect is set for the facial expression to be given.

Table 1 shows examples of expression parameter values including vibrato and staccato. In Table 1, “effective effect value Va” represents a parameter value when emphasizing a facial expression by adding a characteristic facial expression, and “small effect value Vb” represents a facial expression by adding a conservative facial expression. Indicates the parameter value for suppression. On the other hand, the “default value Vo” is a standard parameter value when such strength is not given.

  For example, when adding vibrato, the pitch modulation range is set to 80 cents for emphasis and 10 cents for suppression, whereas the default value is 50 cents (1/2) semitone. Is set. When staccato is given, the ratio to the length of the target note is 60% by default, but is set to 30% during emphasis and 80% during suppression. In addition, parameter values are also set as appropriate for other facial expression parameters. For example, for trills, the default values are finer when emphasized, and slower when suppressed, with values that allow alternate performance with adjacent sounds. Is set.

  Here, the essential point of the expression of performance data in the performance data editing system according to one embodiment of the present invention will be briefly described with reference to a score example as shown in FIG. In this system, when the “expression target part” to be expressed is determined for the performance data composed of a plurality of parts PA and PB, the performance data of the expression target part and the performance data of other parts are determined. Expression is performed on the performance data of the part to be expressed based on the expression. For example, when trying to apply a staccato expression to a part PB (without staccato), other parts than the “expression range” (the second and fourth beats to be expressed) of the expression target part PB When note data exists in PA, expression is controlled conservatively (second beat), and when note data does not exist in other parts PA, expression is controlled more strongly (fourth beat). In addition, when performing expression on the part PA, the performance data of the other part PB has “expression range” (second beat and fourth beat with staccato expression), and expression corresponding to each expression range. If there is a match in the timing and pitch movement of the other part PB in each corresponding range of the target part PA, the expression of the other part PB is imitated.

  An example of facial expression according to one embodiment of the present invention will be described in more detail with reference to FIG. In this example, the performance data is composed of an upper part PA and a lower part PB, and the following cases (1) to (3) are described assuming that staccato is added as an expression parameter.

(1) Case 1: In the case where the lower part PB is a facial expression part (assuming that there is no staccato shown) and staccato is given to the notes e in the note strings d to g in this case. The expression range that is the target of expression in the expression part PB (lower part) is from the beginning of the second beat to the end of the second beat of the illustrated measure, and from this part PA (upper part) to this expression range. Extract note data to enter. The note extracted in this range is only the note b, and there is a note b corresponding to the note e to be expressed. Therefore, according to the rule (b), the note e has a note b in Table 1 (2). A staccato is attached with a small effect value.

(2) Case 2: When staccato is applied to the notes g in the note strings d to g in the expression part PB as above, in this case, the expression range of the expression part PB (lower) Is from the beginning of the 4th beat to the end of the 4th beat of this measure, and the note data that falls into this expression range is extracted from the other part PA (upper stage). Since there are no notes extracted in this range, the effect g of Table 1 (2) is attached to the note g according to the rule (a).

(3) Case 3: When putting an expression on the upper part PA with the staccato attached to the notes e and g in the note strings d to g of the lower part PB as shown in this case, There is a note b in the corresponding range of the expression part PA (upper part) corresponding to the expression range of the first note e (expression from the beginning of the second beat) in the other part PB (lower part). Since these two musical notes e and b have the same timing and pitch name (F = Fa), the similarity is large. Therefore, the expression of the other part PB is imitated according to the rule (c), and at that time, the note b corresponding to the note e is given a highly effective staccato. Note that there is no note corresponding to the expression part PA (expression is not possible) in the range of the next note g (expression from the beginning of the fourth beat) in the other part PB.

  Here, if the note f of the other part PB (lower part) has a staccato, the expression part PA (upper part) in the expression range of the note f (from the beginning to the end of the third beat) Is a note c, and both notes f and c have similar timings and similarities, so that the expression of the other part PB is imitated according to the rule (c). However, since both notes f and c have different note names (f: A = ra, c: F = fa), and the degree of similarity is small, a small staccato is attached to the note c corresponding to the note f.

[Operation flow for editing performance data]
In the performance data editing system according to one embodiment of the present invention, the above-described facial expression processing is executed according to the performance data editing program. FIG. 3 and FIG. 4 are flowcharts showing an operation example [facial expression example 1] of the facial expression processing according to the first embodiment of the present invention. In this facial expression example 1, the rules (a) and (b) are mainly used. It is possible to make facial expressions according to the above.

  3 and FIG. 4, in the first step S1 (FIG. 3), a facial expression is obtained from the performance data stored in the ROM 3 or the external storage device 4 by a user operation on the panel operator of the input operation unit 5. When there is an input for selecting performance data to be added, the CPU 1 reads the selected performance data from the ROM 3 or the external storage device 4 into the work area on the RAM 2. Here, the performance data read into the RAM 2 is composed of a plurality of parts.

  In the subsequent step S2, when there is an input for instructing a part to be expressed from a plurality of parts included in the read performance data by the user operation, the CPU 1 sets the instructed part as the expression adding part. Set. Next, a rule for performing facial expression is set in step S3. This rule includes, for example, the type of rendition style to be used for expression, a detection rule for the expression range, and an actual expression expression algorithm applied to each performance style. In step S3, whether or not to refer to other parts of the performance data can be set for each performance style.

  When the expression target part, the expression rule, and the like are set in this way, in the next step S4, one of the expression methods of the expression method set in step S3 according to the processing progress instruction by the user operation. One performance method type is designated as the target of the facial expression processing, and the process proceeds to step S5.

  In step S5, one or a plurality of temporal ranges in which expression of the performance method designated as the target in step S4 (referred to as “target performance method”) can be performed from the expression part of the performance data read into the RAM 2. Extract. This expressionable range is called a “expression range”, and is extracted in predetermined time units, for example, from the beginning of the first beat of the first measure to the end of the first beat of the same measure. The expression range may be extracted automatically or may be instructed by a user operation.

  In the next step S6, a range corresponding to one of the extracted facial expression ranges is designated as a processing target. Subsequently, in step S7, for the other parts of the performance data, note data that is in a sounding state within the range designated as the processing target in step S4 (referred to as “target range”) is extracted, and in step S8. Then, it is determined whether or not such note data is extracted from other parts.

  Here, when note data is extracted from another part (S8 → YES), a parameter value Vb with a small effect of the rendition style is acquired in step S9, and then the process proceeds to step S11. On the other hand, when note data is not extracted from other parts (S8 → NO), a parameter value Va with a large performance effect is obtained in step S10, and then the process proceeds to step S11.

  In step S11, note data included in the target range is extracted from the expression part, and expression based on the expression parameter values Vb and Va acquired in steps S9 and S10 is performed. Thereafter, the process proceeds to step S12 (FIG. 4), and it is determined whether or not there is another range in which the subject rendition style can be expressed. Here, when there are other facial expression ranges of the same target playing method (S12 → YES), the process returns to step S6, and a range corresponding to one of the other facial expression ranges is designated as a new target range, The above-described steps S6 to S12 are repeated for the new target range.

  It should be noted that the processing in steps S5 to S10 is omitted for the performance style set to perform facial expression without referring to other parts of the performance data in step S3, and the facial expression part is omitted in step S11. It is possible to perform facial expression based on the default value Vo set in the target performance method.

  When there is no more target range in which the same subject performance method can be applied (S12 → NO), the process proceeds to step S13 to determine whether there is another performance method to be expressed. Here, when there are other performance style types to be expressed (S13 → YES), the process returns to step S4, and designates one of the other performance style types as a new target performance style, and a new target performance style. Steps S4 to S13 described above are repeated.

  Then, the processing of steps S4 to S13 is executed for all performance styles to be expressed, and when there is no target performance style (S13 → NO), this operation flow is ended.

  FIG. 5 and FIG. 6 are flowcharts showing an operation example [facial expression example 2] of the facial expression processing according to the second embodiment of the present invention. In this facial expression example 2, the facial expression according to rule (c) is mainly used. It can be performed.

  5 and 6, in the first step R1 (FIG. 5), as in step S1, performance data composed of a plurality of parts is read out from the ROM 3 or the external storage device 4 as an object for facial expression editing. , Read into the work area on the RAM 2. In the next step R2, as in step S2, the part instructed as an expression object from a plurality of parts included in the read performance data is set as the expression part.

  Next, in step R3, a rule for expression is set. This rule includes detailed settings of rules used for similarity determination when applying rule (c), detection rules for facial expression ranges already applied with facial expressions, and actual facial expressions applied for each performance style. Includes algorithms. In this step R3, it is also possible to set for each performance style whether or not to simply imitate other parts.

  When the facial expression target part, the facial expression rule, and the like are set in this way, in the next step R4, other parts not set as the facial expression part are searched in the performance data, and the facial expression is searched from the other part. One or more ranges with attached information are extracted. The range in which expression is applied in this way is called “expression range”. For example, pitch bend data (plural) that seems to be vibrato exist from the beginning of the first beat of the first measure to the end of the first beat of the same measure, etc. As described above, the data is extracted in predetermined time units.

  In the next step R5, a range corresponding to one of the extracted facial expression ranges is designated as a processing target. First, in step R6, note data in the range designated as the processing target in step R5 (referred to as “target range”) is extracted from the expression part of the performance data, and then in step R7 (FIG. 6). Also, note data within the target range is extracted from other parts.

  In step R8, the note data extracted in the expression part and the note data extracted in the other part are compared in similar sound generation timing, and in step R9, the sound generation timing of both note data is similar. It is determined whether or not. Here, when it is determined that the sound generation timings of both note data are similar (R9 → YES), the process further proceeds to step R10.

  In step R10, one or more facial expression information (playing styles) within the target range are extracted from other parts. Subsequently, in step R11, the note data extracted in the expression part in step R6 is compared with the note names of the note data extracted in other parts in step R7. It is determined whether or not the note names of the note data match.

  Here, when the note names of both note data extracted from the expression part and the other parts match (R12 → YES), a parameter value Va with a large performance effect is obtained in step R13, and then the step Proceed to R15. On the other hand, when the note names of both note data do not match (R12 → NO), the parameter value Vb with a small effect of the rendition style is acquired in step R14, and then the process proceeds to step R15.

  In step R15, the facial expression part performs facial expression of the type extracted in step R10 on the note data included in the target range based on the facial expression parameter values Va and Vb acquired in steps R13 and R14. Thereafter, the process proceeds to Step R16.

  Note that the specific processing content of steps R8 to R15 varies depending on the content of the similarity determination rule set in step R3. For example, for the rendition style set to simply imitate other parts in step R3, the processing in steps R10 to R14 is omitted, and in step R15, the target rendition style is set for the expression part. Expression can be performed based on the default value Vo.

  In step R16, it is determined whether or not there is another facial expression range extracted from the other part in step R4. If there is still another facial expression range (R16 → YES), the process returns to step R5 and the other A range corresponding to one of the facial expression ranges is designated as a new target range, and the processes in steps R5 to R16 described above are repeated for the new target range.

  Then, the processing of steps R5 to R16 is executed for all facial expression ranges extracted from other parts, and when there are no more facial expression ranges extracted (R16 → NO), this operation flow is ended.

[Various Embodiments]
Although a preferred embodiment of the present invention has been described above, this is merely an example, and the present invention can be variously modified without departing from the spirit thereof and can be implemented in various modes. it can. For example, performance data supplied for facial expression may originally include facial expression information. In particular, when imitating other parts as in the second embodiment, it is necessary to include facial expression information in the other parts of the performance data.

  As a procedure for performing facial expression, a procedure for automatically analyzing performance data of a certain part and performing multiple types of facial expression may be employed. For example, a mouse or the like may be used on a screen displaying a score. A procedure for designating a note to be expressed may be adopted.

  The expression is applied to a note, and for example, the expression is performed by specifying a range such as a measure. Examples of facial expression performed on notes include staccato, vibrato, choking, and examples of facial expression performed by range designation include crescendo and decrescendo.

  When emphasizing expression, the target note data volume may be increased, and the volume may be decreased when expression is suppressed. If the expression type is staccato, the length of the performance data will be longer if the overall length of the performance data is short, but conversely if the performance data is overall longer, the sound will be longer. If the length is shortened, the expression will be emphasized. In the case of vibrato, if the depth is deepened, the effect is emphasized, and conversely, if the depth is shallow, the effect becomes modest. Alternatively, it is possible to adopt a control in which expression is applied when emphasizing and expression is not performed when conservative.

  The similarity determination of the note data between parts is, for example, whether the rhythm is the same as the note timing of the note data, and whether the pitch of the next note data is the same or lower than the current note data Alternatively, it can be performed by one or a combination thereof, such as whether or not the pitches of the note data at the same timing match. In addition, the timing comparison may allow some errors.

  When it is determined that the note data between parts is similar, it may simply be imitated, but for example, when only the rhythm is similar, and when the note name or pitch also match Then, the expression control may be changed. For example, in the second embodiment, the match of the pitch name is taken into consideration, but if the pitch match is determined in addition to the pitch name or instead of the pitch name, and the pitch is also matched, the effect is further improved. It is possible to add a facial expression so as to increase (corresponding to R13 → R15), and to apply an expression so as to reduce the effect when only the rhythm is similar (R14 → R15).

  In the embodiment, the performance data consisting of two parts has been described for the sake of simplification, but actually there may be more parts. When there are a large number of parts, each part may be set as an expression target in order.

  The actual facial expression method may be a conventional method, for example, assigning pitch bend data or expression data, or assigning waveform data representing a corresponding playing style.

  For the control of facial expression, in the embodiment, in order to simplify the description, control parameter values (Va, Vo, Vb) are set for each performance style when emphasizing, normal, and conservative (suppressing). However, it may be set over several stages. Further, these parameter values may be set not as absolute values but as a percentage of default values such as percentages, and the user may be able to change the settings including the default values.

  Regarding the criteria for similarity determination, the number and types of items are not limited to those in the embodiment, and may be set and edited by the user. Similarly, the priority order and combinations of the standards may be changed without being limited to the embodiments.

It is a block diagram which shows the hardware structural example of the performance data editing system by one Example of this invention. It is a musical score for demonstrating facial expression by one Example of this invention. It is a part of flowchart which shows the operation example [Expression example 1] of the expression process by 1st Embodiment of this invention. It is another part of the flowchart showing the operation example [Expression example 1] of the expression process according to the first embodiment of the present invention. It is a part of flowchart which shows the operation example [Expression example 2] of the expression process by 2nd Embodiment of this invention. It is the other part of the flowchart showing the operation example [Expression example 2] of the expression process according to the second embodiment of the present invention.

Explanation of symbols

PA, PB part,
Vo default facial expression (control) parameter values,
Va parameter value when effect is large (when emphasizing),
Vb Value of expression (control) parameter when effect is small (when suppressed).

Claims (1)

A data supply step for supplying performance data comprising a plurality of parts;
A part determining step for determining a facial expression target part to be subjected to facial expression with respect to the supplied performance data;
Based on the determined performance data of the expression target part and performance data of other parts other than the expression target part, a procedure including an expression step for expressing the performance data of the expression target part is stored in the computer. A performance data editing program for execution,
The facial expression step
Extracting note data in a range corresponding to the expression range in which expression is performed in the performance data of the part to be expressed from the performance data of other parts;
A step of conservatively controlling the expression in the expression range when the note data is extracted, and a step of controlling to enhance the expression in the expression range when the note data is not extracted. A performance data editing program including:

Images