JP2007156181A - Musical performance data editing device and program - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To generate musical performance data that enable even a beginner user who does not have much knowledge to naturally play like a real musical instrument with sufficient expression by taking variation in modulation into consideration. <P>SOLUTION: This musical performance data editing system is characterized in that when modulation data (1b) representing modulation of a musical performance changing with time are set for musical performance data (1a) including note information, a note group having temporal connections is set at a musical performance data part to be given expression and feature information representing features of modulation change such as a rise and a fall in modulation is extracted based upon temporal change of the modulation data (1b) set at each musical performance data part. Expression such as vibratos is imparted to each musical performance data part (1d) according to expression template (table) ((2a), (2b)) selected based upon the extracted feature information. <P>COPYRIGHT: (C)2007,JPO&INPIT

Description

  The present invention relates to a performance data editing system capable of controlling a facial expression added to performance data in accordance with a change in inflection.

  If performance data such as MIDI data is composed only of note information, the performance becomes mechanically expressionless. In order to realize more natural performances, beautiful performances, lively performances, etc., it is necessary to add various musical expressions and musical instrument characteristics as control data and to be familiar with MIDI data editing methods. However, if it is left to the user what kind of expression is added to which part of the music for the work of adding such performance expression, the user needs to be familiar with the characteristics of music and musical instruments. That is, the user cannot create performance data that should be good at both the performance characteristics of the actual musical instrument and the computer music, and is troublesome and difficult even if it is good at both. Therefore, in order to make the system easy to use for a wide range of users, it is better to automatically perform the parts that can be judged by the machine.

For this reason, for example, Patent Document 1 and Patent Document 2 have been proposed that have been devised for automation in order to bring out musicality like performance data.
JP 2002-244657 A JP-A-2005-115073

  In the performance information processing apparatus of Patent Document 1, in order to perform expression with a sense of composition on the entire song, the song is divided into several parts, and an inflection expression is applied by applying inflection data for each divided section. As a specific means for adding an inflection expression, the volume is controlled by inflection data. In addition, in the musical expression device of Patent Document 2, not only the volume but also music expression information such as vibrato is automatically added to the performance data using the expression control data.

  However, in the prior art, the values of inflection data and expression control data corresponding to the temporal position of the note are directly related to expression, and changes in intonation are not reflected. In other words, for example, even if the degree of intonation is the same, if the type of music expression is different between when the inflection increases and when it falls, more natural performances are often obtained, and changes in intonation are important for music expression. Nevertheless, such changes of intonation were not taken into account.

  In view of such circumstances, the main object of the present invention is to allow for even a novice user with little knowledge to realize a natural performance like a real musical instrument, even if it is a novice user with little knowledge. An object is to provide a performance data editing system capable of generating performance data.

  According to the main feature of the present invention, the performance data acquisition means (E1) for acquiring performance data including note information (FIG. 2 (1a)), and the performance data portion (to which a facial expression is applied to the acquired performance data) Target setting means (E5) for setting the target note group A, B, C,..., And inflection data representing the inflection of the performance that changes with time according to the performance with respect to the acquired performance data [FIG. )] And the inflection change based on the temporal change of the inflection data [FIG. 3 (2)] set in the performance data portion (A, B, C,...) Feature extraction means (E7) for extracting feature information representing the features of the expression, and expression adding means (E8; for applying expression to the performance data portion (A, B, C,...) Based on the extracted feature information. Figure 6) Apparatus (electronic music apparatus EM) [Claim 1], performance data acquisition step (E1) for acquiring performance data including note information [Fig. 2 (1a)], and expression of the acquired performance data A target setting step (E5) for setting a target performance data portion (target note group A, B, C,...), And a performance inflection that changes with time according to the performance of the acquired performance data. The inflection setting step (E4) for setting the inflection data [FIG. 2 (1b)] and the inflection data [FIG. 3 (2)] set in the performance data portion (A, B, C,...) Over time A feature extraction step (E7) for extracting feature information representing the feature of the inflection change based on the change, and expression of the performance data portion (A, B, C,...) Based on the extracted feature information. Applying facial expression step E8; performance data editing program for executing the steps consisting FIG. 6) and a computer (electronic music apparatus EM) [Claim 3] is provided. Note that the parentheses are reference symbols, terms, or parts of the examples given for convenience of understanding.

  In the performance data editing apparatus according to the present invention, the target setting means (E5) includes the time of note information constituting the performance data [FIG. 2 (1a); FIG. 3 (1)] acquired by the performance data acquisition means (E1). Each piece of performance data (target note group A, B, C,...) That is a target for expression is set sequentially based on the natural connection.

  In the performance data editing system according to the main feature of the present invention (claims 1 and 3), inflection data [FIG. 2 (1b)], for example, when the inflection is increased or decreased, or when there are a plurality of inflection peaks and valleys. Focusing on the characteristics of the changes extracted from, the expression processing is performed by controlling expression parameters such as vibrato and pitch bend according to each case. Therefore, according to the present invention, even a beginner with little knowledge can create performance data that realizes a natural performance that seems to be a genuine musical instrument with a sufficient expression.

  In the performance data editing apparatus according to the present invention, the performance data [FIG. 2 (1a); individual performance data portions to be expressed based on the temporal connection of the note information constituting FIG. 3 (1). Since the target note groups A, B, C,... Are sequentially set (Claim 3), appropriate expression can be realized for the note group to be expressed in the performance data. .

〔System configuration〕
FIG. 1 is a block diagram showing the hardware configuration of a performance data editing apparatus according to an embodiment of the present invention. The performance data editing device EM uses a personal computer (PC) having a music information processing function or a music information processing device (electronic music device) such as an electronic musical instrument. A generator is provided. The performance data editing device EM includes a central processing unit (CPU) 1, a random access memory (RAM) 2, a read only memory (ROM) 3, an external storage device 4, a performance operation detection circuit 5, a setting operation detection circuit 6, and a display circuit. 7, a sound source circuit 8, an effect circuit 9, a communication interface (I / F) 10, a MIDI interface (I / F) 11, and the like, and these elements 1 to 11 are connected to each other by a bus 12.

  The CPU 1 constitutes a data processing unit together with the RAM 2 and the ROM 3 and executes various music information processing including performance data editing processing using a clock by the timer 13 in accordance with a predetermined control program including a performance data editing program. The RAM 2 is used as a work area for temporarily storing various data necessary for these processes. The ROM 3 stores various control programs necessary for executing these processes, control data such as a facial expression template (facial expression parameter control table), and the like.

  The external storage device 4 is not only a built-in storage medium such as a hard disk (HD) but also a compact disk read only memory (CD-ROM), a flexible disk (FD), a magneto-optical (MO) disk, a digital multipurpose disk ( DVD, SmartMedia (registered trademark) and other small memory cards, etc., including various portable external recording media, in addition to the control program and control data described above, performance data before or after expression. Arbitrary data can be stored in any external storage device (for example, HDD) 4.

  The performance operation detection circuit 5 constitutes a performance operation section together with a performance operation element 14 such as a keyboard, detects a user's performance operation on the performance operation element 14, generates performance data corresponding to the performance contents, and sends it to the data processing section. Introduce. The setting operation detection circuit 6 detects a user setting operation (panel setting) with respect to the setting operation element 15 such as a key switch or a mouse provided on the operation panel of the performance data editing apparatus EM, and setting data corresponding to the setting content. Is introduced into the data processing unit. The display circuit 7 controls display / lighting contents of a display (display device) 16 such as a screen display LCD provided on an operation panel or the like and various indicators (not shown) according to instructions from the data processing unit, Display assistance for operations 14 and 15 is performed.

  The tone generator circuit 8 and the effect circuit 9 function as a musical tone signal generation unit, and both the circuits 8 and 9 can include software. The tone generator circuit 8 generates musical tone data of a predetermined tone color and pitch according to the performance data from the performance operation detection circuit 5, the storage means (3, 4), etc., and the effect circuit 9 having the effect imparting DSP A tone signal in which a predetermined effect is added to the tone data is generated according to the data. The sound system 17 following the effect circuit 9 includes a D / A converter, an amplifier, and a speaker, and generates a musical sound based on a musical sound signal output from the effect circuit 9.

  A communication network CN such as the Internet or a local area network (LAN) is connected to the communication I / F 10, and a control program is downloaded from an external server computer SV or the like, and performance data is stored in the storage device 4. It can be used with the editing apparatus EM. The MIDII / F11 is connected to another electronic music device (external MIDI device) MD such as an external sound source device capable of handling music information in the MIDI format in the same manner as the performance data editing device EM, and both devices are connected through the MIDII / F11. MIDI data can be exchanged between EM and MD.

[Intonation data and expression]
In the performance data editing system according to one embodiment of the present invention, a natural performance with a sufficient expression can be obtained by performing expression processing according to the feature of the intonation change extracted from the intonation data in accordance with the performance data editing program. Performance data to be realized can be created. FIG. 2 is a diagram for explaining the outline of expression in the performance data editing system according to one embodiment of the present invention. FIG. 3 shows a group of target notes to be subjected to a series of expressions on performance data. An example of rules to be determined is shown.

  Here, the main functions of the performance data editing system will be described very roughly. In this performance data editing system, when inflection data (1b) representing inflection of performance that changes with time according to performance is set for performance data (1a) including note information, performance data to be subjected to facial expression. When note groups A to C that are temporally connected are set as portions, and the inflection increases based on temporal changes of the intonation data (1b) set in each performance data portion A to C (2a) The feature information representing the feature of the intonation change such as (2b) is extracted. Then, according to the expression template (expression expression parameter control table) [(2a), (2b)] selected based on the extracted feature information, expression such as vibrato is applied to each performance data portion (1d). ).

  Hereinafter, a specific description will be given with reference to FIG. FIG. 2 (1) shows an example of expression of performance data by inflection data (in the case of vibrato speed control), (1a) shows original performance data called “music data”, and (1b) shows Intonation data applied to this music data is shown.

  “Intonation data” is also called upsurge data, and is abstract data representing the degree of inflection of music performance (the degree of upsurge). The value of intonation data changes with time according to the music performance (for example, 0.0-1.0). Also, for the inflection data applied to each piece of music data, various inflection templates having different temporal change patterns of inflection data are prepared in advance in the storage means (3, 4), and desired inflection templates are obtained from these inflection templates. It can be given by a method of selecting an inflection template or a method in which a user draws a desired inflection pattern with a graphic tool and designates it as inflection data. Therefore, the abstract intonation data representing inflection (swelling) does not represent a change in a specific musical tone control parameter (for example, velocity) as it is.

  For example, by giving the inflection data shown in (1b) to the music data including the note event (NoteEvent) and the velocity (velocity) shown in (1a) of FIG. 2 (1), the velocity is edited according to the inflection data. Then, as shown in (1c), the result of changing the velocity is obtained, and the expression processing based on the volume can be performed.

  At this stage, we are only paying attention to the static characteristics of the inflection data, but even if the inflection data is the same value, when the inflection increases or when the inflection subsides, or when the inflection changes quickly or slowly Then, since the types of expressions are generally different, it is also important for musical expressions to pay attention to changes in intonation data.

  Therefore, in this performance data editing system, a characteristic change state of an inflection curve drawn on the time-inflection value plane is extracted as feature information by using the intonation data, and a facial expression template is selected using the extracted feature information as a parameter. Thus, sufficient expression processing is performed by controlling expression parameters such as vibrato and pitch bend according to changes in inflection. In this case, the expression such as velocity using the inflection curve as it is as in (1c) can be appropriately adopted or not adopted as necessary.

  In the example shown in the figure, two facial expression parameter control tables representing the degree of facial expression such as vibrato are prepared as facial expression templates. The inflection curve shows an increasing tendency and the inflection increases, and the inflection curve shows a decreasing tendency. The case where the intonation is settled is captured as a characteristic change of the intonation data. Then, the expression parameter control table corresponding to the change of the intonation data is selected, and the expression parameters such as vibrato are controlled according to the selected table, and the optimum expression according to the inflection change is performed.

  In other words, the expression parameter control table represents the degree of expression according to the speed (reciprocal of the cycle) and the depth of vibrato for the intonation data value according to the increase and decrease of the inflection data. An expression parameter such as vibrato according to the change of the given inflection data according to the expression parameter control table for the portion of the performance data stored in the storage means (3, 4) to which the inflection data is given To control. (1d) of FIG. 2 (1) shows the result when the vibrato speed is edited using the control characteristics of the vibrato speed shown in FIG. 2 (2) according to the change of the inflection data of (1b). .

  FIG. 2 (2) shows an example of the relationship between the value of intonation data and the vibrato speed, and a vibrato speed control table having this relationship is stored in the storage means 3 and 4 as a facial expression parameter control table. In the expression parameter control characteristic of (2a), when the inflection data increases, the vibrato speed changes as the beginning of the change of the inflection data, and the expression parameter control characteristic of (2b) decreases in the inflection data. In some cases, the vibrato speed means that the change is greater at the beginning of the inflection data change. That is, it means that the value is different when the change is rising and when it is falling even for the same inflection data value.

  As the expression parameter control table, a vibrato depth control table having the same relationship as the vibrato speed of (2a) and (2b) with respect to the vibrato depth is stored in the storage means 3 and 4. In addition, regarding the pitch bend speed and depth, the pitch bend speed control table and the pitch bend depth having the same relationship as the vibrato speeds of (2a) and (2b) when there are a plurality of peaks and valleys of the inflection data. The control table is stored in the storage means 3 and 4 for each range of the number of peaks and valleys of intonation data. These facial expression parameters are also controlled according to the corresponding control table.

  A parameter control table having a characteristic that the change in the degree of expression is larger as the inflection data value is smaller as in (2a) is called a “larger change” table, and the expression is smaller as the inflection data value is smaller as in (2b). A parameter control table having a characteristic with a small change in attachment degree is called a “small change” table. Note that the control characteristics as shown in FIG. 2 (2) are merely examples, and the opposite change may be preferable depending on the type of musical instrument and the music genre.

  Note that the characteristic change state of the inflection curve includes an upward convexity and a downward convexity in addition to the increase and decrease as described above and the number of peaks and valleys, and a predetermined expression template according to each feature. By selecting, the corresponding expression parameter can be controlled.

  FIG. 4 shows a data structure example of performance data and expression data. For example, as shown in FIG. 4 (1), the original performance data before the facial expression includes a number of events sequentially arranged in accordance with the progress of the music performance following the header information including information on the format of the music. Information is described in the SMF format. Each event information includes timing information, a code indicating the type of event such as note-on, a note number, and velocity as shown in the figure.

  Expression of performance data is preferably performed on a set of coherent notes. For example, a target note group to be expressed is determined according to a rule as shown in FIG. In order to determine the target note group, the note events of the performance data are read from the external storage device 4 such as an HDD, and the time is linked based on the result of comparing the time of the preceding note and the following note according to a predetermined rule. Automatically extract notes with a mark. FIG. 3A shows an example of various patterns of note events on the assumption that note events are displayed on the screen of the display 16 in a piano roll, in order to explain the temporal pattern of the read note events.

  In FIG. 3 (1), for example, a note group in which the note-off of the preceding note and the note-on of the succeeding note overlap with each other in time or close to a predetermined position, such as A, is a series like a legato performance. These notes are read out as one expression object over the pronunciation period Ta. As in B, the notes in the pronunciation period Tb apart from the note-off of the preceding note and the note-on of the succeeding note are read out as a single expression object even alone. Further, as in C, a plurality of notes whose note-on timings are close to a predetermined level are determined to be notes that are sounded almost simultaneously in the sound generation period Tc, such as chord performance, and these notes are regarded as one note. It is read out as an expression object. Note that these rules may differ depending on the selected algorithm.

  Further, the inflection data applied to the performance data can be appropriately determined by the above-described method, and the pattern of the determined intonation data is displayed on the screen of the display 16 as shown in FIG. This can be confirmed by displaying the note event corresponding to the piano roll display of (1).

  FIG. 4 (2) shows an example of the structure of facial expression data representing the content of facial expression that is sequentially given to performance data in accordance with intonation data. The facial expression data includes a plurality of facial expression information corresponding to the target note group. Arranged in the order of progression. Each facial expression information is a target section that specifies a section (referred to as a “target section”) to be subjected to facial expression corresponding to the sound generation period (Ta, Tb, Tc,...) Of each target note group at the start / end timing. It consists of designation information, a facial expression type code that represents the type of facial expression for each target note group, a facial expression type dependent parameter that represents the parameter value of the facial expression.

  For example, the expression type code represents vibrato, choking (pitch bend), etc., and the type-dependent parameter is a parameter representing depth or speed (cycle) in the case of vibrato, and depth or rising speed (in the case of choking). This parameter is a reciprocal of the rise time and is simply referred to as “speed”.

[Example of performance data editing process]
FIG. 5 is a flowchart showing an example of performance data editing processing (overall processing) according to one embodiment of the present invention, and FIG. 6 is a flowchart showing an example of expression adding processing during the performance data editing processing. The performance data editing process flow of FIG. 5 is executed when the desired performance data is selected from the performance data prepared in the HDD of the external storage device 4 based on the music selection operation by the user in the performance data editing apparatus EM. Is done.

  First, in the first step E1, the CPU 1 loads the selected performance data from the HDD 4 into the RAM 2, generates piano roll or stave image data from the performance data, and displays on the LCD screen of the display 16 through the display circuit 7. A note event image based on the generated image data is displayed.

  In the following step E2, for example, a list of expression algorithm names represented by instrument names is presented to the user in an algorithm selection window in the same screen, and a desired algorithm name is selected based on a user operation. Specify the expression algorithm to be added to the performance data. Examples of such algorithm names include “Strings Pop”, “Strings Classic”, “Guitar Hot”, “Guitar Smooth”, “Electric Bass Normal”, “Electric Bass Slap”, etc. .

In the next step E3, a time range for expression of the performance data is determined. In determining this range, the following methods (1) to (3) can be used:
(1) Display performance data on the screen and let the user select the performance data by operating the mouse.
(2) Like automatic division of patent document 1, it classify | categorizes into a phrase etc. according to a predetermined rule,
(3) The performance data (song) is from the beginning to the end.

Next, in step E4, intonation data for performance data is determined. For the determination of the intonation data, the following methods (a) to (c) can be used, and the determined intonation data is expanded or contracted according to the expression time range:
(A) selecting one from a plurality of intonation data provided in the system according to a user operation;
(B) Display an inflection data input screen and let the user draw an inflection pattern on this screen.
(C) An intonation data input screen is displayed. On this screen, the user designates a plurality of points and connects the points with a predetermined curve (including a straight line).

  When the expression setting conditions are set as described above, in step E5, the musical data loaded in the RAM 2 in accordance with a predetermined rule are sequentially assigned to the expression objects in accordance with predetermined rules. Are set to individual target note groups (FIG. 3: A to C), and performance events are read into the work area of the RAM 2 in units of target note groups in order from the beginning of the expression time range in the performance data. Steps E6 to E8 are performed for the performance event. In this example, the processing is performed in units of target note groups. However, the simplest target note group may be processed one by one.

  First, in step E6, the average value, maximum value, minimum value, or these of the inflection data in the target section are calculated from the pronunciation period of the target note group (FIG. 3: Ta to Tc), that is, the inflection data corresponding to the target section. The value of either 1 or 2 is obtained. Next, in step E7, the feature of the intonation change is obtained from the intonation data corresponding to the pronunciation period of the target note group. For example, there is no change (a constant value), the value of the intonation data in the pronunciation period is linearly increasing, linearly decreasing, upwardly convex, or having multiple peaks and valleys. Check whether the conditions are met. In addition, the change width of the intonation data value during the pronunciation period is obtained, and when there are a plurality of valleys, the number of peaks and valleys and the time ratio of the change are obtained.

  Then, in step E8, expression processing for generating expression data in the performance data is performed based on the value obtained from the inflection data in steps E6 and E7 and the characteristics of the change. An example of this facial expression processing will be described in more detail with reference to FIG. After the facial expression processing in step E8, the process proceeds to step E9, where it is determined whether or not the end of the facial expression time range has been reached. If the end has not been reached (E9 → NO), the process returns to step E5, and the next Steps E5 to E8 are repeated for the target note group.

  When it is determined that the processing of steps E5 to E8 has been completed for all the target note groups and the end of the expression range has been reached (E9 → YES), the process proceeds to step E10, and other parts of the performance data (music) are also recorded. It is determined whether or not to perform facial expression. Whether or not other parts are to be given a facial expression may be determined by a user operation, or may be in accordance with a predetermined rule as in Patent Document 1. Here, when expressing other parts (E9 → NO), the process returns to step E3, and the processes in steps E3 to E10 are repeated for the newly determined expression time range.

  When it is determined that expression of other parts of the performance data (music) is not performed or when it is determined that expression of other parts is performed and there is no other part to be expressed (E10) → YES), the process proceeds to step E11, and based on the original performance data and expression data, the performance data with expression is generated in the same manner as in Patent Document 2, and the performance data with expression in the subsequent step E12 is generated. From the RAM 2 to the HDD 4, and further at step E 13, the performance data with the expression is passed to the tone signal generators 8 and 9, or is passed to the external tone generator MD via the MIDI interface 11 to generate a tone signal. By doing so, the performance data with the expression is reproduced. Then, the performance data editing process ends after the performance data is reproduced to confirm the state of expression.

  In this example of the processing flow, the performance data with the expression is stored and reproduced as a series of processes, but the performance data with the expression is temporarily stored in the HDD 4 and then reproduced at a later date. You may do it.

[Example flow of facial expression processing]
Next, an example of the facial expression processing executed in step E8 of the performance data editing processing (overall processing) when the facial expression parameters are vibrato and pitch bend will be described with reference to FIG. When this facial expression processing flow starts, first, in step S1, the processing program of the algorithm specified in step E2 is loaded onto the RAM 2, and thereafter the facial expression processing is performed according to the rules according to this processing program.

  First, in step S2, whether to add vibrato, that is, the target section length (the length of the target section indicated by the pronunciation period of the target note group to be processed read out in step E5) is a predetermined length suitable for vibrato provision. If it is equal to or longer than the predetermined length (S2 → YES), the process proceeds to step S3, and it is determined whether or not the feature of the inflection data in the target section tends to increase.

  Here, when the feature of the inflection data in the target section indicates an increase in the intonation data value as a whole (S3 → YES), the process proceeds to step S4, and the vibrato speed ( In the next step S5, the vibrato depth is determined using the vibrato depth table having a large change.

  On the other hand, when the feature of the inflection data in the target section does not indicate an increase in the intonation data value as a whole (S3 → NO), the process proceeds to step S6, and the vibrato speed (cycle) is determined using a table with a small change. In the next step S7, the vibrato depth is determined using a table with a small change.

  Then, after the process of step S5 or step S7, the process proceeds to step S8, and the expression parameter value (expression expression) determined in step S4, S5 or steps S6, S7 is followed by the target section designation information and the expression type code. The expression information of the target section describing the type-dependent parameter) is added to the expression data storage area of the RAM 2.

  When it is determined in step S2 that the target section length is less than the predetermined length (S2 → NO) or in step S8), after adding the facial expression information data, the process proceeds to step S9 and pitch bend is applied. That is, it is determined whether or not the target section length is equal to or longer than a predetermined length suitable for pitch bend assignment. If it is equal to or longer than the predetermined length (S9 → YES), in step S10, the inflection data of the target section is determined. It is determined whether or not there are multiple valleys as features.

  Here, when there are a plurality of peaks and valleys of the inflection data in the target section (S10 → YES), the process proceeds to step S11, the pitch bend speed table is determined using the pitch bend speed table having a large change, and in the next step S12, The pitch bend depth is determined using a pitch bend depth table having a large change.

  On the other hand, when the number of peaks and valleys of the inflection data in the target section is not plural (S10 → NO), the process proceeds to step S13, where the pitch bend speed table is determined using the pitch bend speed table with a small change. The pitch bend depth is determined using a small pitch bend depth table.

  Then, after the process of step S12 or step S14, the process proceeds to step S15, and the expression parameter value (expression expression) determined in step S11, S12 or steps S13, S14 follows the target section designation information and the expression type code. The expression information of the target section describing the type dependent parameter) is added to the expression data storage area of the RAM 2, and then the process returns to step E9 of the entire process to end the expression process.

[Summary of various embodiments and expression]
The preferred embodiment of the present invention has been described in detail with reference to the drawings. However, this embodiment is merely an example, and various modifications can be made without departing from the spirit of the present invention. For example, in the embodiment, a display parameter control table such as a vibrato speed and depth table or a pitch bend speed and depth table is used as a display template. Various expression templates that control the image can be used.

In short, it is only necessary to prepare various display templates that take into account the following points regarding changes in intonation data, and select an optimal template according to the characteristic changes in intonation data:
[1] When the inflection data increases or the fluctuation width of the intonation data is large, the expression is exaggerated as compared to the case where the inflection data is not large.
[2] When the inflection data is convex downward and increases, a larger expression is added when the value of the inflection data is large so that a large inflection is added in a short time.
[3] The more the number of peaks and valleys in the intonation data is, the more demanding the expression is, and the expression is further exaggerated.

  Here, more exaggerated expression means, for example, as in the embodiment, the vibrato is deepened, the vibrato speed is increased (the cycle is shortened), the pitch bend is deepened, and the pitch bend speed is increased ( (Shortening the rise time), varying the timing of notes that sound simultaneously with the stroke of the guitar, adding more special performance sounds and performance noise (switching the sound waveform with velocity), etc. It may include increasing the change by velocity (each sound) or expression (whole).

  Further, although detailed description of the expression of each sound based on inflection data (for example, velocity control: FIG. 2 (1c)) is omitted, the expression of an individual note indicates the value or change of the intonation data for the note. It can be determined according to the state of.

It is a block diagram which shows the hardware constitutions of the performance data editing system by one Example of this invention. It is a figure for demonstrating the outline | summary of the facial expression in the performance data editing system by one Example of this invention. It is a figure showing the example of the rule which determines a target note group in performance data editing (expression addition) of one Example of this invention. It is a figure showing the example of the data structure used with the performance data editing system by one Example of this invention. It is a flowchart showing an example of the performance data edit process by one Example of this invention. It is a flowchart showing an example of the facial expression process by one Example of this invention.

Explanation of symbols

EM performance data editing devices (electronic music devices such as personal computers and electronic musical instruments),
A, B, C Target note group,
Ta, Tb, Tc Sound generation period of the target note group.

Claims (3)

Performance data acquisition means for acquiring performance data including note information;
About the acquired performance data, target setting means for setting a performance data portion to be a facial expression,
Inflection setting means for setting inflection data representing the inflection of the performance that changes with time according to the performance with respect to the acquired performance data;
Feature extraction means for extracting feature information representing features of intonation changes based on temporal changes in intonation data set in the performance data portion;
An apparatus for editing performance data, comprising: expression means for applying an expression to the performance data portion based on the extracted feature information.   The target setting means sequentially sets individual performance data portions to be subjected to facial expression based on temporal connection of note information constituting the performance data acquired by the performance data acquisition means. A performance data editing device. A performance data acquisition step for acquiring performance data including note information;
A target setting step for setting a performance data portion to be a facial expression for the acquired performance data,
An inflection setting step for setting inflection data representing the inflection of the performance that changes with time according to the performance with respect to the acquired performance data;
A feature extraction step for extracting feature information representing features of intonation changes based on temporal changes in intonation data set in the performance data portion;
A performance data editing program for causing a computer to execute a procedure comprising a facial expression step for applying a facial expression to the performance data portion based on the extracted feature information.

Images