JP2012053392A - Musical tone editing device and program - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide a musical tone editing device that can readily edit each set of pitched note sound data separated into individual tone colors and pitched notes on the basis of the original sound data.SOLUTION: Many sets of note sound data comprising waveforms in units of individual tone colors and of pitched notes are assigned to one or another of a plurality of tone color groups by selectively working on pitched note figures displayed on a screen; and, in this assignment, note sound data can be reproduced to perform the assignment while actually listening to musical tones of one individual tone color or another. By displaying on the screen only a pitched note figure associated with pitched note sound data of one tone color group, editing of only a specific set of pitched note sound data belonging to the same tone color group is made possible while selectively playing back the pertinent set of pitched note sound data.

Description

  The present invention relates to a musical sound editing apparatus and program capable of editing and reproducing original acoustic data in which a plurality of musical sounds of different timbres such as instrument sounds and voices are mixed. In particular, the present invention relates to a technique that makes it easy to edit original sound data into separated sound data units separated into individual tone colors and into note units.

  2. Description of the Related Art Musical sound editing apparatuses and programs that can edit and reproduce, for example, audio data (acoustic data) in which a musical sound waveform itself is recorded by recording or the like are known. For example, the technology described in Non-Patent Document 1 shown below is an example of a device related to such an apparatus. Non-Patent Document 1 shown below includes an original pitch consisting of a single continuous waveform in which a plurality of musical tones of different timbres such as instrument sounds and human voices generated at an arbitrary pitch (referred to as a note) and playback timing are mixed. A sound source separation technique for separating acoustic data into the different individual timbres and in units of notes is disclosed. In addition, the individual sound data (referred to as note sound data) separated by different timbres and in units of notes are displayed in a predetermined display mode (for example, a note graphic described later) on a predetermined editing screen such as a piano roll. The user can easily edit the original sound data in units of note sound data by appropriately operating the note graphic corresponding to each note sound data displayed on the editing screen. A technique related to so-called GUI (Graphical User Interface) is also disclosed.

  Furthermore, Patent Document 1 shown below discloses a technique for separating an acoustic signal for each instrument sound from an acoustic signal (corresponding to the original acoustic data) composed of a plurality of instrument sounds played simultaneously.

T. Virtanen, “Sound source separation in monaural music signals”, Ph. D. dissertation, Tampere University of Technology, 2006, Internet <http://www.cs.tut.fi/sgn/arg/music/tuomasv/virtanen_phd .pdf>

International Patent Application Publication WO2008 / 133097

  However, in the conventional technology as described above, the original sound data is separated into individual timbres such as instrument sounds and voices and in units of notes, but these are separated into different timbres and in units of notes. It has been difficult to play or edit note sound data individually or in combination with a plurality of timbres. That is, the technique described in Non-Patent Document 1 is only to separate the original acoustic data for different instrument sounds (tone colors) and in units of notes, and the technique described in Patent Document 1 is the original technique. Since acoustic data is automatically classified by instrument sound, but not all can be accurately classified, according to these conventional techniques, the user listens to the note acoustic data one by one. Since the instrument sounds (tones) cannot be identified and classified into instrument sound units, only the note sound data of one or more specific instrument sounds is selectively reproduced or edited. There was an inconvenience that it was not easy. Specifically, as a method of reproducing only the note sound data of a specific instrument sound, all the note sound data of other instrument sounds may be deleted, but this is troublesome and very troublesome.

  The present invention has been made in view of the above points, and after editing the original acoustic data in which a plurality of musical tones of different timbres such as instrument sounds and voices are mixed, separated into individual timbres and in units of notes. An object of the present invention is to provide a musical sound editing apparatus and program which can be easily performed in units of acoustic data.

  The musical sound editing apparatus according to the present invention is separated according to the analysis of original sound data composed of one continuous waveform in which a plurality of different musical sounds of different timbres are mixed. Storage means for storing each of a plurality of note sound data composed of waveforms in association with at least note specifying information and reproduction information, and a plurality of note graphics associated with each of the plurality of note sound data, Display means for displaying a screen arranged for each pitch based on the note specifying information and the reproduction information and in the order of reproduction, and corresponding to the selected note graphic according to the selection of any note graphic displayed on the screen. Single note playback means for independently generating musical tones consisting only of individual timbres by playing back only the note sound data that is present, The note sound data associated with the selected note graphic is assigned to one of a plurality of timbre groups, a group selection means for selecting one or more of the plurality of timbre groups, and the selected Reproducing means for generating musical sounds in which only timbres belonging to the selected timbre group are mixed by reproducing only the note sound data allocated to each of the one or more timbre groups in the reproduction order based on the reproduction information. .

  As a preferred embodiment of the present invention, it further comprises editing means for editing corresponding note sound data and the note specifying information and reproduction information in response to a user operation for each note graphic displayed on the screen, Only note graphics associated with the note sound data allocated to each of the selected one or more timbre groups are displayed separately on the screen, and only specific note sound data belonging to the same timbre group is extracted. The feature is that it can be edited.

  According to the present invention, a large number of note sound data composed of waveforms of individual timbres and in units of notes can be assigned to any one of a plurality of timbre groups by selecting and operating the note graphic displayed on the screen. In that case, since only the note sound data associated with the selection of the note figure is played back independently, the user actually listens to the musical tone consisting only of each tone and confirms the tone itself It is possible to sort while. In addition, after the distribution, only the note graphic associated with the note sound data distributed to each of the one or more timbre groups can be displayed separately on the screen. By editing the corresponding note sound data and the note specifying information and the reproduction information in response to a user operation on the note graphic, only specific note sound data belonging to the same tone group can be extracted and edited. In this way, the user can distribute the individual note sound data separated for each tone color and in units of notes for each tone color (group), and only the note sound data distributed to each tone color (group). Since editing can be performed while selectively reproducing, the original sound data can be easily edited in units of note sound data.

  The present invention can be constructed and implemented not only as a device invention but also as a method invention. Further, the present invention can be implemented in the form of a program of a processor such as a computer or a DSP, or can be implemented in the form of a storage medium storing such a program.

  According to this invention, the user himself / herself can distribute individual note sound data separated for each tone color and in units of notes, and the user can only assign specific note sound data allocated to each tone color. Since the reproduction and editing can be performed in any combination, the user can easily edit the original sound data in units of note sound data.

1 is a block diagram of a hardware configuration showing an embodiment of the overall configuration of a musical sound editing apparatus according to the present invention. It is a conceptual diagram which shows one Example of each data structure of original sound data, note sound data, note information, and group information. It is a flowchart which shows one Example of a main process. It is a flowchart which shows one Example of a distribution process. It is a conceptual diagram which shows one Example of the acoustic data edit / reproduction screen displayed on a display device at the time of "sorting mode". It is a flowchart which shows one Example of a reproduction | regeneration & edit process. It is a conceptual diagram which shows one Example of the acoustic data edit / playback screen displayed on a display device at the time of "playback & edit mode". It is a flowchart which shows one Example of the display update process of reproduction | regeneration & edit. It is a flowchart which shows one Example of an edit process. It is a flowchart which shows one Example of a reproduction | regeneration process. It is a block diagram for demonstrating the signal processing procedure at the time of reproduction | regeneration processing.

  Embodiments of the present invention will be described below in detail with reference to the accompanying drawings.

  FIG. 1 is a hardware configuration block diagram showing an embodiment of the overall configuration of a musical sound editing apparatus according to the present invention. The tone editing apparatus shown in this embodiment is controlled by a microcomputer comprising a microprocessor unit (CPU) 1, a read only memory (ROM) 2, and a random access memory (RAM) 3. The CPU 1 controls the operation of the entire musical sound editing apparatus. A ROM 2, a RAM 3, a setting operator 4, a display 5, a digital signal processing circuit (DSP) 6, a storage device 8, and a communication interface (I / F) 9 are connected to the CPU 1 via a data and address bus 1D. It is connected.

  The ROM 2 stores various control programs executed by or referred to by the CPU 1, various data, and the like. The RAM 3 is used as a working memory for temporarily storing various data generated when the CPU 1 executes a predetermined program, or as a memory for temporarily storing a currently executing program and related data. The A predetermined address area of the RAM 3 is assigned to each function, and is used as a register, a flag, a table, a temporary memory, or the like.

  A setting operator (switch, etc.) 4 is a mode selection for setting, for example, an editing start / end instruction button for instructing editing start / end of sound data, and at least one of “sorting mode” and “playback & editing mode” to be described later Button, group tab or note graphic for tone specification of “acoustic data editing / playback screen” (see FIGS. 5 and 7 to be described later) displayed on the display 5 in accordance with the setting of any one of the modes. These are configured to include various operators for selecting and operating the etc. Of course, the setting operator 4 may include various operators such as a numeric keypad for inputting numeric data, a keyboard for inputting character data, or a mouse for operating a pointer displayed on the display unit 5 in addition to the above. Good.

  The display 5 is a display composed of, for example, a liquid crystal display panel (LCD) or a CRT, and displays various screens such as an “acoustic data editing / playback screen” (see FIGS. 5 and 7) described later. Of course, various acoustic data and various information (see FIG. 2 to be described later) stored in the ROM 2, the storage device 8, etc., or the control state of the CPU 1 are displayed. The display 5 may be a touch panel having a detection function for detecting (recognizing) a user touch operation performed on the screen.

  The digital signal processing circuit 6 is a dedicated DSP (Digital Signal Processor) that performs various signal control processes on the acoustic data. For example, in order to store the original acoustic data (analog or digital audio signal) acquired from an external acoustic device such as a microphone (not shown) connected to the input signal interface 6A or an audio signal reproduction device in the storage device 8, as appropriate. A / D conversion processing is performed, data analysis processing such as frequency analysis is performed in order to separate the original acoustic data into different timbres and in units of notes, and the sound system 7 including the amplifier and the speaker or the output signal interface 6B Output to the connected external audio equipment such as an audio recorder (not shown) the original sound data and the musical sound generated based on the separated sound data separated by different timbres and in units of notes and those data itself Playback processing or D / A conversion processing was performed in response to user instructions such as To. The sound system 7 generates a musical sound (not only musical instrument sounds but also voices and the like) generated based on the reproduction of the acoustic data output from the digital signal processing circuit 6.

  In addition to the original sound data acquired from an external sound device or the like, the storage device 8 stores various data such as note information and group information as described later, and each note sound data before and after editing (see FIG. 2), or Various control programs executed by the CPU 1 are stored. When the control program is not stored in the ROM 2 described above, the control program is stored in the storage device 8 (for example, a hard disk) and is read into the RAM 3 to store the control program in the ROM 2. It is possible to cause the CPU 1 to execute the same operation as in FIG. In this way, control programs can be easily added and upgraded. The storage device 8 is not limited to a hard disk (HD), but may be a flexible disk (FD), a compact disk (CD-ROM / CD-RAM), a magneto-optical disk (MO), or a DVD (Digital Versatile Disk). It may be a storage device using a portable storage medium in the form. Alternatively, a semiconductor memory such as a flash memory may be used.

  The communication interface (I / F) 9 is an interface for transmitting and receiving various information such as a control program and the original acoustic data as described above between the apparatus and an external device (not shown) via a network. The communication interface 9 may be, for example, a MIDI interface, a LAN, the Internet, a telephone line, or the like, and may include both wired and wireless ones. It should be noted that a file containing a large number of original acoustic data may be acquired from a portable storage medium as described above or a server device via a network. In this case, the file format may be any known format such as a WAV format which is an audio format without data compression or an MP3 format with data compression.

  The musical sound editing apparatus and program according to the present invention can be applied to any type of apparatus / equipment such as an electronic musical instrument, an automatic performance apparatus, a personal computer, a portable communication terminal such as a mobile phone, a karaoke apparatus, or a game apparatus. May be. When applied to a portable communication terminal, not only when a predetermined function is completed with only the terminal, but also a part of the function is provided on the server side, and the predetermined function is realized as a whole system composed of the terminal and the server. You may make it do.

  Next, the original sound data stored in the ROM 2 or the storage device 8, etc., note sound data obtained by separating the original sound data into different instrument sounds (tones) and in units of notes, note information corresponding to each note sound data, Group information for managing the note sound data for each different instrument sound will be described with reference to FIG.

  FIG. 2 (A) shows an example of original sound data by an envelope waveform. The original sound data shown here is a plurality of pieces generated from different sound sources at arbitrary pitches (notes) and timings. This is waveform data composed of one continuous waveform in which musical tone waveforms of musical instruments of different timbres are mixed and different or the same pitches (notes) are continuously generated for a plurality of musical instrument sounds.

  On the other hand, the original note sound data (referred to as original data) shown in FIG. 2 (B) is waveform data obtained by separating the original sound data described above into different instrument sounds and note units by analysis processing such as frequency analysis. . For example, according to the technique described in Non-Patent Document 1, the piano sound “C4” and the guitar sound “E4” are simultaneously generated in a certain time range, and the piano sound in the same time range that follows is generated. The original acoustic data in which “G4” and the guitar sound “E4” are generated simultaneously are separated into the original data of the piano sound “C4” and the original data of the guitar sound “E4” for the preceding time range, The subsequent time range is separated into the original data of the piano sound “G4” and the original data of the guitar sound “E4”.

  When the original data is edited by the user, edited note sound data (referred to as edit data) is generated separately from the original data. That is, unless the original data is edited, edit data corresponding to the original data is not generated. The editing of the original data accompanied by the generation of the editing data is an editing accompanied by a change in waveform shape such as a pitch change, a formant change or a time companding.

  As the note sound data is generated by analyzing the original sound data, note information corresponding to the note sound data is generated. Original attribute information and current attribute information are registered in the note information. The original attribute information represents the attribute of the note sound data (original data) before editing, and the current attribute information is the note sound data (edited data) after editing. Represents the attribute of. However, when the note information is generated, the contents of the attribute information are the same, and the corresponding attribute in the current attribute information according to an editing operation using an “acoustic data editing / playback screen” (see FIG. 5) described later. Information is changed as appropriate. That is, the original attribute information is not changed from when the note information is created, and only the current attribute information is appropriately changed according to the editing operation.

  The original attribute information (or current attribute information) includes basic frequency (note specific information), time start start time and time end end time (playback information), velocity, reference information to original data (or edit data), and the like. . The fundamental frequency is information indicating the pitch (note) of the original data (or edited data), and is a predetermined frequency determined for each pitch in units of semitones (for example, E4 = 330 Hz, A4 = 440 Hz, etc.) . The time start start time is the start time of each original data (or edited data) based on the start time of the original note sound data, and the time end end time is each original data based on the start time of the original note sound data ( (Or edit data) end time. The time from the time start start time to the time end end time corresponds to the relative sound length of each original data (or edit data). The reference information to the original data (or edit data) is information indicating the storage position of the corresponding original data (or edit data). For example, the original data (or edit data) such as a storage address or a data name is used. Any information may be used as long as it can identify the storage position of the stored storage device 8 and refer to or read the data.

  The group information collectively manages one or more note sound data distributed to the same instrument sound (tone group) in accordance with a user operation using an “acoustic data editing / playback screen” (see FIG. 5) described later. This information is generated in response to the generation of a new group tab other than the “ALL” tab prepared in advance in the “acoustic data editing / playback screen”. Therefore, each group information is stored corresponding to a group tab other than “ALL” displayed on the “acoustic data editing / playback screen”. This group information is, for example, a character string of a group name (for example, piano sound, guitar sound, vocal sound, etc.) that identifies the type of classified instrument sound (tone group), and the same group on the “acoustic data editing / playback screen” Group color designation information when displaying the note sound data, and reference information to the note information corresponding to the note sound data distributed as a group of the instrument sound. Note that nothing is described in the note information list of the group information immediately after generation.

  Next, “main processing” for editing the original sound data (see FIG. 2A) stored in the storage device 8 or the like into note sound data units separated into different instrument sounds and note units will be described. To do. FIG. 3 is a flowchart showing an example of “main processing”. This process is started, for example, in response to an operation of an edit start / end instruction button by the user.

  In step S1, original acoustic data designated in accordance with a user operation is read into the RAM 3 from the storage device 8 or the like. In step S2, the read original sound data is separated into different instrument sounds and note units by performing an analysis process according to the known technique described in Non-Patent Document 1, for example, and stored in the storage device 8 and separated. Note information (original attribute information and current attribute information) relating to different musical instrument sounds and note audio data in units of notes is generated and stored in the storage device 8. In step S3, switching to a corresponding process is executed in accordance with a user operation. If the user operation is a designation operation for “sorting mode” by the mode selection button, “sorting process” is executed (step S4). If the user operation is a designation operation to “playback & editing mode” by the mode selection button, “playback & editing processing” is executed (step S5). Details of each process will be described later. If the user operation is an end operation using the edit start / end instruction button, the process ends.

  The “sorting process” (see step S4 in FIG. 3) will be described with reference to FIGS. FIG. 4 is a flowchart showing an example of the “sorting process”. FIG. 5 is a conceptual diagram showing an example of an “acoustic data editing / playback screen” displayed on the display 5 in the “distribution mode”.

  Step S11 relates to all the note information stored in the storage device 8, the position and size according to the fundamental frequency, the start time, the end time, and the velocity, and the specified group if group information already exists. “Sound data editing / playback” in the initial state (before the user himself / herself assigns each note sound data to each instrument sound) in which the figure (note figure) of a predetermined display mode colored in color is arranged in the order of performance in units of notes “Screen” is displayed on the display 5. As an example, three groups of “Vocal”, “Piano”, and “Bass” have already been created in accordance with the execution of “playback & editing process” (see FIG. 6), which will be described later, and any note sound data is also created. FIG. 5A shows an “acoustic data editing / playback screen” that is not yet assigned to any of the groups.

  As shown in FIG. 5A, the “acoustic data editing / playback screen” A has notes corresponding to each piece of note information generated in accordance with separating the original acoustic data into different timbres and in units of notes. The figure C is displayed on a two-dimensional plane in which the horizontal axis is a time axis and the vertical axis is a pitch axis (frequency axis). In each note graphic C, the display position in the vertical axis direction is determined by the fundamental frequency (corresponding to a specific pitch) of the note information, while the display position in the horizontal axis direction is determined by the time start start time (corresponding to the performance timing). The graphic width in the horizontal axis direction (corresponding to the sound length) is determined by the time start start time and the time end end time, while the graphic width in the vertical axis direction (corresponding to the volume) is determined by velocity. . In a state in which no note sound data has been assigned to any of the groups, all the note graphics C are not colored in a predetermined group color.

  When three groups of “Vocal”, “Piano”, and “Bass” are newly created in response to a user operation, a corresponding group tab B is additionally displayed at the top of the screen (step S32 in FIG. 6 described later). reference). However, only by newly creating such a group, any note sound data has not yet been assigned to any of the groups, and thus no note graphic C is colored. In addition, the group can be deleted as well as newly created. In this case, the display of the corresponding group tab B (and reference information to the corresponding note information of the group information) is deleted and deleted. The note sound data distributed to the group does not belong to any group.

  Returning to the description of FIG. 4, in step S <b> 12, it is determined whether or not any of the note graphics C displayed on the “acoustic data editing / playback screen” A has been pressed. If it is determined that none of the note graphics C has been pressed (NO in step S12), the process jumps to step S15. If it is determined that any one of the note graphics C has been pressed (YES in step S12), the corresponding note sound data is searched based on the note information corresponding to the operated note graphics C and pronounced (step S13). ). That is, the user can audition the musical sound to be reproduced based on the corresponding note sound data by long-pressing the note graphic C, so that the musical sound of any musical instrument sound can be obtained before distributing each note sound data. It is possible to confirm whether or not it is the data that emits. In step S14, note information corresponding to the operated note graphic C is selected as a distribution target.

  In step S15, it is determined whether or not any of the note graphics C displayed on the “acoustic data editing / playback screen” A has been short-pressed. If it is determined that none of the note graphics C has been pressed (NO in step S15), the process jumps to step S19. If it is determined that any of the note graphics C has been pressed for a short time (YES in step S15), the notebook information corresponding to the operated note graphic C is selected as a sorting target (step S16). In step S17, it is determined whether or not a specific group tab B is selected on the “acoustic data editing / playback screen” A. If it is determined that the specific group tab B is not selected (NO in step S17), the process jumps to step S19. When it is determined that the specific group tab B is selected (YES in step S17), reference information for referring to the note information selected as the distribution target is displayed in the specific group tab B. By writing in the corresponding group information (distribution destination), the notebook sound data corresponding to the note information is distributed so as to belong to the specific group (step S18).

  A step S19 decides whether or not the selection operation of the group tab B displayed on the “acoustic data editing / playback screen” A has been performed. If it is determined that the group tab B is not selected (NO in step S19), the process jumps to step S23. If it is determined that the group tab B selection operation has been performed (YES in step S19), group information corresponding to the selected group tab B is selected as a distribution destination (step S20). In step S21, it is determined whether or not specific note information is selected as a distribution target. If it is determined that specific note information is not selected (NO in step S21), the process jumps to the process in step S23. If it is determined that the specific note information has been selected (YES in step S21), the specific note information is distributed so as to belong to the selected group information (distribution destination) (step S22).

  In step S23, it is determined whether or not a sorting mode end operation has been performed. If it is determined that the distribution mode end operation has not been performed (NO in step S23), the process returns to step S12 and the above processes are repeatedly executed. If it is determined that the distribution mode end operation has been performed (YES in step S23), the process ends.

  As described above, in the distribution mode, all of the note graphic C corresponding to each of the note acoustic data (note information) can be displayed on the “acoustic data editing / playback screen” A, and the user can display them. Each note sound data can be distributed to each group by appropriately selecting and combining the note graphic C and the group tab B other than the “ALL” tab. An example is shown in FIG. In FIG. 5B, the group tab “Piano” is clicked, and the group “Piano” is selected as the distribution destination. If any of the note graphics (here, C ′) is clicked with a short press while the distribution group is selected, the note graphic C ′ is selected, and the note acoustic data corresponding to the note graphic C ′ ( Note information) is distributed to the selected distribution group “Piano”. While a single group is selected as a distribution destination, a plurality of note graphic data corresponding to them can be distributed to the same group by short-pressing and clicking a plurality of note figures C one after another. Note that note graphics C to which note sound data has been allocated to groups can be distinguished from other note graphics C that have not been allocated by being colored and displayed in a predetermined group color. It has become.

  On the other hand, when one of the note graphics is clicked with a long press while the distribution group is selected, the note graphic C is selected again, and the note sound data corresponding to the selected note graphic C is reproduced. Is done. In this case, only the selection and reproduction are performed, and the distribution of the notebook sound data is not performed. In this way, by sequentially clicking on the note graphic C with different lengths, it is possible to proceed with the distribution of each note sound data to a group while listening to musical sounds in units of note sound data. Yes.

  Note that once the note sound data is assigned to a group of note graphics C, clicking on a different group tab B while the note graphic C is selected allows the note sound data corresponding to the note graphic C to be selected. The distribution destination can be changed. In this case, it goes without saying that the reference information is deleted from the note information in the group information before the distribution destination is changed and the reference information is added to the note information in the group information after the change.

  Next, the “playback & editing process” (see step S5 in FIG. 3) will be described with reference to FIG. FIG. 6 is a flowchart showing an example of the “playback & editing process”. FIG. 7 is a conceptual diagram showing an example of an “acoustic data editing / playback screen” displayed on the display 5 in the “playback & editing mode”.

  A step S31 changes the selection of the group in accordance with the operation of the group tab B by the user, and updates the display of the “acoustic data editing / playback screen”. As a result, only the note graphic C corresponding to the note acoustic data distributed to the selected group is displayed on the “acoustic data editing / playback screen” (see FIG. 7B). In step S32, a new group is created or deleted, the group name or group color is changed in accordance with the user operation, and the display of the “acoustic data editing / playback screen” is updated (see FIG. 8). In step S33, an editing process is executed in accordance with the user operation (see FIG. 9), and the display of the “acoustic data editing / playback screen” is updated in accordance with the execution of the process (see FIG. 8). In step S34, another task of the reproduction process is controlled according to the user operation (see FIG. 10). In step S35, it is determined whether or not a reproduction & editing mode end operation has been performed. If it is determined that the playback & editing mode end operation has not been performed (NO in step S35), the process returns to step S31 and the above processes are repeatedly executed. If it is determined that the playback & editing mode end operation has been performed (YES in step S35), the processing ends.

  In the “acoustic data editing / playback screen” A shown in FIG. 7A, each of a plurality of note acoustic data separated by different timbres and in units of notes is “Vocal”, “Piano”, “Bass”. This is a display example when the “ALL” tab is selected in the state of being distributed to one of the two groups. When FIG. 7A is compared with FIG. 5A, in addition to the difference that each note graphic C is colored in the group color of the distribution destination, a reproduction position instruction graphic D indicating the reproduction position is displayed. Is different. For example, the reproduction position instruction graphic D moves from the left to the right of the drawing in accordance with the progress of the reproduction, thereby clearly indicating the note graphic C corresponding to the note sound data being reproduced to the user. If playback is performed with the “ALL” tab as shown in FIG. 7A selected, a musical tone in which all instrument sounds (tones) included in the original acoustic data are mixed is obtained. It will be pronounced.

  On the other hand, an “acoustic data editing / playback screen” A shown in FIG. 7B shows a display example when a specific group “Piano” is selected by clicking the group tab “Piano”. . In this case, only the note graphic C corresponding to the note acoustic data distributed to the “Piano” group is displayed on the “acoustic data editing / playback screen” A. When playback is performed in this state, each note sound data corresponding to the currently displayed note graphic C (five in the figure) is played back, and for example, only musical sounds of the same tone such as “piano tone” are played. It will be pronounced.

  In addition, regarding group tab selection other than the “ALL” tab, a plurality of group tabs B may be selected at the same time, and in that case, the group tabs are distributed to one of the groups corresponding to the selected group tabs B. All the note graphics C corresponding to the note sound data are displayed on the same screen. When playback is performed in this state, each piece of note sound data corresponding to the note graphic C being displayed is played back, and a musical tone in which the tone colors of a plurality of selected groups are mixed is generated.

  When a tab other than the “ALL” tab is selected, the note graphic C corresponding to the note sound data allocated to the unselected group may not be displayed at all, or the selected group may be displayed. May be displayed in a display mode different from the note graphic C corresponding to the note sound data distributed to any of the above (for example, as thin as shown in FIG. 7B).

  Next, “reproduction & editing display update processing” (steps S31 and S32 in FIG. 6) will be described. FIG. 8 is a flowchart showing an example of “reproduction & editing display update processing”. As described above, the display is updated after changing the group selection in step S31. In step S32, the display is updated after an editing operation for the group. Here, only the display update performed in the same manner in each process of step S31 and step S32 will be described in detail.

  Step S41 specifies the group information memorize | stored in the memory | storage device 8 as a process target in order. In step S42, it is determined whether or not a group tab corresponding to the specified group information displayed on the “acoustic data editing / playback screen” A is selected. If it is determined that the group tab corresponding to the group information is not selected (NO in step S42), the process jumps to step S44. If it is determined that the group tab corresponding to the group information is selected (YES in step S42), the basic frequency, start time, end time, and velocity of each note information based on the reference information in the note information list are determined. The note graphic C is displayed in the position and size and in the specified group color (step S43). A step S44 decides whether or not all groups have been processed. If it is determined that not all groups have been processed (NO in step S44), the process returns to step S41 and the above processes are repeated. If it is determined that all groups have been processed (YES in step S44), the process ends.

  If it is determined that the group tab corresponding to the group information is not selected (NO in step S42), the basic frequency, start time, end time, and velocity of each note information based on the reference information in the note information list are set. The figure may be displayed in a display mode (for example, as shown in FIG. 7B) that is different from the figure displayed in the process of step S43 in the position and size according to the specified group color. Good.

  Next, the “editing process” (step S33 in FIG. 6) will be described. FIG. 9 is a flowchart showing an example of the “editing process”.

  In step S51, it is determined whether or not there is an active note graphic C at the point position on the "acoustic data editing / playback screen" A. If it is determined that there is no active note graphic C at the point position (NO in step S51), the process is terminated. The active note graphic C is one in which note sound data is distributed to each group of the selected group tab B. For example, the note graphic C clearly displayed as shown in FIG. Say that. On the other hand, the note graphic C in which the note sound data is distributed to each group of the unselected group tab B is thinly displayed as shown in FIG. 7B, for example, and such inactive note graphic C is displayed. No processing is performed even if the display position is pointed to.

  If it is determined that there is an active note graphic C at the point position (YES in step S51), the note information is changed in response to the user operating the note graphic C on the "acoustic data editing / playback screen" A. Editing (specifically, current attribute information) is performed, and the display of the “sound data editing / playback screen” A is updated in accordance with the user operation (step S52). At this time, note sound data (edit data) is generated as necessary.

  An example of the note information editing operation will be described below. On the “acoustic data editing / playback screen” A shown in FIG. 7, for example, if the notebook figure C is dragged and its display position is moved in the horizontal axis direction, the time start start time and time will be increased according to the operation amount. End end time can be edited. For example, if the note graphic C is dragged and its display position is moved in the vertical axis direction, the fundamental frequency can be edited. During the operation, the edit data (or original data) is loop-played and the real-time pitch shift process is simply performed according to the amount of operation, so the user can edit while actually listening to the musical sound. Can do. When the operation is completed, new editing data is generated and stored by subjecting the editing data (or original data) to high quality non-real time pitch shift processing.

  For example, if the display width of the note graphic C is increased in the vertical axis direction, the velocity (that is, the volume) can be edited. Even during the operation, the playback volume is changed in accordance with the operation amount while looping playback of the edit data (or original data), so that the user can edit while actually listening to the musical sound. When the operation is completed, new edit data is generated and stored by changing the volume level of the edit data (or original data). For example, if the display width of the notebook graphic C is expanded in the horizontal axis direction, either the time start start time or the time end end time can be edited independently. During the operation, the edit data (or original data) is loop-played and the real-time time stretch process is simply performed according to the amount of operation, so the user can edit while actually listening to the musical sound. Can do. When the operation is completed, new edit data is generated and stored by subjecting the edit data (or original data) to high-quality time stretch processing.

  Although not shown here, it is possible to edit the note information and generate (or edit) the note information by displaying a submenu and performing other than the above, such as formant change and EQ processing. It may be.

  Next, the “reproduction process” (step S34 in FIG. 6) will be described with reference to FIGS. FIG. 10 is a flowchart illustrating an example of “reproduction processing”. FIG. 11 is a block diagram for explaining a signal processing procedure during the reproduction process.

  Step S61 performs initial setting. Initial settings include a playback position reset and a timer setting. A step S62 decides whether or not the selected group tab B is an “ALL” tab. When it is determined that the selected group tab B is the “ALL” tab (YES in step S62), the original sound data is reproduced (step S63). In step S64, for note information whose original attribute information and current attribute information are not identical (that is, edited note information), note sound data (original data) whose playback position matches the time start start time of the original attribute information. ) Is started (step S64). The reproduction at this time is added to the original sound data in reverse phase, thereby canceling out the original component of the corresponding part in the original sound data.

  In step S65, for the note information in which the contents of the original attribute information and the current attribute information are not the same, the reproduction of the note sound data (original data) whose reproduction position matches the time end end time of the original attribute information is terminated. In step S66, for note information whose contents of the original attribute information and the current attribute information are not the same, playback of the note sound data (edit data) whose playback position matches the time start start time of the current attribute information is started. In step S67, for the note information whose original attribute information and current attribute information are not identical, the reproduction of the note sound data (edit data) whose reproduction position matches the time end end time of the current attribute information is terminated.

  FIG. 11A shows a signal processing procedure during reproduction when the “ALL” tab is selected (steps S63 to S67 above). However, for the sake of easy understanding, note sound data 2 (note 2) is not edited and the original attribute information of the corresponding note information is the same as the current attribute information, while note sound data It is assumed that 1 (note 1) and note sound data N (note N) have been edited and the contents of the original attribute information and the current attribute information of the corresponding note information are different.

  The original acoustic data is read from the storage device 8 by the original acoustic data reading unit M and reproduced. Each piece of note sound data is read from the storage device 8 and reproduced by the reproduction processing units N1 to NN in units of note sound data that can be operated in parallel when necessary. However, the original data of the note information such as Note 2 and the content of the current attribute information are not reproduced by the reproduction processing units N1 to NN in units of note sound data. This is because the component of the note sound data (original data) that has not been edited is included in the original sound data and can be sufficiently reproduced simply by reproducing the original sound data.

  On the other hand, when the original attribute information of the note information such as note 1 or note N and the content of the current attribute information are different, reproduction is performed by the reproduction processing units N1 to NN in units of note acoustic data. Of course, for note information whose contents of the original attribute information and the current attribute information are different, the corresponding note sound data components are included in the original sound data. However, it is necessary to reflect the edited note sound data (edit data). Therefore, by superimposing the output of the original data reproduced by the original data reading unit O on the output of the reproduced original audio data in the reverse phase by the adding unit K1, the corresponding component included in the original acoustic data is obtained. Data editing is performed by superimposing the output of the edited data reproduced by the edited data reading processing unit H on the output of the original acoustic data after canceling the corresponding component, and then superimposing the output in the normal phase by the adding unit K2. The musical sound which consists of all the instrument sounds including the made instrument sound is output.

  As described above, even if the contents of the original attribute information and the current attribute information of the note information are different, the edited data may not be processed. In such a case, the edited data read processing unit H also reproduces the original data in the same way as the original data read processing unit O, and outputs the reproduced original data after the corresponding component cancellation. May be superimposed in the positive phase by the adder K2 (in short, the canceled component is restored).

  Returning to the description of FIG. 10, when it is determined that the selected group tab is not the “ALL” tab (NO in step S62), the original acoustic data is not reproduced (step S68). In step S69, the reproduction of the note sound data (edit data) whose reproduction position matches the time start start time of the current attribute information is started. In step S70, the reproduction of the note sound data (edit data) whose reproduction position matches the time end end time of the current attribute information is terminated.

  FIG. 11B shows a signal processing procedure during reproduction when a specific group tab other than the “ALL” tab is selected (steps S68 and S69 above). However, for ease of understanding, note 1 and note 2 are included in the tab-selected (active) group, and note N is included in the non-tab-selected (inactive) group. It shall be.

  When a specific group tab is selected, the original acoustic data reading unit M does not reproduce the original acoustic data. In that case, the output of the edit data reproduced by the edit data read processing unit H is added by the adding unit K2 only for each note included in the active group such as the note 1 and the note 2. On the other hand, for each note included in an inactive group such as note N, the output of the edited data reproduced by the edited data read processing unit H is not added by the adding unit K2. Regardless of whether each of the notes 1 to N is included in the active group, the output of the original data reproduced by the original data read processing unit H is added in both the adding unit K1 and the adding unit K2. There is nothing.

  Returning to the description of FIG. 10, in step S71, the reproduction position is updated in accordance with the timer control. A step S72 updates the display of the “acoustic data editing / playback screen” A according to the updated playback position. This updating of the display includes not only updating the position of the reproduction position instruction graphic D in accordance with the progress of reproduction but also updating the note graphic C. A step S73 decides whether or not all the note sound data has been processed or whether or not a reproduction end operation has been performed. When it is determined that all the note sound data has not been processed or the reproduction end operation has not been performed (NO in step S73), the process returns to the process of step S62 and the above processes are repeated. If it is determined that all the note sound data has been processed or a reproduction end operation has been performed (YES in step S73), the process ends.

  As described above, in the musical sound editing apparatus according to the present invention, a user selects a plurality of note sound data composed of waveforms for each tone color and for each note by selecting a note graphic displayed on the screen. Can be assigned to one of the tone groups. Also, at that time, only the note sound data associated with the selection of the note graphic is reproduced alone, so that the user actually listens to the musical tone consisting only of the individual timbres, and the Sorting can be performed while checking the tone. After such distribution, only the note graphics associated with the note sound data distributed to each of the one or more timbre groups are displayed separately on the screen, and each of the display on the screen is displayed. By editing the corresponding note sound data and the note specifying information and the reproduction information in response to a user operation on the note graphic, only specific note sound data belonging to the same tone group can be extracted and edited. In this way, the user can distribute the individual note sound data separated for each tone color and in units of notes for each tone color (group), and only the note sound data distributed to each tone color (group). Since editing can be performed while selectively reproducing, the original sound data can be easily edited in units of note sound data.

  As mentioned above, although an example of embodiment was demonstrated based on drawing, this invention is not limited to this, It cannot be overemphasized that various embodiment is possible. For example, in the above-described embodiment, the generated note sound data is displayed on the “acoustic data editing / playback screen” and the user appropriately classifies it. According to this technique, it is possible to automatically sort each instrument sound roughly roughly in advance, and then further classify according to the user operation. In order to do this, the automatic distribution process may be executed between step S2 and step S3 in the “main process” shown in FIG. At that time, group information corresponding to each instrument sound (group) distributed according to the automatic distribution process is automatically generated, and “acoustic data editing / recording” is performed based on the generated group information. Needless to say, display of the group tab of the “playback screen”, display of the note graphic corresponding to the note sound data belonging to each group, and the like are performed.

DESCRIPTION OF SYMBOLS 1 ... CPU, 2 ... ROM, 3 ... RAM, 4 ... Setting operation element, 5 ... Display, 6 ... Digital signal processing circuit (DSP), 6A ... Input signal interface, 6B ... Output signal interface, 7 ... Sound system, DESCRIPTION OF SYMBOLS 8 ... Memory | storage device, 9 ... Communication interface, 1D ... Data and address bus, A ... Sound data edit / playback screen, B ... Group tab, C ... Notebook figure, D ... Play position indication figure, H ... Edit data read-out processing part , M ... original sound data read processing unit, N1 to NN ... note sound data unit reproduction processing unit, O ... original data read processing unit, K1 (K2) ... addition unit

Claims (3)

A large number of note sound data consisting of waveforms for each tone and for each note, which are separated in accordance with the analysis of the original sound data consisting of one continuous waveform in which a plurality of different tone sounds are mixed. Storage means for storing each in association with at least note identification information and reproduction information;
A display means for displaying a screen in which a plurality of note graphics associated with each of the plurality of note sound data are arranged for each pitch and in reproduction order based on the associated note specifying information and reproduction information;
By playing back only the note sound data associated with the selected note graphic in response to the selection of any note graphic displayed on the screen, a musical tone consisting only of individual tones is recorded. A single sound reproduction means that is generated independently for each unit;
Distribution means for distributing the note sound data associated with the selected note graphic to any one of a plurality of timbre groups;
Group selection means for selecting one or more of the plurality of tone groups;
Reproduction that generates a musical tone in which only the timbres belonging to the selected timbre group are mixed by reproducing only the note sound data distributed to each of the selected timbre groups in the reproduction order based on the reproduction information. And a music editing apparatus. Further comprising editing means for editing corresponding note sound data and the note specifying information and reproduction information in accordance with a user operation for each note graphic displayed on the screen,
Only note graphics associated with the note sound data allocated to each of the selected one or more timbre groups are displayed separately on the screen, and only specific note sound data belonging to the same timbre group is extracted. The musical sound editing apparatus according to claim 1, wherein the musical sound editing apparatus is configured to be edited. On the computer,
A large number of note sound data consisting of waveforms for each tone and for each note, which are separated in accordance with the analysis of the original sound data consisting of one continuous waveform in which a plurality of different tone sounds are mixed. A procedure for storing each in a predetermined storage means in association with at least note specifying information and reproduction information;
A procedure for displaying on a predetermined display means a screen in which a plurality of note graphics associated with each of the plurality of note sound data is arranged for each pitch and in reproduction order based on the associated note specifying information and reproduction information;
By playing back only the note sound data associated with the selected note graphic in response to the selection of any note graphic displayed on the screen, a musical tone consisting only of individual tones is recorded. Procedures that occur independently in units,
A procedure for assigning the note sound data associated with the selected note graphic to one of a plurality of tone groups;
Selecting one or more of the plurality of tone groups;
A procedure for generating a musical tone in which only the timbres belonging to the selected timbre group are mixed by reproducing only the note sound data distributed to each of the selected timbre groups in the order of reproduction based on the reproduction information. A program that executes

Images