JP2008225200A - Music editing device and program - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide a music editing device by which a user can freely edit a variety of music pieces. <P>SOLUTION: A sequence data creation section 130 creates a sequence data for indicating a piece data which is reproduced as musical sound in each of a plurality of time slots into which a reproduction time period of specified time length is divided, on the basis of on an indicated position by a pointing device 4a, and writes them in a sequence data storage area 203. In that case, on the basis of a first coordinate value of the indicated position by the pointing device, the time slot in which the musical sound is reproduced is determined, and on the basis of a second coordinate value of the same position, the piece data to be reproduced as the music sound in the same time slot is selected from the plurality of piece data in a piece data storage area 201. <P>COPYRIGHT: (C)2008,JPO&INPIT

Description

  The present invention relates to a song editing apparatus and program having a song editing function and a playback function.

Currently, with the spread of so-called DTM (Desk Top Music), various music production application programs called loop sequencers are provided. This loop sequencer is a program that handles music data called loop data. Here, the loop data is audio data of a phrase cut out from a song such as one measure of the intro part of the song and four measures of drum solo. The loop sequencer has a function of editing new song data in which various loop data are mapped on the time axis in accordance with a user instruction given via a GUI (Graphical User Interface). For example, there are Non-Patent Documents 1 and 2 as documents relating to this type of loop sequencer.
JP 2006-20784 A Tomoki Otsubo, “Enjoy a new musical life with“ ACID ”” [online], November 7, 2006, Mainichi Communications, [Search February 20, 2007], Internet <URL: http: // journal.mycom.co.jp/ad/2006/hookup/acid/index2.html> Ken Fujimoto, “Basic Knowledge of Series DTM 5” What is a Loop Sequencer! ? ”, [Online], November 9, 2001, All About, Inc., [Search February 20, 2007], Internet <URL: http://allabout.co.jp/entertainment/dtm/closeup /CU20011109/index3.htm> “Tenorion”, [online], Yamaha Corporation, [Search February 20, 2007], Internet <URL: http://www.yamaha.co.jp/design/tenori-on/>

  By the way, the loop sequencer described above can combine music data parts and edit music in units of loop data such as phrases, but lacks considerations regarding operability when specifying a combination of parts. For this reason, it has been unsatisfactory for users who want to edit various songs freely.

  The present invention has been made in view of the circumstances described above, and is excellent in operability when editing music by combining various pieces, and allows a user to freely edit various music. An object is to provide an editing apparatus and a song editing program.

The present invention accepts an operation for indicating a position in a two-dimensional coordinate system including a display unit and a first coordinate axis and a second coordinate axis, and a first component that is a component of the indicated position in the first coordinate axis direction. A pointing device that generates a coordinate value and a second coordinate value that is a component in the second coordinate axis direction, a segment data storage unit that stores a plurality of segment data each representing an audio waveform, and an operation of the pointing device Is a means for generating sequence data indicating segment data to be played back as a musical sound in each of a plurality of time slots obtained by dividing a playback period of a certain length of time based on the position indicated by Based on the first coordinate value of the determined position, a time slot for playing a musical sound is determined, and based on the second coordinate value of the same position. Sequence data generating means for selecting, from the plurality of segment data stored in the segment data storage means, the sequence data generated by the sequence data generating means. Sequence data storage means for storing data, and a two-dimensional map indicating the piece data to be reproduced as a musical sound among the plurality of piece data stored in the piece data storage means in each time slot of the reproduction period. In accordance with the sequence data display means to be displayed on the display unit in accordance with the data, and in accordance with the sequence data stored in the sequence data storage means, the segment data to be reproduced as a musical tone in each time slot is sequentially read out from the segment data storage means. Playback that plays a piece of data as a musical sound Providing a program that causes a song editing apparatus and a computer, characterized by comprising a stage as the song editing apparatus.
According to this invention, the user can select the segment data to be reproduced in each time slot by operating the pointing device and create desired sequence data. Therefore, various songs can be freely edited by a simple operation.

Embodiments of the present invention will be described below with reference to the drawings.
FIG. 1 is a block diagram showing the configuration of a music editing apparatus according to an embodiment of the present invention. This music editing apparatus is obtained by installing a two-dimensional graphical music sequencer as an embodiment of a music editing program according to the present invention on a computer such as a personal computer.

  In FIG. 1, a CPU 1 is a control center that controls each part of the music editing apparatus. The ROM 2 is a read-only memory that stores a control program for controlling basic operations of the music editing device, such as a loader. The display unit 3 is a device for displaying an operation state of the device, input data, a message for an operator, and the like, and is configured by, for example, a liquid crystal display panel and a drive circuit thereof.

  The operation unit 4 is a means for receiving commands and various types of information from the user, and includes various types of operators. In a preferred embodiment, the operation unit 4 includes a keyboard and a pointing device such as a mouse. In another preferred embodiment, the operation unit 4 includes an input device used as a pointing device for a performance device called Tenorion (registered trademark) proposed by the applicants in addition to a mouse. FIG. 2 is a plan view showing a schematic configuration of the input device. As shown in FIG. 2, the input device includes a switch matrix 40 in which tact switches 41 are arranged in a 16 × 16 matrix (see, for example, Non-Patent Document 3 and Patent Document 1).

  In the present embodiment, a pointing device such as a mouse or a switch matrix 40 accepts an operation for designating a position in a two-dimensional coordinate system including a first coordinate axis and a second coordinate axis, and the first coordinate axis direction of the designated position The first coordinate value that is a component of the second coordinate value and the second coordinate value that is a component in the second coordinate axis direction are generated. The first and second coordinate values generated by this pointing device are captured by the CPU 1.

  The interface group 5 includes a network interface for performing data communication with other devices via a network, a driver for transmitting / receiving data to / from an external storage medium such as a magnetic disk or a CD-ROM, and the like. It is comprised by.

  The HDD (hard disk device) 6 is a non-volatile storage device for storing information such as various programs and databases. The RAM 7 is a volatile memory used as a work area by the CPU 1. The CPU 1 loads a program in the HDD 6 into the RAM 7 and executes it in accordance with a command given via the operation unit 4.

  The sound system 8 is means for outputting the music edited by the music editing apparatus as sound, a D / A converter for converting a digital audio signal which is sample data of the sound into an analog audio signal, and the analog audio signal. And a speaker that outputs an output signal of the amplifier as sound.

  Information stored in the HDD 6 includes a two-dimensional graphical music sequencer 61 that is a song editing program and a song database 62 that is a collection of song data. In a preferred embodiment, the two-dimensional graphical music sequencer 61 is downloaded from a site in the Internet, for example, through an appropriate one in the interface group 5 and installed in the HDD 6. In another aspect, the two-dimensional graphical music sequencer 61 is traded in a state stored in a computer-readable storage medium such as a CD-ROM or MD. In this aspect, the two-dimensional graphical music sequencer 61 is read from the storage medium via an appropriate one in the interface group 5 and installed in the HDD 6. Each piece of music data in the music database 62 may be time series sample data obtained by sampling and digitizing an audio waveform of a music performance sound, or may be compression-coded data of this time series sample data. .

  FIG. 3 is a block diagram showing the configuration of the two-dimensional graphical music sequencer 61 in this embodiment. In FIG. 3, boxes surrounded by double lines indicate various programs constituting the two-dimensional graphical music sequencer 61. A box surrounded by a solid line (single line) indicates an area in the RAM 7 that stores various data. A box surrounded by a broken line indicates hardware resources provided in the music editing apparatus according to the present embodiment.

  As shown in FIG. 3, the two-dimensional graphical music sequencer 61 includes an editing object cutout unit 110, an analysis unit 120, a sequence data generation unit 130, and a sequence data display unit 140, each of which is a program that realizes a predetermined function. And a reproduction unit 150 and a synthesis unit 160. The sequence data generation unit 130 includes a first segment data selection unit 131 that operates in the first mode, a feature amount curve generation unit 132 that operates in the second mode, a feature amount curve display unit 133, and a second A segment data selection unit 134. The first and second modes will be described later. The feature of the present embodiment is the contents of processing executed by the CPU 1 in accordance with these program groups. Hereinafter, the operation of this embodiment will be described focusing on the processing contents of each program.

  When the user instructs execution of the two-dimensional graphical music sequencer 61 by operating the operation unit 4, the CPU 1 transfers the two-dimensional graphical music sequencer 61 from the HDD 6 to the program execution area of the RAM 7 and executes the two-dimensional graphical music sequencer 61. .

  In the process of executing the two-dimensional graphical music sequencer 61, when the user specifies the song data to be edited by operating the operation unit 4 by the user, the editing target cutout unit 110 shown in FIG. Is stored in the work area in the RAM 7. The editing target cutout unit 110 performs a process of allowing the user to specify a portion to be edited among the music data in the work area.

  There may be various modes of this processing, but the following can be considered as an example. First, the editing target cutout unit 110 performs a known beat detection process on the music data in the work area, and divides the music data into segment data in units of beats. Next, each pitch is obtained for each piece data. Then, the editing target cutout unit 110 displays a GUI including a time-series graph image indicating the pitch of each piece data in the progression order of the song on the display unit 3, and edits which part of the song by a pointing device such as a mouse. Let the user specify whether to target.

  In a preferred mode, in order to make it easier for the user to grasp the contents of each part of the song when the edit target part is designated, the edit target cutout unit 110 converts each piece of data in the work area in the order of progress of the song. Sequentially sent to the sound system 8 to emit as a musical tone, and the portion corresponding to the segment data being emitted in the time series graph of the pitch is lit brightly.

  In the present embodiment, segment data for up to 16 beats can be designated as an editing target. The edit target cutout unit 110 stores the edit target segment data string cut out from the song data in accordance with the user's specification in the segment data storage area 201 in the RAM 7.

  When the segment data string to be edited is stored in the segment data storage area 201 by the edit target segmentation unit 110, the analysis unit 120 analyzes each segment data to be edited, and for each segment data, Various feature quantities such as Spectral Centroid, which expresses the pitch of the sound, Loudness, which expresses the sense of volume, Brightness, which expresses the audible brightness of the sound, and Noisiness, which expresses the gritty feel of the sound, are determined and associated with each piece of data. And stored in the feature amount storage area 202 in the RAM 7.

  When the feature amount of each piece of element data to be edited is stored in the feature amount storage area 202, the sequence data generation unit 130 enters an execution state. The sequence data generation unit 130 generates sequence data based on the position indicated by the operation of the pointing device 4 a of the operation unit 4 and stores it in the sequence data storage area 203 in the RAM 7. This sequence data is data indicating segment data to be reproduced as a musical sound in each of a plurality of time slots obtained by dividing a certain length of reproduction period. In the initial state, the sequence data has contents indicating that no musical sound is reproduced in each time slot. Instead of doing this, the contents of the sequence data in the initial state are reproduced by playing the kth segment data as musical sounds in the kth time slot, that is, all of the sequence data stored in the segment data storage area 201 is reproduced. The content may indicate that the segment data is reproduced as a musical sound in the original order.

  In this embodiment, the sequence data generation unit 130 determines a time slot for playing a musical sound based on the first coordinate value at the position instructed by the operation of the pointing device 4a when generating the sequence data. Based on the second coordinate value of the position, segment data to be reproduced as a musical tone in the same time slot is selected from a plurality of segment data stored in the segment data storage area 201.

  In addition, the sequence data generation unit 130 divides the playback time for N beats unless otherwise specified by the user, for example, when segment data for N beats is stored in the segment data storage area 201. Sequence data indicating segment data to be reproduced as a musical sound in each of the N time slots is generated in accordance with the operation of the pointing device 4a. In this case, if there is a special designation from the user, the sequence data generating unit 130, as a musical tone, in each of N ′ time slots obtained by dividing the playback time for N ′ (≠ N) beats according to the designation. Sequence data indicating segment data to be reproduced is generated in accordance with the operation of the pointing device 4a.

  The operation mode of the sequence data generation unit 130 includes a first mode and a second mode. The user designates by operating the operation unit 4 whether the sequence data generation unit 130 is operated in the first mode or the second mode.

  In the first mode, which segment data among the segment data in the segment data storage area 201 is to be reproduced by the operation of the pointing device 4a (more specifically, by the second coordinate value). Is a mode in which is directly determined. The first segment data selection unit 131 in the sequence data generation unit 130 causes the CPU 1 to execute the process in the first mode.

  On the other hand, in the second mode, by operating the pointing device 4a, at least one feature amount curve indicating a change in the feature amount over time is drawn, and in each time slot based on the at least one feature amount curve. This is a mode for selecting segment data to be used for playing music. The feature amount curve generation unit 132, the feature amount curve display unit 133, and the second segment data selection unit 134 in the sequence data generation unit 130 cause the CPU 1 to execute processing in the second mode.

  Hereinafter, the operation in the first mode and various operations related thereto will be described, and finally the operation in the second mode will be described.

  FIG. 4 illustrates a display screen of the display unit 3 when the sequence data generation unit 130 is operating in the first mode. While the sequence data generation unit 130 operates in the first mode, the sequence data display unit 140 operates in parallel with the sequence data generation unit 130. The sequence data display unit 140 creates the two-dimensional map 31 illustrated in FIG. 4 and displays it on the display unit 3. This two-dimensional map 31 indicates which unit data among a plurality of unit data stored in the unit data storage area 201 is reproduced as a musical sound in each time slot of the reproduction period. The sequence data display unit 140 creates the two-dimensional map 31 based on the sequence data stored in the sequence data storage area 203. In the two-dimensional map 31 illustrated in FIG. 4, the arrangement of cells in the vertical direction (cell arrangement direction) corresponds to the arrangement of time slots, and the cells in the horizontal direction (cell arrangement direction) are displayed. The arrangement of the eyes corresponds to the arrangement of a plurality of segment data stored in the segment data storage area 201. The squares with hatched lines or mesh patterns indicate the positions of segment data to be reproduced as musical sounds among the plurality of segment data stored in the segment data storage area 201 in each time slot.

  In the first mode, the first segment data selection unit 131 in the sequence data generation unit 130 operates. The first segment data selection unit 131 is obtained from the pointing device 4a when the user uses the pointing device 4a to perform an operation of instructing an arbitrary grid on the two-dimensional map 31 illustrated in FIG. The row number i and the column number j of the square indicated by the user are obtained from the first and second coordinate values. Then, information specifying the j-th segment data stored in the segment data storage area 201 as the data corresponding to the i-th time slot in the sequence data (specifically, the rank of the segment data is determined). The indicated number j) is written in the sequence data storage area 203.

  When the user designates a desired cell with the pointing device 4a, the segment data of the rank corresponding to the column number j of the cell is reproduced as a musical sound in the time slot corresponding to the cell row number i. The instruction information to be added can be added to the sequence data in the sequence data storage area 203.

  When the sequence data in the sequence data storage area 203 includes instruction information indicating that the j-th segment data is reproduced as a musical tone in the i-th time slot, the sequence data display unit 140 displays the second data in the two-dimensional map 31. The cells in the i-th row and the j-th column are colored and displayed. The user can confirm the content of the sequence data based on the colored display pattern (in FIG. 4, a hatched or meshed grid pattern) in the two-dimensional map 31.

  In addition, when the sequence data in the sequence data storage area 203 includes instruction information indicating that the j-th segment data is reproduced as a musical tone in the i-th time slot, the user deletes the instruction information from the sequence data. You can also In this case, the user may indicate the square in the i-th row and the j-th column colored in the two-dimensional map 31 with the pointing device 4a. The first segment data selection unit 131 that has detected the pointing operation of the pointing device 4a deletes the instruction information for reproducing the j-th segment data as a musical tone in the i-th time slot from the sequence data.

  Although not shown in FIG. 4, the user designates a plurality of cells belonging to the same row in the two-dimensional map 31 with the pointing device 4 a, and sets a plurality of segment data corresponding to each of the cells to one piece. Sequence data to be reproduced in the time slot can be generated.

  As described above, in the first mode, the user operates the pointing device 4a to indicate a desired grid, thereby causing the first segment data selection unit 131 to generate sequence data having a desired content. Can be stored in the sequence data storage area 203. The pointing device used in this case may be a mouse or the above-described switch matrix 40 (see FIG. 2). When the switch matrix 40 is used, it is preferable that the row and column of the tact switch 41 on the switch matrix 40 correspond to the row and column of the two-dimensional map 31. In this case, the user can instruct the grid of the row and column simply by pressing the tact switch 41 of the desired row and column, so that the time slot and segment data can be instructed quickly. it can.

  Although not shown in the figure, the sequence data display unit 140 displays the sequence in the sequence data storage area 203 among the feature quantities of each piece data stored in the feature quantity storage area 202 when a user gives a specific instruction. The feature quantity corresponding to the segment data specified by the data is referred to, and the display mode of each segment data in the two-dimensional map 31 is controlled according to the feature quantity corresponding to the segment data. A user who desires this control designates which feature quantity is used to control the display mode of the segment data by operating the operation unit 4.

  For example, when Brightness representing the brightness of the sound is designated as the feature amount in that case, the sequence data display unit 140 displays the segment data indicating each segment data in the two-dimensional map 31. The smaller the Brightness of the cell, the bluer the color of the square indicating the segment data, and the higher the Brightness of the Segment Data, the redish the color of the square indicating the segment data. To do.

In addition, when, for example, Spectral Centroid that represents a sense of pitch is specified as a feature amount used for display mode control, the sequence data display unit 140 displays a square indicating each piece of data in the two-dimensional map 31. In this case, the square shape of the square data of the fragment data Spectral Centroid is a square and the shape of the square is Spectral
The squares that indicate low segment data for Centroid are transformed into a trapezoid whose lower base is longer than the upper base.
The squares indicating the high unit data of Centroid are deformed into a trapezoid whose upper base is longer than the lower base and displayed.

  It is also possible to reflect a plurality of feature amounts in the display mode of the segment data. For example, the display color of the squares indicating the piece data is controlled by Brightness, and the shape of the squares is controlled by Spectral Centroid.

  The user can visually confirm the feature amount of the segment data specified by the sequence data based on the display mode of the segment data in the two-dimensional map 31.

  In the present embodiment, as illustrated in FIG. 4, a LOAD key 32, a PLAY key 33, a STOP key 34, a SAVE key 35, and an EXIT key 36, which are soft keys, are displayed on the screen of the display unit 3. These are soft keys that are displayed in common in all operation modes. The user can instruct a desired soft key among these by operating the pointing device 4a and the like, and can cause the CPU 1 to execute processing associated with the soft key.

  The LOAD key 32 is a soft key for instructing the activation of the editing target cutout unit 110 described above. The PLAY key 33 is a soft key for instructing the reproduction of music according to the sequence data in the sequence data storage area 203. The STOP key 34 is a soft key for instructing to stop the reproduction of the music. The SAVE key 35 is a soft key for instructing to compose music data according to the sequence data in the sequence data storage area 203 and store it in the HDD 6. The EXIT key 36 is a soft key for instructing to end the operation of the two-dimensional graphical music sequencer 61.

  When the PLAY key 33 is instructed by the user, the playback unit 150 starts operating. The reproducing unit 150 sequentially reads out the segment data from the segment data storage area 201 according to the sequence data stored in the sequence data storage area 203, supplies the segment data to the sound system 8, and reproduces the segment data as a musical sound. For example, in the first time slot, the segment data instructed to be reproduced in the first time slot by the sequence data in the sequence data storage area 203 is read from the segment data storage area 201 and sent to the sound system 8. In the second time slot, the segment data instructed to be reproduced in the second time slot by the sequence data is read from the segment data storage area 201 and sent to the sound system 8, and so on.

  This sequence data reproduction is repeated until the STOP key 34 is designated. For example, when the sequence data includes information indicating segment data for 16 time slots (16 beats), the playback period is 16 time slots, and this playback period is repeated. That is, when the playback unit 150 sends the segment data instructed to be played back in the 16th time slot by the sequence data in a certain time slot to the sound system 8, the playback unit 150 uses the sequence data in the next time slot. The segment data instructed to be reproduced in the first time slot is sent to the sound system 8.

  While the playback unit 150 operates, the music designated by the sequence data is played from the sound system 8. Therefore, the user can confirm this music and can visually confirm whether or not the sequence data has contents corresponding to the desired music.

  Further, when sending the piece data corresponding to a certain time slot (for example, time slot i) to the sound system 8, the reproducing unit 150 sends the time slot number i to the sequence data display unit 140. As a result, the sequence data display unit 140 in the two-dimensional map 31 displayed on the display unit 3 is a grid indicating the segment data corresponding to the time slot i and the grid indicating the segment data in another time slot. Display in different display modes. For example, among the squares indicating the segment data to be reproduced indicated by the sequence data in the two-dimensional map 31, the squares indicating the segment data not currently being reproduced are displayed in green, while the segments currently being reproduced are displayed. The squares indicating the data are displayed in red, which is a different color. In FIG. 4, the squares with a mesh pattern in the two-dimensional map 31 indicate the piece data currently being reproduced. The user can visually confirm the musical sound corresponding to the segment data while visually confirming the segment data being reproduced based on the display of the two-dimensional map 31.

  In the present embodiment, the sequence data generation unit 130 continues to operate even while the playback unit 150 is in operation and the music is being played back according to the sequence data. Accordingly, it is possible for the user to replay the sequence data by operating the pointing device 4a while confirming the content of the song by reproducing the sequence data.

  When the music indicated by the sequence data has the desired contents, the user can instruct the SAVE key 35 to convert the sequence data into music data and store it in the HDD 6. More specifically, in this embodiment, when the SAVE key 35 is instructed, the composition unit 160 operates. The synthesizing unit 160 sequentially reads each piece of data instructed by the sequence data in the sequence data storage area 203 from the piece data storage area 201 in the order of reproduction of music from the one corresponding to the first time slot. Combining song data connecting pieces of data. When the music data is synthesized, the user inputs the file name of the music data, and the file name is given to the music data and stored in the HDD 6. The user can use the music data stored in the HDD 6 in this way for subsequent music composition activities and the like.

  Next, the operation in the second mode will be described. FIG. 5 illustrates a display screen of the display unit 3 when the sequence data generation unit 130 is operating in the second mode. In FIG. 5, the feature amount map 37 is displayed on the display unit 3 by the processing of the feature amount curve generation unit 132 and the feature amount curve display unit 133. A user who desires processing in the second mode designates the type of feature amount used for selecting segment data. In a preferred embodiment, the feature amount curve generation unit 132 displays a list of soft keys indicating the types of feature amounts that can be specified on the display unit 3, and instructs the user to specify a soft key corresponding to a desired feature amount. Accordingly, the user can operate the pointing device 4 a to generate a feature amount curve indicating a change with time of the specified type of feature amount, and draw the feature amount curve on the feature amount map 37. it can.

  More specifically, while the pointing device 4a is operated, the feature amount curve generation unit 132 performs the first coordinate axis and the second coordinate based on the first coordinate value and the second coordinate value obtained from the pointing device 4a. In the two-dimensional coordinate system composed of the coordinate axes of the first and second coordinate data, a first coordinate value is used as a time, and data indicating a feature amount curve having the second coordinate value as a musical feature amount is created. Write. The feature amount curve display unit 133 displays the feature amount curve on the feature amount map 37 based on the data stored in the feature amount curve storage area 204. Note that the pointing device 4a used for the drawing operation of the feature amount curve is preferably a pointing device such as a mouse that enables drawing with high resolution.

  In the present embodiment, the user repeats the designation of the type of feature amount and the drawing operation by the pointing device 4a, thereby causing the feature amount curve generation unit 132 to generate a plurality of types of feature amount curves, and the feature amount curve display unit 133. Can be displayed. In the example shown in FIG. 5, two types of feature amount curves F 1 and F 2 are displayed on the feature amount map 37. For example, below the feature amount map 37, an annotation indicating which type of feature amount the feature amount curves F1 and F2 belong to is displayed. Here, the feature amount curve F1 and the annotation are displayed in the same color, the feature amount curve F2 and the annotation are displayed in the same color, and the user is based on the display color of each feature amount curve, It is possible to determine which type of feature amount the feature amount curve belongs to.

  The second segment data selection unit 134 performs sequence data based on the storage contents of the feature amount curve storage area 204 and the feature amount storage area 202 when a sequence data generation instruction is given by the operation of the operation unit 4. Is written in the sequence data storage area 203.

  More specifically, when data indicating one type of feature amount curve is stored in the feature amount curve storage area 204, the second segment data selection unit 134 displays the feature indicated by the feature amount curve for each time slot. Find the amount. Here, each time slot is a time having a certain width. Therefore, the second segment data selection unit 134 obtains, for example, a feature amount at the center time of each time slot from the feature amount curve, and uses them as the feature amount indicated by the feature amount curve in each time slot.

Then, the second segment data selection unit 134 performs the following processing.
a1. For each piece of data stored in the piece data storage area 201, a feature quantity of the same type as the feature quantity indicated by the feature quantity curve is selected from the feature quantities of the piece data stored in the feature quantity storage area 202. select.
b1. For each time slot, the feature amount indicated by the feature amount curve in the time slot is compared with the feature amount of each piece data selected in the above a1, and the feature amount curve indicates the feature amount of each piece data feature amount. The feature quantity closest to the quantity is obtained, and the piece data having the closest feature quantity is selected from the piece data stored in the piece data storage area 201.
Then, the second segment data selection unit 134 creates sequence data specifying the segment data selected for each time slot in this way, and writes the sequence data in the sequence data storage area 203.

On the other hand, when data indicating a plurality of types of feature amount curves (for example, M types) is stored in the feature amount curve storage area 204, the second segment data selection unit 134 performs the following for each time slot. Perform the process.
a2. For each piece of piece data stored in the piece data storage area 201, M types of feature amounts indicated by M types of feature amount curves from among the feature amounts of the piece piece data stored in the feature amount storage area 202; The same type of feature quantity is selected, and an M-dimensional feature quantity vector having the selected M types of feature quantities as components is constructed.
b2. For each time slot, an M-dimensional feature quantity vector having each feature quantity indicated by the M types of feature quantity curves in that time slot as a component is constructed, and the feature quantity vector obtained from this feature quantity curve, The feature value vector of each piece of segment data is compared. The feature vector having the highest similarity to the feature vector obtained from the feature curve from the feature vectors of each piece data configured in the above a2 (specifically, in the M-dimensional vector space). A feature vector having the shortest distance from the feature vector obtained from the feature curve is selected, and the segment data having the feature vector having the highest similarity is stored in the segment data storage area 201. Select from each segment data.
Then, the second segment data selection unit 134 creates sequence data specifying the segment data selected for each time slot in this way, and writes the sequence data in the sequence data storage area 203.

  After the sequence data is written in the sequence data storage area 203 in this way, when the PLAY key 33 is instructed by the user, the display screen of the display unit 3 changes to a display screen similar to that shown in FIG. Starts operation. Then, the reproducing unit 150 reproduces the music according to the sequence data in the sequence data storage area 203. The operation in this case is the same as in the first mode described above.

  When the music to be reproduced according to the sequence data is not desired, the user can correct the data indicating the feature amount curve stored in the feature amount curve storage area 204. That is, in a state where the feature amount curve is displayed on the display unit 3 by the feature amount curve display unit 133, the user drags a point on the feature amount curve corresponding to a certain time to the right or left by operating the mouse, for example. Then, the feature amount at that time can be increased or decreased, and the increase or decrease in the feature amount can be reflected in the data indicating the feature amount curve stored in the feature amount curve storage area 204. When the user gives an instruction to generate sequence data, the second segment data selection unit 134 generates sequence data corresponding to the changed feature amount curve and writes the sequence data in the sequence data storage area 203. The user may repeat the correction of the characteristic amount curve, the generation of the sequence data, and the reproduction of the music based on the sequence data until the music to be reproduced becomes a desired one.

Further, in the present embodiment, the user can switch the operation mode from the first mode to the second mode or switch from the second mode to the first mode by operating the operation unit 4. When switching from the first mode to the second mode, the sequence data written in the sequence data storage area 203 in the first mode can be taken over as an editing target in the second mode. . On the contrary, when switching from the second mode to the first mode, the sequence data written in the sequence data storage area 203 in the second mode may be taken over as an editing target in the first mode. it can. Therefore, for example, the following work is also possible.
(I) Sequence data is created by operating the pointing device 4a in the first mode.
(Ii) Switch to the second mode, specify a desired type of feature amount, display a feature amount curve corresponding to the sequence data created in the first mode, and correct the feature amount curve. Create sequence data with the contents that reflect
(Iii) Return to the first mode again, and correct the sequence data created in (ii) above by operating the pointing device 4a.
Besides this, the sequence data can be edited in various ways.

  As described above, according to the present embodiment, the user can freely combine the segment data obtained by dividing the song data into beats on the time axis by operating the simple pointing device 4a, and add new song data. Can be generated. Therefore, it is possible to edit music data with high flexibility.

Although one embodiment of the present invention has been described above, other embodiments are possible for the present invention. For example:
(1) The two-dimensional graphical music sequencer 61 may replace part or all of the programs with electronic circuits.
(2) A three-dimensional coordinate input means or display means (input by pointing device or motion capture) may be used for inputting and displaying data such as feature amounts in the second mode.
(3) In the above embodiment, the display mode of the squares indicating each piece of data in the two-dimensional map 31 is changed according to the feature amount of the piece data. However, the pattern, saturation, hue in the display mode is changed. Is optional.
(4) When generating piece data by dividing music data into beat units, multiple beats, (1/2) beats, (1/4) beats, or the like may be used as a unit. Alternatively, an attack portion may be detected in the waveform indicated by the song data, and data indicating the waveform of each section of 0.5 seconds from each detected attack portion may be used as the segment data.

It is a block diagram which shows the structure of the music editing apparatus which is one Embodiment of this invention. It is a top view which shows the switch matrix 40 which is an example of the pointing device in the embodiment. It is a figure which shows the structure of the two-dimensional graphical music sequencer 61 in the embodiment. It is a figure which illustrates the display screen of the display part 3 in the 1st mode in the embodiment. It is a figure which illustrates the display screen of the display part 3 in the 2nd mode in the embodiment.

Explanation of symbols

1 ... CPU, 2 ... ROM, 3 ... display unit, 4 ... operation unit, 4a ... pointing device, 40 ... switch matrix, 41 ... tact switch, 5 ... interface group, 6 ... HDD , 61... 2D graphical music sequencer, 7... RAM, 110... Editing object cutout section, 120... Analysis section, 130... Sequence data generation section, 131. ... Feature amount curve generation unit, 133... Feature amount curve display unit, 134... Second segment data selection unit, 140... Sequence data display unit, 150. ... Segment data storage area, 202... Feature amount storage area, 203... Sequence data storage area, 204.

Claims (7)

A display unit;
An operation for indicating a position in a two-dimensional coordinate system composed of a first coordinate axis and a second coordinate axis is accepted, and a first coordinate value and a second coordinate axis direction that are components of the indicated position in the first coordinate axis direction A pointing device that generates a second coordinate value that is a component of
Segment data storage means for storing a plurality of segment data each representing an audio waveform;
Means for generating sequence data indicating segment data to be reproduced as a musical sound in each of a plurality of time slots obtained by dividing a reproduction period of a certain length of time based on a position indicated by an operation of the pointing device, Based on the first coordinate value at the position instructed by the operation of the device, a time slot for reproducing the musical sound is determined, and based on the second coordinate value at the same position, the musical sound is reproduced as the musical sound in the same time slot. Sequence data generating means for selecting piece data from a plurality of piece data stored in the piece data storage means;
Sequence data storage means for storing sequence data generated by the sequence data generation means;
Sequence data that causes the display unit to display a two-dimensional map indicating segment data to be reproduced as a musical sound among a plurality of segment data stored in the segment data storage means in each time slot of the reproduction period according to the sequence data Display means;
In accordance with the sequence data stored in the sequence data storage means, there is provided reproduction means for sequentially reading out the segment data to be reproduced as musical sounds in each time slot from the segment data storage means and reproducing the segment data as musical sounds. A song editing device characterized by   The sequence data generation means selects the piece data whose rank from the first piece data is the rank corresponding to the second coordinate value among the plurality of piece data stored in the piece data storage means. The music piece editing apparatus according to claim 1, further comprising first segment data selection means.   The sequence data generating means is a curve in a two-dimensional coordinate system composed of the first coordinate axis and the second coordinate axis based on the first coordinate value and the second coordinate value acquired via the pointing device. The first coordinate value indicates a time, and the second coordinate value is generated by a feature amount curve generating unit that generates a feature amount curve indicating a feature amount of a musical sound at the same time, and the feature amount curve generating unit generates the feature amount curve. A feature amount curve display means for two-dimensionally displaying a feature amount curve on the display unit, and a feature amount indicated by the feature amount curve and each piece data stored in the piece data storage means for each time slot. A second segment that compares the feature amount and selects the segment data having the feature amount closest to the feature amount indicated by the feature amount curve from the segment data stored in the segment data storage means Data selection Music editing apparatus according to claim 1 or 2, characterized in that it comprises a stage.   The feature amount curve generation unit can generate a plurality of types of feature amount curves, and the second segment data selection unit can generate a plurality of types of feature amount curves when the feature amount curve generation unit generates the feature amount curves. For each time slot, a feature quantity vector having each feature quantity indicated by the plurality of types of feature quantity curves as a component and a feature quantity vector having the same component included in each piece data stored in the piece data storage means The segment data having the feature quantity vector having the highest similarity with the feature quantity vectors indicated by the plurality of types of feature quantity curves is selected from the segment data stored in the segment data storage means. The music editing apparatus according to claim 3. For each of the plurality of segment data stored in the segment data storage means, comprising: feature quantity storage means for storing at least one feature quantity of the audio waveform indicated by each;
When the two-dimensional map is displayed on the display unit according to the sequence data, the sequence data display means displays the feature data storage means in the two-dimensional map for displaying the segment data to be reproduced as a musical sound in each time slot. The music editing device according to any one of claims 1 to 4, wherein the music editing device is determined based on a feature amount of the segment data stored in.   The playback means sequentially reads out the segment data to be played back as musical sounds in each time slot from the segment data storage means in accordance with the sequence data stored in the sequence data storage means, and reproduces the segment data as musical sounds, The said sequence data display means displays the segment data currently reproduced | regenerated as a musical tone in the said 2D map in the display mode different from other segment data. The music editing device according to any one of claims. On the computer,
Based on the position indicated by the operation of the pointing device, sequence data indicating fragment data to be reproduced as a musical sound in each of a predetermined number of time slots obtained by dividing a reproduction period of a predetermined time length is generated and stored in the sequence data storage means A time slot for playing a musical sound is determined based on a first coordinate value at a position instructed by an operation of the pointing device, and the same time is determined based on a second coordinate value at the same position. Sequence data generation processing for selecting, from a plurality of segment data stored in the storage means, segment data to be played back as a musical sound in the slot;
A two-dimensional map indicating the segment data to be reproduced as a musical sound among the plurality of segment data stored in the storage means in each time slot of the reproduction period is displayed on the display unit according to the sequence data generated by the sequence data generation process. Sequence data display means for displaying;
In accordance with the sequence data stored in the sequence data storage means, segment data to be reproduced as musical sounds in each time slot are sequentially read out from the storage means, and a reproduction process for reproducing the segment data as musical sounds is performed. A song editing program.

Images