JP6007645B2 - Sound waveform editing apparatus and program - Google Patents

Description

  The present invention relates to a sound waveform editing apparatus and a program for editing sound waveform data in which sound materials are connected.

  There is a technology for storing fragmentary sound materials in a database and generating musical sounds by combining these sound materials. Patent Document 1 discloses a technique for extracting a sound material registered in this database from a sound waveform data of a song according to a predetermined algorithm. Recently, the sound waveform of a desired section is extracted from the sound waveforms of an existing song, and various sound materials constituting the sound waveform of the section are replaced with other sound materials registered in the database, A technique for editing the sound waveform of the phrase is proposed (see Non-Patent Document 1, for example).

JP 2010-191337 A

Y2 PROJECT SONOT, [Search on July 22, 2012], Internet <URL: http: // www. y2lab. com / project / sonote />

  By the way, in order to obtain a desired phrase, when editing a sound waveform of a desired section of an existing song, it may be necessary to edit a sound waveform of a section near the section. In such a case, under the conventional technique, there is a problem that it is necessary to start over from the work of selecting a section to be edited from the music, and the work is troublesome.

  The present invention has been made in view of such problems, and after selecting a section to be edited and starting sound waveform editing, a sound waveform that can easily change the section to be edited. An object is to provide an editing device.

  In the present invention, when a part of the sound waveform data stored in the storage unit is instructed by the capturing instruction operation using the operation unit, the sound waveform data in the designated section instructed by the capturing instruction operation And an editing object capturing means for storing sound waveform configuration data indicating the sound waveform data in the extended section continuous to the rear or front of the sound waveform data in the buffer, and pre-designation of the sound waveform configuration data stored in the buffer Editing means for editing the data in the editing target section according to the editing operation using the operating means, and editing for shifting the editing target section in the time axis direction according to the shift instruction operation using the operating means. A sound wave editing apparatus comprising an object shift means.

  According to this invention, when a capturing instruction operation using the operating means is performed, a sound waveform configuration that indicates sound waveform data of a specified section instructed by the capturing instruction operation and an extended section behind or in front of the specified section. Data is stored in the buffer. Then, the editing means edits the data in the editing target section specified in advance among the sound waveform configuration data stored in the buffer according to the editing operation using the operation means. Further, the edit target shift means shifts the edit target section in the time axis direction in response to a shift instruction operation using the operation means. Therefore, according to the present invention, it is possible to easily change the editing target section after taking in the sound waveform configuration data and starting the editing.

It is a block diagram which shows the structure of the sound wave editing apparatus which is one Embodiment of this invention. It is a figure which shows the relationship between the default database and user database AD in the same embodiment, and the music data file in a music database. It is a figure which illustrates the screen transition of the display part in the embodiment. It is a figure which shows the structure of the scene data in the same embodiment. It is a figure which illustrates the screen transition of the display part in the embodiment. It is a figure which illustrates the screen transition of the display part in the embodiment. It is a figure explaining the operation | movement in the shuffle mode of the embodiment.

Embodiments of the present invention will be described below with reference to the drawings.
FIG. 1 is a block diagram showing a configuration of a sound waveform editing apparatus 10 according to an embodiment of the present invention. The sound waveform editing device 10 according to the present embodiment is a mobile phone terminal, for example, and is a device that provides a function called DAW (Digital Audio Workstation) by executing a specific application program on an OS (Operating System). . The sound wave editing apparatus according to the present invention may be an information processing apparatus such as a personal computer, a PDA (Personal Digital Assistant), or a tablet terminal.

  As shown in FIG. 1, the sound wave editing device 10 according to the present embodiment includes a control unit 11, an operation unit 12, a display unit 13, an interface 14, a storage unit 15, an acoustic processing unit 16, and a sensor unit. 17. Each of these components is connected via a bus. In addition, a speaker 161 and a microphone 162 are connected to the acoustic processing unit 16.

  The control unit 11 includes a central processing unit (CPU), a random access memory (RAM), and a read only memory (ROM). The control unit 11 executes various programs stored in the ROM or the storage unit 15 to control each unit connected by the bus and realize various functions.

  The operation unit 12 has an operation element such as an operation button that receives an operation by the user, and outputs operation data indicating the content of the operation on the operation element to the control unit 11. The operation unit 12 constitutes a touch panel together with the display unit 13, and includes a pressing position detection sensor that detects a pressing position on the touch panel. An instruction given from the user via the operation unit 12 is input to the control unit 11. The display unit 13 is a display device such as a liquid crystal display. The display unit 13 constitutes a touch panel together with the operation unit 12, and displays various menus, soft buttons, sound waveforms, and the like under the control of the control unit 11.

  The interface 14 has a function of communicating with an external device by wire or wireless and transmitting / receiving various data. The interface 14 outputs various data input from the external device to the control unit 11, and outputs various data to the external device under the control of the control unit 11.

  When the sound wave editing device 10 performs a telephone call function as a mobile phone terminal, the microphone 162 and the speaker 161 receive means for outputting a received voice from the other party and a transmitted voice from the user. It functions as a means. The speaker 161 functions as a means for outputting a sound waveform signal of a song or phrase as a sound when the sound waveform editing apparatus 10 reproduces a song or a phrase. The sound processing unit 16 is configured by a DSP (Digital Signal Processor) or the like. Under the control of the control unit 11, a sound signal output to the outside through the speaker 161 and a sound input from the outside through the microphone 162. It is means for performing various signal processing such as dynamic range compression and filter processing on the signal.

  The sensor unit 17 is specifically a triaxial acceleration sensor. In the present embodiment, when an operation of shaking the casing of the sound waveform editing device 10 is performed, the control unit 11 detects the occurrence of the shaking operation based on the output signal of the sensor unit 17.

  The storage unit 15 is a nonvolatile memory such as a hard disk or a flash memory, and stores various programs executed by the control unit 11 and various data used by these programs. The predetermined storage area in the storage unit 15 is used as a work area when the control unit 11 executes various programs. Hereinafter, programs and data stored in the storage unit 15 will be described.

  The song database 110 is a collection of song data files downloaded from a site on the Internet or the like via the interface 14. Here, the song data file includes sound waveform data that is a sample data string of a sound waveform such as a song or a phrase.

  The sound material database 120 is a collection of data related to sound material that is a fragment obtained by dividing the sound waveform data of each music data file in the music database 110. The sound material database 120 includes specific data and feature amount data as data for one sound material. Here, the specific data includes information (file name, address, etc.) for specifying a song data file containing sound waveform data of the target sound material, and the sound material in the song indicated by the song data file. Information indicating the start time and end time of the waveform. The feature data includes information indicating various feature values of the target sound material (for example, MFCC (Mel Frequency Cepstrum Coefficient), spectral energy, etc.), and attacks, dust, etc. determined based on the feature values. And categories.

  The analysis program 130 generates specific data and feature amount data of various sound materials based on each song data file in the song database 110, and adds the specific data and feature amount data to create the sound material database 120. It is a program to update. More specifically, for example, when a new song data file is added to the song database 110, the analysis program 130 changes the sound waveform of the song indicated by the song data file, for example, at onset (timing when the energy of the sound suddenly rises). Divide into materials. Then, specific data for each sound material is generated, and each sound material is analyzed to calculate various feature values of each phoneme, and a category of each sound material is determined based on the feature values, Generates feature data of sound material. Then, the sound material database 120 is updated by adding the specific data and feature amount data of each sound material to the sound material database 120. It should be noted that the update of the sound material database 120 accompanying the addition of the new song data file to the song database 110 may be executed by the control unit 11 as background processing.

  The editing program 140 selects a desired song data file in the song database 110, selects a desired section of the sound waveform indicated by the selected song data file, and each sound material constituting the sound waveform of the selected section. Is a program that generates a phrase having a sound waveform in which one or a plurality of sound materials are replaced with other sound materials. The editing program 140 includes an editing target fetch unit 141, an editing unit 142, an editing target shift unit 143, and a playback unit 144, each of which is a subroutine.

  Here, the editing target capturing unit 141 causes the user to select a desired song data file, and to select a desired section of the sound waveform indicated by the song data file as the main loop (designated section). Shape data and sound waveform data in the next loop (extended section) having a predetermined time length continuous behind the main loop are read from the music data file. Then, the editing target capturing unit 141 refers to the sound material database 120, thereby making data (phrase, sound material of the phrase, similar sound material, etc.) constituting scene data from the sound waveform data of the main loop and the next loop. ) And stored in the scene data buffer 151 set in the storage unit 15. The editing target capturing unit 141 stores the sound waveform data of this loop in the waveform data buffer 152 set in the storage unit 15. Then, based on a registration instruction from the user, information stored in the scene data buffer 151 is stored in the scene database 160 in the storage unit 15 as scene data. Here, the scene data is sound waveform configuration data including sound material designation information indicating the sound material constituting the sound waveform data, but the configuration and generation method thereof are described in this embodiment in order to avoid duplication of explanation. Details will be clarified in the operation description.

  In the present embodiment, the editing target capturing unit 141 may read out arbitrary scene data from a scene database 160 described later and store it in the scene data buffer 151 in accordance with the operation of the operation unit 12 performed by the user. . In this case, the editing target capturing unit 141 refers to the sound material database 120 to generate sound waveform data based on data corresponding to this loop among the scene data in the scene data buffer 151, and the waveform data buffer 152. To store.

  Based on the scene data stored in the scene data buffer 151, the editing unit 142 generates sound waveform data of a section selected as a section to be edited by the user from the main loop or the next loop and displays the sound waveform data on the display unit 13. On the other hand, this is a subroutine for editing scene data in accordance with an editing operation performed by the user using the operation unit 12. Here, the editing of the scene data is specifically an operation of replacing the sound material indicated by the sound material designation information of the scene data with another sound material. Then, the editing unit 142 refers to the sound material database 120 when the scene data is edited, and the sound of the sound waveform data in the waveform data buffer 152 so that the content corresponds to the edited scene data. Replace the material. Basically, the editing unit 142 replaces the sound material indicated by the scene data with another sound material in accordance with the operation of the operation unit 12. However, when the shuffle mode is set by the operation of the operation unit 12, the editing unit 142 monitors the output signal of the sensor unit 17, and when detecting that the operation of shaking the housing is performed, the editing unit 142 In response to this pseudo-random number, the sound material indicated by the sequence data is replaced with another similar sound material. The above is an outline of scene data editing performed by the editing unit 142. Then, when the user performs a registration operation using the operation unit 12, the editing unit 142 stores the scene data in the scene data buffer 151 in the scene database 160.

  The editing target shift unit 143 is a subroutine that shifts the editing target section from the main loop to the next loop or from the next loop to the main loop in accordance with a shift operation performed by the user using the operation unit 12. This shift operation is a simple operation of tapping a predetermined position on the touch panel. In the present embodiment, the edit target section of the scene data can be easily changed only by performing this shift operation. This is the greatest feature of this embodiment.

  The reproduction unit 144 is a subroutine for outputting sound waveform data as sound via the sound processing unit 16 and the speaker 161. The sound waveform editing apparatus 10 according to the present embodiment has a music playback mode and a phrase editing mode as operation modes. In the song playback mode, the playback unit 144 reads the sound waveform data from the song data file specified by the operation of the operation unit 12 among the song data files in the song database 110, and passes through the sound processing unit 16 and the speaker 161. Output as sound. In the phrase editing mode, the reproduction unit 144 repeatedly reads out the sound waveform data from the waveform data buffer 152 and outputs the sound waveform data as sound via the acoustic processing unit 16 and the speaker 161.

  The scene database 160 is a collection of scene data. The scene database 160 in this embodiment is divided into a default database and user databases A to D. FIG. 2 shows the relationship between the default database and user databases A to D and each song data file in the song database 110.

  In the sound wave editing apparatus 10 according to the present embodiment, the song database 110 is an access target of a music playback application program different from the editing program 140. In this music reproduction application, each song data file in the song database 110 is divided into a plurality of groups and managed in accordance with an instruction from the user. When the user performs music playback, the music playback application causes the display unit 3 to display a playlist including menus of groups as shown in FIG. 2, and the user selects a group to which a desired song data file belongs. After that, a desired music data file is selected from the music data files belonging to the group.

  User databases A to D are databases for storing scene data created by the user and allowing them to be read out and reused, and can generate phrases (scene data) that suit the user's preference. It is a database prepared to do.

  In the present embodiment, the user can name each group constituting the playlist provided by the music playback application by operating the operation unit 12. In this case, similar phoneme segments can be extracted using the data file of the song data group corresponding to the playlist title. In the present embodiment, when a specific name is given to a certain group in the playlist, the group is associated with one of the user databases A to D.

  Thereafter, in the phrase editing mode, for example, when the user designates the user database A, the editing target import unit 141 applies to the sound material indicated by all scene data in the song database 110 for the songs included in the corresponding group of the playlist. Search for similar sound material and present it to the user as a candidate to replace the existing sound material. When the user performs a registration operation using the operation unit 12, the scene data in the scene data buffer 151 is stored in the user database A of the scene database 160.

In the phrase editing mode, when the user designates a default database, the editing target capturing unit 141 searches all music data files in the music database 110 for similar sound materials for the sound material indicated by the scene data. , Present it to the user as a candidate to replace the existing sound material. When the user performs a registration operation using the operation unit 12, the scene data in the scene data buffer 151 is stored in the default database of the scene database 160.
The above is the configuration of the sound waveform editing apparatus 10 according to the present embodiment.

  Next, the operation of this embodiment will be described. 3A to 3G show screen transitions of the display unit 13 in the present embodiment. In the example shown in FIG. 3A, the user selects a desired song data file in the song database 110 by operating the operation unit 12, and causes the playback unit 144 to play it. The reproduction unit 144 reads out the sound waveform data from the music data file instructed by the user and displays it in the waveform display area 201 of the display unit 13, and passes the sound waveform data through the sound processing unit 16 and the speaker 161. Is output as sound. In addition, the reproduction unit 144 displays a seek bar 201a indicating the position of the sound waveform data currently being emitted. In addition, the playback unit 144 displays a capture instruction button including characters “× 1” to “× 8” in the soft button area 202 below the waveform display area 201.

  When generating the sound waveform data of the phrase using the sound waveform data of a desired section in the currently reproduced music data file, the user performs the phrase edit mode setting operation by operating the operation unit 12. In addition, the user refers to the default database in the scene database 160 and the user databases A to D to generate scene data by operating the operation unit 12, and selects a database as a storage destination of the edited scene data. . Then, when the seek bar 201a tries to reach the start position of a desired section in the song on the display screen of the display unit 13, the user touches a capture instruction button including, for example, a character “× 4”.

  As a result, the edit target capturing unit 141 obtains the nearest onset position of the reproduction position indicated by the seek bar 201a in the sound waveform data in the song data file being reproduced, and obtains an interval of 4 beats starting from the onset position. Let this loop be the next loop. Then, the editing target capturing unit 141 reads the sound waveform data of the main loop and the sound waveform data of the next loop from the music data file, generates scene data from each sound waveform data, and stores the scene data in the scene data buffer 151. The editing target capturing unit 141 stores the sound waveform data of this loop in the waveform data buffer 152.

  Then, as shown in FIG. 3B, the editing unit 142 displays the sound waveform data of the main loop in the waveform data buffer 152 in the waveform display area 201 of the display unit 13, and the scene data in the scene data buffer 151. The contents of the data corresponding to this loop are displayed in the sound composition display area 203 below the waveform display area 201. Further, the reproduction unit 144 repeatedly reads out the sound waveform data of the main loop in the waveform data buffer 152 and sends it to the acoustic processing unit 16 to output it from the speaker 161 as sound.

  Here, the scene data in the scene data buffer 151 and the generation method thereof will be described with reference to FIG. As shown in FIG. 4, the scene data includes a part corresponding to the main loop and a part corresponding to the next loop.

  In the portion corresponding to the main loop of the scene data, the music data file designation information is information indicating the location of the music data file to which the sound waveform data of the main loop belongs (for example, the ID or address of the music data file in the music database 110). Information).

  The in-music start time and in-music end time are the relative time of the start point and the end point of this loop in the music indicated by the music data file. As described above, the in-music start time is relative to the onset position nearest to the reproduction position indicated by the seek bar 201a in the sound waveform data in the music data file being reproduced when the import instruction button is touched. It is time. In this example, the in-music end time is a time that is four beats after the in-music start time.

  The sound material designation information is information for designating each sound material included in the sound waveform data of this loop. In the illustrated example, eight sound materials from sound material 1 to sound material 8 are included in the sound waveform data of this loop. In the data of this loop, this sound material designation information is followed by the configuration information of each sound material and the configuration information of the similar sound material defined in the configuration information of each sound material.

  In the configuration information of the sound material 1, the start time in the loop and the end time in the loop are the relative time of the start point and the end point of the sound material 1 in this loop. The sound material address information is address information for identifying specific data and feature amount data of the sound material 1 in the sound material database 120. The similar sound material designation information is a sound material defined by the sound material database 120 and is a sound material similar to the sound material 1. In the present embodiment, similar sound materials 1 to 4 are designated by the similar sound material designation information as sound materials similar to the sound material 1. The similar category designation information is a category having an acoustic feature similar to the sound material category. In the present embodiment, in this embodiment, similar categories 1 to 4 are designated by the similar category designation information as categories having characteristics similar to the sound material category. The selected sound material is information indicating the sound material that is currently selected by the user as being generated in the section of the sound material 1 (that is, the section from the start time in the loop to the end time in the loop). Values from 1 to 5 can be taken. When the selected sound material is 1, the sound material 1 specified by the sound material address information is the sound material selected by the user. When the selected sound material is 2 to 5, the similar sound materials 1 to 4 are sound materials selected by the user.

  The configuration information of the sound materials 1, 2,... Constituting the loop is generated by the following method, for example. (1) From the specific data of each sound material in the sound material database 120, the one corresponding to the music data file to which this loop belongs is selected.

(2) From the selected specific data group, those having the start time and the end time in the section from the start time in the song to the end time in the song are selected and arranged in time series. As a result, specific data for specifying the in-music end time is obtained from the in-music start time of each of the sound material 1, sound material 2,... Belonging to this loop. Based on these specific data, the in-loop start time and in-loop end time of each of the sound material 1, sound material 2,... Are calculated. Further, information (address or ID) for specifying these specific data is the sound material address information of the sound material 1, the sound material 2,.

(3) Feature quantity data corresponding to each specific data of the sound material 1, sound material 2,... In the main loop obtained in (2) above, that is, each feature quantity data of sound material 1, sound material 2,. , And the sound material category to which sound material 1, sound material 2,. For each of the sound material 1, sound material 2,..., Similar categories similar to the respective sound material categories are obtained, and similar category designation information for designating them is generated.

(4) The similar sound materials 1 to 4 are obtained for each of the sound material 1, sound material 2,. For example, for sound material 1, similar sound materials 1 to 4 are obtained as follows. First, for example, if the user database A is selected by the user, the sound material address information of the sound materials 1, 2,... Is read from all the scene data in the user database A. Then, in the sound material database 120, the top four items similar to the feature value data of the sound material 1 are selected from the feature value data specified by the sound material address information. The sound materials corresponding to the feature value data from the first to the fourth selected in this way become the similar sound materials 1 to 4 of the sound material 1. The same applies to the other sound material 2, sound material 3,.

  The method for obtaining the similar sound materials 1 to 4 has been described above by taking the case where the user database A is selected by the user as an example, but the same applies when the user databases B to D are selected. When the default database is selected by the user, all the sound materials defined by the sound material database 120 are the extraction ranges of the similar sound materials 1 to 4.

(5) The selected sound material is initially set to 1.
The above is the method for generating the configuration information of the sound materials 1, 2,.

  As shown in FIG. 4, the configuration information of the sound material 1 of this loop is followed by the configuration information of similar sound materials 1 to 4 similar to the sound material 1. The method for generating each piece of configuration information is basically the same as the method for generating the configuration information of the sound material 1. However, regarding the similar sound materials 1 to 4, since the similar sound material designation information, the similar category designation information, and the selected sound material data are not necessary, the contents of these data are null.

The data of the next loop is followed by the data of the next loop. The data structure of this next loop and the generation method thereof are the same as the data of this loop.
The above is the scene data in the scene data buffer 151 and its generation method.

  In FIG. 3B, the sound composition display area 203 below the waveform display area 201 displays the contents of the data corresponding to the editing target section (here, this loop) among the scene data described above. The This display control is performed by the editing unit 142. In the example shown in FIG. 3B, in the sound configuration display area 203, vertically long rectangles H1 to H4 in which five ◯ -shaped marks are arranged in the vertical direction are arranged in the horizontal direction. These rectangles H1 to H4 indicate the contents of the selected sound material of the sound materials 1 to 4 in the main loop indicated by the scene data in the scene data buffer 151. In each rectangle H1 to H4, the uppermost circle mark indicates the original sound material (that is, sound material 1 to 4), the second circle mark from the top indicates the similar sound material 1, and the third circle mark indicates The similar sound material 2 and the fourth circle mark indicate the similar sound material 3, and the fifth circle mark indicates the similar sound material 4. In each of the rectangles H1 to H4, among the five circles arranged in the vertical direction, the mark that is ON, that is, the circle that is blacked out in FIG. The selected sound material is shown. In the example shown in FIG. 3B, since the sound materials 1 to 4 are selected sound materials in the sound materials 1 to 4 of the main loop indicated by the scene data in the scene data buffer 151, the rectangles H1 to H4 In each, the uppermost circle mark is ON.

  As shown in FIG. 3B, the waveform display area 201 shows each section of the sound materials 1 to 4 together with the sound waveform of the loop, and the rectangles H1 to H1 in the sections and the sound composition display area 203. A colored display is displayed to indicate the association with H4. In FIG. 3 (b), the boundaries between the colored sections are indicated by broken lines. In the waveform display area 201 shown in FIG. 3B, a region between the leftmost broken line and the right adjacent broken line indicates the section of the sound material 1. The color of this section is determined based on the sound material category of the sound material 1 of the main loop indicated by the scene data, such as red when the sound material 1 is an attack, gray when the sound material 1 is dust. The same applies to the sound materials 2 to 4.

  In the state shown in FIG. 3B, the user touches the desired ○ marks in the rectangles H <b> 1 to H <b> 4 of the sound composition display area 203, so that the sound material 1 to 1 of this loop indicated by the scene data is displayed. The desired selected sound material among the four can be changed. For example, it is assumed that the user touches the second mark from the top in the rectangle H1 in the state shown in FIG. Thereby, the editing unit 142 changes the selected sound material of the sound material 1 of the main loop indicated by the scene data in the scene data buffer 151 to 2 which is a numerical value indicating the similar sound material 1. Further, the editing unit 142 changes the sound waveform data in the waveform data buffer 152 so that the content corresponds to the changed scene data in the scene data buffer 151. More specifically, the editing unit 142 refers to the configuration information of the similar sound material 1 of the sound material 1 in the scene data because the selected sound material of the sound material 1 of the main loop indicated by the scene data is 2, and this similarity is referred to. The specific data indicated by the sound material address information of the sound material 1 is read from the sound material database 120. Then, the sound waveform data specified by the specific data is read from the music database 110, and the sound waveform in the section from the start time in the loop of the sound material 1 to the end time in the loop of the sound waveform data in the waveform data buffer 152 is read. The data is replaced with sound waveform data read from the music database 110. Thereafter, the playback unit 144 reads out the sound waveform data of this loop in which the sound material 1 is replaced with the similar sound material 2 from the waveform data buffer 152 and outputs the sound waveform data as sound via the sound processing unit 16 and the speaker 161.

  Although not shown, the user can replace a desired one of the sound materials 1 to 4 in this loop with a sound material of a similar category by performing a predetermined operation. More specifically, when the user performs, for example, an operation of designating the sound material 1 and an operation of instructing a category change, the editing unit 142 causes the sound material 1 of the main loop indicated by the scene data in the scene data buffer 151. Similar category designation information is read out from the configuration information. Then, similar categories 1 to 4 indicated by the similar category designation information are displayed on the display unit 13 as a menu. When the user selects, for example, the similar category 4 by operating the operation unit 12, the editing unit 142 corresponds to the database selected by the user from the sound materials defined by the sound material database 120. , A menu of items belonging to the similar category 4 is displayed. For example, when the user has selected the user database A, the editing unit 142 reads out the sound material address information of the sound materials 1, 2,... From all the scene data in the user database A. Then, in the sound material database 120, the top four items belonging to the similar category 4 and most similar to the feature value data of the sound material 1 among the feature value data specified by the sound material address information. Select. The top four are associated with the second to fifth circles from the top of the rectangle H1, and the user is made to select them. When the user touches the fifth mark from the top in the rectangle H1, for example, the editing unit 142 sets the sound waveform data corresponding to the sound material address information of the sound material of the similar category 4 corresponding to this mark to the music database 110. From the sound waveform data in the waveform data buffer 152, the sound waveform data in the section from the start time in the loop to the end time in the loop of the sound material 1 is replaced with the sound waveform data read from the music database 110.

  As described above, the user edits the portion corresponding to this loop in the scene data in the scene data buffer 151 by operating the operation unit 12 and edits the sound waveform data in the waveform data buffer 152 after editing. The content can be changed according to the scene data.

  In a situation where the editing operation of the main loop is performed in this manner, there is a case where the user desires to edit not the main loop but the next loop immediately after it in order to generate a desired phrase. In this case, as shown in FIG. 3C, the user may tap (an operation of tapping with a finger) an area near the right end of the waveform display area 201.

  When the editing target shift unit 143 detects a tap operation in the region near the right end of the waveform display area 201, the editing target shift unit 143 waits for the seek bar 201a to reach the right end of the waveform display area 201, as shown in FIG. Then, when the seek bar 201a reaches the right end, an instruction to shift the editing target section from the main loop to the next loop is sent to the editing unit 142. Thus, the editing unit 142 generates next-loop sound waveform data based on the portion corresponding to the next loop in the scene data in the scene data buffer 151, and stores it in the waveform data buffer 152. Then, as illustrated in FIG. 3E, the editing unit 142 displays the rectangles H1 to H7 indicating the selected sound materials of the next loop sound materials 1 to 7 indicated by the scene data in the scene data buffer 151 as the sound configuration display. While displaying in the area 203, the sound waveform data of the next loop in the waveform data buffer 152 is displayed in the waveform display area 201. Then, the playback unit 144 reads the sound waveform data of the next loop in the waveform data buffer 152 and outputs it as sound via the acoustic processing unit 16 and the speaker 161.

  In the state where the display illustrated in FIG. 3E is performed, the user touches the desired ○ marks in the rectangles H1 to H7 in the sound composition display area 203 as in the case of this loop, so that the scene data is displayed. The desired selected sound material can be changed among the sound materials 1 to 7 of the next loop shown. Further, as in the case of the main loop, the user can also replace a desired one of the next loop sound materials 1 to 7 with a sound material of a similar category.

  In a situation where editing of the next loop is performed in this way, the user may desire to return to editing of this loop. In that case, the user may tap the area near the left end of the waveform display area 201 as shown in FIG.

  When the editing target shift unit 143 detects a tap operation in the region near the left end of the waveform display area 201, the seek bar 201a moves and reaches the right end of the waveform display area 201 as shown in FIG. When the seek bar 201a reaches the right end, an instruction to shift the editing target section from the next loop to the main loop is sent to the editing unit 142. As a result, the editing unit 142 generates sound waveform data of the main loop based on the portion of the scene data in the scene data buffer 151 corresponding to the main loop, and stores it in the waveform data buffer 152. Then, as illustrated in FIG. 3B, the editing unit 142 displays the sound configurations of rectangles H1 to H4 indicating the selected sound materials of the sound materials 1 to 4 of the main loop indicated by the scene data in the scene data buffer 151. While being displayed in the area 203, the sound waveform data of this loop in the waveform data buffer 152 is displayed in the waveform display area 201. Then, the reproduction unit 144 reads the sound waveform data of the main loop in the waveform data buffer 152 and outputs it as sound via the acoustic processing unit 16 and the speaker 161.

  Thereafter, the same applies, and the user can shift the edit target section from the main loop to the next loop, and from the next loop to the main loop by a tap operation near the right end or the left end of the waveform display area 201. The data corresponding to the desired edit target section in the scene data can be edited.

  In the present embodiment, the scene data edited in this way can be stored in the scene database 160. When the user gives a registration instruction by operating the operation unit 12, as shown in FIG. 5A, a soft button labeled “Store” on the waveform display area 201 and the numbers “1”, “ “2” and “3” are displayed. Here, the numbers “1”, “2”, and “3” indicate the registration status of the scene data. Further details are as follows. First, it is assumed that, for example, the user database A is selected as a database for extracting similar sound material in editing scene data in the current scene data buffer 151. The scene data in the scene data buffer 151 is generated based on the sound waveform data in the song data file of the song X in the song database 110, for example, and based on the sound waveform data in the song data file of the song X. Assume that one piece of scene data generated in this way is already stored in the user database A. In this case, the number “1” is displayed in red, for example, and the numbers “2” and “3” are displayed in blue, for example. In this state, when the user touches the soft button labeled “Store”, the editing unit 142 uses the scene data in the scene data buffer 151 as the second scene data corresponding to the song X, and the user of the scene database 160. Store in database A. As a result, the numbers “1”, “2”, “3” displayed next to the soft button labeled “Store” are displayed in red as the numbers “1”, “2”, and as “3” as blue. Become.

  In addition, the user can read the scene data stored in the scene database 160 in this way by operating the operation unit 12, reproduce the phrase from the scene data, or edit the scene data. In order to read the scene data, the user performs an operation of designating a database (for example, user database A) to which the scene data is registered. As a result, the song name of the song data file in the song database 110 associated with the user database A is displayed on the display unit 13 as illustrated in FIG. In the example shown in FIG. 5B, the numbers “1”, “2”, and “3” are displayed next to the song title 4. This indicates that three scene data generated based on the song data file of the song name 4 are stored in the user database A. In this case, the user can designate scene data to be read by touching a desired number. Here, for example, when the user touches “2”, the second scene data generated based on the song data file of the song name 4 is read from the user database A and stored in the scene data buffer 151. The sound waveform data of this loop is generated based on the scene data stored in the scene data buffer 151 and stored in the waveform data buffer 152. As a result, the reproducing unit 144 reads out the sound waveform data of the main loop in the waveform data buffer 152 and outputs it as sound via the acoustic processing unit 16 and the speaker 161. In this state, the user can edit the scene data in the scene data buffer 151 by operating the operation unit 12.

  In the state shown in FIG. 5B, the user can instruct reading of scene data by a method different from the above method. As shown in FIG. 5B, a soft button 204 for instructing playback is displayed on the right side of the song title. Here, when the user touches the soft button 204 next to the song name 4, the song data file of the song name 4 is read from the song database 110. The sound waveform data in the song data file with the song title 4 is output as sound through the acoustic processing unit 16 and the speaker 161, and the song with the song title 4 is reproduced. Then, as illustrated in FIG. 6A, the waveform display area 201 of the display unit 13 displays the sound waveform data of the song data file of the song name 4. Also, the seek bar 201a indicating the playback position moves in accordance with the progress of playback of the song with the song name 4. As illustrated in FIG. 6A, numbers “1”, “2”, and “3” are displayed on the waveform display area 201. The editing target capturing unit 141 uses the seek bar 201a to display a display section of the sound waveform data of the main loop indicated by the first scene data among the three scene data corresponding to the song data file of the song name 4 stored in the user database A. When passing, the number “1” is displayed larger, and when the seek bar 201a passes the sound waveform data display section of the main loop indicated by the second scene data, the number “2” is displayed larger and the third scene is displayed. When the seek bar 201a passes through the display section of the sound waveform data of the main loop indicated by the data, the number “3” is displayed large. The user reads out desired scene data from the user database A to the editing target capturing unit 141 by performing a capturing instruction operation when any of the numbers “1”, “2”, and “3” is displayed large. Can be stored in the scene data buffer 151.

  As a result, the screen illustrated in FIG. 6B is displayed on the display unit 13. In this example, since the user instructs to fetch the first scene data corresponding to the song data file of the song name 4 and the scene data is stored in the scene data buffer 151, the number “1” is displayed on the waveform display area 201. "Is displayed large, and the numbers" 2 "and" 3 "are displayed small.

  In this state, the user can replace the scene data in the scene data buffer 151 with other scene data. For example, it is assumed that the user touches the number “2” among the numbers “1”, “2”, and “3”. In this case, the editing target import unit 141 reads out the second scene data corresponding to the song data file of the song name 4 from the user database A and stores it in the scene data buffer 151. Therefore, the user can reproduce a phrase based on the second scene data corresponding to the song data file of the song name 4 or edit the second scene data.

In the present embodiment, the above-described shuffle mode is provided in order to enable editing of scene data with a sense of play. In a state where certain scene data is stored in the scene data buffer 151, the user sets the shuffle mode by operating the operation unit 12, and shakes the sound waveform editing apparatus 10 by hand as illustrated in FIG. 7A. Then, the editing unit 142 generates the same number of pseudo-random numbers as the number of sound materials in the editing target section indicated by the scene data in the scene data buffer 151. Here, each pseudo-random number takes any value from 1 to 5. When the first pseudorandom number is 3, the editing unit 142 sets the selected sound material of the sound material 1 in the editing target section to 3 (similar sound material 2) in the scene data in the scene data buffer 151. When the second pseudorandom number is 1, the editing unit 142 sets the selected sound material of the sound material 2 to 1 (sound material 2). The same applies to other sound materials. FIG. 7B illustrates the display contents of the sound configuration display area 203 and the waveform display area 201 after the scene data in the scene data buffer 151 is changed in this way. As described above, in the shuffle mode, the contents of the scene data in the scene data buffer 151 are randomly changed every time the sound waveform editing device 10 is shaken. Therefore, the user can edit the scene data as if playing.
The above is the operation of this embodiment.

  As described above, according to the present embodiment, when a user selects a desired section in a desired song data file as a main loop, scene data is based on the sound waveform data of the main loop and the next loop immediately thereafter. Is generated and stored in the scene data buffer 151. Then, the user can edit the data in the editing target section in the scene data in the scene data buffer 151 by shifting the editing target from the main loop to the next loop or from the next loop to the main loop. As described above, according to the present embodiment, after the sound waveform section to be edited is selected and editing is started, the section to be edited can be easily changed.

  Further, according to the present embodiment, the user databases A to D of the scene database 160 can be associated with an arbitrary group of music data files of the music database 110, and a scene is edited by selecting a certain user database. In this case, the similar sound material in the scene data can be determined within the range of the sound material in the music data file of the group associated with the user database. Therefore, the user can easily edit scene data that realizes a phrase that suits his / her preference.

  Further, according to the present embodiment, the shuffle mode is provided, and the user can change the contents of the scene data in the scene data buffer 151 at random by shaking the sound waveform editing device 10. Therefore, the scene data can be edited with a sense of play.

<Other embodiments>
Although one embodiment of the present invention has been described above, other embodiments are conceivable for the present invention. For example:

(1) In the above embodiment, the sound material constituting the sound waveform of the two sections of the main loop and the next loop is defined by the scene data and used for editing the sound waveform. However, the sound material constituting the sound waveform data of the three sections consisting of the specified section designated by the operation of the operation unit 12 and the two extended sections before or after the specified section, or the sound material constituting the sound waveform data of the sections higher than that is represented by the scene data. And may be used for sound waveform editing.

(2) In the above embodiment, when a registration instruction operation is performed, the scene data in the scene data buffer 151 is registered in the scene database 160. However, only the portion corresponding to the loop that is the section to be edited in the main loop or the next loop in the scene data may be registered in the scene database 160.

(3) In the above embodiment, when the shift of the editing target section is instructed, the editing target section for one loop is shifted from the main loop to the next loop or from the next loop to the main loop. . However, according to, for example the operation of the operation unit 12, the current editing object section rearward only one beat considerable time, backward by two beats considerable time, forward only one beat considerable time, forward by two beats considerable time You may shift to the condition such as. In this case, data indicating the sound material constituting the editing target section is extracted from the scene data in the scene data buffer 151 and stored in the editing buffer, and in the editing buffer according to the operation of the operation unit 12. This data may be edited, and the editing performed on the data in the editing buffer may be reflected in the scene data in the scene data buffer 151.

(4) In the above-described shuffle mode, when pitching (vertical swing) of the casing of the sound wave editing device 10 is detected, the edit target section is shifted from the main loop to the next loop or from the next loop to the main loop. If yawing (left-right swing) is detected, the selected sound material of each sound material in the loop of the edit target section may be switched randomly.

(5) In the above-described embodiment, the sound waveform data is not limited to data indicating the waveform of a musical instrument sound or data indicating the waveform of a human voice, and any sound generated in nature such as a sound or noise. It is possible to handle the data indicating the waveform as sound waveform data.

(6) In the above embodiment, both the sound waveform data of the main loop and the sound waveform data of the next loop are stored in the waveform data buffer 152, and the change is made when the scene data in the scene data buffer 151 is changed. May be reflected in the sound waveform data in the waveform data buffer 152. In this mode, when the edit target section is shifted from the main loop to the next loop and from the next loop to the main loop, it is not necessary to generate the sound waveform data of the edit target section after the shift from the scene data. There is an advantage that it is possible to shorten the time until the waveform display area 201 displays the sound waveform data of the editing target section after the shift is instructed.

(7) In the above embodiment, the music database 110, the sound material database 120, and the scene database 160 are stored in the storage unit 15. However, all or part of these databases are stored in a server on the network, and the editing program 140 is stored. May access a database stored in this server via the interface 14.

DESCRIPTION OF SYMBOLS 10 ... Sound waveform editing apparatus, 11 ... Control part, 12 ... Operation part, 13 ... Display part, 14 ... Interface, 15 ... Memory | storage part, 16 ... Sound processing part, 161 ... Speaker, 162 …… Microphone, 17 …… Sensor unit, 110 …… Music database, 120 …… Sound material database, 130 …… Analysis program, 140 …… Edit program, 141 …… Edit target import unit, 142 …… Edit unit, 143 ... Editing object shift section, 144... Playback section, 151... Scene data buffer, 152.

Claims (6)

The preparative interrupt instruction operation, when a part of the section of the sound waveform data stored in the storage means is instructed, the rear of the sound waveform data and the sound waveform data in a designated section designated by the incorporation instruction operation Alternatively, edit target capturing means for storing sound waveform configuration data indicating the sound waveform data in an extended section continuous forward in a buffer;
The data of pre-specified edit object within the interval of the sound waveform configuration data stored in the buffer, and editing means for editing in accordance with editing operations,
Depending on the shift instructing operation, the editing shifts the target section in the time axis direction edited shifting means and sound waveform editing apparatus characterized by comprising a. Comprising operating means;
The sound waveform editing apparatus according to claim 1, wherein the operation unit is used for the capturing instruction operation, the editing operation, or the shift instruction operation. The editing object capturing means includes sound waveform configuration data including sound material specification information indicating each sound material constituting the sound waveform data in the specified section and the sound waveform data in the extension section as the sound waveform configuration data. Generated and stored in the buffer,
3. The editing unit according to claim 1, wherein the editing unit replaces the sound material indicated by the sound wave configuration data stored in the buffer within the editing target section with another sound material according to an editing operation. Sound waveform editing device. It has a sound material database that is a collection of various sound materials,
The editing object capturing means includes the sound material designation information and the sound material in the sound material database, as the sound waveform configuration data, each of the sound waveform data in the designated section and the sound waveform in the extension section. Generating sound waveform configuration data including similar sound material designation information indicating a sound material similar to each of the sound materials constituting the data and storing it in the buffer;
4. The sound waveform editing apparatus according to claim 3, wherein the editing unit replaces a sound material indicated by the sound material specifying information with a sound material indicated by the similar sound material specifying information in accordance with an editing operation. A sensor for detecting a motion generated in the sound wave editing device;
And a means for causing the editing means to edit data in the edit target section of the sound waveform configuration data in response to detection of movement of the sound waveform editing apparatus by the sensor. The sound waveform editing apparatus according to any one of claims 1 to 4. Computer
When a part of the sound waveform data stored in the storage unit is instructed by the capturing instruction operation, the sound waveform data in the specified section instructed by the capturing instruction operation and the rear or front of the sound waveform data Editing object capturing means for storing sound waveform configuration data indicating the sound waveform data in the continuous extended section in a buffer;
Editing means for editing the data in the editing target section specified in advance among the sound waveform configuration data stored in the buffer according to an editing operation;
Editing target shift means for shifting the editing target section in the time axis direction in response to a shift instruction operation;
A program characterized by making it function.

Images