JP2018151547A - Sound production device and sound production control method - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide a sound production device and a sound production control method, which are capable of improving expressive power when a loop is reproduced.SOLUTION: A loop section in reproduction information is set by operation of depression/release of a loop button 20. A sound production start is instructed in accordance with operation of a performance operator 16, and syllable information corresponding to the instructed sound production and a sound production control parameter which is made to correspond to the syllable information are read. A CPU 10 produces sound of syllables included in the syllable information on the basis of the sound production control parameter in normal reproduction. In loop reproduction, the CPU 10 produces sound of at least one of syllables included in the syllable information in the loop period at a sound production mode different from that during the normal reproduction on the basis of the sound production control parameter.SELECTED DRAWING: Figure 1

Description

  The present invention relates to a sound generation device and a sound generation control method for performing loop reproduction of a loop section in reproduction information.

  Conventionally, a technique for performing loop reproduction of a loop section in reproduction information is known. For example, the playback device of Patent Document 1 below can change the playback mode with simple processing when a song is repeatedly played at a repeat point set in a silence interval in a song having a silence interval at the end. In addition, the playback device of Patent Document 2 described below makes a metronome sound in an error section different from other sections during a sample performance by automatic performance. There is also known a sounding device that uses a sounding control parameter so that a sound with rich expression can be easily performed during real-time performance (Patent Document 3 below).

JP 2010-015053 A JP 2007-286087 A Japanese Patent Laid-Open No. 2006-177276

  However, the devices disclosed in Patent Documents 1 and 2 have room for improvement in terms of enhancing the expressive power during loop playback compared to normal playback that is not loop playback. The device of Patent Document 3 enriches the expression during normal playback, but there is no description regarding loop playback.

  The present invention has been made to solve the above-described problems of the prior art, and an object of the present invention is to provide a sound generation device and a sound generation control method capable of enhancing the expressive power during loop reproduction.

  In order to achieve the above object, a sound generation device according to claim 1 of the present invention includes a sound generation instruction means (16) for instructing start of sound generation, syllable information including at least syllables, and a sound generation control parameter associated with the syllable information. In the reproduction information (50) including the section setting means (10) for setting a loop section for loop reproduction, the syllable information corresponding to the pronunciation instructed to start by the pronunciation instruction means, and the syllable information. In the loop reproduction of the loop section, the reading means (10) for reading out the sound generation control parameter, and the syllable in the loop section read out by the reading means in response to the sound generation start instruction by the sound generation instruction means At least one of the syllables included in the information is based on the sound generation control parameter read out by the reading means and in normal playback that is not loop playback And tone generation control means (10) to sound at different sound manner, and having a.

  In order to achieve the above object, a sound generation device according to claim 7 of the present invention includes sound generation instruction means for instructing start of sound generation, syllable information including at least a syllable, and a first sound generation control parameter associated with the syllable information. In the playback information including the section setting means for setting the loop section for loop playback, and in normal playback that is not loop playback, the syllable information corresponding to the pronunciation instructed to start by the pronunciation instruction means and the syllable information In the loop reproduction of the loop section, the syllable information corresponding to the pronunciation instructed to be started by the sound generation instruction means in the loop section and the first sound generation control are read out. A reading means for reading a second sound generation control parameter different from the parameter; and in the normal reproduction, the sound generation instruction means In response to a sounding start instruction, the syllable included in the syllable information read by the reading unit is caused to sound in a sounding manner according to the first sounding control parameter read by the reading unit, and the loop In the loop playback of the section, the syllable included in the syllable information in the loop section read by the reading means is read by the reading means in response to an instruction to start sounding by the sounding instruction means. Sound generation control means for generating sound in a sound generation mode according to the second sound generation control parameter.

  In order to achieve the above object, the sound generation device according to claim 8 of the present invention is adapted to specify sound generation instruction means for instructing sound generation start and a loop start position and a loop end position in reproduction information including syllable information including at least syllable. Based on section setting means for setting a loop section for loop playback in the playback information, reading means for reading out syllable information corresponding to the sounding to be started by the sounding instruction means, and loop playback of the loop section Sound generation control means for generating a syllable included in the syllable information in the loop section read by the reading means in response to an instruction to start sounding by the sound generation instruction means, and the section setting means , Before the syllable corresponding to the loop start position and after the syllable corresponding to the designated loop end position. Add a, and sets the loop segment, including the added syllable.

  In addition, the code | symbol in the said parenthesis is an illustration.

  According to the present invention, the expressive power during loop playback can be enhanced.

  According to the second aspect, during the loop reproduction, the manner of the sound generation control parameter can be made different from that during the normal reproduction. According to the third aspect, it is possible to specify syllables having different pronunciation modes. According to claim 4, the expressive power can be further enhanced. According to claim 5, the expressive power can be enhanced by adding syllables. According to the sixth aspect, it is possible to have a plurality of variations of the sound generation mode at the time of loop reproduction.

It is a block diagram which shows the hardware constitutions of the sounding apparatus which concerns on 1st Embodiment. It is a flowchart of a reproduction | regeneration process and an operation element process. It is a flowchart of a key-on process and a syllable information acquisition process. It is a figure explaining a pronunciation instruction | indication reception process, a syllable information acquisition process, and a speech segment data selection process. It is a flowchart of the process at the time of key-off. It is a flowchart of the process at the time of pressing. It is a flowchart of the process at the time of release. It is a flowchart of a syllable information acquisition process. It is a figure which shows the example of a score for explaining pronunciation instruction | indication reception processing, a lyric information table, and a piano roll score. It is a figure which shows each value of a lyric information table. It is a figure which shows the conceptual diagram of a pronunciation control parameter, the conceptual diagram of an information table, and the example of a score.

  Embodiments of the present invention will be described below with reference to the drawings.

(First embodiment)
FIG. 1 is a block diagram showing a hardware configuration of a sound producing device according to the first embodiment of the present invention. The sounding device 1 is configured as a keyboard instrument, for example. In the sound generator 1, a CPU (Central Processing Unit) 10 is a central processing device that controls the entire sound generator 1. A ROM (Read Only Memory) 11 is a non-volatile memory in which a control program and various data are stored. A RAM (Random Access Memory) 3 is a volatile memory used as a work area of the CPU 10 and various buffers. The display unit 15 includes a liquid crystal display unit that displays an operation state, various setting screens, a message for the user, and the like. The performance operator 16 is a performance operator composed of a keyboard or the like. When operated, the performance operator 16 generates performance information such as key-on (pronunciation start instruction), key-off (pronunciation stop instruction), pitch, and velocity. This performance information may be MIDI message performance information. The setting operator 17 is various setting operators such as operation knobs and operation buttons for setting the sound producing device 1.

  The data memory 18 stores syllable information including text data obtained by dividing lyrics into syllables, and a phonological database in which speech segment data of singing sounds is stored. Syllable information (text data 30) and a phonological database 32 described later serve as reproduction information (FIGS. 4B and 4C). In the present embodiment, the syllable information includes at least a syllable, and the reproduction information includes at least syllable information from which a syllable at a reading position (cursor position) is read in accordance with an operation of the performance operator 16. The loop button 20 is an operator for setting a loop section for loop playback (repeat playback) in the playback information. The loop button 20 can be pressed (on) and released (released or turned off). When released, the loop button 20 returns to the initial state before being pressed.

  The sound source 13 has a plurality of tone generation channels, and one tone generation channel is assigned according to real-time performance using the performance operator 16 under the control of the CPU 10. The sound source 13 reads out the speech segment data corresponding to the performance from the data memory 18 in the assigned sound generation channel and generates singing sound data. The sound system 14 converts the singing sound data generated by the sound source 13 into an analog signal by a digital / analog converter, amplifies the singing sound converted into an analog signal, and outputs the amplified singing sound to a speaker or the like. Further, the bus 19 is a bus for transferring data between the respective units in the sound producing device 1.

  FIG. 2A is a flowchart of the reproduction process. This process is realized by the CPU 10 reading and executing a program stored in the ROM 11. When performing a real-time performance, the user instructs real-time reproduction and operates the performance operator 16 to perform the performance. This process is started when real-time playback is instructed.

  First, in step S101, the CPU 10 performs initialization, and reads reproduction information (including lyric data, which is text data) that is to be reproduced according to an instruction. In step S102, the CPU 10 initializes the cursor position, that is, places the cursor on the first syllable of the text data obtained by dividing the lyrics in the reproduction information to be reproduced into syllables. This cursor position becomes the reading position. Next, the CPU 10 executes a manipulator process (FIG. 2B) (step S103), executes other processes (step S104), and returns the process to step S103. In “other processing”, jump processing, reproduction processing end processing, and the like are executed in accordance with an instruction from the user. The jump process is a process for moving the cursor position forward or backward by a plurality of syllables, and is realized by operating a jump button on the setting operator 17. For example, the cursor position is advanced or retracted by a predetermined number of syllables by a predetermined operation of the jump button. The unit of the predetermined syllable number is, for example, a syllable group corresponding to the lyrics displayed in one line on the display unit 15, but is not limited thereto.

  FIG. 2B is a flowchart of the operator processing executed in step S103 of FIG. First, the CPU 10 determines whether or not the performance operator 16 has been key-on (pressed down) (step S110). When the key-on is performed, a key-on process (FIG. 3A) is executed (step S111). The process of FIG. 2B is terminated. If the performance operator 16 is not key-on, the CPU 10 determines whether or not the performance operator 16 is key-off (release operation) (step S112). If the performance operator 16 is key-off, the CPU 10 executes key-off processing (FIG. 5). (Step S113), the process of FIG. If the performance operator 16 is not keyed off, the CPU 10 determines whether or not the loop button 20 has been newly pressed (step S114), and if the loop button 20 is pressed, processing when the loop button 20 is pressed (FIG. 6). Is executed (step S115), and the process of FIG. When the loop button 20 is not pressed, the CPU 10 determines whether or not the loop button 20 has been newly released (press release operation) (step S116). The process (FIG. 7) is executed (step S117), and the process of FIG. When the loop button 20 is not released, the CPU 10 ends the process of FIG.

  FIG. 3A is a flowchart of the key-on process executed in step S111 of FIG. FIG. 3B is a flowchart of the syllable information acquisition process executed in step S202 of FIG. Also, FIG. 4A shows an explanatory diagram of the pronunciation acceptance process in the key-on process, FIG. 4B shows an explanatory diagram of the syllable information acquisition process, and FIG. 4B shows an explanatory diagram of the speech segment data selection process. c).

  First, in step S201 in FIG. 3A, the CPU 10 receives a sound generation instruction based on the performance operator 16 that has been key-on operated. In this case, the CPU 10 receives performance information such as key-on timing, pitch information of the operated performance operator 16 and velocity. For example, when the user performs a real-time performance according to the score shown in FIG. 4A, the CPU 10 receives the pitch information of E5 and the velocity information corresponding to the key speed when receiving the first key-on n1 pronunciation instruction. Next, in step S202, the CPU 10 performs a syllable information acquisition process (FIG. 3B) for acquiring syllable information corresponding to key-on.

  In step S211 in FIG. 3B, the CPU 10 acquires the syllable at the cursor position. Prior to the performance of the user, specific lyrics stored in the data memory 18 are specified corresponding to the score shown in FIG. 4A, and the text data of the specified lyrics divided into syllables is specified. The cursor is on the first syllable. For example, the text data 30 obtained by dividing the lyrics designated corresponding to the score shown in FIG. 4A into syllables is “ha”, “ru”, “yo”, “y” of syllables c1 to c42 shown in FIG. The text data is composed of five syllables of “K” and “I”. In this case, the syllables “ha”, “ru”, and “yo” of c1 to c3 are independent, but the syllable “ko” of c41 and the syllable “i” of c42 are grouped. Information indicating this grouping is embedded or associated with each syllable as grouping information 31. In the grouping information 31, “×” indicates that the group is not grouped, and “◯” indicates that the group is grouped. As a result, as shown in FIG. 4B, when receiving the first key-on n1 pronunciation instruction, the CPU 10 reads “ha”, which is the first syllable c1 of the designated lyrics, from the data memory 18. .

  Next, in step S212, the CPU 10 determines whether or not the acquired syllables are grouped from the acquired syllable grouping information 31. Then, when the acquired syllable is “ha” of c1, for example, the CPU 10 determines that the grouping information 31 is “x”, and thus the process is advanced to step S216. In step S <b> 216, the CPU 10 advances the cursor to the next syllable of the text data 30. As a result, for example, the cursor is placed on “ru” of c2 of the second syllable. When “loop mode” for loop playback of a set loop section, which will be described later, is set, the next syllable to be advanced by the cursor is considered the loop mode, and normally the next syllable in the loop section is considered. Syllable or first syllable. When the process of step S216 ends, the syllable information acquisition process ends.

  On the other hand, if the acquired syllable is grouped as a result of the determination in step S212, the CPU 10 acquires a syllable in the group. For example, when the acquired syllable is “ko”, since “ko” and “i” are grouped, the CPU 10 advances the process to step S213. In step S <b> 213, the CPU 10 reads “I”, which is the syllable c <b> 42 in the group, from the data memory 18. Next, in step S214, the CPU 10 sets a key-off sound generation flag, and prepares to sound the next syllable “I” in the group when the key is turned off. In the next step S215, the CPU 10 advances the cursor to the next syllable beyond the group of the text data 30. However, this process is skipped when there is no next syllable. When the process of step S215 ends, the syllable information acquisition process ends.

  In step S203 in FIG. 3A, the CPU 10 selects speech segment data. This speech segment data selection process is performed by the sound source 13 under the control of the CPU 10, and speech segment data for generating the acquired syllable is selected from the phoneme database 32 (FIG. 4C). As shown in FIG. 4C, the phoneme database 32 stores “phoneme chain data 32a” and “steady part data 32b”. The phoneme chain data 32a is data of phonemes when the pronunciation changes such as silence (#) to consonant, consonant to vowel, vowel to consonant or vowel (next syllable). The stationary part data 32b is phoneme piece data when the vowel sound continues. When the pronunciation instruction of the first key-on n1 is received and, for example, the acquired syllable is “ha” of c1, in the sound source 13, the speech unit data “#” corresponding to “silence → consonant h” from the phoneme chain data 32a. -H "and speech unit data" ha "corresponding to" consonant h → vowel a "are selected, and speech unit data" a "corresponding to" vowel a "is selected from the steady part data 32b. Is done.

  Next, in step S204, the sound source 13 performs sound generation processing based on the speech segment data selected in step S203 under the control of the CPU 10. For example, when the acquired syllable is “ha” of c1, in the sound generation process of step S204, the sound source data of “# -h” → “ha” → “a” is sequentially generated in the sound source 13. As a result, the pronunciation of “ha” in the syllable c1 is performed. At the time of sound generation, the singing sound of “ha” is generated at the volume corresponding to the velocity information at the pitch of E5 received at the time of receiving the sound generation instruction of the key-on n1. When the sound generation process in step S204 ends, the key-on process ends.

  FIG. 5 is a flowchart of the key-off process executed in step S113 of FIG. The process of steps S301 and S304 of the key-off process is executed by the CPU 10, and the processes of steps S302, S303 and S305 are executed by the sound source 13 under the control of the CPU 10. In step S301, the CPU 10 determines whether or not the key-off sound generation flag is on. This key-off sound generation flag is set in step S214 in FIG. 3B when the acquired syllables are grouped. For example, since the first syllable c1 is not grouped, No is determined in step S301, and the process proceeds to step S305. In step S305, the sound source 13 performs a mute process under the control of the CPU 10, and the sound of the “ha” singing sound is stopped. That is, the singing sound of “ha” is muted with a predetermined envelope release curve. Thereafter, the key-off process ends.

  On the other hand, if the key-off sound generation flag is not on, sound generation processing for the next syllable in the group is performed in step S302. In the example of FIG. 4B, this corresponds to a case where key-off is performed after the pronunciation of “ko” is started. In the syllable information acquisition process in step S203, the CPU 10 causes the speech unit data “oi” → “i” selected as speech unit data corresponding to the syllable “I” to be generated at the pitch of E5. Next, in step S303, a mute process is performed. For example, the singing sound of “I” is muted with a release curve of a predetermined envelope. It is assumed that the pronunciation of “ko” is stopped when the pronunciation shifts to “i”. Next, in step S304, the CPU 10 resets the key-off sound generation flag and ends the key-off process.

  The key-on process and the key-off process will be described using syllables c1 to c42 shown in FIG. 4B as an example.

  When the CPU 10 receives a sound generation instruction for the first key-on n1, the CPU 10 acquires the first syllable c1 and determines that it is not grouped. Next, in the sound source 13, speech segment data “# -h”, “ha”, “a” for generating the syllable c1 is selected (step S203), and the volume envelope according to the velocity information of the key-on n1. Is started, and voice segment data of “# -h” → “ha” → “a” is generated with the pitch of E5 and the volume of the envelope (step S204). Thereby, the singing sound of “ha” is pronounced. The envelope is an envelope of a sustained sound that continues sustaining until the key-on n1 is turned off, and the speech unit data “a” is repeatedly reproduced until the key-on n1 key is turned off. Thereafter, the sound is stopped when the key is turned off.

  When the performance operator 16 is operated as the real-time performance progresses and the second key-on n2 is detected, the CPU 10 receives velocity information corresponding to the timing of the key-on n2, the pitch information of E5, and the key speed. Then, the CPU 10 reads “ru”, which is the second syllable c2 where the cursor of the designated lyrics is placed, from the data memory 18, and the grouping information 31 of the acquired syllable “ru” is “x”. Therefore, the cursor is moved to “Y” of c3 of the third syllable. In the speech unit data selection process in step S203, the sound source 13 uses the phoneme chain data 32a to generate speech unit data “# -r” corresponding to “silence → consonant r” and speech corresponding to “consonant r → vowel u”. The segment data “ru” is selected, and the speech segment data “u” corresponding to “vowel u” is selected from the steady portion data 32b. In the sound generation process of step S204, the pronunciation of the syllable of “ru” of c2 is performed by the sound generation of the speech segment data “# −r” → “r−u” → “u”.

  The third key-on n3 is a legato that is keyed on before the second key-on n2 is keyed off. In the third key-on process, the CPU 10 receives velocity information corresponding to the key-on n3 timing, D5 pitch information, and key speed. Then, in the syllable information acquisition process in step S202, the CPU 10 reads “yo”, which is the third syllable c3 on which the cursor of the designated lyrics is placed, from the data memory 18. Then, the CPU 10 determines that the grouping information 31 of the acquired syllable “yo” is “x” and determines that it is not grouped, and advances the cursor to “ko” of c41 of the fourth syllable. In step S203, in the sound source 13, the speech element data “u−y” corresponding to “vowel u → consonant y” and the speech element data “y−” corresponding to “consonant y → vowel o” are selected from the phoneme chain data 32a. “o” is selected, and the speech element data “o” corresponding to “vowel o” is selected from the stationary part data 32b. This is because the third key-on n3 is legato and is smoothly connected from “ru” to “yo” to produce sound. In the sound generation process in step S204, sound segment data “u−y” → “yo” → “o” are sequentially sounded, and “good” of c3 smoothly connected from “ru” of c2. Syllable pronunciation is performed. When the key-on n3 is turned off, the third syllable c3 “yo” is not grouped. In step S305, the sound source 13 is muted, and the sound of the “yo” singing sound is generated. Stopped.

  When the fourth key-on n4 is detected, the CPU 10 receives velocity information corresponding to the timing of the key-on n4, the pitch information of E5, and the key speed. Then, the fourth syllable c41 “ko” is read from the data memory 18. The grouping information 31 of the acquired syllable “ko” is “o”, and it is determined that the group is grouped. “I” which is the syllable c42 in the data is read from the data memory 18.

  In the speech unit data selection process in step S203, speech unit data corresponding to the syllables “ko” and “i” in the group is selected in the sound source 13. That is, as speech unit data corresponding to the syllable “ko”, speech unit data “# -k” corresponding to “silence → consonant k” and speech corresponding to “consonant k → vowel o” from the phoneme chain data 32a. The segment data “k-o” is selected, and the speech segment data “o” corresponding to “vowel o” is selected from the steady-state partial data 32b. Also, as speech segment data corresponding to the syllable “I”, speech segment data “oi” corresponding to “vowel o → vowel i” is selected from the phoneme chain data 32a, and from the steady part data 32b. Speech segment data “i” corresponding to “vowel i” is selected. Then, the pronunciation of the speech segment data “# −k” → “k−o” → “o” causes the pronunciation of the syllable “c” of c41, and “o” until the key on key on n4 is keyed off. "Is repeatedly reproduced. Then, when key-on n4 is keyed off, the singing sound of “i” of c42 is pronounced with the same pitch E5 as “ko” of c41 by the pronunciation of the speech segment data of “oi” → “i”. The Thereafter, a mute process is performed, and the pronunciation of the song sound “I” is stopped.

  In this way, a singing voice, which is a singing sound according to the user's real-time performance, can be generated, and a plurality of singing voices can be generated with one key press during real-time performance. The grouped syllables are a set of syllables that are pronounced by one press and release key operation. For example, the grouped syllables c41 and c42 are generated by one press and release key operation. In this case, the first syllable is pronounced when the key is pressed, and the second and subsequent syllables are pronounced when the key is released. The grouping information is information that determines whether or not the next syllable is pronounced by key-off, and can therefore be referred to as “key-off pronunciation information”. If a key on another key (referred to as key-on n5) is performed before the key-on n4 is keyed off, the key-on n5 is performed after the key-on n4 key-off process is performed. Is pronounced. That is, after the syllable c42 is sounded as the key-on n4 key-off process, the next syllable of c42 corresponding to the key-on n5 is pronounced. Alternatively, in order to immediately sound the syllable corresponding to the key-on n5, the key-on n4 key-off process executed by the key-on operation of the key-on n5 may be configured to omit step S302. In this case, the syllable of c42 is not pronounced, and the syllable next to c42 is pronounced immediately in response to key-on n5.

  FIG. 6 is a flowchart of the pressing process executed in step S115 of FIG. This process is started when the loop button 20 is pressed. In step S401, the CPU 10 determines whether or not the loop mode is set to ON. When the loop mode is set to ON, the loop section has already been set and the loop button 20 has been pressed during the loop playback, so it is necessary to cancel or update the loop section. Therefore, the CPU 10 reserves the loop mode OFF (OFF) for preparing the loop mode OFF (step S402), and ends the process of FIG. Note that the CPU 10 stores the read position at the time when the loop button 20 is pressed in the RAM 12 at the time of reservation.

  On the other hand, when the loop mode is not set to ON, it is a case where the loop button 20 is pressed in a state where the loop section is not set, so that it is necessary to newly set the loop section. Therefore, the CPU 10 determines whether or not the syllable at the reading position (cursor position) at the time when the current loop button 20 is pressed is a syllable included in the inseparable syllable group (step S403). Here, the “inseparable syllable group” is a syllable group composed of a plurality of continuous syllables, and it is inappropriate that the first and last syllables included in the group become the start point or end point of the loop section. is there. The inseparable syllable group is set in advance. The lyrics are not limited to Japanese, but may be other languages such as English. That is, in Japanese, one character is one syllable, but in other languages, one character may not be one syllable. For example, if the English lyrics are “september”, the three syllables are “sep”, “tem”, and “ber”. Of these, “tem” is unnatural when it comes to the beginning or end of loop playback. Therefore, three syllables “sep”, “tem”, and “ber” are set as an inseparable syllable group.

  The group described above is a concept included in the inseparable syllable group, and the two grouped syllables are also inseparable syllable groups. However, not all inseparable syllable groups are grouped. For example, in the example of FIG. 4B, “ko” and “i” are grouped. However, in the case of “september”, two syllables “sep” and “tem” are grouped to make 1 It is possible to sound the “sep” syllable at the time of pressing and releasing the key and the “tem” syllable at the time of releasing the key at the pitch of the pressed key. Alternatively, two syllables “tem” and “ber” may be grouped. Note that the concept of mora may be used instead of characters and syllables.

  If it is determined in step S403 that the syllable at the reading position when the current loop button 20 is pressed is not a syllable included in the inseparable syllable group, the CPU 10 determines the reading position when the current loop button 20 is pressed. It is set (designated) as the start point (start position) of the loop section (step S404), and the process of FIG. On the other hand, when the syllable at the reading position when the current loop button 20 is pressed is a syllable included in the inseparable syllable group, the CPU 10 sets the first syllable in the inseparable syllable group as the start point of the loop section. (Specify) (step S405). Thereby, the starting point is corrected. Thereafter, the process of FIG. 6 ends.

  FIG. 7 is a flowchart of the release time process executed in step S117 of FIG. First, the CPU 10 determines whether or not the loop mode is reserved to be turned off (step S501). If it is reserved to turn off the loop mode, the CPU 10 releases the loop button 20 (step S116 in FIG. 2B) at the time of pressing the loop button 20 (FIG. 2B). It is determined whether or not the reading position is the same as in step S114) (step S506). As a result of the determination, if the read position at the time of the release operation (release) of the loop button 20 is the same as that at the time of the release operation, the cursor moves to the next syllable within a very short time during the loop playback. It can be determined that the loop button 20 has been pressed and released. Therefore, in this case, since it can be determined that the loop mode is intended to be canceled, the CPU 10 turns off the loop mode and clears the set loop section (information of the start point and end point) ( Step S508). Thereafter, the process of FIG. 7 ends.

  On the other hand, if the reading position when the loop button 20 is released is different from the pressing operation, it can be determined that the loop mode is intended to be updated because the reading position has been moved during loop playback. In step S507, the CPU 10 cancels the current loop section that has been set, and sets the read position when the loop button 20 is pressed (the position stored in step S402) as the start point and the read position when released as the end point. A new loop section is set. Thereafter, the process proceeds to step S504.

  As a result of the determination in step S501, if the loop mode OFF is not reserved, it is a case where the loop button 20 is released in a state in which the end point of the loop section is not particularly set, so it is necessary to determine the end point. is there. Therefore, the CPU 10 determines whether or not the syllable at the reading position when the current loop button 20 is released is a syllable included in the inseparable syllable group (step S502). If the syllable at the reading position when the current loop button 20 is released is not a syllable included in the inseparable syllable group, the CPU 10 sets the reading position at the time of the release as the end point of the loop section (end). (Position) is set (designated) (step S505), and the process proceeds to step S504. On the other hand, when the syllable at the reading position when the current loop button 20 is released is a syllable included in the inseparable syllable group, the CPU 10 sets the last syllable in the inseparable syllable group as the end point of the loop section. (Specify) (step S503), and the process proceeds to step S504. Thereby, the end point is corrected.

  In step S504, since the loop section is set, the CPU 10 sets the loop mode to ON (step S504), and ends the process of FIG. When step S504 is executed, the process returns to step S103, and the reproduction of the set loop section is started. That is, each time the user presses (keys on) the performance operator 16 (by pressing and releasing the grouped syllables), the syllables in the loop section are sounded sequentially.

  In this way, in normal playback that is not loop playback, each time the user presses the performance operator 16, the syllable of the text data 30 in which the specified lyrics are divided into syllables is the pitch of the pressed key. It is pronounced. Thereby, the lyrics designated at the time of real-time performance are sung. Also, by grouping the syllables of the lyrics to be sung, the first syllable can be pronounced when the key is depressed in one key depression operation, and the second syllable can be pronounced when the key is released.

  According to the present embodiment, the CPU 10 sets the start position of the loop section in response to the pressing operation of the loop button 20, and performs the pressing release operation (release) of the loop button 20 with the start position set. Accordingly, the end position of the loop section is set. That is, since the user can designate the start position and the end position by simply pressing and releasing the loop button 20, the loop section can be set by a simple operation of a single operator. In particular, since the reproduction information includes syllable information in which the syllable at the reading position is read according to the operation of the performance operator 16, a loop section in syllable reproduction can be set with a simple operation of a single operator.

  In addition, since the loop section setting operation is a simple operation of pushing and releasing, the player's center of gravity moves little and the posture is stable, and the setting operation is simple and easy to understand. Suitable for In repeat playback in an IC recorder or DVD player, it is usual to set a repeat section by pressing and releasing the button at the start point of repetition and pressing and releasing the button at the end point of repetition. The loop section setting method of the present embodiment may be applied to these devices, and an effect that a very short loop section can be easily set can be expected.

  Further, when a loop section is set by releasing the loop button 20, playback of the loop section is started, so that loop playback can be started with a simple operation. In addition, when the loop button 20 is pressed during loop playback of the loop section and then released at the same reading position as the pressing operation, the setting of the loop section is canceled, so it is called on and release in a short time. The loop section setting can be canceled with a simple operation. On the other hand, when the loop button 20 is pressed during loop playback of the loop section, and then released at a reading position different from that at the time of the pressing operation, the loop section is updated to a new loop section. The section can be reset.

  In addition, when the syllable at the reading position is a syllable included in the inseparable syllable group when the loop button 20 is pressed and released, the first syllable of the inseparable syllable group is the start syllable and the last syllable is the end syllable Each is set. Thereby, it is possible to prevent the loop section from being set at an unnatural place.

  In the present embodiment, steps S506 and S507 in FIG. 7 may be omitted. When doing so, the process may move to step S508 when YES in step S501. Thereby, the user can cancel the setting of the loop section at the timing when the user presses the loop button 20 in a state where the loop section is set and then releases it. Alternatively, when steps S506 and S507 are abolished, step S501 may also be abolished, and the loop section setting may be canceled in step S402 of FIG. As a result, the user can immediately cancel the setting of the loop section simply by pressing the loop button 20 during loop playback of the loop section. The release of the loop button 20 immediately after that is not involved in the processing.

  From the viewpoint of setting a loop section by a simple operation of a single operator, it is not essential that the reproduction information includes syllable information. Further, the present invention can be applied not only to singing synthesis but also to a sound generation device that synthesizes speech. For example, a predetermined sound having no lyrics such as a humming sound, a singing sound such as scat or chorus, or a normal instrument sound or a sound effect such as a song of a bird or a telephone bell can be generated. The sound source 13 has a timbre of a predetermined sound without lyrics, and the CPU 10 generates a predetermined sound without lyrics when the user performs a real-time performance using the performance operator 16. In step S202 of FIG. 3 (a), key-off pronunciation information processing is performed instead of the syllable information acquisition process, and in the speech segment data selection process of step S203, a sound source waveform or sound for generating a predetermined sound or sound is generated. Segment data is selected. Since a predetermined sound without lyrics can be generated at the pitch of the depressed key, it can be applied to a karaoke guide or the like. Also in this case, by grouping, a predetermined sound having no lyrics can be generated at the time of key depression and key release in one key depression operation.

  In the syllable pronunciation processing in step S204 in FIG. 3A and step S302 in FIG. 5, the lyrics to be pronounced may be displayed on the display 15, and further, the LED corresponding to the lyrics to be pronounced. A light emitting unit such as the above may be turned on. Note that the key-off pronunciation information may be stored separately from the syllable information instead of being included in the syllable information.

(Second Embodiment)
In contrast to the first embodiment, FIG. 8 is used instead of FIG. 3B, and FIGS. 9 to 11 are further added to describe the second embodiment of the present invention. In the present embodiment, the user can perform a singing voice with rich expression during normal real-time performance using the performance operator 16 or during loop playback.

  FIG. 8 is a flowchart of the syllable information acquisition process executed in step S202 of FIG. FIG. 9A shows an example of a score for explaining the pronunciation instruction receiving process, FIG. 9B shows a lyrics information table for explaining the syllable information acquisition process, and FIG. 9C shows a piano roll score. Shown in “Value 1” in the lyrics information table 50 is shown in FIG. 10A, and “value 2” and “value 3” are shown in FIG.

  Prior to performance, a lyric information table 50 including text data in which lyrics corresponding to the score illustrated in FIG. 9A are divided into syllables is designated on the data memory 18. The cursor is placed on the first syllable of the text data in the designated lyrics information table 50. The lyrics information table 50 corresponding to the reproduction information in the present embodiment includes syllable information including at least syllables and pronunciation control parameters associated with the syllable information. As shown in FIG. 9B, the lyric information table 50 includes a syllable information 50a including text data obtained by dividing lyrics into syllables, a pronunciation control parameter type 50b for designating one of various parameter types, and a pronunciation control parameter. Value information 50c. In the example shown in FIG. 9B, the syllable information 50a is composed of syllables obtained by dividing the lyrics of c1, c2, c3, and c41 as in the text data 30 shown in FIG. 4B. That is, each note shown as key-on n1, n2, n3, n4 in FIG. 9 (a) corresponds to a syllable in which lyrics are separated, shown as c1, c2, c3, c41 in FIG. 9 (b). . In the sound generation control parameter type 50b, any one of parameters a, b, c, and d or a plurality of parameter types are set. This pronunciation control parameter type 50b includes Harmonics that change the balance of overtone components included in the voice, Brightness that produces tone changes by producing the tone of the voice, Resonance that produces the tone and strength of voiced sounds, and formants. There are types such as GenderFactor that change the thickness and texture of feminine or masculine voice. Note that the type of the sound generation control parameter type 50b is not limited to the example.

  The value information 50c defines the value of the sound generation control parameter. “Value 1” can be expressed in a graph shape by setting the manner in which the sound generation control parameter changes over time. An example of “value 1” expressed in a graph shape is shown in FIG. In this figure, “value 1” of w1 to w6 is shown and changes over time. However, the present invention is not limited to this, and “value 1” changes over time. Can be set. “Value 2” sets the time on the horizontal axis of “Value 1” shown in the graph shape as shown in FIG. 10B, and “Value 2” indicates the time from the start of the effect to the end of the effect. You can set the rate of change. “Value 3” sets the amplitude of the vertical axis of “value 1” shown in the graph shape as shown in FIG. 10B, and “value 3” indicates the depth of change indicating the degree of effect. Can be set. The settable range of the sound generation control parameter value set by the value information 50c differs depending on the sound generation control parameter type 50b. However, depending on the syllable specified by the syllable information 50a, there may be one in which the pronunciation control parameter type 50b and its value information 50c are not set. For example, the pronunciation control parameter type 50b and its value information 50c are not set in the syllable c3. The syllable information 50a, the pronunciation control parameter type 50b, and the value information 50c in the lyrics information table 50 are created / edited prior to the performance of the user and stored in the data memory 18.

  In FIG. 8, the same processing steps as those in FIG. 3B are denoted by the same step numbers, and the description thereof is omitted. In FIG. 8, step S601 is inserted between step S211 and step S212 with respect to FIG. First, normal playback that is not loop playback will be described.

  In step S <b> 601, the CPU 10 acquires the pronunciation control parameter associated with the syllable acquired in step S <b> 211 with reference to the lyrics information table 50. For example, at the first key-on n1, the syllable c1 is acquired in step S211, so the parameters a and b associated with the syllable c1 are acquired from the lyrics information table 50. Further, “value 1” to “value 3” are acquired as the value information 50c as the sound generation control parameter type 50b. Then, in the sound generation process in step S204 of FIG. 3A after the process of FIG. 8 returns, as shown by the piano roll score 52 in FIG. 9C, the sound source 13 detects the key-on n1. The selected speech segment data is pronounced at the received pitch of E5, and the singing sound of syllable c1 is pronounced. At the time of this sounding, two different sounding controls of the parameter a set with “value 1”, “value 2” and “value 3” and the parameter b set with “value 1”, “value 2” and “value 3” Since the sound control of the singing sound is performed depending on the parameter type, it is possible to change the expression and inflection, voice quality and tone of the singing voice, and to add fine nuance and inflection to the singing voice.

  When the key-on n2 is detected as the real-time performance progresses, the second syllable c2 corresponding to the key-on n2 is pronounced with a pitch of E5. As shown in FIG. 9B, the syllable c2 is associated with three sound generation control parameter types, parameter b, parameter c, and parameter d, as the sound generation control parameter type 50b. At the same time, the respective sound generation control parameter types are set with the respective “value 1”, “value 2”, and “value 3”. Therefore, when the syllable c2 is pronounced, as shown by the piano roll score 52 in FIG. 9 (c), the pronunciation control of the singing sound is performed by three tone control parameter types having different parameters b, c, and d. Is called. Thereby, a change can be given to the expression, intonation, voice quality and tone of the singing voice.

  When the key-on n3 is detected, the third syllable c3 corresponding to the key-on n3 is pronounced with a pitch of D5. As shown in FIG. 9B, since the sound generation control parameter type 50b is not set for the syllable c3, when the syllable c3 is sounded, as shown by the piano roll score 52 in FIG. 9C. The sound generation control of the singing sound by the sound generation control parameter is not performed.

  In this way, in normal playback that is not loop playback, the syllable of the specified text data is pronounced at the pitch of the pressed key each time the performance operator 16 is pressed. Thus, the singing voice is pronounced by using the text data as lyrics. At this time, sound generation control is performed using the sound generation control parameters associated with each syllable, so that the expression and inflection, voice quality and tone of the singing voice can be changed, and fine nuances and inflections can be added to the singing voice. You can be put on.

  By the way, when the loop mode is set, the CPU 10 causes the sound to be generated in a sound generation mode different from that during normal playback in the loop playback of the loop section. There are several types of modes, which will be described in order. There are roughly three variable modes of pronunciation: first, second, and third variable modes.

  In the first variable mode, the CPU 10 causes at least one of the syllables included in the syllable information in the loop section to be sounded in a sounding manner different from that during normal reproduction based on the sounding control parameter. At this time, the CPU 10 modifies and uses the sound generation control parameters defined in the lyrics information table 50 during normal playback. As a result, it is possible to give and express effects “unique to loop playback”, and to enhance the expressive power during loop playback.

  Specifically, the CPU 10 changes at least one value information of at least one parameter type in the sound generation control parameter in the loop reproduction. For example, the CPU 10 changes at least one of the values 1 to 3 of at least one of w1 to w6 shown in FIG. As a result, the temporal change, change speed, and change depth of the added effect can be made different from those during normal reproduction. It is also possible to add an effect similar to squealing by temporarily lowering and then returning the pitch bend of the first syllable in the loop section. In this way, the manner in which the sound generation control parameter acts during loop playback can be made different from that during normal playback. In order to change the effect, it is conceivable to use a coefficient such as a multiplication value or a conversion table, but the method is not limited. When jump processing is applied, squealing may be applied to the first syllable of the jump destination.

  Alternatively, the CPU 10 may set a part of the syllables included in the loop section to be sounded in a sounding manner different from that during normal playback. This designation includes, for example, designation of a ratio and a position, and is preset by the user. For example, a mode in which vibrato is added to the number of syllables corresponding to the specified ratio in the latter half of the loop section is conceivable. As a result, the user can designate a syllable that changes the sound generation mode in the loop section.

  The application of the mode change to the loop section is started in, for example, step S504 in FIG. 7, and the cancellation of the application is executed in step S508. Note that the type of sound generation mode in loop playback may be determined based on a rule selected by the user from among a plurality of predetermined rules. It is assumed that a rule can be selected in step S104 in FIG. Thereby, it is possible to have a plurality of variations of the sound generation mode during loop reproduction. Further, at the time of loop reproduction, the singer may be changed as compared with the normal reproduction, or a plurality of singer may be mixed.

  In the second variable mode, the reproduction information has a sound generation control parameter for loop reproduction separately from normal reproduction. FIG. 11A is a conceptual diagram of the first sound generation control parameter 33 for normal reproduction and the second sound generation control parameter 34 for loop reproduction. That is, the reproduction information has a sound generation control parameter 34 dedicated to the loop corresponding to all syllables corresponding to the first sound generation control parameter 33. In normal playback, the CPU 10 reads the syllable information corresponding to the pronunciation instructed to start and the first pronunciation control parameter 33 associated with the syllable information, and controls the pronunciation by the method described above. On the other hand, in the loop reproduction, the CPU 10 reads out the syllable information corresponding to the sound generation instructed to start in the loop section 33a and the second sound generation control parameter 34a corresponding to the loop section 33a. Then, in the loop reproduction, the CPU 10 causes the syllable included in the syllable information in the loop section to be sounded in a sounding manner according to the second sounding control parameter 34a.

  Alternatively, the reproduction information may have a sound generation control parameter as not corresponding to all syllables. FIG. 11B is a conceptual diagram of the information table 51 including sound generation control parameters dedicated to loops. In the information table 51, the order of application is determined for the sound generation control parameter type (No1, No2,... Last1). In the loop playback, the CPU 10 sequentially reads out the sound generation control parameters in correspondence with the order in which the sound generation start is instructed in the loop section, and reads out the syllable included in the syllable information in the loop section. Produce pronunciation in a manner of pronunciation according to the parameters. For example, the sound generation control parameter No. 1 is applied to the first syllable and the sound generation control parameter No. 2 is applied to the second syllable. Also, the tone generation control parameter corresponding to the number of syllables in the loop section from No1 is applied to the last syllable in the loop section.

  In the third variable mode, the CPU 10 adds a syllable when setting the loop section. In the third variable mode, the reproduction information does not need to include the sound generation control parameter. For example, the loop section having the syllable corresponding to the score illustrated in FIG. 11C is temporarily set by setting the start point of the loop section (steps S404 and S405) and setting the end point of the loop section (steps S503 and S505). Suppose that it is set. In this case, as shown in FIG. 11 (d), a syllable corresponding to key-on n0 may be added before key-on n1. Alternatively, as shown in FIG. 11E, a syllable corresponding to key-on n5 may be added after a rest after key-on n4. As described above, the CPU 10 adds a syllable to at least one of the syllable corresponding to the temporarily set loop start position and the syllable corresponding to the loop end position, and includes the added syllable and the loop. Set the interval. Expressive power can be improved by adding syllables. The syllable to be added may be similar to a match such as “high”. It should be noted that it may be automatically reflected in the lyrics display on the display unit 15 as the syllable is added. Multiple syllables may be added.

  According to the present embodiment, in loop playback, the CPU 10 causes at least one syllable included in the syllable information in the loop section to sound in a sounding manner different from that during normal playback based on the sounding control parameter ( First variable mode). Alternatively, the CPU 10 causes the syllable included in the syllable information in the loop section to be sounded in a sounding manner according to the second sounding control parameter 34a (second variable manner). Or CPU10 adds a syllable when setting a loop area. As a result, the expressive power during loop playback can be enhanced.

  Note that the first, second, and third variable modes may be applied in appropriate combination. The selection of the rule that determines the type of sounding mode in loop playback can also be applied to the second and third variable modes. Further, in the loop reproduction of the loop section, the CPU 10 may change the sound generation mode between at least the first reproduction and the second reproduction. For example, in the first and second variable modes, control such as increasing the volume every time can be considered. In the third variable mode, the number of syllables to be added and the addition position may be changed each time. As a result, the expressive power can be further enhanced. In the present embodiment, the loop section setting method does not matter.

  It should be noted that the same effect may be obtained by reading a storage medium storing a control program represented by software for achieving the present invention into the apparatus, in which case the data is read from the storage medium. The program code itself realizes the new function of the present invention, and the storage medium storing the program code constitutes the present invention. Further, the program code may be supplied via a transmission medium or the like, and in that case, the program code itself constitutes the present invention.

  Although the present invention has been described in detail based on preferred embodiments thereof, the present invention is not limited to these specific embodiments, and various forms within the scope of the present invention are also included in the present invention. included. A part of the above-described embodiments may be appropriately combined.

10 CPU (section setting means, reading means, pronunciation control means), 16 performance operators (sound generation instruction means), 20 loop buttons, 50 lyrics information table (information for reproduction), 50a syllable information, 50b pronunciation control parameter type, 50c Value information

Claims (11)

Pronunciation instruction means for instructing the start of pronunciation;
Section setting means for setting a loop section for loop playback in information for reproduction including syllable information including at least a syllable and a pronunciation control parameter associated with the syllable information;
Reading means for reading out the syllable information corresponding to the pronunciation instructed to start by the pronunciation instruction means and the pronunciation control parameter associated with the syllable information;
In the loop reproduction of the loop section, at least one of the syllables included in the syllable information in the loop section read out by the reading unit in response to a sounding start instruction by the sounding instruction unit is read out by the reading unit. A sound generation device comprising: sound generation control means for generating sound in a sound generation mode different from that during normal playback that is not based on loop playback based on the sound generation control parameter read out by step (b). The sound generation control parameter includes a plurality of parameter types and a plurality of value information that defines a variable aspect of each parameter type,
The sound generation device according to claim 1, wherein the sound generation control unit changes at least one value information of at least one parameter type in the sound generation control parameter in loop reproduction of the loop section.   In the loop playback of the loop section, the sound generation control means is configured to generate a part of syllables according to the designation among a plurality of syllables included in the loop section in a sound generation mode different from that during normal playback. The sounding device according to claim 1, wherein the sounding device is a sound generator.   The sound generation device according to claim 1, wherein the sound generation control unit changes a sound generation mode between at least the first playback and the second playback in the loop playback of the loop section.   5. The sound generation device according to claim 1, wherein, in the loop reproduction of the loop section, the sound generation control unit causes a predetermined syllable to sound before or after the reproduction of the loop section. .   The sound generation control means controls the sound generation mode at the time of loop reproduction based on a rule selected from a plurality of predetermined rules in the loop reproduction of the loop section. The sounding device according to any one of the above. Pronunciation instruction means for instructing the start of pronunciation;
Section setting means for setting a loop section for loop playback in the reproduction information including syllable information including at least syllable and the first pronunciation control parameter associated with the syllable information;
In normal playback that is not loop playback, the syllable information corresponding to the pronunciation instructed to be started by the pronunciation instruction means and the first pronunciation control parameter associated with the syllable information are read out, and the loop playback of the loop section is performed. In the loop section, reading means for reading out syllable information corresponding to the pronunciation instructed to start by the pronunciation instruction means in the loop section and a second pronunciation control parameter different from the first pronunciation control parameter;
In the normal reproduction, the syllable included in the syllable information read by the reading unit in response to an instruction to start sounding by the sounding instruction unit is the first sounding control parameter read by the reading unit. In the loop reproduction of the loop section, the syllable included in the syllable information in the loop section read out by the reading unit in response to the sounding start instruction by the sounding instruction unit A sounding control means for sounding the sound in a sounding manner according to the second sounding control parameter read by the reading means. Pronunciation instruction means for instructing the start of pronunciation;
Section setting means for setting a loop section for loop playback in the playback information based on designation of a loop start position and a loop end position in the playback information including syllable information including at least syllables;
Reading means for reading out syllable information corresponding to the pronunciation instructed to start by the pronunciation instruction means;
Sound generation control means for sounding a syllable included in the syllable information in the loop section read by the reading means in response to an instruction to start sound generation by the sound generation instruction means in the loop reproduction of the loop section; And
The section setting means adds a syllable to at least one of a syllable corresponding to the loop start position and a syllable corresponding to the designated loop end position, and includes the added syllable and the A sounding device characterized by setting a loop section. A pronunciation instruction step for instructing the start of pronunciation;
A section setting step for setting a loop section for loop playback in the information for playback including syllable information including at least syllable and the pronunciation control parameter associated with the syllable information;
A reading step of reading syllable information corresponding to the pronunciation instructed to start by the pronunciation instruction step and a pronunciation control parameter associated with the syllable information;
In the loop playback of the loop section, at least one of the syllables included in the syllable information in the loop section read out by the reading step in response to the sounding start instruction in the sounding instruction step is the reading step. A sound generation control method comprising: a sound generation control step that causes a sound to be generated in a sound generation mode different from that during normal playback that is not loop playback based on the sound control parameters read by A pronunciation instruction step for instructing the start of pronunciation;
A section setting step for setting a loop section for loop reproduction in the reproduction information including syllable information including at least a syllable and a first sounding control parameter associated with the syllable information;
In normal playback that is not loop playback, the syllable information corresponding to the pronunciation instructed to be started by the sound generation instruction step and the first sound generation control parameter associated with the syllable information are read out, and loop playback of the loop section is performed. A reading step of reading out syllable information corresponding to the sound generation instructed to be started by the sound generation instruction step in the loop section and a second sound generation control parameter different from the first sound generation control parameter;
In the normal reproduction, the syllable included in the syllable information read by the reading step in response to the sounding start instruction by the sounding instruction step is the first sounding control parameter read by the reading step. In the loop playback of the loop section, the syllable included in the syllable information in the loop section read out by the reading step in response to the instruction to start the sound generation by the sound generation instruction step. And a sound generation control step for generating a sound in a sound generation manner according to the second sound generation control parameter read by the reading step. A pronunciation instruction step for instructing the start of pronunciation;
A section setting step for setting a loop section for loop reproduction in the reproduction information based on designation of a loop start position and a loop end position in the reproduction information including at least syllable information;
A reading step of reading syllable information corresponding to the pronunciation instructed to start by the pronunciation instruction step;
In the loop playback of the loop section, there is a sound generation control step of causing the syllable included in the syllable information in the loop section read out by the reading step to sound in response to a sound generation start instruction in the sound generation instruction step. And
The section setting step adds a syllable to at least one of a syllable before the syllable corresponding to the loop start position and a syllable corresponding to the designated loop end position, and includes the added syllable and the A sound generation control method characterized by setting a loop section.

Images