WO2019003349A1

WO2019003349A1 - Sound-producing device and method

Info

Publication number: WO2019003349A1
Application number: PCT/JP2017/023783
Authority: WO
Inventors: 一輝柏瀬; 桂三濱野
Original assignee: ヤマハ株式会社
Priority date: 2017-06-28
Filing date: 2017-06-28
Publication date: 2019-01-03
Also published as: JP6787491B2; JPWO2019003349A1; CN110720122B; CN110720122A

Abstract

Provided is a sound-producing device capable of lessening the incongruity when switching between sound production periods. When a designation start operation (operation of depressing advance operator 34 or reverse operator 35) is detected, a CPU 10 stops a sound being outputted, sets a sound production target phrase as undefined, and automatically generates and starts outputting a dummy sound. Thereafter, the CPU 10 defines the next sound production target phrase when the designation end operation (operation of releasing advance operator 34 or reverse operator 35) is detected. For example, when a release operation is detected after an advance operator 34 depressing operation has been detected, the CPU 10 defines the one phrase that follows the current phrase as the sound production target phrase, and stops the dummy sound.

Description

Sound generation device and method

The present invention relates to a sound generating device and method for producing a singing sound based on singing data.

There is known a sound generation device that generates a singing sound based on data for singing using a speech synthesis technology. For example, the apparatus of Patent Document 1 causes the user to input a plurality of types of synthesis information (phonological information and prosody information) for each note, and performs singing synthesis in real time. Note that the apparatus of Patent Document 1 gives a sense of discomfort to the user if there is a shift in the input timing of the phonetic information and the prosody information, so the device of Patent Document 1 determines the voice signal corresponding to the earliest synthesis information from the first synthesis information Uncomfortable feeling is eased by pronouncing the dummy sound until the output of is started. According to this, the sense of incongruity when singing one syllable one by one in a fixed order can be alleviated.

Patent No. 6044284

By the way, generally, the lyrics of a song are configured to have a plurality of unit (section) having groupings of phrases and the like. Therefore, in the middle of the singing of a certain phrase, a player may want to shift to the singing of the next phrase. If it is configured to be able to switch phrases, it is necessary to confirm the phrase to be switched and to move the sound generation position to syllables in the phrase after switching. If time is required for finalization of the phrase to be switched to and the actual switching process, the pronunciation of syllables based on the original singing instruction may be interrupted every time the phrase is switched, which may cause discomfort. The accompaniment sounds are particularly noticeable when they are also played back.

An object of the present invention is to provide a sound generation device and method capable of alleviating discomfort when switching between sound generation sections.

According to the present invention to achieve the above object, according to the present invention, there is provided a data acquisition unit for acquiring singing data including syllable information as a basis of pronunciation and including a plurality of continuous sections, and for singing performed by the data acquisition unit. Among the data, a detection unit for detecting a section designation operation for specifying a next pronunciation target section, and a predetermined different from the singing sound based on the singing instruction in response to the detection of the section specification operation by the detection section. And a sound generation control unit for generating a singing sound.

In addition, the code in the said parenthesis is an illustration.

According to the present invention, it is possible to alleviate a sense of incongruity at the time of switching of a sound production section.

It is a schematic diagram of a sound generator. It is a block diagram of an electronic musical instrument. It is a figure which shows the principal part of a display unit. It is a flowchart which shows an example of the flow of a process in case a performance is performed. It is a figure which shows an example of lyric text data. It is a figure which shows an example of the kind of voice | phonetic segment data. It is a part of flowchart which shows an example of the flow of a process in case a performance is performed.

Hereinafter, embodiments of the present invention will be described with reference to the drawings.

First Embodiment
FIG. 1 is a schematic view of a sound generation device according to a first embodiment of the present invention. This sound generator is configured as an electronic musical instrument 100 which is a keyboard instrument as an example, and has a main body 30 and a neck 31. The main body portion 30 has a first surface 30a, a second surface 30b, a third surface 30c, and a fourth surface 30d. The first surface 30a is a keyboard mounting surface on which a keyboard section KB composed of a plurality of keys is disposed. The second surface 30 b is the back surface.

Hooks

36 and 37 are provided on the second surface 30 b. A strap (not shown) can be placed between the

hooks

36 and 37, and the player usually puts the strap on his shoulder and performs performance such as operating the keyboard KB. Therefore, at the time of use with shoulders, particularly when the scale direction (key arrangement direction) of the keyboard KB is in the left-right direction, the first surface 30a and the keyboard KB face the listener side, the third surface 30c, the fourth The faces 30d face generally downward and upward, respectively. The neck portion 31 is extended from the side of the main body 30. The neck portion 31 is provided with various operators including the advance operator 34 and the return operator 35. A display unit 33 composed of liquid crystal or the like is disposed on the fourth surface 30 d of the main body 30.

The electronic musical instrument 100 is a musical instrument that simulates singing in response to an operation on a performance operator. Here, the song simulation is to output a voice simulating a human voice by song synthesis. White keys and black keys are arranged in the order of pitches of the keys of the keyboard section KB, and the keys are associated with different pitches. When playing the electronic musical instrument 100, the user presses a desired key on the keyboard KB. The electronic musical instrument 100 detects a key operated by the user, and produces a singing sound of a pitch corresponding to the operated key. The order of the syllables of the singing voice to be pronounced is predetermined.

FIG. 2 is a block diagram of the electronic musical instrument 100. As shown in FIG. The electronic musical instrument 100 includes a central processing unit (CPU) 10, a timer 11, a read only memory (ROM) 12, a random access memory (RAM) 13, a data storage unit 14, a performance control 15, and other operations. A slave 16, a parameter value setting operator 17, a display unit 33, a sound source 19, an effect circuit 20, a sound system 21, a communication I / F (Interface), and a bus 23.

The CPU 10 is a central processing unit that controls the entire electronic musical instrument 100. The timer 11 is a module that measures time. The ROM 12 is a non-volatile memory that stores control programs and various data. The RAM 13 is a volatile memory used as a work area of the CPU 10 and various buffers. The display unit 33 is a display module such as a liquid crystal display panel or an organic EL (Electro-Luminescence) panel. The display unit 33 displays the operation state of the electronic musical instrument 100, various setting screens, a message for the user, and the like.

The performance operator 15 is a module that mainly accepts a performance operation that designates a pitch. In the present embodiment, the keyboard portion KB, the advance operator 34, and the return operator 35 are included in the performance operator 15. As an example, when the performance operation element 15 is a keyboard, the performance operation element 15 may be a note on / note off based on sensor on / off corresponding to each key, a key depression strength (speed, velocity), etc. Output performance information. This performance information may be in the form of a MIDI (musical instrument digital interface) message.

The other operator 16 is, for example, an operation module such as an operation button or an operation knob for performing settings other than performance, such as settings relating to the electronic musical instrument 100. The parameter value setting operation unit 17 is an operation module such as an operation button or an operation knob that is mainly used to set parameters for the attribute of the singing voice. Examples of this parameter include harmonics, brightness, resonance, and gender factor. The harmony is a parameter for setting the balance of the harmonic component contained in the voice. Brightness is a parameter for setting the tone of the voice and gives a tone change. The resonance is a parameter for setting timbre and strength of singing voice and musical instrument sound. The gender element is a parameter for setting formants, and changes the thickness and texture of the voice in a feminine or male manner. The external storage device 3 is, for example, an external device connected to the electronic musical instrument 100, and is, for example, a device that stores audio data. The communication I / F 22 is a communication module that communicates with an external device. The bus 23 transfers data between the units in the electronic musical instrument 100.

The data storage unit 14 stores singing data 14a. The song data 14a includes lyric text data, a phonological information database, and the like. The lyrics text data is data describing the lyrics. In the lyric text data, the lyrics of each song are described divided in syllable units. That is, the lyric text data has character information obtained by dividing the lyrics into syllables, and the character information is also information for display corresponding to the syllables. Here, the syllable is a group of sounds output in response to one performance operation. The phoneme information database is a database storing speech segment data. The voice segment data is data indicating a waveform of voice, and includes, for example, spectrum data of a sample string of the voice segment as waveform data. The speech segment data includes segment pitch data indicating the pitch of the waveform of the speech segment. The lyrics text data and the speech segment data may each be managed by a database.

The sound source 19 is a module having a plurality of tone generation channels. Under the control of the CPU 10, one sound generation channel is assigned to the sound source 19 in accordance with the user's performance. In the case of producing a singing voice, the sound source 19 reads voice segment data corresponding to a performance from the data storage unit 14 in the assigned tone generation channel to generate singing voice data. The effect circuit 20 applies the acoustic effect designated by the parameter value setting operator 17 to the singing voice data generated by the sound source 19. The sound system 21 converts the singing sound data processed by the effect circuit 20 into an analog signal by a digital / analog converter. Then, the sound system 21 amplifies the singing sound converted into the analog signal and outputs it from a speaker or the like.

FIG. 3 is a diagram showing the main part of the display unit 33. As shown in FIG. The display unit 33 has a first main area 41, a second main area 42, a first sub area 43, and a second sub area 44 as display areas. The entire display area is configured in two lines (two stages), and the first main area 41 and the first sub area 43 are the first line (upper stage), and the second main area 42 and the second sub area 44 are two lines. It is placed on the eye (lower). In each of the

main areas

41 and 42, a plurality of display frames 45 (45-1, 45-2, 45-3,...) Are arranged in series in the longitudinal direction of the display unit 33. Starting from the display frame 45-1 at the left end of FIG. 3, characters corresponding to syllables are displayed in the order of scheduled pronunciation. The

main areas

41 and 42 are mainly used for displaying lyrics.

Next, an operation focusing on the singing order and the lyrics display will be described. First, the lyric text data included in the song data 14a at least includes character information associated with a plurality of syllables according to the selected song. The lyrics text data is data to be sung by the singing part (the sound source 19, the effect circuit 20 and the sound system 21). The lyrics text data is divided in advance into a plurality of continuous sections, and each divided section is referred to as a "phrase". A phrase is a unit of unity and is separated by a meaning that can be easily recognized by the user, but the definition of the section is not limited to this. When the song is selected, the CPU 10 acquires the song while being divided into a plurality of phrases. A phrase includes one or more syllables and character information corresponding to the syllables.

When the electronic musical instrument 100 is activated, the CPU 10 causes the first main area 41 (FIG. 3) of the display unit 33 to display character information corresponding to the first phrase of the plurality of phrases corresponding to the selected music. At that time, the first character of the first phrase is displayed in the display frame 45-1 at the left end, and a number of characters that can be displayed in the first main area 41 are displayed. For the second phrase, characters are displayed in the second main area 42 by the number that can be displayed. The keyboard unit KB plays a role as an instruction acquisition unit for acquiring a singing instruction. The CPU 10 causes the singing part to sing the next syllable to be sung in response to the acquisition of the singing instruction by the operation of the keyboard part KB, etc., and causes the display of the characters displayed in the first main area 41 to be performed. Follow the progress of The advancing direction of the character display is the left direction in FIG. 3, and the characters that can not be displayed at first appear from the display frame 45 at the right end according to the progress of singing. The cursor position indicates a syllable to be sung next, and designates a syllable corresponding to the character displayed in the display frame 45-1 of the first main area 41. The lyrics displayed on the display unit 33 are updated according to the operation of the keyboard KB.

Note that one letter and one syllable do not necessarily correspond. For example, in the case of "da" (da) having a cloud point, two letters "ta" (ta) and "" "correspond to one syllable. Also, the lyrics may be in English, for example, if the lyrics are "september", it will be the three syllables of "sep" "tem" "ber". Although "sep" is one syllable, three characters "s" "e" "p" correspond to one syllable. Since the progression of the character display is a syllable unit to the last, in the case of "da", it will advance two characters by singing. Thus, the lyrics are not limited to Japanese and may be other languages.

When all syllables of the phrase to be displayed in the first main area 41 have been pronounced, the CPU 10 belongs to the next phrase of the phrase to be displayed in the first main area 41. Character information is displayed in the first main area 41, and character information belonging to the phrase next to the phrase to be displayed in the second main area 42 is displayed in the second main area 42. If there is no phrase following the phrase to be displayed in the second main area 42, the characters displayed in the second main area 42 will disappear (all display frames 45 are blank).

The advance operator 34 shown in FIG. 1 is an operator for advancing the display in phrase units. In addition, an operation of pressing and releasing the advance operator 34 is an example of the phrase advance operation. The return operator 35 is an operator for advancing the display in phrase units. An operation of pressing and releasing the return operation element 35 is an example of the phrase return operation. The phrase advance operation by the advance operator 34 and the phrase return operation by the return operator 35 correspond to a phrase specification operation (section specification operation) for specifying the next phrase to be sounded (a section to be sounded).

When detecting the phrase specification operation, the CPU 10 fixes the next pronunciation target phrase. For example, after detecting the pressing operation of the advance operator 34, when detecting the release operation of the advance operator 34, the CPU 10 determines the phrase one after the current phrase as the pronunciation target phrase. Further, after detecting the pressing operation of the return operation 35, when detecting the release operation of the return operation 35, the phrase immediately before the current phrase is decided as the pronunciation target phrase. The depression operation of the advance operation element 34 and the depression operation of the return operation element 35 are the designation start operation of the phrase designation operation. The release operation of the advance operation element 34 and the release operation of the return operation element 35 are the designation end operation among the phrase specification operations.

The CPU 10 executes the lyric display process as follows in conjunction with the process of determining the pronunciation target phrase. This lyric display process is executed by a separate flowchart (not shown). First, when detecting the phrase advance operation, the CPU 10 executes the phrase display advancing process to display the determined pronunciation target phrase in the first main area 41. For example, the CPU 10 causes the first main area 41 to display the character string which has been displayed in the second main area 42 so far, and further causes the second main area 42 to display the character string of the next phrase. If there is no phrase following the phrase to be displayed in the second main area 42, the characters displayed in the second main area 42 will disappear (all display frames 45 are blank). On the other hand, when detecting the phrase return operation, the CPU 10 executes the phrase display advancing process to display the determined pronunciation target phrase in the first main area 41. For example, the CPU 10 causes the first main area 41 to display character information belonging to the phrase immediately before the phrase to be displayed in the first main area 41, and the phrase used to be displayed in the second main area 42. The character information belonging to the immediately preceding phrase is displayed in the second main area 42.

By the way, it may take some time to be recognized by the user before the pronunciation target phrase is determined. Since the next syllable can not be pronounced until the pronunciation target phrase is decided, there is a possibility that the user may feel discomfort. Therefore, in the present embodiment, in response to the detection of the phrase advance operation or the return operation (the section designation operation indicating the start of designation), the CPU 10 starts the generation of the dummy sound (predetermined singing sound), and at least the next Continue the dummy sound until the target phrase for pronunciation is decided. The dummy sound is a singing sound such as "ru" by singing synthesis, and regardless of the type, the syllable information which is the basis of its pronunciation is stored in the ROM 12 in advance. The syllable information that is the basis of the pronunciation of the dummy sound may be attached to the singing data 14a. Moreover, in the singing data 14a, syllable information for dummy sound may be added for each phrase, and a dummy sound corresponding to the current pronunciation target phrase or the next pronunciation target phrase may be generated. Also, a plurality of syllable information that is the basis of the pronunciation of the dummy sound may be stored, and the dummy sound may be generated based on the singing voice that was pronounced immediately before.

FIG. 4 is a flowchart showing an example of the flow of processing when a performance is performed by the electronic musical instrument 100. Here, the processing in the case where the user performs the selection of the musical composition and the performance of the selected musical composition will be described. Further, in order to simplify the description, a case where only a single sound is output will be described even if a plurality of keys are simultaneously operated. In this case, only the highest pitch among the pitches of keys operated simultaneously may be processed, or only the lowest pitch may be processed. The processing described below is realized, for example, by the CPU 10 executing a program stored in the ROM 12 or the RAM 13. In the process illustrated in FIG. 4, the CPU 10 plays a role as a data acquisition unit, a detection unit, a sound generation control unit, and a determination unit.

When the power is turned on, the CPU 10 waits until an operation of selecting a song to be played is received from the user (step S101). Note that if there is no song selection operation even after a certain time has elapsed, the CPU 10 may determine that a song set by default has been selected. When the CPU 10 receives the selection of the song, it reads the lyric text data of the song data 14a of the selected song. Then, the CPU 10 sets the cursor position at the top syllable described in the lyric text data (step S102). Here, the cursor is a virtual index indicating the position of the syllable to be pronounced next. Next, the CPU 10 determines whether note-on has been detected based on the operation of the keyboard section KB (step S103). When the note-on is not detected, the CPU 10 determines whether the note-off is detected (step S109). On the other hand, when note-on is detected, that is, when a new key depression is detected, the CPU 10 stops the output of the sound if the sound is being output (step S104). The sounds in this case may include dummy sounds. Next, the CPU 10 determines whether or not the next pronunciation target phrase is in the determined state (step S105). At the stage where the singing syllables are sequentially stepped in response to the acquisition of a normal singing instruction (note-on), the pronunciation target phrase is in the determined state. Therefore, in this case, the CPU 10 executes an output sound generation process for producing a singing sound according to note-on (step S107).

The output sound generation process will be described. First, the CPU 10 reads voice segment data (waveform data) of the syllable corresponding to the cursor position, and outputs the sound of the waveform indicated by the read voice segment data at a pitch corresponding to note-on. Specifically, the CPU 10 obtains the difference between the pitch indicated by the segment pitch data included in the voice segment data and the pitch corresponding to the operated key, and the waveform data is obtained by the frequency corresponding to this difference. The spectral distribution shown is moved in the frequency axis direction. Thus, the electronic musical instrument 100 can output a singing sound at the pitch corresponding to the operated key. Next, the CPU 10 updates the cursor position (read position) (step S108), and advances the process to step S109.

Here, the determination of the cursor position and the sounding of the singing voice according to the processes of steps S107 and S108 will be described using a specific example. First, updating of the cursor position will be described. FIG. 5 is a view showing an example of lyrics text data. In the example of FIG. 5, the lyrics of the five syllables c1 to c5 are described in the lyrics text data. Each character "ha", "ru", "yo", "ko", "i" indicates one Japanese hiragana character and each character corresponds to one syllable. The CPU 10 updates the cursor position in syllable units. For example, when the cursor is located at the syllable c3, the voice segment data corresponding to "Y" is read from the data storage unit 14, and the singing voice of "Y" is pronounced. When the sound generation of "Yo" is completed, the CPU 10 moves the cursor position to the next syllable c4. Thus, the CPU 10 sequentially moves the cursor position to the next syllable in response to the note-on.

Next, the pronunciation of the singing sound will be described. FIG. 6 is a diagram showing an example of the type of speech segment data. The CPU 10 extracts speech segment data corresponding to syllables from the phonological information database in order to pronounce syllables corresponding to the cursor position. There are two types of phonetic segment data: phoneme chain data and stationary partial data. The phoneme chain data is data indicating a speech segment when the pronunciation changes, such as "silence (#) to consonant", "consonant to vowel", "vowel to consonant or vowel (of the next syllable)" . The steady part data is data indicating a speech segment when the pronunciation of the vowel continues. For example, when the cursor position is set to “ha” of syllable c 1, the sound source 19 includes voice chain data “# -h” corresponding to “silence → consonant h”, “consonant h → vowel a The voice chain data “ha” corresponding to “” and the stationary partial data “a” corresponding to “vowel a” are selected. Then, when the performance is started and the key depression is detected, the CPU 10 operates the singing voice based on the voice chain data “# -h”, the voice chain data “ha,” and the steady part data “a”. Output according to the pitch according to, the velocity according to the operation. Thus, the determination of the cursor position and the sounding of the singing sound are performed.

On the other hand, if it is determined in step S105 that the next pronunciation target phrase is in an undetermined state, the CPU 10 generates an output sound of a dummy sound at the note-on pitch detected in step S103, and generates a dummy sound. Output. Here, a dummy sound has already been output based on the designation start operation in step S115 described later. Therefore, when the pitch of the dummy sound being output is different from the pitch of the note-on detected in step S103, the CPU 10 changes the dummy sound being output to the pitch of the note-on detected in step S103. Generate a dummy sound output sound to correct. Therefore, after the output of the dummy sound, the player can correct the pitch of the dummy sound by pressing the key until the next phrase is determined. Thereafter, the process proceeds to step S109.

If note-off is not detected in step S109 of FIG. 4, the CPU 10 advances the process to step S112. On the other hand, when the note-off is detected, the CPU 10 determines whether the next phrase to be sounded is in the finalized state (step S110). At the stage where the singing syllables are sequentially stepped in response to the acquisition of a normal singing instruction (note-on), the pronunciation target phrase is in the determined state. Therefore, in this case, if the sound is being output, the CPU 10 stops the output of the sound (step S111), and the process proceeds to step S112. If it is determined in step S110 that the next pronunciation target phrase is in an undetermined state, the CPU 10 advances the process to step S112. In step S112, the CPU 10 determines whether or not a designation start operation (an operation of pressing the advance operator 34 or the return operator 35) is detected. When the designation start operation is not detected, the CPU 10 determines whether the designation end operation (the release operation of the advance operator 34 or the return operator 35) is detected (step S116). Then, when the designation end operation is not detected, the CPU 10 advances the process to step S121.

As a result of the determination in step S112, when the designation start operation is detected, the CPU 10 stops outputting the sound if it is outputting the sound (step S113), and sets the sound generation target phrase in an unconfirmed state (step S112). Step S114). The CPU 10 manages, for example, the unconfirmed state and the confirmed state of the pronunciation target phrase by setting 0 and 1 to predetermined flags, for example. Next, the CPU 10 automatically generates a dummy sound and starts output of the dummy sound (step S115). Thereby, the sound generation of the dummy sound is started according to the designation start operation. Thereafter, the process proceeds to step S116.

When the designation end operation is detected as a result of the determination in step S116, the CPU 10 determines the next pronunciation target phrase based on the designation start operation detected in step S112 and the designation end operation (step S117). . For example, as described above, after the CPU 10 proceeds in step S112 to detect the pressing operation of the operating element 34, it proceeds in step S116 to detect the releasing operation of the operating element 34, and then pronounces the phrase one phrase after the current phrase. Confirm as the target phrase. Next, the CPU 10 updates the reading position, that is, updates the cursor position to the first syllable in the determined pronunciation target phrase (step S118). As a result, when a singing instruction is acquired in step S103 after the next pronunciation target phrase is determined, the syllable corresponding to the beginning of the pronunciation target phrase is sung, and it is possible to immediately shift to the singing of the determined phrase. The update destination of the cursor position in the determined pronunciation target phrase may be a predetermined position, and may not necessarily be the head position. Thereafter, the CPU 10 sets the phrase to be sounded into a definite state (step S119), and stops the outputting dummy sound (step S120). As a result, the generation of the dummy sound ends in response to the determination of the pronunciation target phrase. Thereafter, the process proceeds to step S121.

In step S121, the CPU 10 executes other processing. For example, when the generation of the dummy sound continues for a predetermined time or more, the CPU 10 restarts generation and output of the same dummy sound. Thereby, for example, when the dummy sound "ru" continues for a long time, the same syllable can be repeatedly sounded like "rule rue". Thereafter, the CPU 10 determines whether or not the performance has ended (step S122), and returns the process to step S103 if the performance has not ended. On the other hand, when the performance is ended, if the sound is being outputted, the CPU 10 stops the output of the sound (step S123), and the processing shown in FIG. 4 is ended. Note that the CPU 10 determines whether the performance has ended, for example, whether the last syllable of the selected song has been pronounced, or whether the operation to end the performance has been performed by the other operating element 16 or the like. It can be determined based on

According to the present embodiment, in response to the phrase designating operation being detected, a dummy sound (predetermined singing sound) different from the singing sound based on the singing instruction is produced. Thereby, even if the pronunciation of the syllable based on the original singing instruction is stopped every time the phrase is switched, the dummy sound is pronounced, so that the sense of discomfort at the switching of the pronunciation section can be alleviated. In particular, since the sound generation of the dummy sound is started in response to the detection of the designation start operation and continues at least until the next sound generation target section is determined, it is avoided to become silent when the sound generation section changes. Further, since the pronunciation target phrase is determined by the designation end operation, it is possible to continue the generation of the dummy sound while the user is performing the phrase specification operation.

Further, when an instruction to specify a pitch is acquired during the generation of the dummy sound, the CPU 10 changes the sound generation pitch of the dummy sound to the specified pitch (step S106), so the dummy sound pitch correction The discomfort can be further alleviated.

Second Embodiment
In the first embodiment, the dummy sound is stopped as soon as the pronunciation target phrase is in the finalized state. On the other hand, in the second embodiment of the present invention, the dummy sound whose sound generation has been started is continued until the note-on is first after the determination of the sound generation target phrase. For that purpose, step S120 of FIG. 4 may be eliminated. Then, by the first note-on after the to-be-pronounced phrase is determined, the dummy sound which has been being output is stopped at step S104. Therefore, it is possible to prevent the dummy sound whose sound generation has been started from being interrupted until note-on after the determination of the sound generation target phrase.

The present embodiment is effective, for example, in a specification in which the designation start operation and the designation end operation are completed by one operation. For example, the present invention may be applied to a specification in which the designation start operation and the designation end operation are instructed only by pressing the advance operator 34 or the return operator 35, and the release operation has no meaning.

Third Embodiment
In the first embodiment, when there is a note-on after the generation of the dummy sound, the pitch of the dummy sound is corrected to the pitch of the note-on by changing the pitch and re-generating the dummy sound. (Step S106). On the other hand, in the third embodiment of the present invention, even if there is a note-on after the generation of the dummy sound, the dummy sound is not regenerated or reproduced again.

FIG. 7 is a part of a flowchart showing an example of the flow of processing when a performance is performed by the electronic musical instrument 100 according to the third embodiment of the present invention. In this flowchart, since the process before step S103 and the process after step S109 are the same as the flowchart in FIG. 4, the illustration thereof is omitted. Steps S105 and S106 are abolished.

When note-on is detected in step S103, the CPU 10 determines whether a dummy sound is being generated (step S201). If the dummy sound is not being generated, steps S104, S107, and S108 are performed, and the process proceeds to step S109. Therefore, the sound being produced based on the previous note-on is stopped, and the singing sound based on the current note-on is produced. In addition, that a dummy sound is stopped means that the pronunciation target phrase is decided. On the other hand, when the CPU 10 is producing a dummy sound, the process proceeds to step S109. Therefore, when the dummy sound is being generated, the sound generation based on the note-on is not performed even if the note-on is performed, and the generation of the dummy sound continues without the pitch correction.

In addition, about the aspect of phrase designation | designated operation, not only what was illustrated but various variations are considered. For example, as mentioned in the second embodiment, pressing the designated operator such as the advance operator 34 or the return operator 35 once instructs the designation start operation and the designation end operation, and the phrase to be sounded May be determined. Further, the phrase to be moved by one set of operation is not limited to the adjacent phrase, and the CPU 10 may jump over a plurality of phrases to determine the pronunciation target phrase. Alternatively, the designation start operation and the designation end operation may be completed by pressing the designation operator for a certain period of time. At that time, the CPU 10 may determine the phrase of the movement destination according to the length of time of the long press. In addition, the CPU 10 may fix the pronunciation target phrase of the movement destination based on the number of repetitions of the pressing operation of the designated operator and the releasing operation within a predetermined time. Alternatively, the configuration may be such that the pronunciation target phrase of the movement destination can be designated by a combination of operations of the designated operator and other operators. Further, by operating the designated operator in a predetermined mode, the leading phrase of the selected music may be determined as the pronunciation target phrase regardless of the current phrase.

The setting of the cursor position in the pronunciation target phrase determined as the determination of the pronunciation target phrase may be performed as follows. For example, if there is a final phrase of the selected song and there is a phrase specification operation by the operating element 34, the CPU 10 determines the top phrase of the selected song as the pronunciation target phrase and sets the cursor to the top syllable of the pronunciation target phrase. Good. In addition, when the phrase specification operation is performed with the return operator 35 as the leading phrase, the CPU 10 may fix the leading phrase of the selected music as the pronunciation target phrase and set the cursor at the leading syllable of the pronunciation target phrase.

The song data 14a for the selected song may be acquired in a state of being divided into a plurality of phrases, and is not limited to acquisition in units of songs, and may be acquired in units of phrases. The manner in which the song data 14a is stored in the data storage unit 14 is not limited to the music unit. Further, the acquisition destination of the singing data 14a is not limited to the storage unit, and an external device through the communication I / F 22 may be the acquisition destination. Alternatively, the CPU 10 may acquire the information by the user editing or creating the electronic musical instrument 100.

Although the present invention has been described in detail based on its preferred embodiments, the present invention is not limited to these specific embodiments, and various embodiments within the scope of the present invention are also included in the present invention. included.

Note that the storage medium storing the control program represented by the software for achieving the present invention may be read out to the present instrument to achieve the same effect, in which case, the storage medium is read from the storage medium. The program code itself implements the novel functions of the present invention, and the non-transitory computer readable recording medium storing the program code constitutes the present invention. Also, the program code may be supplied via a transmission medium or the like, in which case the program code itself constitutes the present invention. In addition to ROMs, floppy disks, hard disks, optical disks, magneto-optical disks, CD-ROMs, CD-Rs, magnetic tapes, non-volatile memory cards, etc. can be used as storage media in these cases. The “non-transitory computer readable recording medium” is a volatile memory (for example, a server or client internal to the computer system when the program is transmitted via a network such as the Internet or a communication line such as a telephone line) It also includes one that holds a program for a fixed time, such as a dynamic random access memory (DRAM).

10 CPU (data acquisition unit, detection unit, sound generation control unit, determination unit)
14a Data for singing

Claims

A data acquisition unit for acquiring song data including plural consecutive segments including syllable information as a basis of pronunciation;
A detection unit for detecting a section designating operation for designating a next sound generation target section among the song data acquired by the data acquisition section;
A sound generation control unit for generating a predetermined singing sound different from the singing sound based on the singing instruction in response to the detection of the section designating operation by the detecting unit.
And a determination unit configured to determine the next sound generation target section based on the section designation operation detected by the detection section,
The sound generation control unit starts sound generation of the predetermined song sound in response to detection of a section designation operation indicating designation start by the detection unit, and at least the next sound generation target section is determined by the determination unit. The sound generation device according to claim 1, wherein the sound generation of the predetermined singing sound is continued until:
The sound generation device according to claim 2, wherein the determination unit determines the next sound generation target interval in response to a detection of a section designation operation indicating designation end by the detection unit.
It has an instruction acquisition unit for acquiring the instruction of the singing,
The sound generation control unit is configured to sing the syllable information defined in a predetermined order among the plurality of syllable information in the song data in response to the song acquisition instruction being acquired by the instruction acquisition unit. Item 4. A sound generator according to any one of Items 1 to 3.
The sound generation control unit sings syllable information corresponding to a predetermined position in the next sound generation target section in response to the instruction acquisition section acquiring a singing instruction after the next sound generation target section is determined. The sound generator according to claim 4.
The sound generation control unit, after the next sound generation target section is determined, until the singing of syllable information corresponding to the predetermined position is started in response to acquisition of a singing instruction by the instruction acquiring unit. The sound generator according to claim 5, wherein the sound generation of a predetermined singing sound is continued.
The sound generation control unit changes the sound generation pitch of the predetermined singing sound to the specified sound pitch when obtaining an instruction to specify the pitch during the generation of the predetermined singing sound. The sound generator according to any one of 6.
A data acquisition step of acquiring singing data including a plurality of continuous sections including syllable information as a basis of pronunciation;
A detection step of detecting a section designating operation for designating a next sound generation target section among the song data acquired by the data acquisition step;
A sound generating step of generating a predetermined singing sound different from the singing sound based on the singing instruction in response to the detection of the section designating operation in the detecting step.