JP6888351B2 - Input device, speech synthesizer, input method, and program - Google Patents

Description

The present invention relates to a technique for synthesizing a singing voice in real time according to a user's operation.

There is known a technique for synthesizing and reproducing a singing voice in real time according to a performance by a user and input of lyrics. For example, Non-Patent Document 1 describes a singing voice synthesizer having a key for inputting a vowel and a key for inputting a performance.

"Singing Keyboard Pocket Miku", [online], April 3, 2014, [Search March 6, 2017], Internet <URL: http://otonanokagaku.net/nsx39/>

In the technique described in Non-Patent Document 1, there is a problem that the lyrics that can be input are only vowels and the synthesized singing voice is monotonous.
On the other hand, an object of the present invention is to provide an input device capable of inputting vowels and consonants into a speech synthesizer with a simple operation.

In the present invention, one of the vowels and consonants of the lyrics of the singing voice synthesized by the singing synthesis control device is designated by the operation on the operator, and the other of the vowels and consonants is used as the movement of the own device. Provided is an input device having a second designated unit designated accordingly and a transmitting unit that transmits the designated vowels and consonants to the singing synthesis control device.

The input device has a gripped portion having a contact surface that comes into contact with the user's finger in use, and the operator may be provided on the contact surface of the gripped portion.

The second designation unit may designate the other of the vowel and the consonant according to the direction in which the input device is moved.

The singing synthesis control device includes an input device having any of the above configurations and a singing synthesis control device, and the singing synthesis control device includes a receiving unit that receives the designated vowels and consonants from the input device, and one or more controls. An operation detection unit that detects an operation on one or more controls, a determination unit that determines the pitch according to the operator whose operation is detected by the operation detection unit, and a vowel received by the reception unit. And a voice synthesizer having a voice synthesizer that generates a synthetic voice having a consonant and a pitch determined by the determination unit.

According to the present invention, it is possible to provide an input device capable of inputting vowels and consonants into a speech synthesizer with a simple operation.

The figure which illustrates the schematic structure of the voice synthesis apparatus which concerns on one Embodiment of this invention. The figure which illustrates the structure of the gripped part 11. The figure which illustrates the relationship between the movement of the input device 10 and the designated consonant. The figure which illustrates the functional structure of the input device 10 and the singing synthesis control device 20. The flowchart which shows the operation of the input device 10 and the singing synthesis control device 20. The figure which illustrates the structure of the gripped part 11 which concerns on the modification. The figure which illustrates the relationship between the movement of the gripped portion 11 and the designated consonant which concerns on a modification. The figure which illustrates the structure of the gripped part 11 which concerns on another modification. The figure which shows the relationship between the movement of the gripped part 11 and the designated consonant which concerns on another modification. The flowchart which shows the operation of the input device and the singing synthesis control device which concerns on a modification.

1. 1. Configuration FIG. 1 is a diagram illustrating a schematic configuration of a speech synthesizer 1 according to an embodiment of the present invention. The voice synthesizer 1 is a device that synthesizes singing voice in real time. The voice synthesis device 1 includes an input device 10 and a singing synthesis control device 20. At least lyrics and pitch information are required for singing speech synthesis. In this example, the lyrics are input by the input device 10, and the pitch is input by the singing synthesis control device 20. In order to transmit the lyrics input by the input device 10, the input device 10 and the singing synthesis control device 20 are connected by using a cable 30 for transmitting and receiving information. However, the input device 10 and the singing synthesis control device 20 may be connected wirelessly instead of being wired.

The song synthesis control device 20 is a device that performs song synthesis. In this example, the singing synthesis control device 20 has an appearance that imitates a keyboard instrument exemplified by an electronic piano. The song synthesis control device 20 includes an operation unit 21 on the front surface. The operation unit 21 has a plurality of controls 211 that imitate a key. The singing synthesis control device 20 controls the synthesis of singing voices based on the lyrics input from the input device 10 and the pitch determined in response to the operation of pressing any of the controls 211.

The input device 10 is a device for inputting lyrics. The lyrics are composed of a combination of vowels and consonants. The input device 10 has a rod-like shape. The input device 10 includes a gripped portion 11 and a light emitting portion 12. The gripped portion 11 is a portion gripped by the user. The light emitting unit 12 is a portion that emits light. In this way, the input device 10 also functions as a lighting fixture exemplified by a chemical light. A known technique is used for the light emitting unit 12 and its control.

FIG. 2 is a diagram illustrating the configuration of the gripped portion 11. The gripped portion 11 has a contact surface 11A that comes into contact with the user's finger in the used state. A plurality of switches 111 to 116 are provided on the contact surface 11A. The switch provided on the contact surface 11A is, for example, a momentary type push type switch. According to this switch, on is input while these switches are pressed, and off is input while the switches are not pressed. The switch does not have to be a push type as long as it can be input on / off.

In this embodiment, the vowels and consonants that make up the lyrics are designated by the operation of switches 111 to 114. For example, [a] (a) is specified while only the switch 111 is pressed. While only switch 112 is pressed, [i] (i) is specified. While only switch 113 is pressed, [u] is specified. While only switches 111 and 112 are pressed, [e] is specified. While only switches 111 and 113 are pressed, [o] (o) is specified.

While the switch 114 is pressed, the use of a yoon (semivowel) is specified. For example, the yoon of [ka] (ka) is [kja] (ka). Therefore, while the switch 114 is pressed, it is specified that a semivowel [j] is inserted immediately before the vowel [a] in order to express the yoon.

The vowels and consonants of the lyrics are designated by the operation of switches 115 and 116 and the movement of the input device 10. In this example, the "movement" of the input device 10 is a change (that is, movement) in the position of the input device 10 due to the shaking of the input device 10.

Further, in this embodiment, the clear sound is specified by the movement of the input device 10, the presence / absence of the use of the voiced sound is specified by the operation of the switch 115, and the presence / absence of the use of the semi-voiced sound is specified by the operation of the switch 116. For example, when [k] (or line) is specified as a consonant and the use of voiced sound is specified, [g] (ga line) is specified. When [h] (ha line) is specified as a consonant and the use of handakuon is specified, [p] (pa line) is specified.

FIG. 3 is a diagram illustrating the relationship between the movement of the input device 10 and the designated consonant. Here, the central axis extending from the bottom to the top of the input device 10 is defined as "L". [K] is designated while the input device 10 is swung in the axial direction of the central axis L, and [h] is designated while the input device 10 is swung in the opposite direction. While the input device 10 is swung in the direction rotated 45 degrees clockwise with respect to the central axis L, [s] is swung in the opposite direction, and [m] is swung in the opposite direction. (Ma line) is specified. While the input device 10 is swung in the direction rotated 90 degrees clockwise with respect to the central axis L, [t] (row) is swung in the opposite direction, [y]. (Or line) is specified. While the input device 10 is swung in the direction rotated 135 degrees clockwise with respect to the central axis L, [n] (na line) is swung in the opposite direction, while [r] is swung. (Ra line) is specified. If the input device 10 is not swung in either direction, [a] (A line) is specified. When the input device 10 is swung in a direction other than the direction indicated by the arrow shown in FIG. 3, the consonant corresponding to the closest direction is designated.

The relationship between the movement of the input device 10 and the designated consonant is not limited to the example of FIG. In the example of FIG. 3, when the input device 10 is used upright on the ground, consonants are defined according to the movement of the input device 10 on a surface substantially perpendicular to the ground. However, the central axis L in the example of FIG. 3 may be set laterally in the input device 10 (specifically, in the direction perpendicular to the surface of the gripped portion 11 where the switch is provided). According to this example, consonants are defined according to the movement of the input device 10 on a plane substantially horizontal to the ground.

The sounds [wa], [o], and [n] are specified by, for example, turning on the switch 115 and not moving the input device 10. Further, when expressing small characters such as [ya] and [yu] [yo], a switch for designating these characters may be provided separately.

FIG. 4 is a diagram illustrating the functional configurations of the input device 10 and the song synthesis control device 20. The input device 10 includes an operation detection unit 101, a first designation unit 102, a motion detection unit 103, a second designation unit 104, and a transmission unit 105. The operation detection unit 101 detects the operation state of the switches 111 to 116 based on the signals input from the switches of the switches 111 to 116. The first designation unit 102 designates a vowel among the vowels and consonants of the lyrics according to the operation state of the switches 111 to 114 detected by the operation detection unit 101. The motion detection unit 103 detects the motion of the input device 10. In this embodiment, the motion detection unit 103 detects at least the moved direction (swinged direction) of the input device 10 based on information from a sensor (not shown). Sensors include, for example, 2-axis or 3-axis accelerometers. The motion detection unit 103 detects the motion of the input device 10 based on, for example, the acceleration measured by the acceleration sensor, the velocity obtained from the acceleration, and the magnitude of the displacement. The motion detection unit 103 may detect the motion of the input device 10 by using a sensor other than the acceleration sensor. The second designation unit 104 sets the consonants of the vowels and consonants of the lyrics to the movement of the input device 10 detected by the motion detection unit 103 and the operation state of the switches 115 and 116 detected by the operation detection unit 101. Specify according to. The transmission unit 105 transmits the vowels designated by the first designated unit 102 and the consonants designated by the second designated unit 104 to the singing synthesis control device 20.

Each function of the input device 10 is equipped with an arithmetic processing unit exemplified by a CPU (Central Processing Unit), a memory exemplified by a ROM (Read only memory) and a RAM (Random access memory), a communication module, and the like. Implemented by the processor. Each function of the input device 10 is implemented by, for example, a processor and a program executed by the processor. Further, the function of the input device 10 may be implemented by two or more processors or programs.

The singing synthesis control device 20 includes a reception unit 201, an operation detection unit 202, a determination unit 203, a synthesis instruction unit 204, a voice synthesis unit 205, and a voice output unit 206. The receiving unit 201 receives the vowels and consonants of the lyrics from the input device 10 (transmitting unit 105). The operation detection unit 202 is based on the signal input from each operator 211 of the operation unit 21.
The operation status of each operator 211 is detected. The determination unit 203 determines the pitch according to the operator 211 pressed by the user based on the detection result of the operation detection unit 202. The synthesis instruction unit 204 instructs the voice synthesis unit 205 to synthesize the singing voice based on the consonants and vowels received by the reception unit 201 and the pitch determined by the determination unit 203. The voice synthesis unit 205 synthesizes the singing voice according to the synthesis instruction from the synthesis instruction unit 204 to generate the singing voice (synthetic voice). The voice synthesis unit 205 outputs a sound signal indicating the synthesized singing voice to the voice output unit 206. The voice output unit 206 outputs sound according to the sound signal output from the voice synthesis unit 205.

The functions of the reception unit 201, the operation detection unit 202, the determination unit 203, the synthesis instruction unit 204, and the voice synthesis unit 205 are the arithmetic processing unit exemplified by the CPU, the memory exemplified by the ROM and RAM, and the communication module. It is implemented by a processor equipped with such as. Each function of the song synthesis control device 20 is implemented by, for example, a processor and a program executed by the processor. Further, the function of the song synthesis control device 20 may be implemented by two or more processors or programs. The audio output unit 206 includes, for example, a signal processing circuit, an amplifier, and a speaker.

2. Operation FIG. 5 is a flowchart showing the operation of the input device 10 and the song synthesis control device 20. The flow of FIG. 5 is executed, for example, during the period when the power of the input device 10 and the song synthesis control device 20 is turned on.

In the input device 10, the first designation unit 102 determines whether or not at least one of the switches 111 to 113 has been pressed based on the detection result of the operation detection unit 101 (step S11). When it is determined that none of the switches are pressed (step S11; NO), the first designated unit 102 stands by. When it is determined that at least one of the switches 111 to 113 is pressed (step S11; YES), the first designation unit 102 designates a vowel (step S12). The first designation unit 102 designates one of the vowels [a], [i], [u], [e], and [o] according to the operation state of the switches 111 to 113, and also A semivowel for expressing a yoon is specified according to the operation state of the switch 114.

Next, the motion detection unit 103 detects the motion of the input device 10 (step S13). The second designation unit 104 designates consonants according to the direction in which the input device 10 is moved detected by the motion detection unit 103 and the operation states of the switch 115 and the switch 116 detected by the operation detection unit 101 ( Step S14). The second designation unit 104 includes [a], [k], [s], [t], [n], [h], [m], [g], [z] (sounds), and [d]. Specify one of the consonants of (da line), [b] (ba line), and [p] (pa line).

Next, the transmission unit 105 transmits the designated vowels and consonants to the song synthesis control device 20 (step S15). After this transmission, the processing of the input device 10 is returned to step S11. That is, while at least one of the switches 111 to 113 is pressed, the transmission unit 105 transmits the vowel and the consonant to the song synthesis control device 20.

In the song synthesis control device 20, the receiving unit 201 determines whether or not vowels and consonants have been received from the input device 10 (step S21). When it is determined that the vowels and consonants have not been received (step S21; NO), the receiving unit 201 stands by. When it is determined that the vowel and the consonant have been received (step S21; YES), the determination unit 203 determines whether or not at least one of the controls 211 has been pressed based on the detection result of the operation detection unit 202 (step S21; YES). Step S22). If it is determined that none of the controls 211 has been pressed (step S21; NO), the process of the song synthesis control device 20 is returned to step S21.

When it is determined that at least one of the controls 211 has been pressed (step S22; YES), the determination unit 203 determines the pitch according to the pressed controls 211 (step S23). The determination unit 203 determines the pitch peculiar to the operator 211. The operator 211 is an operator that imitates a key. Therefore, it is preferable that the determination unit 203 determines the higher pitch as the operator 211 corresponding to the key corresponding to the higher pitch is pressed.

The synthesis instruction unit 204 instructs the voice synthesis unit 205 to synthesize the singing voice based on the received consonants and vowels and the determined pitch (step S24). Specifically, the synthesis instruction unit 204 converts the lyrics determined according to the consonants and vowels into phonetic symbols, generates an instruction to synthesize the phonetic symbols and the voice of the determined pitch, and sends the voice synthesis instruction unit 205 to the voice synthesis instruction unit 205. Output. The voice synthesis unit 205 synthesizes the singing voice according to the input synthesis instruction (step S25). Since a known technique can be used for singing voice synthesis, only the outline thereof will be described here. The voice synthesis unit 205 has a piece library. A piece library is a database containing music pieces (fragments of a singing voice) sampled from the voice of a specific singer. The fragment library contains a plurality of fragment data collected from the singing voice waveform of the singer. The elemental piece data refers to voice data obtained by cutting out a phonetic feature part from a singing voice waveform and encoding it.

Here, the case of synthesizing the singing voice of the lyrics [Saita] will be described as an example of the elemental piece data. The lyrics [saita] are phonetic symbols expressed as [saita]. Analyzing the waveform of the voice represented by the phonetic symbol [saita] by characteristics, the rising part of the sound of [s], the sound of [s], the transition part from the sound of [s] to the sound of [a], [ It continues with the sound of [a], and ends with the attenuated part of the sound of [a]. Each piece of data is voice data corresponding to these phonetic feature parts. The elemental transformation library stores elemental data for all sounds and sound combinations. In the following description, the piece data corresponding to the rising part of the sound represented by a certain phonetic symbol is represented as [# s] by adding [#] in front of the phonetic symbol. Further, the elemental piece data corresponding to the attenuated portion of the sound represented by a certain phonetic symbol is represented as [a #] by adding [#] after the phonetic symbol. In addition, the piece data corresponding to the transition part from the sound represented by one phonetic symbol to the sound represented by another phonetic symbol is inserted with [-] between those phonetic symbols, and [s-a]. ] Is expressed as.

For example, the voice [pa] is synthesized by connecting the element data [#p], [p], [pa] and [a] in order. The voice synthesis unit 205 adjusts the pitch after combining these elemental piece data. The voice synthesis unit 205 outputs the sound signal of the synthetic voice whose pitch is adjusted. The voice output unit 206 outputs the synthesized voice according to the sound signal output from the voice synthesis unit 205 (step S26).

Next, the synthesis instruction unit 204 determines whether or not the vowel or consonant received from the input device 10 has changed (step S27). Specifically, the synthesis indicator 204 determines whether at least one of the vowels and consonants has changed, and whether the vowels and consonants are no longer received. When it is determined that there is no change in the vowels and consonants (step S27; NO), the synthesis instruction unit 204 determines whether or not there is a change in pitch (step S28). Specifically, the synthesis instruction unit 204 determines whether the operator 211 is no longer pressed (a finger is released from the operator 211) or another operator 211 is pressed. If it is determined that there is no change in pitch (step S28; NO), the synthesis instruction unit 204 does not instruct the synthesis of a new singing voice. Specifically, the processing of the leaf and singing synthesis control device 20 is returned to step S25, and the voice synthesis unit 205 continues to output the synthetic voice of the same lyrics (characters) using the voice output unit 206 (step S25). , S26). The voice synthesis unit 205 outputs a sound signal that keeps extending the last vowel ([a] in the previous example).

On the other hand, when the synthesis instruction unit 204 determines that the vowel or consonant received from the input device 10 has changed (step S27; YES), or determines that the pitch has changed (step S28; YES). , The process of the singing synthesis control device 20 is returned to step S21.
Then, when the vowel and the consonant are received from the input device 10 (step S21; YES) and the pitch is specified by the operation of the operator 211 (step S22; YES), the synthesis instruction unit 204 is newly added. The voice synthesis unit 205 is instructed to synthesize the singing voice, and the singing voice is synthesized and the synthesized voice is output (steps S23 to S26).

According to the speech synthesizer 1 described above, the user holds the input device 10 with one hand, and can specify the vowels and consonants of the lyrics by the operation of pressing the switch and the operation of moving the input device 10. Further, the user can specify the pitch of the lyrics by operating the singing synthesis control device 20 with the other hand. Therefore, the user can easily specify the vowels, consonants, and pitches of the lyrics and have the singing synthesis control device 20 output the synthesized speech.

3. 3. Modifications The present invention is not limited to the above-described embodiment, and various modifications can be performed. Hereinafter, some modification examples will be described. Two or more of the following modifications may be used in combination.

3-1. Grasped portion 11
FIG. 6 is a diagram illustrating the structure of the gripped portion 11 according to the modified example, and FIG. 7 is a diagram illustrating the relationship between the movement of the gripped portion 11 and the designated consonant. The type and number of switches provided on the contact surface 11A of the gripped portion 11 are not limited to the example of FIG. In this modification, as shown in FIG. 6, on the contact surface 11A, the switch 115 for designating the voiced sound and the 116 for specifying the handakuon are not provided, and instead, a switch 117 for switching the mode is provided. .. While the switch 117 is off, the first designation unit 102 has [a], [k], [s], [t], [n], as consonants, as shown in the figure on the left side of FIG. [H], [m], [y], and [r] can be specified. On the other hand, while the switch 117 is turned on, the first designated unit 102 has [y], [w], [g], [z], and [d] as consonants, as shown in the figure on the right side of FIG. ], [B], [p] can be specified.

FIG. 8 is a diagram illustrating the structure of the gripped portion 11 according to another modification, and FIG. 9 is a diagram illustrating the relationship between the movement of the gripped portion 11 and the designated consonant. The input device 10 may specify a consonant according to the operation of a switch provided on the contact surface 11A and a vowel according to the movement of the input device 10. In this example, as shown in FIG. 8, switches 111 to 114 and 118 are provided on the contact surface 11A as switches for designating consonants. In this case, a total of 16 consonants including clear sound, voiced sound, and semi-voiced sound can be specified by the combination of turning on / off the four switches 111 to 113 and 118. The switch 114 is a switch for designating whether or not to use the yoon, as in the above-described embodiment. As shown in FIG. 9, in this modified example, the first designated unit 106 and the second designated unit 107 are provided in place of the first designated unit 102 and the second designated unit 104. The first designation unit 106 designates a consonant among the vowels and consonants of the lyrics according to the operation state of the switches 111 to 113 and 118 detected by the operation detection unit 101. The second designation unit 107 designates the vowels and consonants of the lyrics of the singing voice according to the operation state of the switch 114 and the movement of the input device 10 detected by the movement detection unit 103. The transmission unit 105 transmits the consonants designated by the first designated unit 106 and the vowels designated by the second designated unit 107 to the singing synthesis control device 20. The configuration of the song synthesis control device 20 may be the same as that of the above-described embodiment.

FIG. 10 is a flowchart showing the operation of the input device 10 and the song synthesis control device 20 according to this modification. The flow of FIG. 10 is executed, for example, while the power of the input device 10 and the song synthesis control device 20 is turned on. In the input device 10, the first designation unit 106 determines whether or not at least one of the switches 111 to 113 and 118 has been pressed based on the detection result of the operation detection unit 101 (step S31). If it is determined that none of the switches are pressed (step S31; NO), the first designated unit 106 stands by. When it is determined that at least one of the switches 111 to 113 and 118 is pressed (step S31; YES), the first designation unit 106 designates a consonant (step S32).

Next, the motion detection unit 103 detects the motion of the input device 10 (step S33). The second designation unit 107 designates a vowel according to the moving direction of the input device 10 detected by the motion detection unit 103 (step S34).

Next, the transmission unit 105 transmits the designated consonants and vowels to the song synthesis control device 20 (step S35). After this transmission, the processing of the input device 10 is returned to step S31. That is, while at least one of the switches 111 to 113 and 118 is pressed, the transmission unit 105 transmits consonants and vowels to the song synthesis control device 20.

3-2. Relationship between the movement of the input device 10 and consonants The relationship between the direction of movement of the input device 10 and the designated consonant described in the above-described embodiment is only an example. For example, a three-axis Cartesian coordinate system may be defined, and different consonants may be associated with each axis direction. Further, the movement of the input device 10 is not limited to the vibration of the input device 10, and may be a change (rotation, twist) of the posture of the input device 10. The input device 10 may be configured to specify a consonant or a vowel according to its movement.

3-3. Other Modifications The specific shape of the input device 10 is not limited to that illustrated in the embodiment. For example, the input device 10 may be a rod-shaped device such as a guide light for traffic control. Further, the input device 10 does not have to have a lighting function, and may be, for example, a cane or a baton. Further, the shape of the input device 10 is not limited to a rod shape, and may be a non-rod shape device such as a dumbbell or a device worn on a part of the user's body (for example, a glove type device). .. Further, the input device 10 may be a portable device (for example, a smartphone). In this case, the input device 10 may detect the movement of the user's finger tracing the surface of the touch screen and specify a vowel or a consonant according to the movement. In this case, it is sufficient that the direction in which the finger moves on the touch screen is associated with the vowel or consonant.

The input device 10 may detect the movement of the input device 10 only during the period when the switch used for designating the vowel or consonant is pressed. As a result, the power consumption of the input device 10 can be expected to be reduced as compared with the case where the movement of the input device 10 is constantly detected.

The controls used to specify vowels or consonants in the input device are not limited to momentary switches. Alternate type switches may be used in place of or in addition to the momentary type switches. Alternatively, or in addition to the switch, a lever, slider, dial, or the like may be used.

The singing synthesis control device 20 may not have an appearance imitating an electronic keyboard instrument, may have an appearance imitating a musical instrument such as a stringed instrument, a wind instrument, or a wind instrument, or may imitate an instrument. It does not have to be the appearance. The singing synthesis control device 20 may have at least a function of controlling the synthesis of the singing voice. The number of controls included in the operation unit 21 may be any number as long as it is 1 or more.

A part of the configuration or operation of the input device 10 and the song synthesis control device 20 described in the above-described embodiment may be omitted. For example, the input device 10 may be configured not to specify at least one of a yoon, a voiced sound, and a semi-voiced sound.

1 ... Voice synthesizer, 10 ... Input device, 101 ... Operation detection unit, 102 ... First designated unit, 103 ... Motion detection unit, 104 ... Second designated unit, 105 ... Transmitting unit, 106 ... First designated unit, 107 ... 2nd designated unit, 11 ... gripped unit, 11A ... contact surface, 111-118 ... switch, 12 ... light emitting unit, 20 ... singing synthesis control device, 201 ... receiver unit, 202 ... operation detection unit, 203 ... determination unit , 204 ... synthesis instruction unit, 205 ... voice synthesis unit, 206 ... voice output unit, 21 ... operation unit, 211 ... operator, 30 ... cable.

Claims (7)

The first designated part that specifies one of the vowels and consonants of the lyrics of the singing voice synthesized by the singing synthesis control device according to the operation on the operator, and
A second designated part that specifies the other of the vowels and consonants according to the movement of the own device, and
An input device having a transmission unit that transmits the designated vowels and consonants to the singing synthesis control device. It has a gripped portion that has a contact surface that comes into contact with the user's finger in use.
The input device according to claim 1, wherein the operator is provided on the contact surface of the gripped portion. The input device according to claim 1 or 2, wherein the second designated unit designates the other of the vowel and the consonant according to the direction in which the input device is moved. The input device is a device separate from the singing synthesis control device having an operator for inputting pitch.
The input device according to claim 1 or 2. The input device according to any one of claims 1 to 4 and
Equipped with a singing synthesis control device
The singing synthesis control device is
A receiving unit that receives the specified vowels and consonants from the input device, and
With one or more controls,
An operation detection unit that detects an operation on one or more controls, and an operation detection unit.
It has a determination unit that determines the pitch according to the operator whose operation is detected by the operation detection unit, the vowels and consonants received by the reception unit, and a pitch determined by the determination unit. A voice synthesizer having a voice synthesizer that generates a synthetic voice. In the input device, a step of designating one of the vowels and consonants of the lyrics of the singing voice synthesized by the singing synthesis control device according to the operation on the controller, and
In the input device, a step of designating the other of the vowel and the consonant according to the movement of the own device, and
A step in which the input device transmits the designated vowels and consonants to the song synthesis control device.
Input method with. Computer,
The first designated part that specifies one of the vowels and consonants of the lyrics of the singing voice synthesized by the singing synthesis control device according to the operation on the operator, and
A second designated part that specifies the other of the vowels and consonants according to the movement of the own device, and
With a transmitter that transmits the specified vowels and consonants to the singing synthesis control device
A program to make it work.

Images