JP2002354111A - Voice signal synthesizing device, method, program and recording medium for recording the program - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide a voice signal synthesizing device that synthesizes voice signals with high quality in the case of synthesizing the voice signals. SOLUTION: A microphone 12 transduces a voice (OGM: a response message by an automatic telephone message recorder) into a 1st voice signal and a BGM reproduction section 24 allows a BGM recording section 22 to output a BGM (2nd voice signal). A voice signal synthesizing section 30 synthesizes the 1st and 2nd voice signals. Since the BGM (2nd voice signal) is not sounded from a speaker 52 and deterioration in the case of converting the BGM into voice can be prevented, the quality of the synthesized voice signal can be enhanced.

Description

DETAILED DESCRIPTION OF THE INVENTION

[0001]

The present invention relates to speech synthesis in a communication terminal device.

[0002]

2. Description of the Related Art Conventionally, there is a type of communication terminal device such as a portable telephone having an answering machine function. The answering machine function is a function that, when an incoming call is received, sends an answering machine answer message (OGM) for notifying that the user is not present to the other party, and then records a message transmitted from the other party.

[0003] In a mobile phone having a voice recording function, which has become popular in recent years, voice recorded through a microphone provided in the mobile phone can be used as OGM. Thus, a user-specific OGM can be created.

[0004] In addition, a user's own OGM stores B
It is also conceivable to add GM (Back Ground Music). In this case, the BGM is recorded on the mobile phone,
It can be reproduced from the speaker of the mobile phone. So, OGM
When the BGM is added to the sound, the voice, which is the OGM unique to the user, and the BGM reproduced from the speaker of the mobile phone are simultaneously recorded through the microphone.

[0005]

However, if the speaker and the microphone are too close, the BGM to be recorded is relatively too large, and if the speaker and the microphone are too far apart,
There is a problem that the recorded BGM becomes relatively too small. In addition, BGM is reproduced from a speaker of a mobile phone, and the reproduced sound is recorded through a microphone, so that quality degradation is inevitable.

SUMMARY OF THE INVENTION It is an object of the present invention to provide an audio signal synthesizing apparatus or the like which can perform high-quality synthesis in audio synthesis in which BGM is added to OGM.

[0007]

SUMMARY OF THE INVENTION The present invention relates to an audio signal synthesizer. An audio signal synthesizing device according to the present invention includes an audio signal converting unit, an audio signal recording unit, and an audio signal synthesizing unit. The audio signal conversion means converts the audio to a first audio signal. The audio signal recording means records the second audio signal. The audio signal synthesizing unit synthesizes the first audio signal and the second audio signal and outputs a synthesized audio signal.

[0008] The audio signal referred to here is a signal obtained by converting audio into an analog or digital signal.

According to the present invention, the second audio signal is synthesized with the first audio signal as it is. Therefore, it is possible to prevent deterioration when converting the second audio signal into audio, so that the quality of the synthesized audio signal can be improved.

[0010]

Embodiments of the present invention will be described below with reference to the drawings.

FIG. 1 is a block diagram showing a configuration of a mobile phone 1 according to a first embodiment of the present invention. The mobile phone 1 includes a microphone (sound signal conversion means) 12, an A / D converter 14, a BGM
Recording unit (audio signal recording unit) 22, BGM reproducing unit 24,
It includes an audio signal synthesizing unit 30, an audio CODEC unit 42, a synthesized audio signal recording unit 44, a synthesized audio signal output unit 46, a communication circuit control unit 48, and a speaker 52.

A microphone (sound signal conversion means) 12 converts a sound into a first sound signal which is an analog signal and outputs the first sound signal. The voice is, for example, an answering machine answering message (OGM) such as “I am out of the office now” spoken by the user. The A / D converter 14 receives the input of the analog signal output from the audio signal synthesizer 30, converts it into a digital signal, and outputs the digital signal.

BGM recording section (audio signal recording means) 22
Records BGM (Back Ground Music) added to OGM. The BGM recording unit (audio signal recording means) 2
Reference numeral 2 records, in addition to the BGM, a ring tone (sound for notifying the user of an incoming call) and a hold tone (sound transmitted to the other party of the call when the call is on hold). BGM corresponds to the second audio signal. The BGM reproducing unit 24 converts the second audio signal into a BG
It is read from the M recording unit (audio signal recording unit) 22 and output to the audio signal synthesis unit 30. Here, the BGM playback unit 2
4 outputs the second audio signal as an analog signal. Further, the BGM reproducing unit 24 outputs the second audio signal to the speaker 52 as an analog signal.

The audio signal synthesizing section 30 synthesizes the OGM-converted first audio signal and the BGM second audio signal and outputs an OGM with BGM (synthesized audio signal). However, when the input of the first audio signal is cut off, the second audio signal is output. When the input of the second audio signal is cut off, the first audio signal is output.

The audio CODEC 42 encodes and outputs a digital audio signal synthesized by the A / D converter 14. The synthesized voice signal recording unit 44 records the synthesized voice signal output by the voice CODEC unit 42. The synthesized voice signal output unit 46 receives an OG with BGM from the communication circuit control unit 48.
When there is a request for M (synthesized voice signal) output, OGM with BGM (synthesized voice signal) is read from the voice signal recording unit 44 and output to the communication circuit control unit 48. Communication circuit controller 4
Reference numeral 8 controls data exchange between the mobile phone 1 and the communication circuit. Note that the communication circuit control unit 48 has an OG with BGM.
A request for M (synthesized voice signal) output and a request for holding sound output are made.

The speaker 52 outputs the BGM reproduced by the BGM reproducing section 24 as sound.

FIG. 2 shows a modified example of the configuration of the mobile phone 1 according to the first embodiment of the present invention. The difference is that the A / D converter 14 is arranged before the audio signal synthesizer 30 as compared with the example of FIG.

The A / D converter 14 converts an analog signal output from the microphone (audio signal converter) 12 into a digital signal and outputs the digital signal. This output result is the first audio signal. Here, the A / D converter 14 also constitutes an audio signal converter together with the microphone 12.

The BGM reproducing section 24 outputs the second audio signal as a digital signal. The audio signal synthesizing unit 30 outputs A /
The first audio signal output from the D conversion unit 14 and the second audio signal that is BGM are combined to output an OGM with BGM (synthesized audio signal). OGM with BGM (synthesized audio signal) is a PCM output.

Next, the operation of the first embodiment will be described.

First, an OGM is recorded on the mobile phone 1. O
The operation of GM recording will be described with reference to the flowchart of FIG. First, the user of the mobile phone 1 selects whether or not to add BGM to OGM (S10).

If BGM is added (S10, Ye
s) The output of the BGM reproducing unit 24 is only the second audio signal, and is not output to the speaker 52 (S20). Then, recording is started by pressing a recording button (S2).
2). Then, the microphone 12 (or the A / D converter 1)
4), the first audio signal is obtained (S24a),
4 to the second audio signal (S24b), the audio signal synthesis unit 3
Output to 0. The first audio signal and the second audio signal are synthesized by the audio signal synthesizing unit 30 to be an OGM with BGM (synthesized audio signal) (S26). The OGM with BGM (synthesized audio signal) is converted by the A / D converter 14 and the audio CODEC 4
2 (or only the audio CODEC unit 42) and is output to the synthesized audio signal recording unit 44 and recorded (S28). Then, it is determined whether or not the end of the recording is instructed. If it is not ended, that is, if the recording is still continued (S30, N
o), output of the first audio signal and the second audio signal (S24)
a, Return to S24b). If the recording end is instructed by pressing the recording end button or the like (S30, Yes),
The process ends.

If BGM is not added (S10, N
o), the input of the audio signal synthesis unit 30 is only the first audio signal (S40). Then, recording is started by pressing a recording button or the like (S42). Then, the first audio signal is output from the microphone 12 (or the A / D converter 14) (S44).
Is output to the audio signal synthesis unit 30. The audio signal synthesizer 30 outputs the first audio signal as it is. The first audio signal is supplied to the synthesized audio signal recording unit 4 via the A / D converter 14 and the audio CODEC 42 (or only the audio CODEC 42).
4 and recorded (S48). Then, it is determined whether or not the end of the recording is instructed. If the end is not completed, that is, if the recording is still continued (S50, No), the process returns to the output of the first audio signal (S44). If the end of recording is instructed by pressing the end recording button or the like (S50, Ye
s), end the process.

After recording the OGM on the portable telephone 1, if there is an incoming call on the portable telephone 1, the recorded OGM is used.
The operation of such an incoming call will be described with reference to the flowchart of FIG.

First, when there is an incoming call to the mobile phone 1, if the ring tone is set to be output (S100, Yes), B
The output of the GM reproducing unit 24 is supplied only to the speaker 52 (S102). Then, the BGM reproducing unit 24 reproduces the BGM or the ringtone (S104) and outputs it from the speaker. In the case of setting not to output a ringtone (S100, N
o), the vibrator is vibrated (S106). In addition,
The description of the vibrator provided in the mobile phone is omitted because it is well known. The user is notified of the incoming call as described above.

The mobile phone 1 determines whether or not the busy tone has reached the set number of times (S110). If it has reached (S110, Yes), the user is unable to answer the mobile phone 1, and thus fulfills the function of answering machine. That is, the communication circuit control unit 48
The output of M (synthesized speech signal) is requested to the synthesized speech signal output unit 46 (S112). The synthesized voice signal output unit 46 outputs an OGM with BGM (synthesized voice signal) from the voice signal recording unit 44.
Is read (S114). Then, the synthesized voice signal output unit 46 outputs the OGM with BGM (synthesized voice signal) to the communication circuit via the communication circuit control unit 48 (S11).
6).

If the busy tone has not reached the set number of times (S110, No), it is determined whether or not an off-hook has been performed (S120). If not off-hook (S120,
No), the process returns to the determination of the number of busy tones (S110).
If the user is off-hook (S120, Yes), the call or call is put on hold (S122), and the process is terminated as appropriate.

At the time of holding (S122), a holding sound is generated. The procedure will be described with reference to the flowchart of FIG. First, it is determined whether or not the output of BGM is set when suspended (S124). B
If the GM is output (S124, Yes), the input of the audio signal synthesizing unit 30 is set to only the second audio signal (S12).
6). Then, the BGM reproducing unit 24 reproduces the BGM (S128). Then, the A / D converter 14 and the audio CODEC
The BGM is output to the communication circuit control unit 48 via the unit 42 (or only the audio CODEC unit 42), and the BGM is transmitted to the other party via the communication line. If the BGM is not output (S124, No), the BGM reproducing unit 24 reproduces the hold sound (S130). Then, the A / D converter 14, the audio
The hold sound is output to the communication circuit control unit 48 via the CODEC unit 42 (or only the voice CODEC unit 42), and the hold sound is transmitted to the other party via the communication line. If the hold is not released (S132, No), the process returns to the output setting determination (S124), and if the hold is released (S132,
Yes), ends the suspension processing.

According to the first embodiment, the second audio signal (BGM) is synthesized with the first audio signal (OGM) as it is. Accordingly, it is possible to prevent deterioration when the second audio signal (BGM) is converted into audio, so that the synthesized audio signal (BGM)
OGM with GM) can be made high quality.

Also, a synthesized speech signal (OGM with BGM)
Is recorded in the synthesized voice signal recording unit 44, so that a synthesized voice signal (OGM with BGM) can be transmitted as necessary.

Second Embodiment A portable telephone 1 according to a second embodiment is different from the first embodiment in that the audio signal synthesizing unit 30 synthesizes an audio signal when a request from the synthesized audio signal output unit 46 is made. Different from the embodiment. Hereinafter, the same parts as those in the first embodiment are denoted by the same reference numerals, and description thereof will be omitted.

FIG. 6 is a block diagram showing the configuration of the mobile phone 1 according to the second embodiment of the present invention. Mobile phone 1
Is a microphone (audio signal conversion means) 12, an A / D conversion unit 1
4, OGM recording unit 16, BGM recording unit (audio signal recording unit) 22, BGM reproducing unit 24, audio signal synthesizing unit 30, audio CODEC unit 42, synthesized audio signal recording unit 44, synthesized audio signal output unit 46, communication circuit The control unit 48 includes a speaker 52.

Microphone (audio signal conversion means) 12, A / D
The conversion unit 14 is the same as in the first embodiment. The OGM recording unit 16 records the output of the microphone (audio signal conversion unit) 12.

BGM recording section (audio signal recording means) 22,
The BGM reproducing unit 24 is the same as in the first embodiment.

The audio signal synthesizing section 30 is provided with the OGM recording section 16.
And the second audio signal, which is BGM, is synthesized to output an OGM with BGM (synthesized audio signal). However, when the input of the first audio signal is cut off, the second audio signal is output. When the input of the second audio signal is cut off, the first audio signal is output.

The voice CODEC 42 is the same as in the first embodiment. The synthesized voice signal output unit 46 includes the communication circuit control unit 4
8, if there is a request for an OGM with BGM (synthesized audio signal) output, the audio signal synthesizing unit 30 requests the audio signal synthesizing unit 30 to synthesize an audio signal,
(Synthesized voice signal) is read and output to the communication circuit control unit 48. The communication circuit control unit 48 is the same as in the first embodiment.

The speaker 52 is the same as in the first embodiment.

FIG. 7 shows a modified example of the configuration of the mobile phone 1 according to the second embodiment of the present invention. The difference is that the A / D conversion unit 14 is arranged before the OGM recording unit 16 as compared with the example of FIG.

The A / D converter 14 converts an analog signal output by the microphone (sound signal converter) 12 into a digital signal and outputs the digital signal. This output result is the first audio signal. Here, the A / D converter 14 also constitutes an audio signal converter together with the microphone 12. The first audio signal is recorded in the OGM recording unit 16.

The BGM reproducing section 24 outputs the second audio signal as a digital signal. The audio signal synthesis unit 30
The first audio signal recorded in the M recording unit 16 and the second audio signal, which is BGM, are synthesized to output an OGM with BGM (synthesized audio signal). OGM with BGM (synthesized voice signal)
Is a PCM output.

Next, the operation of the second embodiment will be described.

First, the OGM is recorded on the mobile phone 1. O
The GM recording operation will be described with reference to the flowchart of FIG.

First, recording is started by pressing a recording button or the like (S42). Then, the microphone 12 (or A /
The first audio signal is output from the D conversion unit 14) (S4).
4). Then, the first audio signal is recorded in the OGM recording unit 16 (S48). Then, it is determined whether or not the end of the recording has been instructed. If the recording has not been completed, that is, if the recording is still continued (S50, No), the output of the first audio signal (S4).
Return to 4). If the recording end is instructed by pressing the recording end button or the like (S50, Yes), the process ends.

After recording the OGM on the mobile phone 1, if there is an incoming call on the mobile phone 1, the recorded OGM is used.
Such an incoming call operation will be described with reference to the flowchart of FIG.

First, when there is an incoming call to the mobile phone 1, if the setting is to output a ringtone (S100, Yes), B
The output of the GM reproducing unit 24 is supplied only to the speaker 52 (S102). Then, the BGM reproducing unit 24 reproduces the BGM or the ringtone (S104) and outputs it from the speaker. In the case of setting not to output a ringtone (S100, N
o), the vibrator is vibrated (S106). In addition,
The description of the vibrator provided in the mobile phone is omitted since it is well known. The user is notified of the incoming call as described above.

The mobile phone 1 determines whether or not the busy tone has reached the set number of times (S110). If it has reached (S110, Yes), the user is unable to answer the mobile phone 1, and thus fulfills the function of answering machine. That is, the communication circuit control unit 48
The output of M (synthesized speech signal) is requested to the synthesized speech signal output unit 46 (S112). The synthesized voice signal output unit 46 requests the voice signal synthesis unit 30 to synthesize a voice signal (S14).
2). Upon receiving the request, the audio signal synthesis unit 30 synthesizes the first audio signal and the second audio signal to generate a synthesized audio signal (S144). The synthesized voice signal is supplied to the A / D converter 14
The voice signal is output to the synthesized voice signal output unit 46 via the voice CODEC unit 42 (or only the voice CODEC unit 42). Then, the synthesized voice signal output unit 46 outputs the OGM with BGM (synthesized voice signal) to the communication circuit via the communication circuit control unit 48 (S116).

If the busy tone has not reached the set number of times (S110, No), it is determined whether or not an off-hook has been performed (S120). If not off-hook (S120,
No), the process returns to the determination of the number of busy tones (S110).
If the user is off-hook (S120, Yes), the call or call is put on hold (S122), and the process is terminated as appropriate.

At the time of holding (S122), a holding sound is generated. The procedure is the same as that of the first embodiment, and the description is omitted (see FIG. 5).

According to the second embodiment, the second audio signal (BGM) is synthesized as the audio signal with the first audio signal (OGM). Accordingly, it is possible to prevent deterioration when the second audio signal (BGM) is converted into audio, so that the synthesized audio signal (BGM)
OGM with GM) can be made high quality.

Also, a synthesized voice signal (OGM with BGM)
After the output of is requested, a synthesized speech signal (OGM with BGM) can be transmitted as needed to generate a synthesized speech signal.

The above embodiment can be realized as follows. CPU, hard disk, flash memory, media (floppy (registered trademark) disk, C
(A D-ROM, a memory stick, etc.) A media reading device of a computer having a reading device is made to read a medium recording a program for realizing the above-described respective portions, and is installed on a hard disk, a flash memory, or the like. Even with such a method, the above function can be realized.

[0052]

According to the present invention, the second audio signal is synthesized as it is with the first audio signal. Therefore, it is possible to prevent deterioration when converting the second audio signal into audio, so that the quality of the synthesized audio signal can be improved.

[Brief description of the drawings]

FIG. 1 is a block diagram showing a configuration of a mobile phone 1 according to a first embodiment of the present invention.

FIG. 2 is a block diagram showing a configuration of a mobile phone 1 according to a modification of the first embodiment of the present invention.

FIG. 3 is a flowchart illustrating an operation of recording an OGM.

FIG. 4 is a flowchart showing an incoming call operation.

FIG. 5 is a flowchart illustrating a procedure for generating a hold sound;

FIG. 6 is a block diagram illustrating a configuration of a mobile phone 1 according to a second embodiment of the present invention.

FIG. 7 is a block diagram showing a configuration of a mobile phone 1 according to a modification of the second embodiment of the present invention.

FIG. 8 is a flowchart showing an operation of recording an OGM.

FIG. 9 is a flowchart showing an incoming call operation.

[Explanation of symbols]

 Reference Signs List 1 mobile phone 12 microphone (audio signal conversion means) 14 A / D conversion section 22 BGM recording section (audio signal recording means) 24 BGM reproduction section 30 audio signal synthesis section 42 audio CODEC section 44 synthesized audio signal recording section 46 synthesized audio signal Output unit 48 Communication circuit control unit 52 Speaker

Claims (8)

[Claims] 1. An audio signal converting means for converting audio into a first audio signal, an audio signal recording means for recording a second audio signal, and synthesizing and synthesizing the first audio signal and the second audio signal. An audio signal synthesizing unit that outputs an audio signal. 2. The audio signal synthesizing device according to claim 1, wherein said synthesized audio signal recording means for recording said synthesized audio signal, and said synthetic audio signal recording when an output of said synthesized audio signal is requested. And a synthesized voice signal output means for reading and outputting the synthesized voice signal from the means. 3. The audio signal synthesizing device according to claim 1, wherein when an output of a synthesized audio signal is requested, the audio signal synthesizing means outputs the first audio signal and the second audio signal to each other. An audio signal synthesizer comprising a synthesized audio signal output unit for requesting synthesis and outputting the synthesized audio signal. 4. The audio signal synthesizing device according to claim 1, wherein said audio signal converting means converts said first audio signal into an analog signal. 5. The audio signal synthesizing device according to claim 1, wherein said audio signal converting means converts said first audio signal into a digital signal. 6. An audio signal synthesizing method in an audio signal synthesizing apparatus comprising: audio signal converting means for converting audio into a first audio signal; and audio signal recording means for recording a second audio signal. An audio signal synthesizing method comprising an audio signal synthesizing step of synthesizing one audio signal and the second audio signal and outputting a synthesized audio signal. 7. A computer for executing an audio signal synthesizing process in an audio signal synthesizing device comprising an audio signal converting means for converting audio into a first audio signal and an audio signal recording means for recording a second audio signal. A program for causing a computer to execute an audio signal synthesizing process of synthesizing the first audio signal and the second audio signal and outputting a synthesized audio signal. 8. A computer for executing an audio signal synthesizing process in an audio signal synthesizing device comprising an audio signal converting means for converting audio into a first audio signal and an audio signal recording means for recording a second audio signal. A computer-readable recording medium having recorded thereon a program for causing a computer to execute an audio signal synthesizing process of synthesizing the first audio signal and the second audio signal and outputting a synthesized audio signal. A recording medium readable by a computer on which is recorded.