JP6166059B2 - Call apparatus and sound correction method thereof - Google Patents

Description

  The present invention relates to a call device, and more particularly to a voice correction technique in a mobile phone device.

  With the background of development of wireless communication technology and electronic device technology, communication devices such as mobile phone devices are widely spread. In addition, people who use communication devices and places where communication devices are used are diversified with the spread. For this reason, it is desirable to be able to use it comfortably regardless of the age of the user and the place where it is used, and the operation of the telephone device suitable for each condition is expected.

  One optimization of the operation according to the person who uses it and the place where it is used is to optimize the sound output from the communication device according to the conditions. As a method for optimizing the voice according to the conditions, for example, there is a method of adjusting the voice according to the other party. As a technique for adjusting the sound in accordance with the other party, there is a technique disclosed in Patent Document 1.

  Patent Document 1 discloses a technology related to a communication terminal capable of adjusting sound quality during a call. The communication terminal of Patent Document 1 has a function of correcting a voice to be transmitted when used under noise and a function of correcting a voice received when it is difficult to hear the other party's voice. The sound correction is performed by a method of emphasizing the sound and suppressing the noise so that the frequency characteristic is a narrow band high sound emphasis type or a method of making the frequency characteristic a wide band flat type so that all sounds are easy to hear. In Patent Document 1, it is said that the use of such a function can eliminate problems caused by the voice quality of the other party and the usage environment and obtain a good call quality.

  Patent Document 2 discloses an information communication terminal having a function of centrally adjusting volume, sound quality, and speech speed. The information communication terminal of Patent Document 2 has a function of adjusting each of volume, sound quality, and speech speed. In addition, these adjustments can be performed by manipulating the set values that are centrally displayed on the display screen. Japanese Patent Laid-Open No. 2004-26883 states that by having these functions, it is possible to arbitrarily adjust the volume, sound quality, and speech speed in a unified manner during a call.

JP 2001-136239 A JP 2008-252849 A

  However, the technique disclosed in Patent Document 1 has the following problems. In the technique of Patent Document 1, only a condition for which correction contents are set in advance is selected, and each element relating to audio correction cannot be set individually. For this reason, it is not sufficient to make fine settings according to the other party and the environment and optimize the voice quality in the call. Further, in the technique disclosed in the cited document 2, each element relating to voice correction can be set, but only has a function of performing the correction during a call. Therefore, it is necessary to view the display screen of the information communication terminal during a call, which may hinder the call during that time. In addition, when the call is for a short period of time or when there is no room for viewing the display screen, sufficient adjustment may not be possible.

  An object of the present invention is to obtain a call device that can set the correction of the voice of the call partner individually and easily for each item and can optimize the correction contents.

  In order to solve the above-described problem, the communication device of the present invention includes a voice storage unit, a correction condition determination unit, and a voice correction unit. The voice storage means has a function of storing voice during a two-way call. The correction condition determining means has a function of determining a condition for correcting the voice based on the stored voice and saving it as a correction condition. The voice correction means corrects the voice of the other party on the basis of the correction condition.

  In the voice correction method for a call device according to the present invention, the voice is stored during a two-way call, and the condition for correcting the voice based on the stored voice is determined as the correction condition. Based on this, the other party's voice is corrected.

  In the present invention, conditions for correcting the voice of the other party are set based on the voice data saved during the call. For this reason, it becomes easy to set a setting value related to voice correction, and it is possible to optimize voice correction during a call without interrupting the call.

It is a figure which shows the outline | summary of a structure of the 1st Embodiment of this invention. It is a figure which shows the example of the operation screen in the 1st Embodiment of this invention. It is a figure which shows the outline | summary of the operation | movement flow in the 1st Embodiment of this invention. It is a figure which shows the outline | summary of the operation | movement flow in the 1st Embodiment of this invention. It is a figure which shows the outline | summary of a structure of the 2nd Embodiment of this invention. It is a figure which shows the outline | summary of the operation | movement flow in the 2nd Embodiment of this invention. It is a figure which shows the outline | summary of the operation | movement flow in the 2nd Embodiment of this invention. It is a figure which shows the example of the operation screen in embodiment of this invention. It is a figure which shows the example of the operation screen in embodiment of this invention. It is a figure which shows the outline | summary of a structure of the 3rd Embodiment of this invention.

  A first embodiment of the present invention will be described in detail with reference to FIG. FIG. 1 shows an outline of the configuration of the mobile phone device of this embodiment.

  The mobile phone device according to the present embodiment includes a control unit 11, a voice correction unit 12, a voice storage unit 13, a setting information storage unit 14, a communication unit 15, an operation unit 16, a display unit 17, and a voice output unit. 18 and a voice input unit 19.

  The control unit 11 has a function of sending an instruction regarding an operation to each part constituting the mobile phone device and performing control. The sound correction unit 12 has a function of processing sound based on predetermined setting information stored in the setting information storage unit 14 and causing the sound output unit 18 to send and output sound data. The voice correction by the voice correction unit 12 is performed by signal enhancement and attenuation processing in a predetermined frequency band, change of the call speed by adjusting the output speed, and the like. In the present embodiment, as shown in FIG. 2, the setting items related to audio correction are set with three items of reproduction speed, noise removal, and sound quality. The playback speed is an item for adjusting the speed of the other party's voice that can be heard by the user, and the voice output speed is adjusted. Noise removal removes voice other than the voice of the other party as noise to make it easier to hear the voice of the other party. Noise removal is performed by removing voices having frequencies other than those corresponding to human voices. The sound quality is an item relating to the adjustment of the frequency characteristics of the sound. For example, in the correction relating to the sound quality, the sound output by amplifying or suppressing the sound of a specific frequency is adjusted.

  The voice storage unit 13 is composed of a semiconductor memory element or the like, and has a function of storing voice during a call as voice data. The setting information storage unit 14 has a function of storing setting values and the like when the audio correction unit 12 corrects audio. The communication unit 15 has a function of transmitting / receiving data to / from a communication network. For example, the communication unit 15 performs wireless communication according to the LTE (Long Term Evolution) standard. The operation unit 16 includes a button-type input element and the like, and has a function of detecting a user operation or information input. Some of the functions of the operation unit 16 may be performed by a voice input method using a user's voice input from the voice input unit 19. The display unit 17 includes a liquid crystal display device, an organic EL (Electro Luminescence) display device, and the like, and has a function of displaying each piece of information. Further, by combining information display on the screen with a display unit 17 and an input function by a user operation, a part of the function of the operation unit 16 and the display unit 17 are integrally configured. Sometimes. The audio output unit 18 has a function of converting a signal including audio data into audio and outputting it to the user. The voice input unit 19 includes a microphone and has a function of converting a user's voice into an electric signal.

  An operation when a call is performed in the mobile phone device of this embodiment will be described. FIG. 3 shows an outline of a flow when a call is performed. It is assumed that the mobile phone device initiates a call by making an outgoing call from the other party or a user operation (step 101). When the control unit 11 detects the start of a call, the control unit 11 checks whether the setting information of the calling party is stored in the setting information storage unit 14 (step 102). The setting information storage unit 14 stores a telephone number and setting data of a call partner corresponding to the number in association with each other. The control unit 11 detects the telephone number of the other party and determines the presence / absence of setting data stored in association with the number. If the control unit 11 determines that there is no setting data for the other party in the setting information storage unit 14 (No in step 103), the control unit 11 sends an instruction to the voice storage unit 13 to start saving the voice data. Receiving the instruction to start saving the voice data, the voice storage unit 13 saves the voice of the other party who is calling from the communication unit 15 as voice data (step 104). The voice data is stored in the voice storage unit 13 until the call is finished or until a predetermined set time elapses. When the control unit 11 detects the end of the call or the elapse of a predetermined set time, the control unit 11 sends an instruction to the audio storage unit 13 to stop storing the audio data. When the voice storage unit 13 receives an instruction from the control unit 11 to stop saving the voice data, the voice storage unit 13 stops saving the voice data.

  When the control unit 11 determines that the setting information regarding the other party is stored (Yes in Step 103), the control unit 11 requests the setting information storage unit 14 to read the setting information (Step 105). Upon receiving a request for setting information data from the control unit 11, the setting information storage unit 14 sends the setting information data to the control unit 11. Upon receiving the setting information data, the control unit 11 sends the setting information data to the voice correction unit 12 and sends an instruction to correct the voice data. When the voice correction unit 12 receives the setting information and an instruction to perform voice correction, the voice correction unit 12 corrects the voice data based on the setting information (step 106). The sound correction unit 12 sends the corrected sound data to the sound output unit 18. The audio output unit 18 outputs the audio data sent from the audio correction unit 12 as audio (step 107).

  Next, a description will be given of an operation when making settings related to sound correction while the user confirms sound based on the stored sound data. FIG. 4 shows an outline of the flow when setting audio correction. It is assumed that the user performs an operation for starting a setting related to sound correction when a call is not being performed. (Step 111). When the control unit 11 detects the start of the setting related to audio correction, the control unit 11 sends an instruction to display a screen for changing the setting item to the display unit 17. Upon receiving an instruction to display a screen for changing setting items, the display unit 17 displays a setting item input screen (step 112). In the present embodiment, setting items relating to audio correction are set such as reproduction speed, noise removal, and sound quality, as shown in FIG. As shown in FIG. 2, the display unit 17 displays setting items related to sound correction, and a setting value can be input for each setting item. For example, the playback speed is divided into “normal” and “slow” in several stages, and the user can select a setting value by input from the operation unit 16.

  When an instruction to display information related to the setting is sent to the display unit 17, the control unit 11 sends an instruction to output the stored voice data to the voice storage unit 13. When the voice storage unit 13 receives an instruction to output the stored voice data, the voice storage unit 13 sends the voice data to the voice correction unit 13. When the sound correction unit 13 receives the sound data, the sound correction unit 13 transmits the sound data to the sound output unit 18 and outputs the sound (step 113).

  When voice output is started, the user inputs setting values for each setting item from the operation unit 11 while listening to the voice (step 114). When the operation unit 16 detects an input of a setting value from the user, the operation unit 16 sends information on the input setting value to the control unit 11. Upon receiving the setting value information from the operation unit 16, the control unit 11 sends the setting value information received from the operation unit 16 to the voice correction unit 12, and sends an instruction to perform voice correction based on the setting value. In addition, the control unit 11 temporarily stores the setting value information in the setting information storage unit 14. When the voice correction unit 12 receives information on the set value from the control unit 11, the voice correction unit 12 corrects the voice data based on the information (step 115). The audio data corrected by the audio correcting unit 12 is sent to the audio output unit 18 to output audio (step 116).

  When the user performs a setting completion operation when the corrected sound is output (Yes in step 117), the operation unit 16 sends setting completion information to the control unit 11. Upon receiving the setting completion information, the control unit 11 sends an instruction to stop outputting audio data to the audio storage unit 13. When the voice storage unit 13 receives an instruction to stop outputting voice data, the voice storage unit 13 stops outputting voice data. When the control unit 11 sends an instruction to stop outputting audio data to the audio storage unit 13, the control unit 11 sends an instruction to save the setting information temporarily stored in the setting information storage unit 14. When the setting information storage unit 14 receives an instruction to save the setting information, the setting information storage unit 14 saves the setting information in association with the information on the other party of the call (step 118). For example, the other party's telephone number is used as information on the other party of the call. When the setting information storage unit 14 is instructed to save the setting information, the control unit 11 sends an instruction to the display unit 17 to stop the screen display related to the setting. When the display unit 17 receives an instruction from the control unit 11 to stop the screen display related to the setting, the display unit 17 stops the display related to the setting and returns to the normal screen display. With the above operation, the setting operation relating to the sound correction is completed (step 119). Before returning to the normal screen display, information indicating that the setting is completed may be displayed on the display unit 17. At this time, the information indicating that the setting has been completed may be deleted by a user operation after confirmation by the user, or may be automatically deleted when a predetermined time elapses. Good.

  If the user does not perform a setting completion operation when the corrected sound is output (No in step 117), the output of the corrected sound data is continued (step 120). If the user does not complete the setting operation, the process returns to step 114 and the operation from the input of the user's setting value is repeated while the output of the audio data corrected in step 120 is continued. At this time, if the sound data stored in the sound storage unit 13 is output to the end before the setting is completed, the sound is output after returning to the beginning of the sound data.

  In the cellular phone device of the present invention, voice data during a call is stored in the voice storage unit, and setting values relating to voice correction in the voice correction unit are set for each item based on the voice data. Therefore, it is not necessary for the user to interrupt the conversation and perform an operation in order to view the display unit during a call or the like. In addition, since correction is performed based on the voice data saved during a two-way call, it is possible to set each setting item while checking the sound quality and speed of the voice during actual conversation during non-calling etc. . As a result, it becomes easy to set a setting value related to voice correction, and it is possible to optimize voice correction during a call.

  A second embodiment of the present invention will be described in detail with reference to FIG. FIG. 5 shows an outline of the configuration of the mobile phone device of this embodiment. In the first embodiment, the call partner is stored in the voice storage unit and manually set. In this embodiment, the stored voice data is analyzed by the voice identification unit and a correction value is set.

  The mobile phone device according to the present embodiment includes a control unit 21, a voice correction unit 22, a voice storage unit 23, a voice identification unit 24, a setting information storage unit 25, a communication unit 26, an operation unit 27, and a display unit. 28, an audio output unit 29, and an audio input unit 30. The configurations and functions of the voice correction unit 22, the setting information storage unit 25, the communication unit 26, the operation unit 27, the display unit 28, the voice output unit 29, and the voice input unit 30 are the same as those in the first embodiment. is there.

  The control unit 21 has a function of sending an instruction to each part of the mobile phone device and controlling the whole. The voice storage unit 23 is composed of a semiconductor memory element or the like and has a function of storing voice data. The voice storage unit 23 has a function of storing the voice of the other party and the voice of the user as voice data. The voice of the other party and the voice of the user are stored in a state where they can be distinguished. For example, the voice storage unit 23 can store the voice data of the call partner and the user in different memory areas, and can store and manage the voice data by associating two voice data. In addition, the voice storage unit 23 stores the voice data of the other party and the voice data of the other party in a predetermined unit, and adds information indicating which voice data is included in each predetermined unit of data, so that the voice is stored. Data can also be managed separately.

  The voice identification unit 24 has a function of analyzing voice data stored in the voice storage unit 23. For example, the voice identification unit 24 compares the frequency characteristic data stored in advance for each group having a tendency similar to that of the stored voice frequency characteristic data, and determines a group close to the voice data. Groups with similar trends refer to groups of people with similar voice characteristics such as age and gender, and store frequency characteristic data for each group. In addition, setting values for setting items relating to corrections such as reproduction speed, noise removal, and voice are set for each group. Therefore, by determining a group close to the recorded voice data, a setting value suitable for the voice can be set. In addition, the voice identification unit 24 may identify words that are repeatedly issued and measure the interval between conversations to determine whether a call is being smoothly performed. For example, if the same word is repeatedly uttered, it is determined that listening is not good and the playback speed is set slower than the value set in advance for the group.

  Not only a method in which data for each group is set in advance, but also a set value and voice frequency characteristic data when the user has set the same method as the setting method in the first embodiment is stored, and the frequency characteristic is stored. It is also possible to adopt a method that is determined based on data. That is, it is possible to determine a setting value related to correction based on a tendency related to past settings performed by the user.

  An operation when a call is performed in the mobile phone device of this embodiment will be described. FIG. 6 shows an outline of a flow when a call is performed. It is assumed that a call is started by an incoming call from the other party or a user operation in the mobile phone device (step 141). When the control unit 21 detects the start of the call, it checks whether the setting data of the calling party is stored in the setting information storage unit 25 (step 142). When the control unit 21 determines that there is no setting data for the other party in the setting information storage unit 25 (No in step 143), the control unit 21 sends an instruction to start storing the voice data to the voice storage unit 23. In response to the instruction to start saving the voice data, the voice storage unit 43 saves the voice of the other party who is talking and the voice of the user input from the voice input unit 30 sent from the communication unit 26 as voice data. (Step 144). The voice data is stored in the voice storage unit 23 until the call is finished or until a predetermined set time elapses. When the control unit 21 detects the end of the call or the elapse of a predetermined set time, it sends an instruction to the audio storage unit 23 to stop storing the audio data. When the voice storage unit 23 receives an instruction to stop saving the voice data from the control unit 21, the voice storage unit 23 stops saving the voice data.

  When the control unit 21 determines that the setting information regarding the other party is stored (Yes in step 143), the control unit 21 requests the setting information storage unit 25 to read the setting information (step 145). Upon receiving a request for setting information data from the control unit 21, the setting information storage unit 25 sends the setting information data to the control unit 21. Upon receiving the setting information data, the control unit 21 sends the setting information data to the voice correction unit 22 and sends an instruction to correct the voice data. When the voice correction unit 12 receives the setting information and an instruction to perform voice correction, the voice correction unit 12 corrects the voice data based on the setting information (step 146). The sound correction unit 22 sends the corrected sound data to the sound output unit 29. The audio output unit 29 outputs the audio data sent from the audio correction unit 22 as audio (step 147).

  Next, in the present embodiment, an operation when an audio correction value is set will be described. FIG. 7 shows an outline of an operation flow when the correction value is set.

  When the control unit 21 detects the end of the call, the control unit 21 starts to set the voice correction value (step 151). When the control unit 21 starts setting the audio correction value, the control unit 21 sends an instruction to identify the audio data stored in the audio storage unit 23 to the audio identification unit 24. When the operation load of the mobile phone device is high, the control unit 21 may temporarily stop the start of the setting value of the voice correction value and instruct the voice identification unit 24 to identify the voice data after a certain time.

  Upon receiving the voice data identification instruction from the control unit 21, the voice identification unit 24 requests the voice data stored in the voice storage unit 23. The voice storage unit 23 having received the voice data request outputs the stored voice data and sends it to the voice identification unit 24 (step 152). When the voice identification unit 24 receives the voice data, it analyzes the frequency characteristics and the like (step 153). When the voice identification unit 24 analyzes the frequency characteristic, it compares the frequency characteristic data stored in advance for each group (step 154). The voice identification unit 24 determines which group the frequency characteristics of the voice data of the communication partner are close to by comparing the frequency characteristics data (step 155). The voice identification unit 24 may use the measurement result of the conversation interval in addition to the frequency characteristics as a judgment criterion when making a group judgment. When the voice identification unit 24 determines the group to which the voice data belongs, the information or setting data of the determined group is sent to the control unit 21. When the control unit 21 receives the determination result or setting data of the voice data group, the control unit 21 stores the group or setting data in the setting information storage unit 25 in association with the information of the other party (step 156). When the control unit 21 stores the setting data, the setting of the audio correction value is terminated (step 157).

  In the mobile phone device of the present embodiment, both the voice of the other party and the user's voice are saved, but only the voice of the other party may be saved. At this time, the interval between the voice of the other party and the user or the interval between the other party's voice is stored, and the data of the interval can also be used for setting the voice correction value. Also, when different correction values are determined for each part in a single call, the most frequently set value or average value is selected in multiple determinations, or it is determined near the middle of the call time. A set value may be used.

  In the mobile phone device according to the present embodiment, voice data of the other party is stored in the voice storage unit, and the voice identification unit determines appropriate correction content based on the stored voice data and sets a correction value. Since the actual two-way call is stored and the voice correction value is set based on the voice data, a more suitable correction value can be set. As a result, the user can make a call with a sound that has been corrected to be suitable for the other party without being aware of the setting or the like when calling the same party again.

  In the first embodiment, an example in which the audio correction value using the saved audio data is set by a user's manual operation is shown. In the second embodiment, an example in which the setting is automatically set is shown. However, it may be a method in which the user can set manual or automatic. An example of the operation screen when the user can set automatic and manual is shown in FIG. When the control unit detects the end of the call, a screen as shown in FIG. 8 is displayed. When the user selects automatic setting on the screen of FIG. 8, the audio correction value is set by the method of the second embodiment. When manual is selected, a selection for each item in the first embodiment is displayed as shown in FIG. FIG. 9 shows a screen in which a correction value can be input for each correction value setting item, as in the first embodiment. In addition, when “slow playback”, “reproducible female playback” or “reproducible male playback” is selected while the screen as shown in FIG. 8 is displayed, the sound is corrected according to preset values for each and output. Is done. These settings are used for simple audio correction without making detailed settings, or when performing manual corrections such as men and women, and then setting correction values for each item. It can be used for example. In this case, for example, the set value is set so that the playback speed is slow in “slow playback”, and the noise removal and sound quality are moderate. In “male distinct reproduction”, the setting values are set so that the reproduction speed and noise removal are moderate, and the sound quality is emphasized in the bass. In “Women's Clear Playback”, the setting values are set to moderate playback speed and noise removal, and the sound quality is set to slightly emphasize high sounds. If “no correction” is selected, sound is output without sound correction.

  In the first embodiment and the second embodiment, the correction value is set in a state where no call is made. However, a method in which the correction value can be set even during a call can be used. In this case, it is possible to adopt a method in which the correction value can be set during a call from the operation screen as shown in FIG. By adopting a method in which the correction value can be set even during a call, the user can cope with the case where the stored correction value is not optimal.

  In the first embodiment and the second embodiment, the voice correction method has been described by taking the cellular phone device as an example. The call device is not limited to a mobile phone device, and even when using a multi-function mobile phone such as a smartphone, a tablet computer with a call function, an information device of a personal computer with a call function, and other information devices, the sound correction is similarly performed. It can be carried out.

  A third embodiment of the present invention will be described in detail with reference to FIG. FIG. 10 shows an outline of the configuration of the call device according to this embodiment. The call device according to the present embodiment includes a voice storage unit 41, a correction condition determination unit 42, and a voice correction unit 43. The voice storage means 41 has a function of saving voice during a two-way call. The correction condition determination means 42 has a function of determining a condition for correcting the voice based on the stored voice and storing it as a correction condition. The voice correcting unit 43 corrects the voice of the other party based on the correction condition.

  In the call device of the present embodiment, conditions for correcting the voice of the other party are set based on the voice data saved during the call. For this reason, it becomes easy to set a setting value related to voice correction, and it is possible to optimize voice correction during a call without interrupting the call.

  The present invention can be used for voice correction of a call device, and in particular, can be used as a voice correction technique for a portable call device such as a mobile phone device.

DESCRIPTION OF SYMBOLS 11 Control part 12 Voice correction part 13 Voice storage part 14 Setting information storage part 15 Communication part 16 Operation part 17 Display part 18 Voice output part 19 Voice input part 21 Control part 22 Voice correction part 23 Voice storage part 24 Voice identification part 25 Setting Information storage unit 26 Communication unit 27 Operation unit 28 Display unit 29 Audio output unit 30 Audio input unit 41 Audio storage unit 42 Correction condition determination unit 43 Audio correction unit 101-107 Operation steps when storing audio 111-120 Setting of correction value Operation Step 141-147 Operation Step When Saving Audio 151-157 Operation Step When Setting Correction Values

Claims (10)

Voice storage means for storing voice during a two-way call;
A voice recognition means for comparing the voice stored in the voice storage means with preset voice data for each predetermined group to determine which group the stored voice belongs to;
Correction condition determination means for determining a condition for correcting the voice based on the group determined by the voice identification means and storing it as a correction condition;
A call device comprising: a voice correction unit that corrects the voice of the other party on the basis of the correction condition. The correction condition determining means further comprises a correction value setting means for setting a correction value for each sound correction item by the sound correction means,
The call device according to claim 1, wherein the correction value set by the correction value setting means is used as the correction condition. Display means for displaying the correction item when determining the correction condition;
Input means for inputting a setting value of the correction item displayed on the display means,
3. The communication device according to claim 2, wherein the correction value setting means uses the setting value input by the input means as the correction value. Before SL correction value setting means communication apparatus according to claim 2, characterized in that for setting the correction value for each of the correction item on the basis of the group that is determined by the speech recognition means. The correction condition is stored in association with the information of the communication partner,
5. The voice correction unit corrects the voice of the other party based on the correction condition stored in association with the other party when calling again with the other party. The call device according to any one of the above. The correction condition communication apparatus according to claims 1 to 5 or the determination of the correction condition in the decision means is characterized by being performed at the time of non-speech. Save audio during a two-way call,
Comparing the saved voice with the preset voice data for each predetermined group to determine which group the saved voice belongs to,
A condition for correcting sound based on the determined group is determined as a correction condition,
A voice correction method for a call device, wherein the voice of the other party is corrected based on the correction condition. The correction conditions are set for each audio correction item,
8. The voice correction method for a call device according to claim 7, wherein a correction value is set for each correction item. When determining the correction condition, and displaying the correction items of the speech,
9. The voice correction method for a call device according to claim 8, wherein the correction condition is determined using a set value input for each correction item as a correction value. The correction condition stored in association with the calling party information,
10. The voice of the other party is corrected based on the correction condition stored in association with the other party when making a call again with the other party. 10. Correction method for telephone equipment.

Images