JP2012074911A - Portable electronic apparatus and voice control system - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide a portable electronic apparatus and a voice control system which can properly correct voice to be outputted and output the voice which is more easily to be heard by a user.SOLUTION: The portable electronic apparatus and voice control system comprise: an enclosure; a sound generation part for generating a sound based on a voice signal; a storage part for storing user information and a correction parameter of the user; an identification information acquisition part for acquiring identification information for identifying a user who is hearing a sound generated by the sound generation part; a processing part for determining whether a user is the right user based on the identification information acquired by the identification information acquisition part and the information of the user in the storage part, and for reading the correction parameter of the user from the storage part to set the read correction parameter as a usage correction parameter when the user is the right user; and a correction part for correcting a voice signal based on the usage correction parameter set by the processing part and supplying the corrected voice signal to the sound generation part.

Description

  The present invention relates to a portable electronic device that outputs sound and a sound control system.

  Mobile electronic devices such as mobile phones and mobile TVs output audio. Here, among users of portable electronic devices, there are users whose hearing ability is reduced due to aging or the like and it is difficult to hear the output sound.

  On the other hand, for example, Patent Document 1 describes a mobile device with a voice correction function that corrects frequency characteristics and levels of voice output from a receiver or the like in accordance with auditory changes due to age.

JP 2000-209698 A

  Here, there are various causes of hearing loss, such as aging, illness, and noise exposure, and the degree of hearing loss varies widely. For this reason, as described in Patent Document 1, it is not possible to correct a sound sufficiently satisfactory for the user only by correcting the frequency characteristics and level of the sound output from the receiver or the like according to the age.

  An object of the present invention is to provide a portable electronic device and a sound control system that can appropriately correct a sound to be output and can output a sound that can be easily heard by a user.

  A portable electronic device according to the present invention includes a housing, a sound generation unit that is provided in the housing and generates sound based on an audio signal, the user information provided in the housing, A storage unit for storing correction parameters of the user, and an identification information acquisition unit that is provided in the housing and acquires identification information for identifying the user who is listening to the sound generated by the sound generation unit And whether the user is the user based on the identification information acquired by the identification information acquisition unit and the information of the user in the storage unit, and the user is the user In some cases, the correction parameter of the user is read from the storage unit, a processing unit that sets the read correction parameter as a use correction parameter, and an audio signal based on the use correction parameter set by the processing unit. Correct and correct Characterized in that it comprises a correction unit for supplying the sound generator sound signal.

  A portable electronic device according to the present invention includes a housing, a communication unit that communicates with other devices, a sound generator that is provided in the housing and generates sound based on an audio signal, and the housing. An identification information acquisition unit configured to acquire identification information for identifying a user who is listening to the sound generated by the sound generation unit; and Transmitting the identification information to a device, acquiring a correction parameter corresponding to the identification information of a user who is listening to the sound generated by the sound generator from the other device, and using the acquired correction parameter as a correction parameter And a correction unit that corrects an audio signal based on the use correction parameter and supplies the corrected audio signal to the sound generation unit.

  Here, it is preferable that the identification information acquisition unit is a microphone that acquires voice, and the processing unit acquires the voice acquired by the microphone as the identification information and identifies the user.

  The identification information acquisition unit is a camera that is arranged in the vicinity of the sound generation unit and acquires an image of a region facing the sound generation unit, and the processing unit is the sound generation unit detected by the camera. It is preferable that an image of an area facing the user is acquired as the identification information to identify the user.

  In addition, the identification information acquisition unit is a fingerprint sensor that detects a fingerprint that contacts a predetermined position of the casing, and the processing unit acquires the fingerprint detected by the fingerprint sensor as the identification information, and the user Is preferably identified.

  Moreover, it is preferable to further include a voice call function unit for making a voice call, and the fingerprint sensor is disposed at a portion that is in contact with the voice call function when the voice call function is started.

  Further, the apparatus further includes an acceleration sensor that detects an acceleration acting on the housing, and the processing unit acquires the identification information again when the movement of the acceleration sensor is detected to be greater than or equal to a preset threshold value, and the use It is preferable to detect a person.

  The correction parameter is preferably a parameter for adjusting the volume of sound for each audio frequency.

  Further, the correction parameter is preferably a parameter for correcting the sound generated from the sound generating unit so as to have a magnitude between an unpleasant threshold value and an audible threshold value.

  An audio control system according to the present invention obtains identification information for identifying a sound generator that generates sound based on an audio signal and identification information for identifying a user who is listening to the sound generated by the sound generator. A storage unit that stores the user information and the correction parameter of the user, and the correction parameter of the user when the user is the user stored in the storage unit. A controller that performs control to correct the sound generated from the sound generator based on the read correction parameter, and between the controller and each other part, wired or wirelessly, And a signal circuit network for transmitting or receiving a signal, wherein the sound generation unit and the identification information acquisition unit are provided in a casing that can be carried by a user.

  It is preferable to provide one or both of the storage unit and the control unit in the server.

  According to the present invention, it is possible to appropriately correct the sound to be output in accordance with the hearing ability of each user, and it is possible to output a sound that is easier for the user to hear.

FIG. 1 is a front view showing a schematic configuration of an embodiment of a portable electronic device. FIG. 2 is a side view of the portable electronic device shown in FIG. FIG. 3 is a block diagram illustrating a schematic configuration of functions of the portable electronic device illustrated in FIGS. 1 and 2. FIG. 4 is a flowchart for explaining an example of the operation of the portable electronic device. FIG. 5 is a flowchart for explaining an example of the operation of the portable electronic device. FIG. 6 is a flowchart for explaining an example of the operation of the portable electronic device. FIG. 7 is a diagram illustrating an example of human hearing characteristics. FIG. 8 is a diagram illustrating an example of hearing characteristics of a hearing impaired person. FIG. 9 is a diagram illustrating examples of the audible threshold value and the unpleasant threshold value. FIG. 10 is a diagram in which the magnitudes and frequencies of vowels, voiced consonants, and unvoiced consonants are superimposed on FIG. FIG. 11 is a diagram obtained by simply amplifying the treble (consonant) of FIG. FIG. 12 is a diagram in which compression processing is performed on the loud sound of FIG. FIG. 13 is a flowchart for explaining an example of the operation of the mobile electronic device. FIG. 14A is a diagram of an audio signal having a sound slightly smaller than the discomfort threshold. FIG. 14-2 is a diagram illustrating spectral components of the audio signal of FIG. 14-1. FIG. 14C is a diagram of an audio signal having a sound slightly larger than the audible threshold. FIG. 14-4 is a diagram illustrating spectral components of the audio signal of FIG. 14-3. FIG. 15A is a diagram illustrating dissatisfaction regarding sounds displayed in a list on a display when a loud sound is reproduced as a presentation sound. FIG. 15B is a diagram illustrating dissatisfaction with sounds listed on the display when a small sound is reproduced as a presentation sound. FIG. 16 is a flowchart for explaining an example of the operation of the mobile electronic device. FIG. 17 is a flowchart for explaining an example of the operation of the mobile electronic device. FIG. 18 is a schematic diagram illustrating a schematic configuration of a communication system including a portable electronic device.

  Hereinafter, the present invention will be described in detail with reference to the drawings. The present invention is not limited to the following description. In addition, constituent elements in the following description include those that can be easily assumed by those skilled in the art, those that are substantially the same, and those in a so-called equivalent range. In the following, a cellular phone is taken as an example of a portable electronic device, but the application target of the present invention is not limited to a cellular phone. For example, a PHS (Personal Handy-phone System), a PDA, a portable navigation device, a notebook The present invention can also be applied to personal computers, game machines, and the like. The present invention can also be applied to a system including a portable electronic device.

  FIG. 1 is a front view showing a schematic configuration of an embodiment of a portable electronic device according to the embodiment, and FIG. 2 is a side view of the portable electronic device shown in FIG. A portable electronic device 1 shown in FIGS. 1 and 2 is a mobile phone having a wireless communication function, an output unit, and a voice acquisition unit. In the portable electronic device 1, the housing 1C is composed of a plurality of housings. Specifically, the housing 1C is configured to be openable and closable by a first housing 1CA and a second housing 1CB. That is, the portable electronic device 1 has a foldable housing. In addition, the housing | casing of the portable electronic device 1 is not limited to such a structure. For example, the casing of the portable electronic device 1 may be a sliding casing that allows one casing and the other casing to slide from each other in a state where both casings are overlapped, It may be a rotary type in which one casing is rotated around an axis along the overlapping direction, or both casings are connected via a biaxial hinge.

  1st housing | casing 1CA and 2nd housing | casing 1CB are connected by the hinge mechanism 8 which is a connection part. By connecting the first casing 1CA and the second casing 1CB with the hinge mechanism 8, the first casing 1CA and the second casing 1CB rotate together around the hinge mechanism 8 and move away from each other. And it is comprised so that it can rotate in the direction (direction shown by arrow R of FIG. 2) which mutually approaches. When the first casing 1CA and the second casing 1CB rotate in a direction away from each other, the portable electronic device 1 opens, and when the first casing 1CA and the second casing 1CB rotate in a direction approaching each other, the portable electronic device 1 opens. The device 1 is closed and folded (a state indicated by a dotted line in FIG. 2).

  The first housing 1CA is provided with a display 2 shown in FIG. 1 as a display unit. The display 2 displays a standby image when the portable electronic device 1 is waiting for reception, or displays a menu image used for assisting the operation of the portable electronic device 1. In addition, the first housing 1CA is provided with a receiver 16 that is an output unit that outputs sound when the mobile electronic device 1 is in a call. A camera 38 is provided in the vicinity of the receiver 16 on the surface where the display 2 of the first housing 1CA is disposed.

  The second casing 1CB is provided with a plurality of operation keys 13A for inputting a telephone number of a call partner, a mail, etc., and selection and determination of a menu displayed on the display 2 and a screen. A direction and determination key 13B for easily executing scrolling and the like are provided. The operation key 13 </ b> A and the direction / decision key 13 </ b> B constitute the operation unit 13 of the mobile electronic device 1. In addition, the second casing 1CB is provided with a microphone 15 that is a voice acquisition unit that receives voice when the mobile electronic device 1 is in a call. The operation unit 13 is provided on the operation surface 1PC of the second housing 1CB shown in FIG. The surface opposite to the operation surface 1PC is the back surface 1PB of the portable electronic device 1. Of the keys constituting the operation key 13A, a key for inputting a call operation and a call reception operation (the upper left key in FIG. 1) is also provided with a fingerprint sensor 36. That is, when a finger touches a key for inputting a transmission operation and a reception operation, the fingerprint of the finger touched by the fingerprint sensor 36 is detected.

  An antenna is provided inside the second housing 1CB. The antenna is a transmission / reception antenna used for wireless communication, and is used for transmission / reception of radio waves (electromagnetic waves) related to calls, electronic mails, and the like between the portable electronic device 1 and a base station. In addition, the microphone 15 is provided in the second housing 1CB. The microphone 15 is arranged on the operation surface 1PC side of the portable electronic device 1 shown in FIG.

  FIG. 3 is a block diagram illustrating a schematic configuration of functions of the portable electronic device illustrated in FIGS. 1 and 2. As illustrated in FIG. 3, the mobile electronic device 1 includes a processing unit 22, a storage unit 24, a transmission / reception unit 26, an operation unit 13, an audio processing unit 30, a display unit 32, and an output sound correction unit 34. , An acceleration sensor 35, a fingerprint sensor 36, and a camera 38. The processing unit 22 has a function of comprehensively controlling the overall operation of the mobile electronic device 1. In other words, the processing unit 22 transmits and receives various processes of the mobile electronic device 1 so as to be executed in an appropriate procedure according to the operation of the operation unit 13 and the software stored in the storage unit 24 of the mobile electronic device 1. The operations of the unit 26, the voice processing unit 30, the display unit 32, and the like are controlled.

  Various processes of the portable electronic device 1 include, for example, a voice call performed via a circuit switching network, creation and transmission / reception of an electronic mail, browsing of a Web (World Wide Web) site on the Internet, and the like. Examples of operations of the transmission / reception unit 26, the audio processing unit 30, and the display unit 32 include transmission / reception of signals by the transmission / reception unit 26, input / output of audio by the audio processing unit 30, display of images by the display unit 32, and the like. .

  The processing unit 22 executes processing based on a program (for example, an operating system program, application program, etc.) stored in the storage unit 24. The processing unit 22 is constituted by, for example, a microprocessor unit (MPU: Micro Processing Unit), and executes various processes of the portable electronic device 1 described above in accordance with procedures instructed by the software. That is, the processing unit 22 sequentially reads instruction codes from an operating system program, application program, or the like stored in the storage unit 24 and executes processing.

  The processing unit 22 has a function of executing a plurality of application programs. The application program executed by the processing unit 22 includes, for example, an application program that reads and decodes various image files (image information) from the storage unit 24, and an application program that displays an image obtained by decoding on the display unit 32. There are multiple application programs.

  In the present embodiment, the processing unit 22 includes a correction parameter setting unit 22a that sets a correction parameter of the output sound correction unit 34, a voice analysis unit 22b that performs voice recognition processing, a spectrum analysis unit 22c that performs voice spectrum analysis, A presentation sound generation unit 22d that generates a presentation sound (test sound) and a correction function control unit 22e that controls an output sound correction function are provided. The functions of the correction parameter setting unit 22a, the voice analysis unit 22b, the spectrum analysis unit 22c, the presentation sound generation unit 22d, and the correction function control unit 22e are processed by the hardware resources configured by the processing unit 22 and the storage unit 24, respectively. This is realized by executing a task assigned by the control unit of the unit 22. Here, a task is a processing unit that cannot be executed at the same time among the entire processing performed by the application software or the processing performed by the same application software. The functions of the correction parameter setting unit 22a, the voice analysis unit 22b, the spectrum analysis unit 22c, and the presentation sound generation unit 22d are executed by a server that can communicate with the portable electronic device 1 via the transmission / reception unit 26. May be transmitted to the portable electronic device 1.

  The storage unit 24 stores software and data used for processing in the processing unit 22, and stores a task for operating the above-described image processing program. In addition to these tasks, for example, communication, downloaded voice data, software used by the processing unit 22 to control the storage unit 24, the telephone number or mail address of the communication partner, etc. are described in the storage unit 24. The address book to be managed, voice files such as dial tone and ring tone, temporary data used in the process of software, and the like are stored.

  Further, the storage unit 24 further stores identification information (user identification information) for identifying the user and correction parameters corresponding to the user (registered user). That is, in the storage unit 24, information for specifying a user and correction parameters are set and stored for each user. The identification information of the user (registered user) includes voiceprint information, image information of a part of the user (or user) face or head, fingerprint information, and the like. The correction parameters are set by a predetermined parameter setting process using the correction parameter setting unit 22a, the voice analysis unit 22b, the spectrum analysis unit 22c, and the presentation sound generation unit 22d. The correction parameter setting process will be described later.

  Note that computer programs and temporary data used in the software processing process are temporarily stored in the work area assigned to the storage unit 24 by the processing unit 22. The storage unit 24 includes, for example, a nonvolatile storage device (nonvolatile semiconductor memory such as ROM: Read Only Memory, a hard disk device, etc.), and a readable / writable storage device (for example, SRAM: Static Random Access Memory, DRAM: Dynamic Random Access Memory).

  The transmission / reception unit 26 has an antenna 26a, establishes a radio signal line by a CDMA (Code Division Multiple Access) method or the like with the base station via a channel assigned by the base station, and makes a telephone call with the base station. Perform communication and information communication. The operation unit 13 includes, for example, an operation key 13A to which various functions such as a power key, a call key, a numeric key, a character key, a direction key, a determination key, and a call key are assigned, and a direction and determination key 13B. The When these keys are input by a user operation, a signal corresponding to the operation content is generated. The generated signal is input to the processing unit 22 as a user instruction.

  The audio processing unit 30 executes processing of an audio signal input to the microphone 15 and an audio signal output from the receiver 16 and the speaker 17. That is, the sound processing unit 30 amplifies the sound input from the microphone 15 and executes AD conversion (Analog Digital conversion), and then performs signal processing such as encoding to convert the sound into digital sound data. Output to the processing unit 22. Further, the audio data sent from the processing unit 22 via the output sound correction unit 34 is subjected to processing such as decoding, DA conversion (Digital Analog conversion), amplification and the like, and converted into an analog audio signal, and then the receiver. 16 and the speaker 17. Here, the speaker 17 is disposed in the housing 1C of the portable electronic device 1, and outputs a ringtone, a mail transmission sound, and the like.

  The display unit 32 includes the display 2 described above, and displays a video corresponding to the video data supplied from the processing unit 22 and an image corresponding to the image data on the display panel. The display 2 is configured by a display panel configured by, for example, a liquid crystal display (LCD) or an organic EL (Organic Electro-Luminescence) panel. The display unit 32 may include a sub display in addition to the display 2.

  Based on the correction parameter set by the processing unit 22, the output sound correction unit 34 corrects the audio data sent from the processing unit 22 and outputs it to the audio processing unit 30. Note that the correction performed by the output sound correcting unit 34 is a correction for amplifying the input audio data with a gain that varies depending on the volume and frequency of the sound based on the correction parameter. The output sound correction unit 34 may be realized by a hardware circuit, or may be realized by a CPU and a program. When the output sound correction unit 34 is realized by a CPU and a program, the output sound correction unit 34 may be realized in the processing unit 22. Further, the function of the output sound correction unit 34 may be executed by a server that can communicate via the transmission / reception unit 26, and the server may transmit the corrected audio data to the portable electronic device 1.

  The acceleration sensor 35 is a detector that detects acceleration applied to the housing 1C. As the acceleration sensor 35, a detector that detects acceleration by various methods can be used. For example, a detector that detects acceleration by a change in capacitance, a change in piezoresistance, a change in relative position, or the like is used. Can do. The acceleration sensor 35 detects an acceleration acting on the housing 1C when the operator shakes or moves the housing 1C.

  As described above, the fingerprint sensor 36 is arranged on the key (the upper left key in FIG. 1) for inputting the outgoing operation and the incoming operation of the operation key 13A, and detects the fingerprint of the finger touching the key. As the fingerprint sensor 36, a detection element that detects a fingerprint by pressure sensitivity, an element that detects a fingerprint based on a change in capacitance, or the like can be used.

  The camera 38 is an imaging mechanism that is provided on the upper surface of the first housing 1CA and acquires an image of an area facing the display 2.

  Next, an example of processing when the mobile electronic device 1 outputs sound will be described with reference to FIGS. 4 and 5. Here, FIG. 4 and FIG. 5 are flowcharts for explaining an example of the operation of the portable electronic device. Note that the processing operations shown in FIGS. 4 and 5 are basically executed when the processing unit 22 causes the correction function control unit 22e to function. The processing shown in FIGS. 4 and 5 is performed at the time of executing processing for outputting sound from the receiver 16 and the speaker 17 such as during a call. Note that the process shown in FIG. 4 is started when the process of outputting sound is started. The processing shown in FIGS. 4 and 5 acquires identification information for identifying the use state (the user who is using) by the sound acquired by the microphone 15, and based on the acquired information, the user This is a process of confirming whether or not the person is set and, if the person is the person, setting a correction parameter that uses the set correction parameter. Further, the processing shown in FIG. 4 is controlled using the detection result of the acceleration sensor 35.

  The processing unit 22 of the portable electronic device 1 first performs a voice print analysis of the microphone sound as step S12. That is, the processing unit 22 acquires voice with the microphone 15 and analyzes the acquired voice to extract a voice print of the user who uses the voice output function of the portable electronic device 1. After analyzing the voiceprint in step S12, the processing unit 22 determines whether the person is the person in step S14. That is, the processing unit 22 compares the voiceprint extracted in step S12 with the voiceprint stored in the storage unit 24, and determines whether the user is the person whose correction parameter is set in the storage unit 24. .

  If it is determined in step S14 that the user is not the user (No), the processing unit 22 turns off the output correction in step S16, and if it is determined that the user is the user (Yes), the processing unit 22 performs output correction in step S18. Set to ON. Here, the output correction is a function for correcting the output sound using the correction parameter. When the output correction is ON, the processing unit 22 supplies the output sound correction unit 34 with correction parameters corresponding to the person stored in the storage unit 24. The output sound correction unit 34 corrects the supplied audio signal using the supplied correction parameter, and outputs the corrected sound from the receiver 16 and the speaker 17. Further, when the output correction is OFF, the processing unit 22 stops the function of the output sound correction unit 34 and outputs the sound obtained by converting the supplied sound signal as it is from the receiver 16 and the speaker 17. When the processing unit 22 sets the output correction function to ON or OFF in step S16 or step S18, the processing unit 22 proceeds to step S20.

  The processing unit 22 detects acceleration by the acceleration sensor 35 as step S20, and determines whether threshold value ≦ detection value as step S22. That is, the processing unit 22 determines whether the detected acceleration is equal to or greater than a threshold value. Note that the threshold value is a value that is set in advance and is a value with which it can be determined that the mobile electronic device 1 has moved. That is, an acceleration value that is greater than the acceleration generated by hand shake or the like is generated, and the mobile electronic device 1 can be determined to have moved more than a certain distance.

  If the processing unit 22 determines in step S22 that threshold value ≦ detection value (Yes), it determines that the mobile electronic device 1 has moved beyond a certain level, and performs interrupt processing in step S24. Here, the interruption process is a process that is performed when it is determined that the mobile electronic device 1 has moved beyond a certain level and the user may have changed, and is an output correction function ON / OFF resetting process. . Hereinafter, the interrupt process will be described with reference to FIG.

  When the interrupt process is executed, the processing unit 22 turns off the output correction in step S30. That is, the processing unit 22 stops the sound correction function by the output sound correcting unit 34 and outputs the sound signal as it is without correcting the sound signal. When the output correction is turned off in step S30, the processing unit 22 performs voiceprint analysis of the microphone sound in step S31. After analyzing the voiceprint at step S31, the processing unit 22 determines whether the person is the person at step S32. If it is determined in step S32 that the user is not the user (No), the processing unit 22 ends the process, and if it is determined that the user is the user (Yes), in step S36, the output correction is turned on. . The processing unit 22 terminates the interrupt process when No or the process of step S36 is completed in step S32, and returns to the process of the flowchart shown in FIG.

  After performing the interrupt process in step S24, the processing unit 22 proceeds to step S20, performs acceleration detection again, and performs the determination in step S22.

  If the processing unit 22 determines in step S22 that the threshold value ≦ the detected value is not satisfied (No), that is, the threshold value> the detected value, the portable electronic device 1 is not moved and the same user In step S26, it is determined whether the call has ended.

  If the processing unit 22 determines in step S26 that the call has not ended (No), the processing unit 22 proceeds to step S20 and repeats the above processing. If the processing unit 22 determines in step S26 that the call is ended (Yes), the processing ends.

  As described above, when the audio signal is input, the portable electronic device 1 corrects the audio signal based on the set correction parameter by the output sound correction unit 34 and outputs the corrected audio signal to the audio processing unit 30. Thereby, the portable electronic device 1 can correct the audio signal with the correction parameter set in accordance with the user's hearing (how to hear the sound, characteristics of hearing), and can output the sound that is easier to hear for the user. .

  Further, the processing unit 22 determines the user, and corrects the output sound with a correction parameter corresponding to the user's hearing when the user is the user, and outputs the output when the user other than the user is the user. By not correcting the sound, it is possible to output the sound with a sound suitable for the user using the portable electronic device 1. Thereby, even when the portable electronic device 1 is used by a person other than the person himself / herself, the sound can be suitably heard. That is, when used by a person other than the person himself / herself, it is possible to listen to a sound that has not been corrected and is not a corrected sound that is output more than usual. As a result, it is possible to listen with a voice that is easy to hear even when a person other than the user uses it.

  In addition, the mobile electronic device 1 detects the user and automatically controls ON / OFF of the output sound correction function, so that the user can make a call, view, etc. with appropriate sound without switching the setting. It can be carried out.

  In the above embodiment, the output sound correction function is switched ON / OFF depending on whether or not the user is the person himself / herself, but the present invention is not limited to this. The mobile electronic device 1 stores identification information of a plurality of users and correction parameters corresponding to the respective users, detects which one of the users is based on the voiceprint information, and detects the detected use A correction parameter corresponding to the user may be set as a use correction parameter to correct the output sound. That is, a correction parameter used corresponding to the detected user may be set. In this case as well, when the user is not any of the users, the output sound correction function is turned off, so that the sound can be output with no correction.

  Here, in the said embodiment, although the information of the user who is listening to the audio | voice was detected based on the audio | voice information acquired with the microphone 15, it is not limited to this. The portable electronic device 1 can use various information as information for detecting the user, that is, identification information, and the identification information detection unit for detecting the identification information also uses various detection units other than the microphone 15. Can do.

  Next, another example of processing at the time of audio output of the mobile electronic device 1 will be described with reference to FIG. Here, FIG. 6 is a flowchart for explaining an example of the operation of the portable electronic device. The process shown in FIG. 6 is a process for acquiring identification information for identifying the user by the camera 38 and setting a correction parameter to be used based on the acquired information.

  First, the processing unit 22 of the portable electronic device 1 acquires an image with the camera 34 in step S62. When the processing unit 22 acquires an image in step S62, the processing unit 22 determines whether the user is the person in step S64. That is, when the person is reflected in the image acquired in step S62, the processing unit 22 extracts the person's image. Thereafter, the processing unit 22 compares the extracted image with the identification information stored in the storage unit 24, and determines whether the person of the acquired image is the person of the identification information stored in the storage unit 24 or the book In the embodiment, it is determined whether or not the user is the person.

  If it is determined in step S64 that the user is not the user (No), the processing unit 22 turns off the output correction in step S66, and if it is determined that the user is the user (Yes), the output correction is performed in step S68. Set to ON. If the processing unit 22 sets the output correction function to ON or OFF in step S66 or step S68, the processing unit 22 proceeds to step S70.

  The processing unit 22 acquires an image again with the camera 34 in step S70, and determines whether the subject has changed in step S72. That is, it is determined whether the subject, that is, the person in the vicinity of the receiver 16 has changed from the state in which it is determined whether or not the user is the user.

  If it is determined in step S72 that the subject has changed (Yes), the processing unit 22 turns off output correction in step S74. That is, the processing unit 22 stops the sound correction function by the output sound correcting unit 34 and outputs the sound signal as it is without correcting the sound signal. When the output correction is turned off in step S74, the processing unit 22 determines in step S76 whether the subject of the image acquired in step S70, that is, the subject determined to have changed in step S72 is the person himself / herself. If it is determined in step S76 that the user is not the user (No), the processing unit 22 proceeds to step S72. If it is determined in step S76 that the user is the user (Yes), the processing unit 22 turns on output correction in step S78. If the output correction is turned on in step S78, the processing unit 22 performs the determination in step S72. Note that the processing unit 22 may proceed to step S70 and acquire an image again when it is determined No in step S76 or when the processing of step S78 is completed.

  If it is determined in step S72 that the subject has not changed (No), the processing unit 22 determines in step S80 whether the call has ended. If it is determined in step S80 that the call has not ended (No), the processing unit 22 proceeds to step S70 and repeats the above processing. If the processing unit 22 determines in step S80 that the call has ended (Yes), the processing ends.

  In this way, instead of or in addition to the detection result of the microphone 15, the user is detected based on the detection result of the camera 38, and correction parameters corresponding to the user are set in the same manner as described above. An effect can be obtained.

  The fingerprint sensor 36 can also be used as the identification information acquisition unit. In this case, the portable electronic device 1 detects the fingerprint of the finger that has touched the fingerprint sensor 36 in order to input an operation at the start of a call, etc., identifies the user from the detected fingerprint, and the identified user If it is detected whether the user is the person (the user whose identification information is stored) and the identification information and the correction parameters corresponding to the identification information are set for the user, the corresponding correction parameter is used to correct the output sound. The output sound is corrected by the unit 34. As described above, the user can be specified also by using the fingerprint sensor 36, and the correction parameter can be set based on the specified result.

  Here, it is preferable that the mobile electronic device 1 sets the correction parameter with a parameter for each frequency. Further, it is preferable to analyze the presentation sound to be viewed in order to set the correction parameter into vowels, voiced consonants and unvoiced consonants, and set the correction parameters for each corresponding frequency. Thereby, by setting the correction parameter as a parameter for each frequency, it is possible to output a more audible voice, and further, by analyzing the presentation sound into vowels, voiced consonants and unvoiced consonants, Outputting easy-to-hear sound can set the correction parameter. In addition, when the correction parameter is set as a parameter for each frequency, the correction process is performed according to the user. Therefore, by changing the state of the output sound correction process for each user, a plurality of users have used it. Even in this case, it is possible to output a sound according to the user.

  Here, human hearing will be described with reference to FIGS. FIG. 7 is a graph showing the relationship between the volume of sound entering the human ear and the volume of sound that humans can hear (feel). In the case of a normal hearing person, the volume of sound that enters the ear and the volume of sound that can be heard are in a proportional relationship. On the other hand, in the case of a hearing-impaired person (elderly person, person with ear illness, etc.), as a general image, it is hardly audible until the volume of the sound entering the ear reaches a certain value. When the loudness exceeds a certain value, the sound can be heard in proportion to the sound entering the ear. In other words, it is considered that a person with a general image should simply amplify the sound that enters the ear. However, in reality, a hearing-impaired person hardly hears until the volume of sound entering the ear reaches a certain value, and when the volume of sound entering the ear exceeds a certain value, it may be heard as a loud sound suddenly. become. Thereby, a hearing-impaired person will hear the change of 10 dB in the change of 20 dB, for example. Therefore, it is necessary to perform compression processing (processing for making the gain for a loud sound smaller than the gain for a small sound) on a loud sound. FIG. 8 is a graph showing the frequency characteristics of the hearing ability of the hearing impaired. As shown in FIG. 8, it can be seen that a hearing-impaired person can hear a low sound well, but a high sound is difficult to hear. The characteristic shown in FIG. 8 is an example, and the frequency characteristic that can be heard varies depending on the user.

  FIG. 9 is a diagram illustrating an example of the relationship between the volume of sound output by a normal hearing person and a hearing impaired person, and an audible threshold value and an unpleasant threshold value. The audible threshold is a lower limit sound volume at which a sound can be properly heard, for example, a sound that can be heard at 40 dB. Sounds that are smaller than the audible threshold are small and difficult to hear. The unpleasant threshold is the upper limit sound volume at which a sound can be properly heard, for example, a sound that can be heard at 90 dB. Sounds that are greater than the unpleasant threshold are sounds that are loud and feel uncomfortable. As shown in FIG. 9, the hearing loss threshold value 42 and the discomfort threshold value 44 of the hearing-impaired person increase as the frequency increases. In contrast, for a normal hearing person, both the audible threshold value 46 and the unpleasant threshold value 48 are constant with respect to the volume of the output sound.

  Next, FIG. 10 shows the size and frequency of vowels, voiced consonants and unvoiced consonants output without adjustment in the relationship between the loudness of the hearing impaired and the audible threshold and unpleasant threshold. FIG. As shown in FIG. 10, vowels that are output without adjustment, that is, output in the same state as the use state of a normal hearing person, are output as sounds in the range between the frequency and the loudness that are surrounded by the range 50. Similarly, the voiced consonant is output as a sound in the range between the frequency and the sound volume surrounded by the range 52, and the unvoiced consonant is output as a sound in the frequency and sound range surrounded by the range 54. Here, as shown in FIG. 10, the vowel range 50 and a part of the voiced consonant range 52 are included between the range in which the hearing impaired person can hear the sound, between the audible threshold 42 and the unpleasant threshold 44. A part of the consonant range 52 and the whole unvoiced consonant range 54 do not enter. For this reason, when a hearing impaired person outputs a sound with the same output as a normal hearing person, it can be seen that vowels can be heard but consonants (voiced consonants, unvoiced consonants) are hardly heard. Specifically, some voiced consonants can be heard, but unvoiced consonants are hardly audible.

  FIG. 11 is a diagram obtained by simply amplifying the treble (consonant) of FIG. The vowel range 50a shown in FIG. 11 is the same range as the vowel range 50 shown in FIG. The voiced consonant range 52a is set so that the overall loudness is larger than the voiced consonant range 52 shown in FIG. 10, that is, the range moves upward in FIG. The unvoiced consonant range 54a is also set so that the overall loudness is larger than the unvoiced consonant range 54 shown in FIG. 10, that is, the range moves upward in FIG. As shown in FIG. 11, if the voice in the frequency domain that is difficult to hear, that is, the voiced consonant range 52a and the unvoiced consonant range 54a are simply amplified, the louder range exceeds the discomfort threshold 44, Treble sounds are heard in my ears. That is, the sound is distorted and the words cannot be heard clearly.

  On the other hand, in FIG. 12, the sound is corrected by the output sound correction unit 34 of the portable electronic device 1 according to the present embodiment. Specifically, the compression processing is performed on the loud sound in FIG. It is the figure which performed the process made smaller than the gain with respect to a small sound. The vowel range 50b shown in FIG. 12 has a smaller gain for sounds larger than the vowel range 50a shown in FIG. In the voiced consonant range 52b, the gain for a sound larger than the voiced consonant range 52a shown in FIG. 11 is reduced. The unvoiced consonant range 54b also has a smaller gain for sounds larger than the unvoiced consonant range 54a shown in FIG. As shown in FIG. 12, a small sound is amplified with a large gain, and a large sound is amplified with a small gain, so that the vowel range 50b, the voiced consonant range 52b, and the unvoiced consonant range 54b can be comfortably loud. (The size between the audible threshold 42 and the discomfort threshold 44). The portable electronic device 1 determines correction parameters for input audio data in consideration of the above matters. The correction parameter is a parameter for performing correction so that the input sound can be heard by the user as a sound having a volume between the audible threshold 42 and the discomfort threshold 44. In the portable electronic device 1, the output sound correction unit 34 performs correction to be amplified with a gain corresponding to the volume and frequency of the sound using the determined correction parameter, and outputs the correction to the sound processing unit 30. Thereby, the portable electronic device 1 can hear a sound suitably even for a user who is hard to hear.

  Next, an example of the correction parameter setting operation of the portable electronic device will be described with reference to FIG. Here, FIG. 13 is a flowchart showing an example of the operation of the portable electronic device. Note that the operation shown in FIG. 13 may be processed by executing an application stored in the storage unit 24. The program can be downloaded and acquired from the outside. Further, the operation shown in FIG. 13 is executed by a server that can communicate with the portable electronic device 1 via the transmission / reception unit 26, the server transmits voice, an image, and the like to the portable electronic device 1, and the portable electronic device 1 from the server. The received audio may be output, an image may be displayed, and the input data may be transmitted to the server when the mobile electronic device 1 receives an input from the user.

  First, the processing unit 22 of the portable electronic device 1 reproduces a presentation sound (test sound) as step S112. That is, the processing unit 22 of the mobile electronic device 1 generates a presentation sound (test sound) by the presentation sound generation unit 22 d and outputs the presentation sound from the receiver 16 or the speaker 17 via the voice processing unit 30. In addition, as the present sounds, sounds near the unpleasant threshold and the audible threshold have a great influence on hearing, so the sound that is just below the unpleasant threshold initially set for a normal hearing person (for example, a sound slightly smaller than the unpleasant threshold) It is preferable to use a sound just below the set audible threshold (for example, a sound slightly larger than the audible threshold). In addition, it is preferable to use a marginal sound for the discomfort threshold and the audible threshold of each user after the second time. FIG. 14A is a diagram of an audio signal having a sound slightly smaller than a set discomfort threshold. FIG. 14B is a diagram illustrating spectral components obtained by accumulating the audio signals illustrated in FIG. FIG. 14C is a diagram of an audio signal having a sound slightly larger than a set audible threshold. FIG. 14-4 is a diagram illustrating spectral components obtained by accumulating the audio signals illustrated in FIG. 14-3.

  Referring to FIG. 13 again, next, the processing unit 22 displays a dissatisfaction (request) regarding the sound expected to be possessed by the user on the display 2 as a list in step S114. FIG. 15A is a diagram illustrating dissatisfaction regarding sounds displayed in a list on the display 2 when a loud sound (slightly smaller than an unpleasant threshold) is reproduced as a presentation sound. FIG. 15B is a diagram illustrating dissatisfaction regarding the sounds listed on the display 2 when a small sound (slightly larger than the audible threshold) is reproduced as the presentation sound. Referring to FIG. 15A, when a loud sound (a sound slightly smaller than the unpleasant threshold) is reproduced as the presentation sound, an item 151 a “cracking / noisy”, an item 151 b “kinking”, and “muffled” An item 151c, an item 151d “listen up”, and an item 151e “not dissatisfied” are listed on the display 2. Also, referring to FIG. 15-2, when a small sound (slightly larger than the audible threshold) is reproduced as the presentation sound, an item 152a “almost inaudible”, an item 152b “sound sharply”, An item 52c “Sound is not clear” and an item 152d “No dissatisfaction” are displayed in a list on the display 2.

  Referring to FIG. 13 again, next, in step S116, the processing unit 22 determines whether any item listed on the display 2 has been selected. If it is determined that any of the items listed on the display 2 has not been selected (No in step S116), the processing unit 22 causes the process to wait in step S116.

  If the processing unit 22 determines that any of the items listed on the display 2 has been selected (Yes in step S116), the correction parameter setting unit 22a alleviates the selected dissatisfaction (step S118) (step S118). A correction parameter that satisfies the request is set in the output sound correction unit 34. For example, the processing unit 22 reproduces the presentation sound shown in FIG. 14-1 (a sound slightly smaller than the unpleasant threshold), and when the item 151b “King” is selected as shown in FIG. Since it is understood that the sound exceeds the unpleasant threshold for the user, the correction parameter setting unit 22a sets a correction parameter for reducing the gain of a large and high sound in the output sound correction unit 34. Further, for example, the processing unit 22 reproduces the presentation sound (sound slightly larger than the audible threshold) shown in FIG. 14C, and the item 152a “almost unheard” is selected as shown in FIG. 15B. Since the sound does not reach the audible threshold for the user as a whole (over the entire frequency band), the correction parameter setting unit 22a sets a correction parameter for increasing the gain of a small sound over the entire frequency band to the output sound correcting unit 34. Set to. The correction parameter may be a gain itself or a control value for controlling the output sound correction unit 34 so as to amplify with a desired gain. The correction parameter setting unit 22a of the processing unit 22 repeats the operation of setting (adjusting) the correction parameter for each frequency based on the relationship between the presentation sound output as described above and the response input by the user to the sound. .

  As a result, the correction parameter can be set in accordance with the user's hearing (how to hear the sound (how to hear), auditory characteristics), and sound that is easier to hear for the user can be output.

  Note that the processing unit 22 can repeatedly execute the flow illustrated in FIG. 13 using various presentation sounds to converge the correction parameter to a value suitable for the user, and output a voice that can be easily heard by the user. Further, the processing unit 22 performs the flow shown in FIG. 13 periodically (for example, every 3 months, every 6 months, etc.), so that even if there is a change in the user's hearing, the processing unit 22 can hear it. Easy voice can be output.

  If the processing unit 22 determines that any of the items listed on the display 2 in step S116 is selected (Yes in step S116), the processing unit 22 stores the selected item in the storage unit 24 as a log, and from the user. The content of the log may be displayed on the display unit 32 in response to the instruction input. Thereby, the user can grasp the item selected in the past by referring to the log and grasp the process of adjusting the correction parameter. This makes it easier for the user to adjust the correction parameter.

  Next, another example of the correction parameter setting operation of the mobile electronic device 1 will be described. When the correction parameter setting function is activated, the mobile electronic device 1 performs correction parameter setting processing by the correction parameter setting unit 22a. First, a presentation sound is generated by the presentation sound generation unit 22 d and output from the receiver 16 or the speaker 17. Here, in the present embodiment, the presentation sound is a voice to be heard by the user when setting the correction parameter, and is a word or a sentence. In addition, it is preferable to use the word and the sentence which are easy to generate mistakes as the presentation sound. For example, “safe”, “complete”, or “absolutely” can be used as the presentation sound. “Safe”, “complete” and “absolutely” are voices that are easy to misunderstand each other. In addition, “sales”, “souvenirs”, and “sides” can be used as the presentation sound. In addition, “environment”, “resonance”, and “exploration” can also be used. In addition, the presentation sound can be set to a discomfort threshold and an audible threshold, so that the sound just below the set discomfort threshold (for example, a sound slightly smaller than the discomfort threshold) or the sound just below the set audible threshold (for example, audible) It is preferable to use a sound slightly larger than the threshold.

  When the portable electronic device 1 outputs the presentation sound, the portable electronic device 1 displays a screen for inputting the heard sound. When the operation unit 13 is operated and characters are input while the screen is displayed, the mobile electronic device 1 displays the input characters. In addition, the mobile electronic device 1 displays a screen for notifying the user whether or not the character of the presentation sound matches the input character. As described above, the mobile electronic device 1 outputs the presentation sound while controlling the display 2 while displaying the screen on the display 2, and performs control to adjust the correction parameter for each frequency range, each vowel, each voiced consonant, Perform with unvoiced consonants. The portable electronic device 1 sets the correction parameter for each frequency as described above.

  Hereinafter, the correction parameter setting operation of the mobile electronic device 1 will be described in more detail with reference to FIG. Here, FIG. 16 is a flowchart showing an example of the operation of the portable electronic device. Note that the operation shown in FIG. 16 may be processed by executing an application stored in the storage unit 24. The program can be downloaded and acquired from the outside.

  First, the processing unit 22 of the portable electronic device 1 reproduces a presentation sound (test sound) as step S212. That is, the processing unit 22 of the portable electronic device 1 generates a presentation sound (test sound) by the presentation sound generation unit 22 d and outputs the presentation sound from the receiver 16 or the speaker 17 via the voice processing unit 30. As the presentation sound, as described above, it is preferable to use words and sentences that are likely to cause various mistakes. In addition, the mobile electronic device 1 uses a sound that is just below the set unpleasant threshold (for example, a sound that is slightly smaller than the unpleasant threshold) or a sound that is just below the set audible threshold (for example, a sound that is slightly larger than the audible threshold). ) Is preferably output.

  After reproducing the presentation sound in step S212, the processing unit 22 displays an input screen as step S214. That is, a screen for inputting what the presentation sound is heard, what words and sentences are heard is displayed. After displaying the input screen in step S214, the processing unit 22 determines whether the input is completed in step S216. Here, the processing unit 22 determines that the input has been completed when the necessary number of characters has been input or when a certain time has elapsed. If the processing unit 22 determines in step S216 that the input has not been completed (No in step S216), the processing unit 22 proceeds to step S216. That is, the processing unit 22 repeats the process of step S216 until the input is completed. Note that when the operation unit 13 is operated and characters are input during the process of step S216, the processing unit 22 performs control by reflecting the input characters.

  If it is determined in step S216 that the input has been completed (Yes in step S216), the processing unit 22 determines in step S218 whether the presentation sound matches the input character. If it is determined in step S218 that the presentation sound matches the input character (Yes in step S218), the processing unit 22 ends the process. If it is determined in step S218 that the presentation sound does not match the input character (No in step S218), the processing unit 22 adjusts the correction parameter and ends the process in step S220.

  Next, a correction parameter adjustment process based on the fact that the presentation sound and the input character in step S220 do not match will be described using FIG. Here, FIG. 17 is a flowchart showing an example of the operation of the portable electronic device. Note that the operation shown in FIG. 17 may also be processed by executing an application stored in the storage unit 24. The program can be downloaded and acquired from the outside.

  First, the processing unit 22 determines whether the vowels do not match as step S240. If it is determined in step S240 that the vowels do not match (Yes in step S240), the processing unit 22 specifies the target frequency in the frequency range of the vowel as step S242. That is, the frequency band corresponding to the mismatched vowels or one or more frequencies are specified. When the processing unit 22 identifies the frequency in step S242, the processing unit 22 proceeds to step S250.

  If it is determined in step S240 that the vowels do not match (No in step S240), that is, if all the vowels match, it is determined in step S244 whether the voiced consonants do not match. If it is determined in step S244 that the voiced consonants do not match (Yes in step S244), the processing unit 22 specifies the target frequency in the frequency range of the voiced consonant as step S246. That is, the frequency band corresponding to the non-matched voiced consonant or one or more frequencies are specified. When the processing unit 22 specifies the frequency in step S246, the processing unit 22 proceeds to step S250.

  If the processing unit 22 determines in step S244 that the voiced consonants are not inconsistent (No in step S244), that is, the mismatched speech is an unvoiced consonant, in step S248, the processing unit 22 performs the target in the frequency range of the unvoiced consonant. Specify the frequency. That is, the frequency band corresponding to the unvoiced unvoiced consonant or one or more frequencies are specified. When the processing unit 22 specifies the frequency in step S248, the processing unit 22 proceeds to step S250.

  When the processing of step S242, step S246, and step S248 is completed, the processing unit 22 determines whether the output of the mismatched sound is close to the unpleasant threshold as step S250. That is, in step S250, the processing unit 22 determines whether the output level of the unmatched sound is close to the unpleasant threshold or the audible threshold, and the cause of the mistaken listening is greater than the user's unpleasant threshold. Or because it is smaller than the audible threshold.

  If the processing unit 22 determines in step S250 that the output of the mismatched sound is close to the unpleasant threshold (Yes in step S250), that is, the output of the mismatched sound is closer to the unpleasant threshold than the audible threshold, step S252 is performed. Decrease the discomfort threshold of the corresponding frequency. That is, the unpleasant threshold value of the frequency to be adjusted is set to a smaller value. When the process of step S252 ends, the processing unit 22 proceeds to step S256.

  If the processing unit 22 determines in step S250 that the output of the mismatched sound is not close to the unpleasant threshold (No in step S250), that is, the output of the mismatched sound is closer to the audible threshold than the unpleasant threshold, step S254 is performed. , Increase the audible threshold of the corresponding frequency. That is, the audible threshold value of the frequency to be adjusted is set to a larger value. When the process of step S254 ends, the processing unit 22 proceeds to step S256.

  When the processing of step S252 and step S254 is completed, the processing unit 22 determines whether all the unmatched sounds have been corrected, that is, whether the correction process for the unmatched sounds has been completed, as step S256. If it is determined in step S256 that all unmatched sounds have not been corrected (No in step S256), that is, there is a mismatched sound that has not been corrected, the processing unit 22 proceeds to step S240 and repeats the above processing. As a result, the processing unit 22 performs threshold value correction processing on all sounds determined to be inconsistent. If the processing unit 22 determines in step S256 that all non-matching sounds have been corrected (Yes in step S256), the processing ends.

  The portable electronic device 1 sets the correction parameter for each frequency as described above. In the portable electronic device 1, when an audio signal is input, the output sound correction unit 34 corrects the audio signal based on the set correction parameter and outputs the corrected audio signal to the audio processing unit 30. Thereby, the portable electronic device 1 can correct the audio signal with the correction parameter set in accordance with the user's hearing (how to hear the sound, characteristics of hearing), and can output the sound that is easier to hear for the user. .

  Furthermore, the processing unit 22 repeatedly executes the flow shown in FIGS. 16 and 17 using various words and sentence presentation sounds, thereby converging the correction parameter to a value suitable for the user and making the sound easy to hear by the user. Can be output.

  Further, the processing unit 22 periodically executes the flow shown in FIGS. 16 and 17 (for example, every 3 months, every 6 months, etc.), so that even if the user's hearing changes, It is possible to output a voice that is easier for the user to hear.

  In addition, the processing unit 22 uses a word as a presentation sound, inputs a word heard by the user, and performs a comparison, thereby using a word that is actually heard during telephone communication or TV broadcast viewing. Correction processing can be performed. Thereby, the correction parameters can be adjusted more appropriately, and telephone conversation and television broadcast viewing can be performed more smoothly.

  Further, as in the present embodiment, the processing unit 22 analyzes the presentation sound into vowels, voiced consonants, and unvoiced consonants, and sets correction parameters for each corresponding frequency, thereby making it easier to hear. Audio can be output.

  In addition, since the sound that has been heard can be input as characters, the processing unit 22 can detect the user's input reliably and without mistakes, and can correct the sound with higher accuracy. In addition, the mobile electronic device 1 adjusts the correction parameter, inputs characters as in the present embodiment, and displays the result, that is, the matching result on the display 2, so that the user gradually. Can make it easier to hear. As a result, the correction parameter can be set with high satisfaction and low stress. Further, it is possible to cause the user to set the correction parameter as if it were a game.

  Moreover, in the said embodiment, although the input column of character input was made into the number corresponding to the number of characters, this invention is not limited to this. For example, a text input screen may simply be displayed.

  Moreover, the portable electronic device 1 can use various output methods as an output method of a presentation sound. For example, a preset voice may be used, or a voice used in a call may be sampled and used. In addition, the correction parameter may be set so that a specific caller reads out the text information prepared in advance, acquires the text information and the voice information, and inputs the character information heard while the user listens to the voice information. Can be set. In addition, by using the voice of the specific target as the presentation sound, it is possible to make the voice of the specific target easier to hear, and a call with the specific target can be performed more smoothly.

  The correction parameter setting method by the correction parameter setting unit 22a is not limited to this. For example, the call voice during a call may be analyzed by the spectrum analysis unit 22c, and the correction parameter may be set based on the user's impression (for example, difficult to hear or can be heard) of the analysis result of the spectrum analysis unit 22c. Note that there are various input methods such as item selection, character input, and voice input as the user's impression input method. Moreover, you may make it output the audio | voice of a sample from the presentation sound production | generation part 22d.

  In addition, the portable electronic device 1 can use various output methods as a method for outputting the presentation sound when the correction parameter is set. For example, a preset voice may be used, or a voice used in a call may be sampled and used. In addition, the correction parameter may be set so that a specific caller reads out the text information prepared in advance, acquires the text information and the voice information, and inputs the character information heard while the user listens to the voice information. Can be set. In addition, by using the voice of the specific target as the presentation sound, it is possible to make the voice of the specific target easier to hear, and a call with the specific target can be performed more smoothly.

  Here, when the correction parameter is set for a plurality of users, the mobile electronic device 1 performs the correction parameter setting process described above for each user, thereby correcting the correction parameter for each user. Can be set. When setting correction parameters, user identification information is also set in association with each other.

  The processing unit 22 preferably sets the correction parameter corresponding to the frequency actually output by the voice processing unit 30, and more preferably sets the correction parameter corresponding to the frequency used for telephone communication. Is preferred. In this way, by setting the correction parameter for the frequency that is actually used, the sound output from the portable electronic device 1 can be made easier to hear. Here, the frequency for setting the correction parameter is set, for example, for the frequency used in the CELP (Code Excited Linear Predictive Coding) method, the EVRC (Variable Rate Speech Codec) method, and the AMR (Adaptive Multirate) method. It is preferable to do.

  In the above embodiment, the correction parameter is set by the portable electronic device 1, but the present invention is not limited to this. The correction parameter may be set by another electronic device, and the set correction parameter may be stored in the portable electronic device 1. In addition, the correction parameter corresponding to the condition at the time of use can be made by setting the correction parameter based on the sound generated from the mobile electronic device 1 as in the above embodiment.

  In this embodiment, the correction parameter setting process and the correction parameter selection process are performed by the processing unit 22, but the present invention is not limited to this. The portable electronic device 1 may execute various arithmetic processes on a server that can communicate via the transmission / reception unit 26. That is, the arithmetic processing itself may be performed outside. In this case, the portable electronic device 1 transmits identification information to the server, receives correction parameters from the server, and the like. In this way, the load applied to the portable electronic device 1 can be reduced by performing calculations on the server or setting correction parameters. Alternatively, a correction parameter may be set in advance on a server that performs communication, and the server may correct the audio signal based on the correction parameter. That is, the above-described processing may be performed using the server and the portable electronic device as one system. Thereby, since the portable electronic device 1 can receive the sound signal corrected in advance, the correction process itself can be prevented from being executed.

  Here, FIG. 18 is a schematic diagram illustrating a schematic configuration of a communication system including a portable electronic device. A communication system (voice control system) 201 illustrated in FIG. 18 includes portable electronic devices 1 and 1a, servers 202 and 202a, a communication network 203, and a database 204. In addition, the number of each part which comprises the communication system 201 is not specifically limited, Each part may be provided with the some apparatus. For example, a plurality of portable electronic devices 1 and 1a may be provided for one server 202 and 202a.

  The server 202 has various data such as information (telephone number and address) specifying each communication device, and communicates with the portable electronic device 1 via the communication network to supply various information. The server 202 and the portable electronic device 1 communicate with each other via a communication network that is formed by a base station and a relay station and that wirelessly transmits and receives communication waves. In addition, the communication network can use various communication methods as long as communication can be performed between the server 202 and the portable electronic device 1. For example, communication may be performed using a satellite line.

  The servers 202 and 202a also receive information from the mobile electronic device 1 and communicate information to other communication devices via the communication network 203 based on the information, and also relay information. That is, the server 202 collects and stores information sent from each communication device, and supplies (provides) the collected information to the communication device as necessary. The server 202a can also process (process) the collected information and supply it to the communication device.

  The communication network 203 includes an exchange and a wired / wireless communication line. The communication network 203 performs information communication between a communication device and another communication device using a wired or wireless communication line. Specifically, the communication network 203 performs information communication between the server 202 and the server 202 a and information communication between the servers 202 and 202 a and the database 204. The communication network 203 may be a communication network similar to the communication network connecting the server 202 and the portable electronic device 1 or may be a different communication network. Further, an Internet communication network can be used as the communication network 203.

  The database 204 is a storage device, and stores various data necessary for processing in the portable electronic device 1, such as correction parameter information and user information for analyzing identification information. The database 204 supplies various stored information to the server 202 or the server 202a via the communication network 203.

  In the system as described above, the communication system 201 sends the identification information acquired by the mobile electronic device 1 to the server 202, and the server 202 acquires necessary information from the database 204 and determines the correction parameter to be used. The use correction parameter may be sent to the portable electronic device 1 and the use correction parameter sent by the portable electronic device 1 may be used. Thereby, the portable electronic device 1 can correct the output sound similar to the above by outputting the acquired identification information to the server 202 and using the information supplied from the server 202. Thereby, the processing amount and storage amount in the portable electronic device 1 can be reduced. Further, by using a common server as the server 202, the same correction processing can be performed even when communication is performed with other communication devices.

  Moreover, the process performed by the server and the process performed by the portable electronic device can be divided into various shares. For example, the server may perform output sound correction processing based on the correction parameters. Thereby, the process of a portable electronic device can be reduced more. In the case where the call operation between the mobile electronic device 1 and another communication device is relayed by the server, this processing can be performed by correcting the sound supplied from the server to the mobile electronic device.

  In addition, the identification information and the correction parameter are stored in the server 202, and the determination of the user and the determination of the correction parameter are performed, so that once the identification information and the correction parameter are set, the same applies when another electronic device is used. Correction can be performed using correction parameters. As a result, when an electronic device that can communicate with the server 202 is used, the user can output sound that can be easily heard by the user regardless of which electronic device is used, and is output from the electronic device. It becomes easier to hear the voice.

  As described above, the present invention is useful for outputting sound.

DESCRIPTION OF SYMBOLS 1 Portable electronic device 1C Case 2 Display 13 Operation part 13A Operation key 13B Direction and determination key 22 Processing part 22a Correction parameter setting part 22b Speech analysis part 22c Spectrum analysis part 22d Presentation sound generation part 22e Correction function control part 24 Storage part 30 Audio processing unit 32 Display unit 34 Output sound correction unit 35 Acceleration sensor 36 Fingerprint sensor 38 Camera

Claims (11)

A housing,
A sound generator provided in the housing for generating sound based on an audio signal;
A storage unit provided in the housing for storing user information and the correction parameters of the user;
An identification information acquisition unit that is provided in the housing and acquires identification information for identifying a user who is listening to the sound generated by the sound generation unit;
When it is determined whether the user is the user based on the identification information acquired by the identification information acquisition unit and the information of the user in the storage unit, and the user is the user Reads a correction parameter of the user from the storage unit, and sets the read correction parameter as a use correction parameter;
A correction unit that corrects an audio signal based on the use correction parameter set by the processing unit and supplies the corrected audio signal to the sound generation unit;
A portable electronic device comprising: A housing,
A communication unit that communicates with other devices;
A sound generator provided in the housing for generating sound based on an audio signal;
An identification information acquisition unit that is provided in the housing and acquires identification information for identifying a user who is listening to the sound generated by the sound generation unit;
Corresponding to the identification information of the user who is provided in the case and transmits the identification information to another device via the communication unit and listening to the sound generated by the sound generation unit from the other device A processing unit for acquiring a correction parameter to be set, and setting the acquired correction parameter as a use correction parameter;
A correction unit that corrects an audio signal based on the use correction parameter and supplies the corrected audio signal to the sound generation unit;
A portable electronic device comprising: The identification information acquisition unit is a microphone that acquires sound;
The portable electronic device according to claim 1, wherein the processing unit acquires a voice acquired by the microphone as the identification information and identifies the user. The identification information acquisition unit is a camera that is disposed in the vicinity of the sound generation unit and acquires an image of a region facing the sound generation unit,
The said processing part acquires the image of the area | region which faces the said sound generation part detected with the said camera as said identification information, The said user is identified, The any one of Claim 1 to 3 characterized by the above-mentioned. The portable electronic device described. The identification information acquisition unit is a fingerprint sensor that detects a fingerprint that contacts a predetermined position of the housing,
5. The portable electronic device according to claim 1, wherein the processing unit acquires a fingerprint detected by the fingerprint sensor as the identification information and identifies the user. 6. It further has a voice call function unit for making voice calls,
The portable electronic device according to claim 5, wherein the fingerprint sensor is disposed at a portion that contacts when the voice call function is started. An acceleration sensor for detecting acceleration acting on the housing;
The said process part acquires the said identification information again, and detects the said user, if the movement beyond the threshold value preset by the said acceleration sensor is detected, The said user is detected. Item 1. A portable electronic device according to item 1.   The portable electronic device according to any one of claims 1 to 7, wherein the correction parameter is a parameter for adjusting a sound volume for each audio frequency.   9. The portable electronic device according to claim 8, wherein the correction parameter is a parameter for correcting the sound generated from the sound generating unit to have a magnitude between an unpleasant threshold value and an audible threshold value. A sound generator that generates sound based on an audio signal;
An identification information acquisition unit for acquiring identification information for identifying a user who is listening to the sound generated by the sound generation unit;
A storage unit for storing user information and the correction parameters of the user;
When the user is the user stored in the storage unit, the correction parameter of the user is read from the storage unit, and the sound generated from the sound generation unit is corrected based on the read correction parameter. A control unit for performing control, and
A signal circuit network for transmitting or receiving a signal between the control unit and each other unit in a wired or wireless manner;
The sound generation system and the identification information acquisition unit are provided in a casing that can be carried by a user.   The voice control system according to claim 10, wherein one or both of the storage unit and the control unit are provided in a server.

Images