JP5582946B2 - Portable electronic device and voice control system - Google Patents

Description

  The present invention relates to a portable electronic device that outputs sound and a sound control system.

  Mobile electronic devices such as mobile phones and mobile TVs output audio. Here, among users of portable electronic devices, there are users whose hearing ability is reduced due to aging or the like and it is difficult to hear the output sound.

  On the other hand, for example, Patent Document 1 describes a mobile device with a voice correction function that corrects frequency characteristics and levels of voice output from a receiver or the like in accordance with auditory changes due to age.

JP 2000-209698 A

  Here, there are various causes of hearing loss, such as aging, illness, and noise exposure, and the degree of hearing loss varies widely. For this reason, as described in Patent Document 1, it is not possible to correct a sound sufficiently satisfactory for the user only by correcting the frequency characteristics and level of the sound output from the receiver or the like according to the age.

  An object of the present invention is to provide a portable electronic device and a sound control system that can appropriately correct a sound to be output and can output a sound that can be easily heard by a user.

  A portable electronic device according to the present invention includes a housing, a sound generator that is provided in the housing and generates sound based on an audio signal, and is provided in the housing and includes at least a right ear correction parameter. And a storage unit that stores either the correction parameter for the left ear or the left ear, and a sound that is provided in the housing and that is generated by the sound generation unit is heard as the right ear or as the ear. An identification information acquisition unit for acquiring identification information for identifying whether the right ear is heard as the listening ear or the left ear as the listening ear based on the identification information acquired by the identification information acquisition unit. If a correction parameter corresponding to the detected ear is detected, the correction parameter is read from the storage unit, and the read correction parameter is set as a use correction parameter. Ri based on the set the used correction parameter to correct the sound signal, characterized in that the corrected audio signal and a correction unit for supplying the sound generator.

  Here, the storage unit further stores information on the dominant ear of the user, and the processing unit stores the correction parameter if there is a correction parameter corresponding to the dominant ear before the detection of the listening ear. It is preferable to set as a use parameter.

  A portable electronic device according to the present invention includes a housing, a communication unit that communicates with other devices, a sound generator that is provided in the housing and generates sound based on an audio signal, and the housing. An identification information acquisition unit for acquiring identification information for identifying whether the right ear is heard as an ear or the left ear is heard as an ear, and the casing; The identification information is transmitted to the other device via the communication unit, and the right ear correction parameter or the left ear correction parameter corresponding to the detected ear is obtained from the other device. Then, a processing unit that sets the acquired correction parameter as a use correction parameter, and a sound signal is corrected based on the use correction parameter set by the processing unit, and the corrected sound signal is supplied to the sound generation unit. A correction unit; Characterized in that it comprises.

  Here, the identification information acquisition unit is an acceleration sensor that detects acceleration acting on the casing, and the processing unit acquires the movement direction of the casing detected by the acceleration sensor as the identification information, It is preferable to detect the listening ear.

  Moreover, it is preferable that the processing unit detects a listening ear when the acceleration sensor detects an acceleration of a certain level or more.

  The identification information acquisition unit is a camera that is arranged in the vicinity of the sound generation unit and acquires an image of a region facing the sound generation unit, and the processing unit is the sound generation unit detected by the camera. It is preferable that an image of a region facing the user is acquired as the identification information to detect the listening ear.

  The identification information acquisition unit is a pressure sensor that detects acceleration acting on the housing, and the processing unit is configured to control a hand holding the housing based on the pressure detected by the pressure sensor. It is preferable to detect, acquire the gripped hand as the identification information, and detect the listening ear.

  The identification information acquisition unit is an optical sensor that detects a distribution of light applied to the casing, and the processing unit is configured to detect the distribution of the light detected by the optical sensor. It is preferable that the orientation is determined, the orientation of the housing is acquired as the identification information, and the listening ear is detected.

  The correction parameter is preferably a parameter for adjusting the volume of sound for each audio frequency.

  Further, the correction parameter is preferably a parameter for correcting the sound generated from the sound generating unit so as to have a magnitude between an unpleasant threshold value and an audible threshold value.

  The sound control system according to the present invention identifies a sound generation unit that generates sound based on a sound signal and whether the sound generated by the sound generation unit is a right ear or a left ear. The identification information acquisition unit for acquiring the identification information, the storage unit for storing correction parameters for one or both of the right ear and the left ear, and the use when the user is listening to the right ear or the left ear. A correction parameter corresponding to the person's ear is read from the previous storage unit, and a control unit that performs control to correct the sound generated from the sound generation unit based on the read correction parameter; and the control unit and each of the other units And a signal circuit network for transmitting or receiving signals in a wired or wireless manner, and at least the sound generation unit and the identification information acquisition unit are provided in a casing that can be carried by a user. And wherein the door.

  Here, in the voice control system, it is preferable to provide one or both of the storage unit and the control unit in a server.

  According to the present invention, it is possible to appropriately correct the sound to be output in accordance with the hearing ability of each user, and it is possible to output a sound that is easier for the user to hear.

FIG. 1 is a front view showing a schematic configuration of an embodiment of a portable electronic device. FIG. 2 is a side view of the portable electronic device shown in FIG. FIG. 3 is a block diagram illustrating a schematic configuration of functions of the portable electronic device illustrated in FIGS. 1 and 2. FIG. 4 is a diagram illustrating an example of human hearing characteristics. FIG. 5 is a diagram illustrating an example of hearing characteristics of a hearing impaired person. FIG. 6 is a diagram illustrating examples of the audible threshold value and the unpleasant threshold value. FIG. 7 is a diagram in which the magnitudes and frequencies of vowels, voiced consonants and unvoiced consonants are superimposed on FIG. FIG. 8 is a diagram obtained by simply amplifying the treble (consonant) of FIG. FIG. 9 is a diagram in which compression processing is performed on the loud sound of FIG. FIG. 10 is a flowchart for explaining an example of the operation of the portable electronic device. FIG. 11 is an explanatory diagram for explaining the operation of the mobile electronic device. FIG. 12 is an explanatory diagram for explaining the operation of the mobile electronic device. FIG. 13 is an explanatory diagram for explaining the operation of the mobile electronic device. FIG. 14 is a flowchart for explaining an example of the operation of the mobile electronic device. FIG. 15 is a flowchart for explaining an example of the operation of the mobile electronic device. FIG. 16 is an explanatory diagram for explaining the operation of the mobile electronic device. FIG. 17 is an explanatory diagram for explaining the operation of the mobile electronic device. FIG. 18 is an explanatory diagram for explaining the operation of the mobile electronic device. FIG. 19 is an explanatory diagram for explaining the operation of the mobile electronic device. FIG. 20 is a schematic diagram illustrating a schematic configuration of a communication system including a portable electronic device.

  Hereinafter, the present invention will be described in detail with reference to the drawings. The present invention is not limited to the following description. In addition, constituent elements in the following description include those that can be easily assumed by those skilled in the art, those that are substantially the same, and those in a so-called equivalent range. In the following, a cellular phone is taken as an example of a portable electronic device, but the application target of the present invention is not limited to a cellular phone. For example, a PHS (Personal Handy-phone System), a PDA, a portable navigation device, a notebook The present invention can also be applied to personal computers, game machines, and the like. The present invention can also be applied to a system including a portable electronic device.

  FIG. 1 is a front view showing a schematic configuration of an embodiment of a portable electronic device according to the embodiment, and FIG. 2 is a side view of the portable electronic device shown in FIG. A portable electronic device 1 shown in FIGS. 1 and 2 is a mobile phone having a wireless communication function, an output unit, and a voice acquisition unit. In the portable electronic device 1, the housing 1C is composed of a plurality of housings. Specifically, the housing 1C is configured to be openable and closable by a first housing 1CA and a second housing 1CB. That is, the portable electronic device 1 has a foldable housing. In addition, the housing | casing of the portable electronic device 1 is not limited to such a structure. For example, the casing of the portable electronic device 1 may be a sliding casing that allows one casing and the other casing to slide from each other in a state where both casings are overlapped, It may be a rotary type in which one casing is rotated around an axis along the overlapping direction, or both casings are connected via a biaxial hinge.

  1st housing | casing 1CA and 2nd housing | casing 1CB are connected by the hinge mechanism 8 which is a connection part. By connecting the first casing 1CA and the second casing 1CB with the hinge mechanism 8, the first casing 1CA and the second casing 1CB rotate together around the hinge mechanism 8 and move away from each other. And it is comprised so that it can rotate in the direction (direction shown by arrow R of FIG. 2) which mutually approaches. When the first casing 1CA and the second casing 1CB rotate in a direction away from each other, the portable electronic device 1 opens, and when the first casing 1CA and the second casing 1CB rotate in a direction approaching each other, the portable electronic device 1 opens. The device 1 is closed and folded (a state indicated by a dotted line in FIG. 2).

  The first housing 1CA is provided with a display 2 shown in FIG. 1 as a display unit. The display 2 displays a standby image when the portable electronic device 1 is waiting for reception, or displays a menu image used for assisting the operation of the portable electronic device 1. A touch sensor 39 is disposed on the surface of the display 2. In addition, the first housing 1CA is provided with a receiver 16 that is an output unit that outputs sound when the mobile electronic device 1 is in a call. In addition, on the surface of the first housing 1CA opposite to the surface on which the display 2 is disposed, the position in the longitudinal direction is in the vicinity of the receiver 16, and the light detection element 36a is disposed at both ends in the lateral direction. A light detection element 36b is provided. A camera 38 is provided in the vicinity of the receiver 16 on the surface where the display 2 of the first housing 1CA is disposed.

  The second casing 1CB is provided with a plurality of operation keys 13A for inputting a telephone number of a call partner, a mail, etc., and selection and determination of a menu displayed on the display 2 and a screen. A direction and determination key 13B for easily executing scrolling and the like are provided. The operation key 13 </ b> A and the direction / decision key 13 </ b> B constitute the operation unit 13 of the mobile electronic device 1. In addition, the second casing 1CB is provided with a microphone 15 that is a voice acquisition unit that receives voice when the mobile electronic device 1 is in a call. The operation unit 13 is provided on the operation surface 1PC of the second housing 1CB shown in FIG. The surface opposite to the operation surface 1PC is the back surface 1PB of the portable electronic device 1. Further, pressure detection elements 37a and 37b constituting the pressure sensor 37 are provided on two side surfaces (two side surfaces parallel to the longitudinal direction) of the second housing 1CB, respectively.

  An antenna is provided inside the second housing 1CB. The antenna is a transmission / reception antenna used for wireless communication, and is used for transmission / reception of radio waves (electromagnetic waves) related to calls, electronic mails, and the like between the portable electronic device 1 and a base station. In addition, the microphone 15 is provided in the second housing 1CB. The microphone 15 is arranged on the operation surface 1PC side of the portable electronic device 1 shown in FIG.

  Here, in the present embodiment, as shown in FIG. 1, the receiver 16 side (the direction of the arrow 102) is the upward direction in the direction toward the display 2 of the first casing 1CA, and the hinge 8 (second casing 1CB). ) Side (the direction of the arrow 104) is the downward direction. Further, the left side (direction of arrow 106) in FIG. 1 is the right direction, and the right side (direction of arrow 108) in FIG. 1 is the left direction.

  FIG. 3 is a block diagram illustrating a schematic configuration of functions of the portable electronic device illustrated in FIGS. 1 and 2. As illustrated in FIG. 3, the mobile electronic device 1 includes a processing unit 22, a storage unit 24, a transmission / reception unit 26, an operation unit 13, an audio processing unit 30, a display unit 32, and an output sound correction unit 34. , An acceleration sensor 35, an optical sensor 36, a pressure sensor 37, a camera 38, and a touch sensor 39. The processing unit 22 has a function of comprehensively controlling the overall operation of the mobile electronic device 1. In other words, the processing unit 22 transmits and receives various processes of the mobile electronic device 1 so as to be executed in an appropriate procedure according to the operation of the operation unit 13 and the software stored in the storage unit 24 of the mobile electronic device 1. The operations of the unit 26, the voice processing unit 30, the display unit 32, and the like are controlled.

  Various processes of the portable electronic device 1 include, for example, a voice call performed via a circuit switching network, creation and transmission / reception of an electronic mail, browsing of a Web (World Wide Web) site on the Internet, and the like. Examples of operations of the transmission / reception unit 26, the audio processing unit 30, and the display unit 32 include transmission / reception of signals by the transmission / reception unit 26, input / output of audio by the audio processing unit 30, display of images by the display unit 32, and the like. .

  The processing unit 22 executes processing based on a program (for example, an operating system program, application program, etc.) stored in the storage unit 24. The processing unit 22 is constituted by, for example, a microprocessor unit (MPU: Micro Processing Unit), and executes various processes of the portable electronic device 1 described above in accordance with procedures instructed by the software. That is, the processing unit 22 sequentially reads instruction codes from an operating system program, application program, or the like stored in the storage unit 24 and executes processing.

  The processing unit 22 has a function of executing a plurality of application programs. The application program executed by the processing unit 22 includes, for example, an application program that reads and decodes various image files (image information) from the storage unit 24, and an application program that displays an image obtained by decoding on the display unit 32. There are multiple application programs.

  In the present embodiment, the processing unit 22 includes a correction parameter setting unit 22a that sets a correction parameter of the output sound correction unit 34, a voice analysis unit 22b that performs voice recognition processing, a spectrum analysis unit 22c that performs voice spectrum analysis, A presentation sound generation unit 22d that generates a presentation sound (test sound) and a correction function control unit 22e that controls an output sound correction function are provided. The functions of the correction parameter setting unit 22a, the voice analysis unit 22b, the spectrum analysis unit 22c, the presentation sound generation unit 22d, and the correction function control unit 22e are processed by the hardware resources configured by the processing unit 22 and the storage unit 24, respectively. This is realized by executing a task assigned by the control unit of the unit 22. Here, a task is a processing unit that cannot be executed at the same time among the entire processing performed by the application software or the processing performed by the same application software. The functions of the correction parameter setting unit 22a, the voice analysis unit 22b, the spectrum analysis unit 22c, and the presentation sound generation unit 22d are executed by a server that can communicate with the portable electronic device 1 via the transmission / reception unit 26. May be transmitted to the portable electronic device 1.

  The storage unit 24 stores software and data used for processing in the processing unit 22, and stores a task for operating the above-described image processing program. In addition to these tasks, for example, communication, downloaded voice data, software used by the processing unit 22 to control the storage unit 24, the telephone number or mail address of the communication partner, etc. are described in the storage unit 24. The address book to be managed, voice files such as dial tone and ring tone, temporary data used in the process of software, and the like are stored.

  In addition, the storage unit 24 further includes dominant ear information 24a which is information about the dominant ear of the user, a right ear correction parameter 24b in which a correction parameter corresponding to hearing of the right ear is set, and hearing of the left ear. A left ear correction parameter 24c in which a corresponding correction parameter is set is stored. The dominant ear information 24a is set by the user. The right ear correction parameter 24b and the left ear correction parameter 24c are set by a predetermined parameter setting process using the correction parameter setting unit 22a, the voice analysis unit 22b, the spectrum analysis unit 22c, and the presentation sound generation unit 22d. Is done.

  Note that computer programs and temporary data used in the software processing process are temporarily stored in the work area assigned to the storage unit 24 by the processing unit 22. The storage unit 24 includes, for example, a nonvolatile storage device (nonvolatile semiconductor memory such as ROM: Read Only Memory, a hard disk device, etc.), and a readable / writable storage device (for example, SRAM: Static Random Access Memory, DRAM: Dynamic Random Access Memory).

  The transmission / reception unit 26 has an antenna 26a, establishes a radio signal line by a CDMA (Code Division Multiple Access) method or the like with the base station via a channel assigned by the base station, and makes a telephone call with the base station. Perform communication and information communication. The operation unit 13 includes, for example, an operation key 13A to which various functions such as a power key, a call key, a numeric key, a character key, a direction key, a determination key, and a call key are assigned, and a direction and determination key 13B. The When these keys are input by a user operation, a signal corresponding to the operation content is generated. The generated signal is input to the processing unit 22 as a user instruction.

  The audio processing unit 30 executes processing of an audio signal input to the microphone 15 and an audio signal output from the receiver 16 and the speaker 17. That is, the sound processing unit 30 amplifies the sound input from the microphone 15 and executes AD conversion (Analog Digital conversion), and then performs signal processing such as encoding to convert the sound into digital sound data. Output to the processing unit 22. Further, the audio data sent from the processing unit 22 via the output sound correction unit 34 is subjected to processing such as decoding, DA conversion (Digital Analog conversion), amplification and the like, and converted into an analog audio signal, and then the receiver. 16 and the speaker 17. Here, the speaker 17 is disposed in the housing 1C of the portable electronic device 1, and outputs a ringtone, a mail transmission sound, and the like.

  The display unit 32 includes the display 2 described above, and displays a video corresponding to the video data supplied from the processing unit 22 and an image corresponding to the image data on the display panel. The display 2 is configured by a display panel configured by, for example, a liquid crystal display (LCD) or an organic EL (Organic Electro-Luminescence) panel. The display unit 32 may include a sub display in addition to the display 2.

  Based on the correction parameter set by the processing unit 22, the output sound correction unit 34 corrects the audio data sent from the processing unit 22 and outputs it to the audio processing unit 30. Note that the correction performed by the output sound correcting unit 34 is a correction for amplifying the input audio data with a gain that varies depending on the volume and frequency of the sound based on the correction parameter. The output sound correction unit 34 may be realized by a hardware circuit, or may be realized by a CPU and a program. When the output sound correction unit 34 is realized by a CPU and a program, the output sound correction unit 34 may be realized in the processing unit 22. Further, the function of the output sound correction unit 34 may be executed by a server that can communicate via the transmission / reception unit 26, and the server may transmit the corrected audio data to the portable electronic device 1.

  The acceleration sensor 35 is a detector that detects acceleration applied to the housing 1C. As the acceleration sensor 35, a detector that detects acceleration by various methods can be used. For example, a detector that detects acceleration by a change in capacitance, a change in piezoresistance, a change in relative position, or the like is used. Can do. The acceleration sensor 35 detects an acceleration acting on the housing 1C when the operator shakes or moves the housing 1C.

  The optical sensor 36 is a detector that calculates the intensity of incident light, and includes a light detection element 36a and a light detection element 36b. In the optical sensor 36, the light detection element 36a and the light detection element 36b calculate the light intensity at each position. As the light detection element 36a and the light detection element 36b, a photo detector using a photodiode or the like to convert received light into a voltage and detecting the light intensity based on the converted voltage value, or a photo sensor whose resistance changes depending on the light intensity. A detector that detects the intensity of light using a resistor or a light-dependent resistor (LDR), a detector that detects the intensity of light from the amount of power generation using a solar cell that generates power when receiving light, or the like can be used. .

  The pressure sensor 37 is a sensor that detects pressure, and includes a pressure detection element 37a and a pressure detection element 37b. As described above, the pressure detection element 37a and the pressure detection element 37b are provided at positions facing each other on the side surface of the second housing 1CB. The pressure sensor 37 detects, as a detection value, a pressure applied in a direction orthogonal to the surface on which the pressure detection elements 37a and 37b are provided, that is, in a direction in which the pressure detection element 37a and the pressure detection element 37b are brought closer. In addition, the pressure detection element 37a and the pressure detection element 37b detect a pressure with each element. Here, as the pressure detection element, for example, various types of pressure detection elements such as a semiconductor diaphragm type, a capacitance type, an elastic diaphragm type, a piezoelectric type, and a vibration type can be used.

  The camera 38 is an imaging mechanism that is provided on the upper surface of the first housing 1CA and acquires an image of an area facing the display 2.

  The touch sensor 39 is a sensor that detects contact, and is disposed on the surface of the display 2 (surface on which an image is displayed). The touch sensor 39 can detect contact with the surface. The mobile electronic device 1 displays characters, figures, images, and the like on the display 2 and detects various operations performed on the touch sensor 39 using a finger, a stylus, a pen, and the like, thereby detecting a user operation. can do. That is, the portable electronic device 1 can execute the function of the touch panel operation unit by the touch sensor 39 and the display 2. As the touch sensor 39, a touch sensor 39 (or a touch panel in which the touch sensor 39 and the display 2 are combined) using various methods such as a capacitance method, a surface acoustic wave method, and a resistive film method can be used.

  Here, human hearing will be described with reference to FIGS. FIG. 4 is a graph showing the relationship between the volume of sound entering the human ear and the volume of sound that humans can hear (feel). In the case of a normal hearing person, the volume of sound that enters the ear and the volume of sound that can be heard are in a proportional relationship. On the other hand, in the case of a hearing-impaired person (elderly person, person with ear illness, etc.), as a general image, it is hardly audible until the volume of the sound entering the ear reaches a certain value. When the loudness exceeds a certain value, the sound can be heard in proportion to the sound entering the ear. In other words, it is considered that a person with a general image should simply amplify the sound that enters the ear. However, in reality, a hearing-impaired person hardly hears until the volume of sound entering the ear reaches a certain value, and when the volume of sound entering the ear exceeds a certain value, it may be heard as a loud sound suddenly. become. Thereby, a hearing-impaired person will hear the change of 10 dB in the change of 20 dB, for example. Therefore, it is necessary to perform compression processing (processing for making the gain for a loud sound smaller than the gain for a small sound) on a loud sound. FIG. 5 is a graph showing frequency characteristics of hearing ability of the hearing impaired. As shown in FIG. 5, it can be seen that a hearing-impaired person can hear low sounds well, but high sounds are difficult to hear. Note that the characteristic shown in FIG. 5 is an example, and the frequency characteristic that can be heard varies depending on the user.

  FIG. 6 is a diagram illustrating an example of the relationship between the volume of sound output by a normal hearing person and a hearing impaired person, and an audible threshold value and an unpleasant threshold value. The audible threshold is a lower limit sound volume at which a sound can be properly heard, for example, a sound that can be heard at 40 dB. Sounds that are smaller than the audible threshold are small and difficult to hear. The unpleasant threshold is the upper limit sound volume at which a sound can be properly heard, for example, a sound that can be heard at 90 dB. Sounds that are greater than the unpleasant threshold are sounds that are loud and feel uncomfortable. As shown in FIG. 6, the hearing loss threshold value 42 and the discomfort threshold value 44 of the hearing impaired increase as the frequency increases. In contrast, for a normal hearing person, both the audible threshold value 46 and the unpleasant threshold value 48 are constant with respect to the volume of the output sound.

  Next, FIG. 7 shows the magnitude and frequency of vowels, voiced consonants and unvoiced consonants that are output without adjustment in the relationship between the loudness of the hearing impaired and the audible threshold and unpleasant threshold. FIG. As shown in FIG. 7, vowels that are output without adjustment, that is, output in the same state as the use state of a normal hearing person, are output as sounds in a frequency and sound volume range surrounded by a range 50. Similarly, the voiced consonant is output as a sound in the range between the frequency and the sound volume surrounded by the range 52, and the unvoiced consonant is output as a sound in the frequency and sound range surrounded by the range 54. Here, as shown in FIG. 7, the vowel range 50 and a part of the voiced consonant range 52 are included between the range in which the hearing impaired person can hear the sound, between the audible threshold 42 and the unpleasant threshold 44. A part of the consonant range 52 and the whole unvoiced consonant range 54 do not enter. For this reason, when a hearing impaired person outputs a sound with the same output as a normal hearing person, it can be seen that vowels can be heard but consonants (voiced consonants, unvoiced consonants) are hardly heard. Specifically, some voiced consonants can be heard, but unvoiced consonants are hardly audible.

  FIG. 8 is a diagram obtained by simply amplifying the treble (consonant) of FIG. The vowel range 50a shown in FIG. 8 is the same range as the vowel range 50 shown in FIG. The voiced consonant range 52a is set so that the overall loudness is larger than the voiced consonant range 52 shown in FIG. 7, that is, the range moves upward in FIG. The unvoiced consonant range 54a is also set so that the overall loudness is larger than the unvoiced consonant range 54 shown in FIG. 7, that is, the range moves upward in FIG. As shown in FIG. 8, if the voice in the frequency domain that is difficult to hear, that is, the voiced consonant range 52 a and the unvoiced consonant range 54 a are simply amplified, the louder range exceeds the unpleasant threshold 44. Treble sounds are heard in my ears. That is, the sound is distorted and the words cannot be heard clearly.

  On the other hand, in FIG. 9, the sound is corrected by the output sound correction unit 34 of the portable electronic device 1 of the present embodiment, specifically, the compression processing (the gain for the loud sound is set for the loud sound in FIG. 8). It is the figure which performed the process made smaller than the gain with respect to a small sound. The vowel range 50b shown in FIG. 9 has a smaller gain for sounds larger than the vowel range 50a shown in FIG. In the voiced consonant range 52b, the gain for a sound larger than the voiced consonant range 52a shown in FIG. 8 is reduced. The unvoiced consonant range 54b also has a smaller gain for sounds larger than the unvoiced consonant range 54a shown in FIG. As shown in FIG. 9, a small sound is amplified with a large gain, and a large sound is amplified with a small gain, so that the vowel range 50b, the voiced consonant range 52b, and the unvoiced consonant range 54b can be comfortably loud. (The size between the audible threshold 42 and the discomfort threshold 44). The portable electronic device 1 determines correction parameters for input audio data in consideration of the above matters. The correction parameter is a parameter for performing correction so that the input sound can be heard by the user as a sound having a volume between the audible threshold 42 and the discomfort threshold 44. In the portable electronic device 1, the output sound correction unit 34 performs correction to be amplified with a gain corresponding to the volume and frequency of the sound using the determined correction parameter, and outputs the correction to the sound processing unit 30. Thereby, the portable electronic device 1 can hear a sound suitably even for a user who is hard to hear.

  Next, the correction parameter setting operation of the portable electronic device will be described. When the correction parameter setting function is activated, the mobile electronic device 1 performs correction parameter setting processing by the correction parameter setting unit 22a. First, a presentation sound is generated by the presentation sound generation unit 22 d and output from the receiver 16 or the speaker 17. Here, in the present embodiment, the presentation sound is a voice to be heard by the user when setting the correction parameter, and is a word or a sentence. In addition, it is preferable to use the word and the sentence which are easy to generate mistakes as the presentation sound. For example, “safe”, “complete”, or “absolutely” can be used as the presentation sound. “Safe”, “complete” and “absolutely” are voices that are easy to misunderstand each other. In addition, “sales”, “souvenirs”, and “sides” can be used as the presentation sound. In addition, “environment”, “resonance”, and “exploration” can also be used. In the following description, it is assumed that “Inaka (countryside)” is output as the presentation sound. In addition, the presentation sound can be set to a discomfort threshold and an audible threshold, so that the sound just below the set discomfort threshold (for example, a sound slightly smaller than the discomfort threshold) or the sound just below the set audible threshold (for example, audible) It is preferable to use a sound slightly larger than the threshold.

  When the portable electronic device 1 outputs the presentation sound, the portable electronic device 1 displays a screen for inputting the heard sound. When the operation unit 13 is operated and characters are input while the screen is displayed, the mobile electronic device 1 displays the input characters. In addition, the mobile electronic device 1 displays a screen for notifying the user whether or not the character of the presentation sound matches the input character. As described above, the mobile electronic device 1 outputs the presentation sound while controlling the display 2 while displaying the screen on the display 2, and performs control to adjust the correction parameter for each frequency range, each vowel, each voiced consonant, Perform with unvoiced consonants. The portable electronic device 1 sets the correction parameter for each frequency as described above.

  The correction parameter setting method by the correction parameter setting unit 22a is not limited to this. For example, the call voice during a call may be analyzed by the spectrum analysis unit 22c, and the correction parameter may be set based on the user's impression (for example, difficult to hear or can be heard) of the analysis result of the spectrum analysis unit 22c. Note that there are various input methods such as item selection, character input, and voice input as the user's impression input method. Moreover, you may make it output the audio | voice of a sample from the presentation sound production | generation part 22d.

  In addition, the portable electronic device 1 sets the correction parameter in a state where the user outputs the sound output by the right ear, sets the right ear correction parameter, and stores the right ear correction parameter in the storage unit 24. Further, the portable electronic device 1 sets the correction parameter in a state where the output sound is heard only by the left ear, sets the correction parameter for the left ear, and stores it in the storage unit 24.

  Next, an example of processing at the time of audio output of the mobile electronic device 1 will be described with reference to FIGS. 10 to 14. Here, FIG. 10 is a flowchart for explaining an example of the operation of the portable electronic device. 11 to 13 are explanatory diagrams for explaining the operation of the portable electronic device. FIG. 14 is a flowchart for explaining an example of the operation of the mobile electronic device. Note that the processing operations shown in FIGS. 10 and 14 are basically executed when the processing unit 22 causes the correction function control unit 22e to function. Further, the process shown in FIG. 10 is performed at the time of executing a process of outputting sound from the receiver 16 and the speaker 17 such as during a call. Further, the process shown in FIG. 10 is a process for acquiring identification information for identifying the use state by the acceleration sensor 35 and setting a correction parameter to be used based on the acquired information.

  The processing unit 22 of the portable electronic device 1 determines whether the start process completed flag is ON in step S12. Here, the start process completed flag is a flag indicating whether or not a process executed at the start of a process of outputting a sound, for example, a telephone call or a call button is pressed. If it is determined in step S12 that the start process completed flag is not ON (No), that is, if the start process completed flag is OFF, the processing unit 22 sets dominant ear information in the used ear data in step S14. That is, the processing unit 22 reads information stored in the dominant ear information 24a of the storage unit 24, and sets the read ear information as a use ear (an ear used for listening to sound). After setting the use ear data in step S14, the processing unit 22 turns on the start process completion flag in step S16, and then proceeds to step S32.

  If it is determined in step S12 that the start process completed flag is ON (Yes), the processing unit 22 determines whether an acceleration equal to or greater than the threshold value ThH is detected in either the left or right direction in step S20. Note that the threshold value ThH is a preset value and is an acceleration at which it can be determined that the housing 1C has moved. If it determines with the process part 22 not detecting the acceleration more than threshold value ThH in any of the left-right direction in step S20 (No), it will progress to step S32.

  If the processing unit 22 determines in step S20 that an acceleration equal to or greater than the threshold value ThH has been detected in either the left or right direction (Yes), the process proceeds to step S22. In other words, when the processing unit 22 detects an acceleration equal to or greater than the threshold value ThH in either the direction of the arrow 106 or the direction of the arrow 108, the process proceeds to step S22. For example, as shown in FIG. 12, the user moves the mobile electronic device 1 on the table and moves it closer to his / her face, specifically, the trajectory indicated by the arrow 120 (the left direction (arrow 108 for the mobile electronic device 1). When the movement to the right ear is performed on the (direction) side), or the movement to the left ear is performed on the trajectory indicated by the arrow 122 (right direction (direction of the arrow 106 for the portable electronic device 1)), the processing unit 22 The acceleration generated by the movement is detected and it is determined that the portable electronic device 1 has moved, and the process proceeds to step S22.

  Next, if it determines with Yes by step S20, the process part 22 will determine whether the acceleration of the left-right direction was stabilized below threshold value ThL as step S22. Here, the threshold value ThL is a preset value, and is an acceleration that can be determined that the housing 1C is not moving. The threshold value ThL is a value higher than the acceleration that occurs due to camera shake or the like. Note that the processing unit 22 determines that the acceleration is stable if a state where the acceleration is equal to or less than the threshold value ThL continues for a predetermined time. If the processing unit 22 determines in step S22 that the lateral acceleration is not stable below the threshold ThL (No), the processing unit 22 proceeds to step S22. That is, when the processing unit 22 detects the acceleration equal to or greater than the threshold value ThH in either the left or right direction in step S20, the processing unit 22 repeats the process of step S22 until the lateral acceleration is stabilized to be equal to or less than the threshold value ThL.

  If the processing unit 22 determines in step S22 that the acceleration in the left-right direction is stable below the threshold ThL (Yes), the processing unit 22 determines the tilt direction as step S24. The processing unit 22 can detect the vertical direction based on the acceleration detected by the acceleration sensor 35, and can detect the orientation of the portable electronic device 1 from the relative relationship between the vertical direction and the orientation of the portable electronic device 1. If it is determined in step S24 that the tilt direction is not present, the processing unit 22 proceeds to step S26. If the tilt direction is determined to be right, the processing unit 22 proceeds to step S28. If the tilt direction is determined to be left, the processing unit 22 proceeds to step S30. .

  If the processing unit 22 determines in step S24 that there is no tilt direction, that is, the housing 1C is not tilted in the right direction (arrow 106 direction) or the left direction (arrow 108 direction), in step S26, the threshold value ThH is exceeded. It is determined whether the acceleration direction is right. That is, it is determined whether the direction in which the acceleration is detected in step S20 is the right direction (the direction of arrow 106). If the processing unit 22 determines in step S26 that the detection direction is the right direction (Yes), the processing unit 22 proceeds to step S28. If the processing unit 22 determines in step S26 that the detection direction is not the right direction (No), that is, if it is determined in step S20 that the direction in which the acceleration is detected is the left direction (the direction of the arrow 108), step S30 is performed. Proceed to

  The processing unit 22 determines that the tilt direction is the right direction in step S24, that is, when the portable electronic device 1 is tilted to the right as shown in FIG. 12, and the detection direction is the right direction in step S26. Is determined, the receiver of the portable electronic device 1 is determined to be applied to the left ear, and the left ear is set in the used ear data as step S28. When the processing unit 22 sets the left ear as the usage ear data in step S28, the processing unit 22 proceeds to step S32.

  Further, the processing unit 22 determines that the tilt direction is the left direction in step S24, that is, if the portable electronic device 1 is tilted to the left as shown in FIG. 13, or the detection direction is the left direction in step S26. If it is determined that the receiver of the portable electronic device 1 is applied to the right ear, the right ear is set in the used ear data in step S30. When the processing unit 22 sets the right ear to use ear data in step S30, the processing unit 22 proceeds to step S32.

  When the processing of step S16, step S28, and step S30 is completed, or when it is determined No in step S20, the processing unit 22 determines whether a processing end trigger is generated as step S32. Here, the process end trigger is a flag indicating an instruction to end the voice correction processing by the output sound correction unit 34. For example, when a voice call is ended or an instruction to stop the output sound correction function is input. generate.

  If it is determined in step S32 that a process end trigger has not occurred (No), that is, if there is no process end trigger, the processing unit 22 proceeds to step S12 and repeats the processes from step S12 to step S32 described above.

  If the processing unit 22 determines in step S32 that a processing end trigger has occurred (Yes), in step S34, the processing unit 22 turns off the start processing completion flag and ends the present processing.

  Next, the processing unit 22 of the mobile electronic device 1 outputs a sound while correcting the sound signal based on the ear-use data set using FIG. Hereinafter, a description will be given with reference to FIG. First, processing part 22 detects use ear data as Step S40. If the processing unit 22 determines that the use ear data is the right ear in step S40, the processing unit 22 corrects the audio signal with the right ear correction parameter in step S42. That is, the processing unit 22 sets the right ear correction parameter 24b as a correction parameter (use correction parameter) when the use ear data is the right ear. Then, the output sound correction unit 34 corrects the audio signal according to the set use correction parameter, and outputs it from the audio processing unit 30.

  When the processing unit 22 determines that the use ear data is the left ear in step S40, the processing unit 22 corrects the audio signal with the left ear correction parameter in step S44. In other words, when the usage ear data is the left ear, the processing unit 22 sets the left ear correction parameter 24c as a correction parameter (use correction parameter). Then, the output sound correction unit 34 corrects the audio signal according to the set use correction parameter, and outputs it from the audio processing unit 30. When the processing of step S42 and step S44 ends, the processing unit 22 ends this processing. Note that the processing unit 22 repeats and executes the process of FIG. 14 until the process of outputting the sound ends. Note that the processing unit 22 may perform the processes of steps S42 and S44 until the use ear is reset, and may perform the process of step S40 when the use ear data is updated.

  In the portable electronic device 1, when an audio signal is input, the output sound correction unit 34 corrects the audio signal based on the set correction parameter and outputs the corrected audio signal to the audio processing unit 30. Thereby, the portable electronic device 1 can correct the audio signal with the correction parameter set in accordance with the user's hearing (how to hear the sound, characteristics of hearing), and can output the sound that is easier to hear for the user. .

  Furthermore, the processing unit 22 provides a right-ear correction parameter and a left-ear correction parameter, and outputs a voice that is easier to hear for the user by switching the correction parameter to be used depending on which ear is listening to the sound. be able to. In other words, in addition to the hearing for each user (how to hear the sound, characteristics of hearing), it is possible to correct the sound to be adapted to the left and right hearing of the user. Further, by automatically detecting whether the user is listening to the sound with the left or right ear, it is possible to set a correction parameter according to use without the user inputting an operation.

  In addition, by setting dominant ear information and setting the ear to be used based on the ear ear information in the initial setting, the ear that is likely to be used is detected when the ear being used is not detected. Correction parameters can be set.

  Further, by determining the orientation of the portable electronic device 1 based on the detection result of the acceleration sensor 35, it is possible to efficiently detect information on the ear in use. Furthermore, the user's ear can be detected by detecting information on the user's ear based on the acceleration of movement of the portable electronic device 1. Moreover, if the movement of the portable electronic device 1 is detected, it is possible to accurately detect a change in the used ear by performing processing for updating the information on the used ear.

  In addition, the processing unit 22 analyzes the presented sound into vowels, voiced consonants, and unvoiced consonants, and can set a correction parameter for each corresponding frequency to output more easily audible sound. .

  Moreover, when detecting the moving direction of the housing | casing 1C by the acceleration sensor 35 like this embodiment, it is preferable to set use ear data based on the moving direction after a call button is pressed down. Here, pressing of the call button is performed while the user visually confirms the position of the button, and thereafter, for a call, an operation of moving the housing 1C to either the left or right ear outside the field of view is performed. For this reason, after the call button is pressed, movement of the housing to the use ear side occurs with high probability, so that the use ear can be more accurately determined.

  Here, in the said embodiment, although the information of the listening ear which is hearing the sound was detected based on the information acquired with the acceleration sensor 35, it is not limited to this. The portable electronic device 1 can use various information as information for detecting the listening ear, that is, identification information, and the identification information detection unit for detecting the identification information can also use various detection units other than the acceleration sensor. it can.

  Next, another example of processing at the time of audio output of the mobile electronic device 1 will be described with reference to FIGS. 15 to 17. Here, FIG. 15 is a flowchart for explaining an example of the operation of the portable electronic device. FIGS. 16 and 17 are explanatory diagrams for explaining the operation of the portable electronic device. Further, the process shown in FIG. 15 is a process for acquiring identification information for identifying the use state by the optical sensor 36 and setting a correction parameter to be used based on the acquired information.

  The processing unit 22 of the portable electronic device 1 determines whether the start process completed flag is ON in step S12. If it is determined in step S12 that the start process completed flag is not ON (No), that is, if the start process completed flag is OFF, the processing unit 22 sets dominant ear information in the used ear data in step S14. Note that the processing in step S14 and the processing in step S16 are the same as the processing in FIG.

  If it is determined in step S12 that the start process completed flag is ON (Yes), the processing unit 22 determines whether there is a light / dark change in step S80. The light / dark change determines whether the balance of the amount of light (light intensity) to be detected has changed between the light detection element 36a and the light detection element 36b, that is, whether the element for detecting a higher light amount has been switched. If the processing unit 22 determines in step S80 that there is no change in brightness (No), the processing unit 22 proceeds to step S32.

  If the processing unit 22 determines that there is a change in brightness (Yes) in step S80, the process proceeds to step S82. Next, the process part 22 determines whether the left side is brighter than the right side as step S82. That is, the amount of light detected by the light detection element 36b arranged on the right side of the portable electronic device 1, that is, the arrow 106 side in FIG. 1, and the processing unit 22 are on the left side of the portable electronic device 1, that is, the arrow 108 in FIG. The amount of light detected by the light detecting element 36a arranged on the side is compared to determine whether the left side is brighter than the right side. That is, the processing unit 22 determines whether the light amount detected by the light detection element 36a is higher than the light amount detected by the light detection element 36b.

  If the processing unit 22 determines in step S82 that the left side is brighter than the right side (Yes), that is, the light amount detected by the light detection element 36a is higher than the light amount detected by the light detection element 36b, the processing unit 22 It is determined that the receiver is placed on the left ear, and in step S84, the left ear is set in the used ear data. When the processing unit 22 sets the left ear to use ear data in step S84, the processing unit 22 proceeds to step S32. That is, when the left side is brighter than the right side, as shown in FIG. 16, it is determined that the mobile electronic device 1 that receives more light on the upper side is placed on the left ear as shown in FIG.

  In step S82, the processing unit 22 determines that the left side is not brighter than the right side (No), that is, the right side is brighter than the left side, that is, the amount of light detected by the light detection element 36a is detected by the light detection element 36b. If it is determined that the amount of light is less than or equal to the light amount, it is determined that the receiver of the portable electronic device 1 is applied to the right ear, and the right ear is set in the usage ear data in step S86. When the processing unit 22 sets the right ear as the usage ear data in step S86, the processing unit 22 proceeds to step S32. That is, when the right side is brighter than the left side, as shown in FIG. 17, it is determined that the mobile electronic device that receives more light on the upper side is placed on the right ear as shown in FIG.

  When the processing of step S16, step S84, and step S86 is completed, or when it is determined No in step S80, the processing unit 22 determines whether a processing end trigger is generated as step S32. Here, the process end trigger is a flag indicating an instruction to end the voice correction processing by the output sound correction unit 34. For example, when a voice call is ended or an instruction to stop the output sound correction function is input. generate.

  If it is determined in step S32 that a process end trigger has not occurred (No), that is, if there is no process end trigger, the processing unit 22 proceeds to step S12 and repeats the processes from step S12 to step S32 described above.

  If the processing unit 22 determines in step S32 that a processing end trigger has occurred (Yes), in step S34, the processing unit 22 turns off the start processing completion flag and ends the present processing.

  Thus, instead of or in addition to the acceleration sensor 35, the same effect as described above can be obtained even if the use ear data is detected and set based on the detection result of the optical sensor 36.

  Here, when using the optical sensor 36 to determine the ear to be used, it is preferable to detect the posture of the housing 1 </ b> C with the acceleration sensor 35 and adjust the light intensity balance setting based on the detected posture. Thereby, when using the portable electronic device 1 while the user is standing, or when using the portable electronic device 1 while sleeping, an appropriate determination criterion can be set. it can.

  A pressure sensor can also be used as the identification information acquisition unit. Here, FIG.18 and FIG.19 is explanatory drawing for demonstrating operation | movement of a portable electronic device, respectively. The pressure detection elements 37a and 37b of the pressure sensor 37 detect the pressure that is applied when the user holds the casing when outputting sound. The pressure sensor 37 can detect a difference in pressure that depends on the right side surface and the left side surface of the housing by the pressure detection elements 37a and 37b. That is, when the case is gripped with the right hand and when the case is gripped with the left hand, the sides on which the thumb contacts are reversed. For this reason, the processing unit 22 can detect the hand holding the housing 1C based on the pressure difference, and can detect the use ear depending on whether the detected hand is the right hand or the left hand. it can. Specifically, as shown in FIG. 18, when the housing 1 is gripped with the right hand, the thumb is on the pressure detection element 37a side. Based on the detection value of the pressure sensor 37, the processing unit 22 can detect that the user is grasping with the right hand, and based on the result, can detect that the ear to be used is the right ear. Further, as shown in FIG. 19, when the case 1C (second case 1CB) is held with the left hand, the thumb is on the pressure detection element 37b side. Based on the detection value of the pressure sensor 37, the processing unit 22 can detect that the user is grasping with the left hand, and based on the result, can detect that the ear to be used is the left ear. As described above, the portable electronic device 1 can detect the use ear even based on the detection result of the pressure sensor 37.

  In addition to this, as the identification information acquisition unit, the camera 38 can be used to acquire an image of the area facing the receiver 16 when used with the camera 38, and the ear to be used can be determined based on the result. That is, it is possible to detect the orientation of the face and whether the ear facing the receiver 16 is the right ear or the left ear by capturing an image of the user's profile or ear by the camera 38 and analyzing the image. it can. In this way, the same effect can be obtained when the camera 38 is used.

  Further, as the identification information acquisition unit, the touch sensor 39 can be used to determine the ear to be used based on the contact detected by the touch sensor 39 when outputting sound. That is, the touch sensor 39 detects the touch sensor 39 in the vicinity of the receiver 16 when outputting sound, that is, the touch of the user's ear to the touch sensor 39 or the touch sensor 39 of the lateral part of the face. By analyzing the contact, it is possible to detect whether the ear facing the receiver 16 is the right ear or the left ear. In this way, the same effect can be obtained when the touch sensor 39 is used.

  In the above-described embodiment, the user's effort can be reduced. Therefore, the use ear is automatically detected and the use correction parameter is set, but the present invention is not limited to this. Whether the right ear correction parameter or the left ear correction parameter is used may be switched by a user operation.

  In addition, the portable electronic device 1 can use various output methods as a method for outputting the presentation sound when the correction parameter is set. For example, a preset voice may be used, or a voice used in a call may be sampled and used. In addition, the correction parameter may be set so that a specific caller reads out the text information prepared in advance, acquires the text information and the voice information, and inputs the character information heard while the user listens to the voice information. Can be set. In addition, by using the voice of the specific target as the presentation sound, it is possible to make the voice of the specific target easier to hear, and a call with the specific target can be performed more smoothly.

  Here, the processing unit 22 preferably sets the correction parameter corresponding to the frequency actually output by the voice processing unit 30, and more preferably sets the correction parameter corresponding to the frequency used for telephone communication. It is preferable. In this way, by setting the correction parameter for the frequency that is actually used, the sound output from the portable electronic device 1 can be made easier to hear. Here, the frequency for setting the correction parameter is set, for example, for the frequency used in the CELP (Code Excited Linear Predictive Coding) method, the EVRC (Variable Rate Speech Codec) method, and the AMR (Adaptive Multirate) method. It is preferable to do.

  In the above embodiment, the right-ear correction parameter and the left-ear correction parameter are set by the portable electronic device 1, but the present invention is not limited to this. The right ear correction parameter and the left ear correction parameter may be set by another electronic device, and the set right ear correction parameter, the left ear correction parameter, and the portable electronic device 1 may be stored. In addition, the correction parameter corresponding to the condition at the time of use can be made by setting the correction parameter based on the sound generated from the mobile electronic device 1 as in the above embodiment.

  In this embodiment, the correction parameter setting process and the correction parameter selection process are performed by the processing unit 22, but the present invention is not limited to this. The portable electronic device 1 may execute various arithmetic processes on a server that can communicate via the transmission / reception unit 26. That is, the arithmetic processing itself may be performed outside. In this case, the portable electronic device 1 transmits identification information to the server, receives correction parameters from the server, and the like. In this way, by performing calculations on the server or setting correction parameters, the load on the portable electronic device can be reduced. Alternatively, a correction parameter may be set in advance on a server that performs communication, and the server may correct the audio signal based on the correction parameter. That is, the above-described processing may be performed using the server and the portable electronic device as one system. Thereby, since the portable electronic device 1 can receive the sound signal corrected in advance, the correction process itself can be prevented from being executed.

  Here, FIG. 20 is a schematic diagram illustrating a schematic configuration of a communication system including a portable electronic device. A communication system (voice control system) 201 illustrated in FIG. 20 includes portable electronic devices 1 and 1a, servers 202 and 202a, a communication network 203, and a database 204. In addition, the number of each part which comprises the communication system 201 is not specifically limited, Each part may be provided with the some apparatus. For example, a plurality of portable electronic devices 1 and 1a may be provided for one server 202 and 202a.

  The server 202 has various data such as information (telephone number and address) specifying each communication device, and communicates with the portable electronic device 1 via the communication network to supply various information. The server 202 and the portable electronic device 1 communicate with each other via a communication network that is formed by a base station and a relay station and that wirelessly transmits and receives communication waves. In addition, the communication network can use various communication methods as long as communication can be performed between the server 202 and the portable electronic device 1. For example, communication may be performed using a satellite line.

  The servers 202 and 202a also receive information from the mobile electronic device 1 and communicate information to other communication devices via the communication network 203 based on the information, and also relay information. That is, the server 202 collects and stores information sent from each communication device, and supplies (provides) the collected information to the communication device as necessary. The server 202a can also process (process) the collected information and supply it to the communication device.

  The communication network 203 includes an exchange and a wired / wireless communication line. The communication network 203 performs information communication between a communication device and another communication device using a wired or wireless communication line. Specifically, the communication network 203 performs information communication between the server 202 and the server 202 a and information communication between the servers 202 and 202 a and the database 204. The communication network 203 may be a communication network similar to the communication network connecting the server 202 and the portable electronic device 1 or may be a different communication network. Further, an Internet communication network can be used as the communication network 203.

  The database 204 is a storage device, and stores various data necessary for processing in the portable electronic device 1, such as correction parameter information and user information for analyzing identification information. The database 204 supplies various stored information to the server 202 or the server 202a via the communication network 203.

  In the system as described above, the communication system 201 sends the identification information acquired by the mobile electronic device 1 to the server 202, and the server 202 acquires necessary information from the database 204 and determines the correction parameter to be used. The use correction parameter may be sent to the portable electronic device 1 and the use correction parameter sent by the portable electronic device 1 may be used. Thereby, the portable electronic device 1 can correct the output sound similar to the above by outputting the acquired identification information to the server 202 and using the information supplied from the server 202. Thereby, the processing amount and storage amount in the portable electronic device 1 can be reduced. Further, by using a common server as the server 202, the same correction processing can be performed even when communication is performed with other communication devices.

  Moreover, the process performed by the server and the process performed by the portable electronic device can be divided into various shares. For example, the server may perform output sound correction processing based on the correction parameters. Thereby, the process of a portable electronic device can be reduced more. In the case where the call operation between the mobile electronic device 1 and another communication device is relayed by the server, this processing can be performed by correcting the sound supplied from the server to the mobile electronic device.

  In the above embodiment, the description has been given of the case where the sound is corrected with the corresponding correction parameter regardless of whether the sound is viewed with any ear using the right ear correction parameter and the left ear correction parameter. Not. The portable electronic device and the voice control system may set either the right ear correction parameter or the left ear correction parameter. In this case as well, by switching the control based on the ear that is being heard, the sound is corrected when listening with one ear, and the sound is not corrected when listening with the other ear. Can do. Thereby, it is difficult to hear one ear, and a user who can hear the other ear in the same manner as a normal hearing person can also be suitably used.

  As described above, the present invention is useful for outputting sound.

DESCRIPTION OF SYMBOLS 1 Portable electronic device 1C Case 2 Display 13 Operation part 13A Operation key 13B Direction and determination key 22 Processing part 22a Correction parameter setting part 22b Speech analysis part 22c Spectrum analysis part 22d Presentation sound generation part 22e Correction function control part 24 Storage part 30 Audio processing unit 32 Display unit 34 Output sound correction unit 35 Acceleration sensor 36 Optical sensor 37 Pressure sensor 38 Camera 39 Touch sensor

Claims (8)

A housing,
A sound generator provided in the housing for generating sound based on an audio signal;
A storage unit that is provided in the housing and stores at least one of the correction parameter for the right ear and the correction parameter for the left ear;
An identification information acquisition unit that is provided in the housing and acquires the identification information for identifying whether the right ear is heard as an ear or the left ear is heard as an ear, and the sound generated by the sound generation unit; ,
Based on the identification information acquired by the identification information acquisition unit, whether the right ear is heard as an ear or the left ear is heard as an ear is detected, and if there is a correction parameter corresponding to the detected ear, the correction parameter A processing unit for reading out the storage unit and setting the read correction parameter as a use correction parameter;
A correction unit that corrects an audio signal based on the use correction parameter set by the processing unit and supplies the corrected audio signal to the sound generation unit;
A portable electronic device comprising:
The identification information acquisition unit is an acceleration sensor that detects acceleration acting on the housing,
The portable electronic device, wherein the processing unit acquires the moving direction of the casing detected by the acceleration sensor as the identification information, and detects the listening ear. The storage unit further stores information on a user's dominant ear,
The portable electronic device according to claim 1, wherein the processing unit sets the correction parameter as a use parameter if there is a correction parameter corresponding to the dominant ear before the detection of the hearing ear. A housing,
A communication unit that communicates with other devices;
A sound generator provided in the housing for generating sound based on an audio signal;
An identification information acquisition unit that is provided in the housing and acquires the identification information for identifying whether the right ear is heard as an ear or the left ear is heard as an ear, and the sound generated by the sound generation unit; ,
A correction parameter for the right ear or a correction for the left ear corresponding to the detected ear from the other device, which is provided in the housing and transmits the identification information to the other device via the communication unit. A processing unit that acquires parameters and sets the acquired correction parameters as use correction parameters;
A correction unit that corrects an audio signal based on the use correction parameter set by the processing unit and supplies the corrected audio signal to the sound generation unit;
A portable electronic device comprising:
The identification information acquisition unit is an acceleration sensor that detects acceleration acting on the housing,
The portable electronic device, wherein the processing unit acquires the moving direction of the casing detected by the acceleration sensor as the identification information, and detects the listening ear.   The portable electronic device according to claim 3, wherein the processing unit detects a listening ear when the acceleration sensor detects a certain acceleration or more. The portable electronic device according to any one of claims 1 to 4 , wherein the correction parameter is a parameter that adjusts the volume of sound for each audio frequency. The portable electronic device according to claim 5 , wherein the correction parameter is a parameter that corrects the sound generated from the sound generation unit to have a magnitude between an unpleasant threshold value and an audible threshold value. A sound generator that generates sound based on an audio signal;
An identification information acquisition unit for acquiring identification information for identifying whether the sound generated by the sound generation unit is a right ear listening ear or a left ear listening ear;
A storage unit for storing correction parameters for one or both of the right ear and the left ear;
When the user is listening to the right or left ear, the correction parameter corresponding to the user's ear is read from the front storage unit, and the sound generated from the sound generation unit is corrected based on the read correction parameter. A control unit for performing control, and
A signal circuit network for transmitting or receiving a signal between the control unit and each other unit in a wired or wireless manner;
At least the sound generation unit and the identification information acquisition unit are voice control systems provided in a casing that can be carried by a user,
The identification information acquisition unit is an acceleration sensor that detects acceleration acting on the housing,
The said control part acquires the moving direction of the said housing | casing detected with the said acceleration sensor as said identification information, The audio | voice control system which detects the said listening ear. The voice control system according to claim 7 , wherein one or both of the storage unit and the control unit is provided in a server.

Images