JP2011205256A - Telephone set and method of correcting position thereof - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide a telephone set that facilitates matching of a position of a speaker to the position of the user's ear.SOLUTION: In a mobile phone 1, an instruction control unit 16 instructs a user to correct the position of a receiver 2 for the ear based on a comparison result of an image during use which is the image of a user captured by a built-in camera 4 when the user is using the receiver 2 and a proper position image stored in an image database 18. Based on a comparison of the image during use and the proper position image in a deviation operating unit 15, it is possible to estimate how much the position of a speaker 6 is deviated from the position facing the ear of the user during use of the receiver 2. A position correction is instructed by the instruction control unit 16 based on the comparison results, so that an instruction can be made for the user to reduce a displacement of the speaker 6. Consequently, the position of the speaker 6 can be matched easily to the position of the user's ear.

Description

  The present invention relates to a telephone and a telephone position correction method.

  2. Description of the Related Art Conventionally, as described in Patent Document 1 below, a mobile phone device is known in which the positions of a microphone and a speaker can be set to optimum positions according to the positions of a user's mouth and ears. This mobile phone device includes a main body provided with a microphone, and a casing provided with a speaker and rotatably connected to the main body via a hinge portion. Then, by rotating the housing, the angle between the main body and the housing can be arbitrarily set, and the positions of the microphone and the speaker can be matched with the positions of the user's mouth and ear.

JP 2006-5564 A

  In the mobile phone device described above, when the user makes a call or the like, the speaker is out of the user's field of view. Therefore, the user relies on a sense other than vision to adjust the position of the speaker to the position of the ear. However, with recent miniaturization of telephones, speakers tend to be smaller. For example, the size of a speaker hole in a recent telephone is about several mm. Therefore, it may be difficult for the telephone user to align the position of the speaker with the position of the ear.

  SUMMARY OF THE INVENTION An object of the present invention is to provide a telephone and a telephone position correction method that can easily adjust the position of a speaker to the position of a user's ear.

  In order to achieve the above object, a telephone set according to the present invention is a telephone set including a receiver that is applied to a user's ear, and a speaker that is mounted on the receiver and outputs sound toward one side of the receiver. A camera directed to one side of the handset, a storage unit for storing proper position information corresponding to a proper position image that is a user's image with a speaker facing the ear, and a camera when the user uses the handset Based on the comparison result by the comparison means, the comparison means for comparing the use position information corresponding to the use image that is taken by the user and the appropriate position information stored in the storage unit, to the user And instructing means for instructing to correct the position of the handset relative to the ear.

  According to the telephone set of the present invention, the appropriate position information corresponding to the appropriate position image, which is the image of the user when the speaker faces the ear, is stored by the storage unit. In addition, the comparison unit compares the in-use position information corresponding to the in-use image, which is the user's image taken by the camera when the user uses the handset, with the appropriate position information stored in the storage unit. Then, based on the comparison result by the comparison unit, the instruction unit instructs the user to correct the position of the handset with respect to the ear. Here, it is possible to estimate how much the position of the speaker is deviated from the position facing the user's ear when the handset is used, by comparing the in-use position information with the appropriate position information. Since the position correction instruction by the instruction means is performed based on the comparison result, it is possible to instruct the user to reduce the displacement of the speaker position. Therefore, the user can adjust the position of the speaker to the position of the ear simply by following the instruction. Therefore, the position of the speaker can be easily adjusted to the position of the user's ear.

  Here, in the telephone according to the present invention, the comparison means calculates a difference in position between the user feature included in the appropriate position image and the feature included in the in-use image, and the instruction means is determined by the comparison means. It is preferable to instruct the difference to be small based on the calculated difference.

  According to this invention, the difference between the positions of the user feature included in the proper position image and the feature included in the in-use image is calculated by the comparison unit. Further, an instruction is given by the instruction means so that the difference between the positions becomes small. Therefore, the position of the speaker can be accurately adjusted to the position of the user's ear.

  In the telephone set according to the present invention, it is preferable that the comparison unit calculates the difference using at least one of the user's jaw, blood vessel, beard, and skin color as a feature.

  The user's jaw, blood vessel, beard, and skin color are portions that have a shape unique to the user, and it is considered that there is little temporal change in the shape. Therefore, since the difference is calculated using at least one of these as a feature by the comparison means, it is possible to perform accurate alignment for each user. In addition, accurate positioning can be performed at any time regardless of the time zone in which the handset is used.

  Moreover, in the telephone set according to the present invention, it is preferable that the instruction means performs the instruction by causing the speaker to output a position correction message indicating that the position of the handset is to be corrected.

  According to the present invention, the user can correct the position of the handset according to the position correction message output from the speaker by the instruction means, so that the position of the speaker can be more easily adjusted to the position of the user's ear.

  The telephone according to the present invention further includes voice input / output detection means for detecting voice input / output between a microphone and a speaker for inputting a user's voice, and the instruction means is a voice non-input / output by the voice input / output detection means. It is preferable to output a position correction message to the speaker when the state is detected.

  According to the present invention, since the position correction message is output when the voice input / output detection means detects the non-input / output state of the voice, it is possible to prevent the position correction message from interfering with the telephone call. The position can be easily adjusted to the position of the user's ear.

  Further, the telephone according to the present invention preferably includes a vibration unit that vibrates the handset, and the instruction unit preferably instructs the vibration unit to vibrate the handset with a vibration pattern indicating that the position of the handset is to be corrected. .

  According to the present invention, since the position correction instruction is performed by the vibration pattern indicating that the position of the handset is to be corrected, it is possible to prevent the position correction instruction from interfering with the call. Therefore, a position correction instruction can be issued regardless of the call timing, and the position of the speaker can be quickly adjusted to the position of the user's ear.

  Further, the telephone according to the present invention includes left and right detection means for detecting the acceleration of the handset and detecting whether the user's ear is the right ear or the left ear based on the detected acceleration, and is stored in the storage unit. Right position information corresponding to the right right position image, which is the user's image in a state where the speaker faces the right ear, and left side, which is the user's image in a state where the speaker faces the left ear. Left side appropriate position information according to the appropriate position image, and the comparison means uses the appropriate position information according to the detection result detected by the left and right detection means when the user uses the handset, and It is preferable to make a comparison.

  According to this invention, the comparison using the right proper position information or the left proper position information is performed according to the detection result of the right ear or the left ear detected by the left / right detection means when the user uses the handset. Done. Therefore, even if the handset is applied to any ear of the user, the position of the speaker can be accurately adjusted to the position of the user's ear.

  In the telephone according to the present invention, it is preferable that the appropriate position image is a user's image taken by the camera with the speaker facing the ear.

  According to the present invention, the proper position image is captured by the same camera that captures the in-use image. Then, the comparing means compares the appropriate position information corresponding to the appropriate position image with the use position information corresponding to the use image, so that more accurate comparison can be performed. Therefore, the accuracy of the position correction instruction by the instruction unit can be improved.

  By the way, the present invention can be described as the invention of the telephone as described above, and can also be described as the invention of the method of correcting the position of the telephone as follows. This is substantially the same invention only in different categories, and has the same operations and effects.

  That is, the method for correcting the position of a telephone according to the present invention is directed to a receiver that is applied to a user's ear, a speaker that is mounted on the receiver, and outputs sound toward one side of the receiver, and one side of the receiver. And a storage unit for storing appropriate position information corresponding to an appropriate position image that is an image of the user in a state where the speaker faces the ear, and the use of the receiver by the user The comparison step of comparing the in-use position information corresponding to the in-use image, which is an image of the user that is sometimes photographed by the camera, with the appropriate position information stored in the storage unit, and the comparison result in the comparison step, And an instruction step for instructing to correct the position of the receiver with respect to the ear.

  According to the present invention, the position of the speaker can be easily adjusted to the position of the user's ear.

It is a block diagram which shows the structure of the mobile telephone which concerns on one Embodiment of this invention. It is explanatory drawing of the example in which the mobile telephone of FIG. 1 is used by the user. It is a figure which shows the hardware constitutions of the mobile telephone of FIG. It is a flowchart which shows the process sequence of appropriate position registration. It is a figure which shows the specific example of the appropriate position image memorize | stored in an image database. It is a figure which shows the specific example of the characteristic part appropriate position data memorize | stored in an image database. It is a flowchart which shows the process sequence of position alignment. It is a flowchart which shows a part of processing procedure of FIG. FIG. 8 is an explanatory diagram of image processing and shift calculation processing in the processing of FIG. 7. It is explanatory drawing of the timing when the position correction instruction | indication in the process of FIG. 7 is performed. It is a figure which shows the example of the position correction instruction | indication by vibration.

  Hereinafter, a telephone and a telephone position correction method according to an embodiment of the present invention will be described with reference to the drawings. In the following description, a mobile phone and a position correction method for the mobile phone will be described as an example. In the description of the drawings, the same elements are denoted by the same reference numerals, and redundant descriptions are omitted.

  FIG. 1 is a block diagram showing a configuration of a mobile phone according to the present embodiment, and FIG. 2 is an explanatory diagram of an example in which the mobile phone of FIG. 1 is used by a user. As shown in FIGS. 1 and 2, the mobile phone 1 is a so-called foldable mobile phone. The mobile phone 1 includes a receiver 2 equipped with a speaker 6 that outputs sound toward the user, a microphone 9 that inputs the user's voice, and a speaker 6 in order to match the position of the speaker 6 with the position of the user's ear E. And a control unit 10 that issues a position correction instruction to correct the position of the handset 2 with respect to the ear E.

  As shown in FIG. 2, the handset 2 is rotatable with respect to the first casing 2 a and a flat first casing 2 a on which an input button 3 to be pressed by the user for operating the mobile phone 1 is mounted. And a flat second housing 2b on which the speaker 6 is mounted. When the user does not make a call, the receiver 2 is folded so that the first casing 2a and the second casing 2b are overlapped. On the other hand, when the user makes a call, the handset 2 is unfolded by rotating the second housing 2b relative to the first housing 2a, and is in the state shown in FIG. When the user makes a call, the second housing 2b is applied to the user's ear E in this state where the handset 2 is deployed.

  On the second housing 2b of the receiver 2, an image is displayed toward the side facing the user (one side; hereinafter also referred to as "user side") of the second housing 2b in a state where the receiver 2 is deployed. A display 20 is provided. In addition, illustration of the display 20 is abbreviate | omitted in FIG.

  The speaker 6 is a user-side surface of the second housing 2 b and is mounted on the distal end side of the second housing 2 b with respect to the display 20. The speaker 6 outputs the other party's voice toward the user side of the second housing 2b when the user makes a call. In addition, the speaker 6 outputs sound to the control unit 10 at the same time as outputting sound, indicating that sound is being output. Furthermore, the speaker 6 is controlled by the control unit 10 and outputs various messages for guidance and instructions to the user.

  Further, an in-camera (camera) 4 directed to the user side of the second housing 2b is mounted on the user-side surface of the second housing 2b on the base end side of the second housing 2b with respect to the display 20. ing. As the in-camera 4, for example, a conventionally known CMOS (Complementary Metal Oxide Semiconductor) camera can be used. The in-camera 4 photographs the user's face (more specifically, the periphery of the jaw) from the side in conjunction with the operation of the input button 3 by the user.

  In particular, in the present embodiment, the in-camera 4 is an image of the user in a state where the speaker 6 faces the hole of the user's ear E when the user operates the input button 3 in accordance with voice guidance from the speaker 6. A proper position image is taken. Further, when the user makes a call, the in-camera 4 is controlled by the control unit 10 to photograph the user's face from the side. The image of the user's face captured by being controlled by the control unit 10 corresponds to an in-use image that is an image of the user when the handset 2 is used by the user. When the in-camera 4 captures the user's face in this way, the in-camera 4 generates an appropriate position image and an in-use image. The in-camera 4 outputs the generated proper position image and in-use image to the control unit 10.

  The first housing 2 a of the receiver 2 includes an acceleration sensor 5 that detects the acceleration of the receiver 2 and a vibrator (vibration unit) 7 that vibrates the receiver 2. The acceleration sensor 5 is a semiconductor triaxial acceleration sensor, for example, and can detect the inclination of the receiver 2. When the acceleration sensor 5 detects the inclination of the handset 2, the acceleration sensor 5 outputs inclination information indicating the detected inclination to the control unit 10. This inclination information is used in the control unit 10 for detecting whether the user's ear E applied to the receiver 2 is the right ear or the left ear. The vibrator 7 is, for example, a vibration motor.

  The microphone 9 is, for example, an electret condenser microphone. The microphone 9 inputs voice of the user and simultaneously outputs voice input information indicating that voice is being input to the control unit 10.

  Furthermore, the mobile phone 1 includes an image database (storage unit) 18 that stores the above-described appropriate position image. This right position image is a right right position image PR that is a user's image when the speaker 6 faces the user's right ear, and a left side that is the user's image when the speaker 6 faces the user's left ear. It includes one appropriate position image PL and one each (see FIG. 5). Further, in the image database 18, in addition to the right proper position image PR and the left proper position image PL, the right feature part proper position data and the left feature which are information corresponding to each of the right proper position image PR and the left proper position image PL. Part proper position data is stored. These characteristic part appropriate position data are data obtained by extracting the position of the user's characteristic part included in the appropriate position images PR and PL as xy coordinates (see FIG. 6). Specific examples of the user's features include jaw lines (contours), blood vessels visible through the skin, beards, and skin color. These feature portions are portions exhibiting a shape unique to the user, and have little temporal change in the shape. The proper position images PR and PL and the feature part proper position data stored in the image database 18 in this way correspond to proper position information.

  Furthermore, the mobile phone 1 is provided with a message database 19 for storing a position correction message for instructing the position correction of the handset 2 to the user. More specifically, this position correction message is a message indicating to the user that the position of the handset 2 is to be corrected through the speaker 6. In the message database 19, in addition to the position correction message, a proper position registration guidance message for guiding the user to shoot a proper position image and a timing for taking a proper position image are shown to the user. The imitation sound is memorized.

  The control unit 10 inputs audio output information output from the speaker 6, an image output from the in-camera 4, tilt information output from the acceleration sensor 5, audio input information output from the microphone 9, and the like. Then, the control unit 10 executes predetermined processing using the input information and the like, the appropriate position information stored in the image database 18 and the position correction message stored in the message database 19, thereby allowing the user to The position correction instruction of the handset 2 is given to (a series of processes related to the position correction instruction are collectively referred to as “positioning”). Positioning by the control unit 10 may be performed once per call, or may be repeated periodically (for example, every minute) during one call.

  Further, prior to the alignment, the control unit 10 stores the appropriate position image (the right appropriate position image PR and the left appropriate position image PL) and the feature portion appropriate position data corresponding thereto in the image database 18 (this appropriate position). A series of processes related to image storage are collectively referred to as “appropriate position registration”). The appropriate location registration by the control unit 10 may be performed only once when the user uses the mobile phone 1 for the first time, or periodically (for example, once a month) after the use of the mobile phone 1 is started. It may be done.

  The control unit 10 includes a voice input / output detection unit 11, an image acquisition unit 12, a left / right detection unit 13, an image processing unit 14, a deviation calculation unit 15, and an instruction control unit 16.

  The voice input / output detection unit 11 is voice input / output detection means for detecting voice input / output between the microphone 9 and the speaker 6 at the time of alignment. Specifically, the voice input / output detection unit 11 inputs voice input information output from the microphone 9 and voice output information output from the speaker 6. The voice input / output detection unit 11 detects a voice input / output state that is a state in which voice is being input / output from the speaker 6 or the microphone 9 based on the input voice input information and voice output information. The voice input / output detection unit 11 detects a voice non-input / output state in which no voice is input / output in the speaker 6 and the microphone 9 based on the input voice input information and voice output information. When the voice input / output detection unit 11 detects the voice input / output state or the non-input / output state, the voice input / output detection unit 11 outputs voice state information indicating that the input / output state or the non-input / output state is detected to the instruction control unit 16. In addition, the voice input / output detection unit 11 detects that a call button that is a part of the input button 3 is operated by the user, for example, and detects the start of a call by the mobile phone 1. When the voice input / output detection unit 11 detects the start of a call, the voice input / output detection unit 11 notifies the left / right detection unit 13 to that effect, and controls the in-camera 4 to cause the in-camera 4 to capture an in-use image. Thereby, detection of the start of a call by the voice input / output detection unit 11 serves as a trigger for starting alignment in the control unit 10.

  The image acquisition unit 12 inputs an image output from the in-camera 4. That is, the image acquisition unit 12 inputs a proper position image output from the in-camera 4 at the time of proper position registration. In addition to the input of the proper position image, the image acquisition unit 12 receives right position right and left information indicating whether the right position image PR captured by the in-camera 4 is the right right position image PR or the left right position image PL. Obtained from the instruction control unit 16. When the appropriate position image is input, the image acquisition unit 12 performs image processing on the input appropriate position image, thereby including user features (for example, jaw lines, blood vessels, whiskers, skin color, etc.) included in the appropriate position image. ) And the position of the extracted feature in the image is extracted as xy coordinates. The image acquisition unit 12 generates feature portion appropriate position data including xy coordinates indicating the position of the feature portion in the image. Then, the image acquisition unit 12 attaches the appropriate position image right / left information and the characteristic portion appropriate position data to the appropriate position image and stores them in the image database 18. It should be noted that a conventional pattern recognition technique can be used for the extraction of the characteristic part and the conversion to the coordinates of the position in the image acquisition unit 12.

  On the other hand, the image acquisition unit 12 inputs an in-use image output from the in-camera 4 at the time of alignment. When the use image is input, the image acquisition unit 12 outputs the input use image to the left / right detection unit 13.

  The left / right detection unit 13 detects whether the user's ear E is the right ear or the left ear based on the acceleration of the receiver 2 at the time of alignment. Specifically, when the left / right detection unit 13 obtains notification from the voice input / output detection unit 11 that the start of the call has been detected, the left / right detection unit 13 inputs the tilt information output from the acceleration sensor 5. The left / right detection unit 13 detects whether the user's ear E applied to the receiver 2 is the right ear or the left ear based on the inclination indicated by the input inclination information. That is, the left / right detection unit 13 constitutes a left / right detection unit together with the acceleration sensor 5. The left and right detection by the acceleration sensor 5 and the left and right detection unit 13 is the same as the conventional method.

  Further, when detecting whether the user's ear E applied to the receiver 2 is the right ear or the left ear, the left / right detection unit 13 extracts an appropriate position image corresponding to the detection result from the image database 18. More specifically, when the left / right detection unit 13 detects that the user's ear E applied to the receiver 2 is the right ear, the proper position image attached to the proper position image stored in the image database 18. The right appropriate position image PR is extracted from the image database 18 by referring to the left and right information. Further, when the left / right detection unit 13 detects that the user's ear E applied to the receiver 2 is the left ear, the right / left detection unit 13 refers to the right / left information of the proper position image attached to the proper position image stored in the image database 18. Thus, the left proper position image PL is extracted from the image database 18.

  Furthermore, the left / right detection unit 13 acquires the in-use image output from the image acquisition unit 12. When the left / right detection unit 13 acquires the in-use image output from the image acquisition unit 12, the left / right detection unit 13 outputs the acquired in-use image and the appropriate position image extracted from the image database 18 to the image processing unit 14.

  The image processing unit 14 acquires an in-use image and an appropriate position image output from the left / right detection unit 13 during alignment. The image processing unit 14 performs image processing on the acquired in-use image to extract and extract a user feature (for example, jaw line, blood vessel, whiskers, skin color) included in the in-use image. The position of the feature portion in the image is extracted as xy coordinates. The image processing unit 14 generates feature portion use position data including xy coordinates indicating the position of the feature portion in the image. Then, the image processing unit 14 attaches the feature portion use position data to the use image, and outputs it to the shift calculation unit 15 together with the appropriate position image. The in-use image and feature portion use position data output here correspond to use position information. It should be noted that a conventional pattern recognition technique can be used for the extraction of the characteristic part and the conversion to the coordinates of the position in the image processing unit 14.

  The shift calculation unit 15 is a comparison unit that compares the in-use position information output from the shift calculation unit 15 and the appropriate position information stored in the image database 18 during alignment. The deviation calculation unit 15 acquires an in-use image and an appropriate position image output from the image processing unit 14. The deviation calculation unit 15 performs image processing to superimpose the acquired in-use image and appropriate position image. Then, the deviation calculator 15 calculates a difference in position (hereinafter also referred to as “deviation”) between the predetermined feature included in the appropriate position image and the predetermined feature included in the in-use image. Specifically, in the image obtained by superimposing the in-use image and the appropriate position image, the deviation calculation unit 15 includes the predetermined feature of the user included in the appropriate position image and the predetermined image included in the in-use image. A feature corresponding to the feature is detected. Here, the corresponding feature is detected based on, for example, its shape and position. Then, a coordinate difference (x direction, y direction) of corresponding points between the feature part included in the appropriate position image and the feature part included in the in-use image is calculated as a position difference. When calculating the position difference, the shift calculation unit 15 generates position difference information indicating the position difference.

  As described above, when the deviation is calculated by comparing the appropriate position image with the in-use image, the appropriate position image corresponds to the appropriate position information (right-side appropriate position information or left-side appropriate position information), and the in-use image is in use. It corresponds to position information.

  In the above-described shift calculation by the image processing unit 14 and the shift calculation unit 15, first, a feature part is extracted from the appropriate position image and the in-use image, and a difference in position between corresponding feature parts is calculated. The shift may be calculated by detecting the shift between the proper position image and the in-use image without extracting the feature portion. In this case, a conventional image processing technique for detecting a shift between two images can be used.

  Here, the shift calculation unit 15 does not directly use the in-use image and the appropriate position image, but includes the appropriate position data and the in-use position data attached to each of the in-use image and the appropriate position image. , The coordinate difference (x direction, y direction) of corresponding points between the feature part included in the proper position image and the feature part included in the in-use image may be calculated. In this case, the right position feature proper position data and the left feature position proper position data may be stored in the image database 18 without storing the proper position image. Also, in this case, the right-side feature part proper position data and the left-hand side part proper position data correspond to the proper position information (right-side proper position information and left-side proper position information), and the feature part use-time position data corresponds to the use-time position information. To do.

  Further, the deviation calculation unit 15 determines whether or not the in-use image matches the appropriate position image based on the calculated position difference. Specifically, the deviation calculation unit 15 determines whether or not they match by comparing a predetermined difference threshold stored in advance with a position difference. The deviation calculation unit 15 outputs the generated position difference information to the instruction control unit 16 for a position correction instruction in the instruction control unit 16 when the position difference is greater than or equal to a predetermined difference threshold value. In addition, when the position difference is less than the difference threshold, the deviation calculation unit 15 generates instruction-unnecessary information indicating that the position correction instruction in the instruction control unit 16 is not necessary, and the generated instruction-unnecessary information is transmitted to the instruction control unit. 16 is output.

  The instruction control unit 16 is an instruction unit that gives a position correction instruction to the user to correct the position of the handset 2 with respect to the ear E based on the comparison result by the deviation calculation unit 15 at the time of alignment. Specifically, the instruction control unit 16 acquires position difference information or instruction unnecessary information output from the deviation calculation unit 15. When the instruction control unit 16 acquires the position difference information from the deviation calculation unit 15, based on the position difference indicated in the acquired position difference information, the instruction control unit 16 issues a position correction instruction to the user so that the position difference becomes smaller. More specifically, the instruction control unit 16 indicates a correspondence relationship (for example, a conversion formula) between the position difference calculated by the deviation calculation unit 15 and the position correction direction and position correction distance so as to reduce the position difference. I remember it. By using this correspondence relationship, the instruction control unit 16 uses a position correction direction and a position correction distance (for example, “right (right)” to reduce the position difference according to the position difference indicated in the acquired position difference information. Or, the left) amm, the upper (or lower) bmm "and the like. The position correction direction here is based on the mobile phone 1 (in-camera 4). Note that the instruction control unit 16 may calculate only the position correction direction without calculating the position correction distance.

  In addition, the instruction control unit 16 acquires voice state information output from the voice input / output detection unit 11. Further, the instruction control unit 16 acquires a position correction message from the message database 19 when the acquired voice state information indicates a voice non-input / output state continuously for a predetermined time. When the instruction control unit 16 acquires the position correction message, the instruction control unit 16 includes the calculated position correction direction and position correction distance in the acquired position correction message. And the instruction | indication control part 16 performs the position correction instruction | indication with respect to a user by controlling the speaker 6 and making the speaker 6 output the position correction message containing a position correction direction and a position correction distance. Note that when the instruction control unit 16 acquires the instruction-unnecessary information from the deviation calculation unit 15, the instruction control unit 16 ends the alignment. When the instruction control unit 16 calculates only the position correction direction without calculating the position correction distance, the instruction control unit 16 includes only the position correction direction in the position correction message.

  In addition, the instruction control unit 16 stores repetitive information indicating whether or not the alignment is repeatedly performed during one call. This repeated information is information indicating, for example, “perform once per call” or “repeat periodically (for example, every minute) during one call”. The instruction control unit 16 determines whether or not to periodically perform the positioning of the receiver 2 based on the repeated information during the positioning.

  Further, the instruction control unit 16 stores location registration frequency information indicating the frequency of performing proper location registration periodically. This location registration frequency information is, for example, “performed only when the user uses the mobile phone 1 for the first time” or “performed periodically (for example, once a month) after the use of the mobile phone 1 is started”. ". The instruction control unit 16 performs proper position registration based on the position registration frequency information.

  In addition, the instruction control unit 16 guides the user to register the appropriate position image when registering the appropriate position. Specifically, the instruction control unit 16 acquires an appropriate location registration guidance message from the message database 19. When the instruction control unit 16 acquires the appropriate position registration guidance message, the instruction control unit 16 controls the speaker 6 to cause the speaker 6 to output the appropriate position registration guidance message. The proper position registration guidance message includes a right message for guiding the user to shoot the right proper position image PR and a left message for guiding the user to shoot the left proper position image PL. included. In addition, the instruction control unit 16 causes the speaker 6 to output an appropriate position registration guidance message. Then, the instruction control unit 16 determines that the proper position image captured by the in-camera 4 is the right proper position depending on whether the proper position registration guidance message output to the speaker 6 is a right message or a left message. Proper position image right / left information indicating whether the image is the image PR or the left proper position image PL is generated. The instruction control unit 16 outputs the generated appropriate position image left-right information to the image acquisition unit 12.

  Further, the instruction control unit 16 causes the user to measure the timing for capturing the appropriate position image when registering the appropriate position. Specifically, the instruction control unit 16 acquires from the message database 19 an imitation sound for allowing the user to measure the timing for capturing an appropriate position image. When obtaining the imitation sound, the instruction control unit 16 controls the speaker 6 to cause the speaker 6 to output the imitation sound.

  FIG. 3 is a diagram illustrating a hardware configuration of the mobile phone 1. As shown in FIG. 3, the mobile phone 1 includes a central processing unit (CPU) 101, a random access memory (RAM) 102 that is a main storage device, a read only memory (ROM) 103, an operation unit 104 including an input button 3, The wireless communication module 105 includes a computer including hardware such as an auxiliary storage device 106 such as a hard disk. By operating these components, the above-described functions of the mobile phone 1 are exhibited.

  Next, processing (position correction method for the mobile phone 1) executed by the mobile phone 1 will be described. The processing by the mobile phone 1 is mainly executed by the control unit 10 in accordance with the flowcharts shown in FIGS. FIG. 4 is a flowchart showing a processing procedure of proper position registration. FIG. 7 is a flowchart showing the alignment processing procedure.

  First, the proper position registration will be described with reference to FIG. Here, the appropriate position registration is executed based on the position registration frequency information stored in the instruction control unit 16. In the following description, a case will be described in which the location registration frequency information indicates that “only once when the user uses the mobile phone 1 for the first time”. The proper position registration starts when a power button that is a part of the input button 3 is pressed by the user or when an operation for performing proper position registration is performed by the user. First, the instruction control unit 16 detects whether or not an appropriate position image is stored in the image database 18. When the proper position image is already stored in the image database 18, the proper position registration is not executed. However, appropriate location registration may be executed again.

  When the appropriate position image is not stored in the image database 18, as shown in FIG. 4, the instruction control unit 16 guides the user to register the appropriate position image (S01). Here, an appropriate position registration guidance message is output from the speaker 6 to the user. An example of the appropriate location registration guidance message is “Start proper location registration from now on. Place the handset on the right ear (or left ear) and press the input button at the position where you can hear the imitation sound best. Is applicable. Further, the instruction control unit 16 outputs the right and left information on the proper position image to the image acquisition unit 12.

  Next, an imitation sound is output by the instruction control unit 16 (S02). Here, an imitation sound is output from the speaker 6 toward the user. As the imitation sound, for example, a sound “Peepy ...” is applicable. The output of the imitation sound is performed to allow the user to measure the timing for capturing the appropriate position image. Subsequently, the user presses the input button 3 at a position where the imitation sound can be heard best. By operating the input button 3, the in-camera 4 captures an appropriate position image (S03). Then, an appropriate position image is generated by the in-camera 4, and the generated appropriate position image is output to the image acquisition unit 12.

  Next, the appropriate position image is stored in the image database 18 by the image acquisition unit 12 (S04). Here, when the image acquisition unit 12 performs image processing on the appropriate position image, the feature portion of the user included in the appropriate position image is extracted, and feature portion appropriate position data is generated. Then, the appropriate position image right / left information and the proper position appropriate position data are attached to the appropriate position image and stored in the image database 18.

  Appropriate position registration is performed by executing the above-described series of processing for each of the right side (right ear) and the left side (left ear). FIG. 5 is a diagram showing a specific example of the proper position image stored in the image database 18. As shown in FIG. 5, the image database 18 includes a right-side proper position image PR that is a user image in a state where the speaker 6 faces the user's right ear, and a state where the speaker 6 faces the user's left ear. The left proper position image PL which is a user image is stored. In the right appropriate position image PR, jaw lines AR, blood vessels BR, and mustache CR are extracted as user features. In the left proper position image PL, the jaw line AL, the blood vessel BL, and the whiskers CL are extracted as the user's characteristic portions.

  FIG. 6 is a diagram showing a specific example of the feature portion appropriate position data stored in the image database 18. As shown in FIG. 6, the image database 18 stores coordinates in an image corresponding to jaw lines, blood vessels, and beards. Furthermore, as shown in FIG. 6, the skin color (spotted part or the like) may be recognized as a feature part, and the coordinates of the part where the skin color has changed may be stored. This appropriate position data is stored for each of the right appropriate position image PR and the left appropriate position image PL.

  Next, alignment will be described with reference to FIG. First, the operation of the call button is detected by the voice input / output detection unit 11, and the start of the call by the mobile phone 1 is detected (S11). When the start of a call is detected, this is notified to the left / right detection unit 13. Next, the left / right detection unit 13 detects whether the user's ear E applied to the receiver 2 is the right ear or the left ear (S12). Further, it is detected whether the user's ear E is the right ear or the left ear, and the right and left detection unit 13 detects an appropriate position image (right appropriate position image PR or left appropriate position image PL). Are extracted from the image database 18. In the following description, a case where the user's ear E is the right ear will be described.

  Next, the in-camera 4 is controlled by the voice input / output detection unit 11 and an in-use image is taken (S13). Then, the in-camera 4 generates an in-use image, and the generated in-use image is output to the left / right detection unit 13 via the image acquisition unit 12. Then, the left and right detection unit 13 outputs the in-use image and the appropriate position image to the image processing unit 14. Next, the image processing unit 14 performs image processing on the in-use image, thereby extracting the feature portion of the user included in the in-use image and generating feature portion use position data (S14). Then, the image processing unit 14 attaches the characteristic part use position data to the use image, and outputs the characteristic part use position data together with the appropriate position image to the deviation calculation unit 15.

  FIG. 9A shows the in-use image P2 that has been subjected to image processing in step S14. As shown in FIG. 9A, in the in-use image P2, jaw lines A2, blood vessels B2, and whiskers C2 are extracted as user features. The in-use image P2 shown in FIG. 9A is an in-use image when the handset 2 is put on the user's right ear.

  Next, the displacement calculation unit 15 calculates a difference (deviation) in position between the predetermined feature included in the appropriate position image and the predetermined feature included in the in-use image (S15: comparison step). The calculation process here is executed by the deviation calculation unit 15 in accordance with the flowchart shown in FIG. First, the in-use image and the appropriate position image are superimposed by image processing (S51). Next, a predetermined feature of the user included in the proper position image and a feature corresponding to the predetermined feature included in the in-use image are detected (S52). Then, the position difference (deviation) between the predetermined feature included in the appropriate position image and the predetermined feature included in the in-use image is calculated (S53). When the position difference is calculated, the position difference information indicating the position difference is generated by the shift calculation unit 15.

FIG. 9B is an explanatory diagram of the shift calculation processing in step S15 (S51 to S53). As shown in FIG. 9B, in the image PS superimposed in step S51, the in-use image P2 shown in FIG. 9A and the right-side proper position image PR shown in FIG. 5 have a predetermined deviation. . Here, the jaw line AR, the blood vessel BR, and the mustache CR of the right appropriate position image PR indicated by a broken line respectively correspond to the jaw line A2, the blood vessel B2, and the mustache C2 of the in-use image P2 indicated by a solid line. . In the calculation of the deviation in step S53, the difference between the coordinates of the corresponding feature portions in the x direction and the y direction is calculated. In the example shown in FIG. 9B, the upper end point q of the blood vessel B2 corresponds to the upper end point p of the blood vessel BR. The coordinates of the upper end point p of the blood vessel BR are (x11, y11), while the coordinates of the upper end point q of the blood vessel B2 are (x12, y12). Therefore, the deviation is calculated by the following equation.
(Deviation in X direction) = x12−x11
(Shift in Y direction) = y12−y11

  As described above, the deviation calculation unit 15 calculates the deviation using at least one of the user's jaw, blood vessel, and beard as a characteristic part. Further, the shift calculation unit 15 may perform shift calculation using the skin color (such as a dull spot) as a feature.

  The calculation of the deviation may be performed as a difference in coordinates between corresponding specific points as in the above formula, or when the difference in coordinates differs between a plurality of corresponding points, It may be computed by averaging the differences. In addition, the feature position proper position data (see FIG. 6) attached to the use position image P2 and the proper position image PR are not directly used, but the feature position use position data is included in the proper position image. The coordinate difference (x direction, y direction) of the corresponding point between the feature part and the feature part included in the in-use image may be calculated.

  When the deviation is calculated in step S15, the deviation calculating unit 15 determines whether or not the in-use image matches the appropriate position image (S16 in FIG. 7). Here, the determination is performed by comparing the predetermined difference threshold value with the position difference. If the position difference is less than the difference threshold, it is determined that the in-use image matches the appropriate position image. Then, the deviation calculation unit 15 generates instruction-unnecessary information indicating that the position correction instruction in the instruction control unit 16 is unnecessary, and the generated instruction-unnecessary information is output to the instruction control unit 16. This completes the alignment. When the position difference is equal to or greater than the difference threshold, it is determined that the in-use image does not match the proper position image. Then, the position difference information is output to the instruction control unit 16, and the instruction control unit 16 issues a position correction instruction to the user so that the position difference indicated by the position difference information is reduced (S17; instruction step).

  Here, in the position correction instruction in step S17, the instruction control unit 16 calculates a position correction direction and a position correction distance that reduce the shift according to the shift calculated in step S15. In the example shown in FIG. 9B, the upper end point q of the blood vessel B2 is shifted from the upper end point p of the blood vessel BR by, for example, “3 mm rightward in the X direction and 2 mm downward in the Y direction”. Is calculated. In this case, the position of the speaker 6 of the receiver 2 is 3 mm in the left direction in the X direction and 3 mm in the Y direction with respect to the right ear of the user, as viewed from the direction facing the user's right ear (in-camera 4 side). Is estimated to be 2 mm. In other words, the handset 2 is located slightly upper left than the appropriate position when viewed from the direction facing the user's right ear. Therefore, the instruction control unit 16 calculates “slightly lower right” or “3 mm to the right and 2 mm to the lower” as the position correction direction and the position correction distance.

  Also, the instruction control unit 16 acquires the voice state information output from the voice input / output detection unit 11. Further, when the voice non-input / output state is indicated continuously for a certain period of time, the instruction control unit 16 acquires a position correction message and includes the calculated position correction direction and position correction distance. Then, a position correction message is output from the speaker 6. FIG. 10 is an explanatory diagram of the timing at which the position correction instruction is performed in step S17. In FIG. 10, the flow of a call between the user A of the mobile phone 1 and the caller B is shown on the time axis. As shown in FIG. 10, after the voice by Mr. B is output for the second time, the voice is not input / output continuously for a certain time T1. Therefore, a position correction message is output from the speaker 6 at time t1, which is the time when the predetermined time T1 has elapsed. For example, in the example shown in FIG. 9B, the position correction message to be output corresponds to “a little lower right” or “3 mm to the right and 2 mm to the bottom”.

  As described above, in the cellular phone 1 according to the present embodiment, when the non-input / output state of the voice is detected by the voice input / output detection unit 11, the position correction message is output to the speaker 6. Such control prevents the position correction message from interfering with the call. Further, in the mobile phone 1, a position correction instruction is given based on an appropriate position image corresponding to the detection result (right ear or left ear) detected by the left / right detection unit 13. Therefore, the calculation accuracy of the deviation is increased, and the position of the speaker can be accurately adjusted to the position of the user's ear.

  Subsequent to step S17, the instruction control unit 16 determines whether or not the positioning of the handset 2 is periodically executed based on the repeated information (S18). When the repeat information indicates that “repeated every minute during one call”, the instruction control unit 16 determines that the alignment is periodically performed, and this determination is performed. After one minute from the time, the process returns to the left / right detection process in step S12. If the repeat information indicates “perform once per call”, the instruction control unit 16 determines that the alignment is not performed periodically, and the process shown in FIG. 7 ends.

  According to the mobile phone 1 of the present embodiment described above, the appropriate position image (the right appropriate position image PR shown in FIG. 5 or the left side) is an image of the user in a state where the speaker 6 faces the ear E by the image database 18. The proper position image PL) is stored. Further, the deviation calculation unit 15 compares the in-use image P2 that is the user's image taken by the in-camera 4 when the user uses the handset 2 with the appropriate position image PR stored in the image database 18 ( (See FIG. 9). Then, based on the comparison result by the deviation calculation unit 15, the instruction control unit 16 instructs the user to correct the position of the handset 2 with respect to the ear E. Here, it is estimated how much the position of the speaker 6 is deviated from the position facing the user's ear E when the handset 2 is used, by comparing the in-use image P2 and the appropriate position image PR in the deviation calculation unit 15. be able to. Since the position correction instruction by the instruction control unit 16 is performed based on this comparison result, it is possible to instruct the user to reduce the positional deviation of the speaker 6. Therefore, the user can adjust the position of the speaker 6 to the position of the ear E only by following the instruction. Therefore, the position of the speaker 6 can be easily adjusted to the position of the user's ear E where the sound output from the speaker 6 can be heard well.

  In the conventional technology as described in Patent Document 1, a physical configuration such as a special hinge portion that connects the first housing and the second housing is required to adjust the position of the speaker to the position of the user's ear. It was. However, according to the mobile phone 1 of the present embodiment, the position of the speaker 6 can be easily adjusted to the position of the user's ear E without requiring such a special physical configuration.

  In addition, the displacement calculation unit 15 calculates the difference in position between the images of the user feature portions AR, BR, and CR included in the appropriate position image PR and the images of the feature portions A2, B2, and C2 included in the in-use image P2. Calculated. Further, since the instruction control unit 16 instructs the position difference to be small, the position of the speaker 6 can be accurately adjusted to the position of the user's ear E.

  In addition, the user's jaw, blood vessels, whiskers, and skin color are portions that have a shape unique to the user, and it is considered that there is little temporal change in the shape. Therefore, the difference calculation unit 15 calculates the difference using at least one of them as a feature portion, so that accurate alignment can be performed for each user. In addition, accurate positioning can be performed at any time regardless of the time zone in which the handset 2 is used.

  In addition, since the user can correct the position of the receiver 2 according to the position correction message output from the speaker 6 by the instruction control unit 16, the position of the speaker 6 can be more easily adjusted to the position of the user's ear E. it can.

  In addition, since a position correction message is output when a voice non-input / output state is detected by the voice input / output detection unit 11, the position of the speaker 6 can be adjusted while preventing the position correction message from interfering with the call. It can be easily adjusted to the position of the user's ear E.

  In addition, a position correction instruction based on the right proper position image PR or the left proper position image PL according to the detection result of the right ear or the left ear detected by the left / right detector 13 when the handset 2 is used by the user. Is done. Therefore, the position of the speaker 6 can be more accurately matched with the position of the user's ear E.

  Furthermore, since the proper position image PR is taken by the same in-camera 4 as the use-time image P2, the displacement calculation unit 15 compares the use-time image P2 with the proper position image PR more accurately. It can be carried out. Therefore, the accuracy of the position correction instruction by the instruction control unit 16 can be improved.

  The preferred embodiment of the present invention has been described above, but the present invention is not limited to the above embodiment.

  For example, in the above-described embodiment, the case where the position correction instruction by the instruction control unit 16 is performed through the speaker 6 has been described. However, as illustrated in FIG. 11, the vibrator 7 has a vibration pattern indicating that the position of the receiver 2 is corrected. A position correction instruction may be issued by vibrating the handset 2. In this case, the vibrator 7 is controlled by the control unit 10 to vibrate the handset 2 with a predetermined vibration pattern. In this position correction instruction by vibration, as shown in FIG. 11A, a position difference equal to or greater than the difference threshold is detected regardless of the flow of the call between the user (Mr. A) and the other party (Mr. B). At time t2, a position correction instruction is issued. Also, as shown in FIG. 11B, the direction indicated by the position correction instruction can be transmitted to the user by changing the vibration length and interval in each vibration pattern. For example, when it is desired to correct the position of the handset 2 to “lower right” in the example shown in FIG. 11B, a position correction instruction is issued with a vibration pattern based on a combination of the pattern B and the pattern D. The vibration pattern used here is stored in the message database 19.

  According to such a configuration, since the vibrator 7 vibrates the handset 2 with a vibration pattern indicating that the position of the handset 2 is to be corrected, the position correction instruction is performed. Can be prevented. Therefore, a position correction instruction can be issued regardless of the call timing, and the position of the speaker 6 can be quickly adjusted to the position of the user's ear E.

  Further, the appropriate position image stored in the image database 18 is not limited to the case where the image is captured by the in-camera 4, and may be an image generated by other means other than the in-camera 4. Moreover, although the said embodiment demonstrated the case where the in camera 4 was mounted in the 2nd housing 2b, the in camera 4 may be mounted in the 1st housing 2a. In addition, the present invention is not limited to a foldable type telephone, and can also be applied to a straight-type mobile phone. Furthermore, the present invention is not limited to a mobile phone, and can also be applied to a land-line telephone handset and its handset.

  DESCRIPTION OF SYMBOLS 1 ... Mobile phone (telephone), 2 ... Handset, 4 ... In camera (camera), 5 ... Acceleration sensor (left-right detection means), 6 ... Speaker, 7 ... Vibrator (vibration part), 9 ... Microphone, 11 ... Sound input Output detection unit (voice input / output detection unit), 13 ... left / right detection unit (left / right detection unit), 15 ... deviation calculation unit (comparison unit), 16 ... instruction control unit (instruction unit), 18 ... image database (storage unit) , E ... ear, P2 ... use image, PL ... left proper position image, PR ... right right position image.

Claims (9)

A telephone set provided with a handset that is placed on a user's ear; and a speaker that is mounted on the handset and outputs sound toward one side of the handset,
A camera directed to the one side of the handset;
A storage unit that stores appropriate position information according to an appropriate position image that is an image of the user in a state where the speaker faces the ear;
Comparing means for comparing in-use position information corresponding to an in-use image, which is an image of the user taken by the camera when the user uses the handset, with the appropriate position information stored in the storage unit; ,
Instructing means for instructing the user to correct the position of the receiver with respect to the ear based on the comparison result by the comparing means;
A telephone set comprising: The comparison unit calculates a difference in position between the feature portion of the user included in the appropriate position image and the feature portion included in the in-use image;
2. The telephone according to claim 1, wherein the instruction unit performs the instruction so that the difference becomes small based on the difference calculated by the comparison unit.   The telephone according to claim 1 or 2, wherein the comparison means calculates the difference using at least one of the user's jaw, blood vessel, beard, and skin color as the characteristic portion.   The telephone according to claim 1, wherein the instruction unit performs the instruction by causing the speaker to output a position correction message indicating that the position of the handset is to be corrected. Voice input / output detection means for detecting voice input / output between the microphone for inputting the user's voice and the speaker;
5. The telephone set according to claim 4, wherein the instruction unit causes the speaker to output the position correction message when the voice input / output detection unit detects a non-input / output state of the voice. A vibration unit for vibrating the receiver;
The said instruction | indication means performs the said instruction | indication by vibrating the said handset to the said vibration part by the vibration pattern which shows that the position of the said handset is correct | amended. Phone. Left and right detection means for detecting acceleration of the handset and detecting whether the user's ear is a right ear or a left ear based on the detected acceleration;
The right position information stored in the storage unit includes right right position information according to a right right position image that is an image of the user in a state where the speaker faces the right ear, and the speaker has the left ear. Left proper position information corresponding to the left proper position image that is the image of the user in a state of facing,
The comparison means performs comparison with the in-use position information by using the appropriate position information according to a detection result detected by the left / right detection means when the handset is used by the user. Item 7. The telephone set according to any one of items 1 to 6.   The telephone according to claim 1, wherein the proper position image is an image of the user taken by the camera in a state where the speaker faces the ear. A receiver that is placed on a user's ear; a speaker that is mounted on the receiver and that outputs sound toward one side of the receiver; a camera that is directed to the one side of the receiver; and the speaker is connected to the ear And a storage unit that stores appropriate position information corresponding to an appropriate position image that is an image of the user in a state of facing the phone,
A comparison step of comparing in-use position information corresponding to an in-use image that is an image of the user taken by the camera when the user uses the handset with the appropriate position information stored in the storage unit; ,
An instruction step for instructing the user to correct the position of the receiver with respect to the ear based on the comparison result in the comparison step;
A method for correcting the position of a telephone, comprising:

Images