JP2004128712A - Portable terminal device - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide an image display device in which vertical and lateral shakes of a screen caused by vibrations can be corrected with a display position and forward and backward shakes can be corrected with a display magnification ratio. <P>SOLUTION: A camera 16 is provided to the image display device 10. The image display device 10 is provided with an AF function for measuring a distance to the face of a user. Distance data to the face of the user measured by the AF mechanism, and a vertical, lateral, and forward/backward movement amount of the portable terminal device 10 detected by a built-in acceleration sensor 32, are transmitted to a CPU 30. A magnification/reduction amount of a display image for correcting visual size fluctuations of the display image following the movement in the forward/backward directions (remote and near) detected by the acceleration sensor 32, by making the distance to the face as an initial value is calculated by the CPU 30. Also, a shift direction and a shift amount in the display region of the screen for correcting the vertical and lateral shaking of the screen are calculated from the vertical and lateral movement amount of the portable terminal device 10 detected by the acceleration sensor 32. <P>COPYRIGHT: (C)2004,JPO

Description

[0001]
BACKGROUND OF THE INVENTION
The present invention relates to a portable terminal device.
[0002]
[Prior art]
Conventionally, in a car or other place where it is difficult to see the monitor screen due to vibrations, the amount of vertical and horizontal movement of the monitor screen is measured, and the display position in the monitor screen is moved vertically and horizontally to correct screen blurring. Is disclosed (for example, see Patent Document 1).
[0003]
Even in the case of a display screen that is operated while walking with the hand held like a mobile terminal device, the mobile terminal device is also shaken because the body vibrates due to walking, and the display screen is also shaken at the same time, so the screen is difficult to see It is the same. However, in the case of a portable terminal device, the distance from the face cannot be kept constant when walking while being carried by hand, and therefore, it is necessary to correct forward and backward movements in addition to vertical and horizontal movements. Furthermore, since the distance between the display screen and the user's eyes is short in the mobile terminal device, the influence of the variation in distance is large.
[0004]
[Patent Document 1]
Japanese Patent Laid-Open No. 6-121243 (pages 1 to 3, FIG. 3)
[0005]
[Problems to be solved by the invention]
In consideration of the above-described facts, the present invention provides a mobile terminal device that corrects screen shake due to vibration during walking, corrects the vertical / horizontal shake at the display position, and corrects the forward / backward (far / near) shake at the display magnification. The task is to do.
[0006]
[Means for Solving the Problems]
The image display apparatus according to claim 1, wherein a first detection unit that detects a perspective shake amount from the face to the image display unit, and the image display unit according to the perspective shake amount detected by the first detection unit. And a first correction means for changing the display magnification.
[0007]
In the invention with the above-described configuration, the amount of shake in the perspective from the user's face to the image display unit is detected, and the image display magnification is changed according to the amount of shake, thereby moving the user in the front-rear (perspective) direction. It can correct | amend and the display size on visual observation can be made constant.
[0008]
According to a second aspect of the present invention, there is provided an image display device comprising first detection means for measuring an initial distance from the face to the image display unit.
[0009]
In the invention having the above-described configuration, the initial distance from the user's face to the image display unit can be measured and used as data for performing more accurate correction when the first correction unit changes the image display magnification.
[0010]
The image display device according to claim 3 is characterized in that the first correction means does not change the display magnification within a range of a predetermined distance of near and far.
[0011]
In the invention with the above configuration, the correction amount is small when the forward and backward shake amount is smaller than a certain value, and when it is larger than the certain value, the correction amount is set according to the shake amount. As a result, when the shake is small and easy to follow visually, a high-speed and wide effective range display is performed with a small correction amount.When the shake is large and the follow-up cannot be followed with the line of sight, the correction is made according to the shake amount, and the visual display size is Keep it constant.
[0012]
According to a fourth aspect of the present invention, there is provided an image display device comprising: a third detection unit configured to detect a vertical and horizontal shake amount of the image display unit; and a display position of the image display unit according to the shake amount detected by the third detection unit. And a second correcting means for changing.
[0013]
In the invention having the above-described configuration, the shake amount of the image display device is detected by detecting the shake amount in the vertical and horizontal directions of the image display device, and the display position of the image display unit is changed in accordance with the shake amount. Can be made constant.
[0014]
The image display device according to claim 5 is characterized in that the second correction means does not change the display position within a predetermined range of up / down / left / right shake with respect to the initial measurement position.
[0015]
In the invention with the above configuration, the correction amount is small when the amount of shake in the vertical and horizontal directions is smaller than a certain value, and when it is larger than the certain value, the correction amount is set according to the amount of shake. As a result, if the shake is small and easy to follow visually, high speed and wide effective range display is performed with a small correction amount.If the shake is large and cannot follow visually, the display is corrected according to the shake amount and the visual display position is set. Keep it constant.
[0016]
The image display apparatus according to claim 6, a first detection unit that detects a near and far shake amount from the face to the image display unit, a second detection unit that measures an initial distance from the face to the image display unit, First correction means for changing the display magnification of the image display unit in accordance with the near and far shake amounts detected by the first and second detection means, and third detection means for detecting the vertical and horizontal shake amounts of the image display unit; And second correction means for changing the display position of the image display unit in accordance with the shake amount detected by the third detection means.
[0017]
In the invention with the above configuration, the amount of shake of the image display unit before and after and up and down, left and right is detected, the display magnification of the image is changed with respect to front and back shake, and the display position of the image is changed with respect to up and down and left and right shake. Each of the corrections can be performed to correct the shake of the mobile terminal device and to make the display size and display position of the display image visually constant.
[0018]
DETAILED DESCRIPTION OF THE INVENTION
FIG. 1 is a perspective view of a mobile terminal device according to the first embodiment.
[0019]
As shown in FIG. 1, the mobile terminal device 10 has a shape in which a display unit 12 and an operation unit 14 are rotatably connected by a connecting unit 18. An operation button 24 is provided on the operation surface 22 of the operation unit 14 and performs operations such as dialing a mobile phone and a web browser. A display 26 is provided on the display surface 20 of the display unit 12 to display contents such as a telephone directory and a browser, information such as a navigation screen, mail, and TV. Further, an acceleration sensor 32 (not shown) is built in the display unit 12 to detect the vertical and horizontal movements of the mobile terminal device 10 and the movement in the front-rear direction, that is, the movement perpendicular to the surface of the display 26.
[0020]
The connecting unit 18 is provided with a camera 16 and has an AF function for measuring the distance to the user's face in addition to capturing an image of the user's face and the like.
[0021]
FIG. 2 shows a block diagram of the mobile terminal device according to the first embodiment.
[0022]
As shown in FIG. 2, the distance data to the user's face measured by the AF mechanism of the camera 16, and the amount of movement of the mobile terminal device 10 up and down, left and right and front and rear detected by the built-in acceleration sensor 32 are as follows. It is transmitted to the CPU 30.
[0023]
The CPU 30 calculates the enlargement / reduction amount of the display image for correcting the visual size variation of the display image due to the movement in the front-rear direction (far / near) detected by the acceleration sensor 32 using the distance to the face as an initial value.
[0024]
Further, the CPU 30 calculates the shift direction and the shift amount of the display area of the screen for correcting the vertical and horizontal shakes of the screen from the vertical and horizontal movement amounts of the mobile terminal device 10 detected by the acceleration sensor 32. The
[0025]
These correction data are sent to the memory control unit 34, and are sent to the display memory 36 as address correction values due to screen enlargement / reduction and display area shift.
[0026]
The display memory 36 corrects the uncorrected image data and character data sent from the CPU 30 in accordance with the address correction value sent from the memory control unit 34 and develops it on the memory. The final display image obtained here is sent to the display circuit 38 and displayed on the display 26 driven by the display circuit 38.
[0027]
Here, the shake in the front-rear direction is detected by the acceleration sensor 32, but the distance to the user's face is constantly measured by the AF mechanism of the camera 16, and the change in the distance can be used as the movement amount in the front-rear direction. Good. In this case, even if the mobile terminal device 10 and the user's face are shaken forward or backward at the same time, there is no risk of erroneous detection as a distance fluctuation in the front-rear direction. Further, the position of the camera 16 is not limited to the connecting portion 18 and may be provided around the display 26.
[0028]
FIG. 3 is a diagram illustrating the relationship between the shake amount and the correction amount of the mobile terminal device according to the first embodiment.
[0029]
As shown in FIG. 3, when the shake amount d is smaller than d1 and there is almost no shake, the correction amount is 0, that is, no correction is performed. When the shake amount is between d1 and d2, an amount smaller than the calculated correction amount is corrected. The amount of shake increases. Between d2 and d3, the amount of increase in the correction amount increases as the amount of shake increases. When the amount of shake is greater than or equal to d3, correction is performed according to the correction amount calculated from the shake amount.
If larger, correction is performed according to the calculated correction amount.
[0030]
This is because it is easy to follow visually when the shake amount is small and the effect of correction is weak, and when the correction is always made in response to a slight shake amount, the display screen always shakes and is stable by continuing scaling. The reason for this is that eyes are tired without using the battery, and if the correction is always performed, the battery is consumed significantly.
[0031]
For this reason, when the shake amount is smaller than d1, the follow-up is visually observed. When the shake amount is between d1 and d2, visual follow-up is supported by correction. When the shake amount is greater than d3, the correction is performed according to the calculated value. Eliminates the need for following. When the shake amount is between d2 and d3, the correction amount with respect to the shake amount gradually changes so that the correction amount does not change abruptly due to the change in the shake amount.
[0032]
FIG. 4 is a diagram illustrating the relationship between the shake amount and the return speed of the mobile terminal device according to the first embodiment.
[0033]
In this embodiment, up / down / left / right movement is dealt with by shifting the display position on the display 26, but when the shake is reduced, it is necessary to return the display position to the default position. If this is not done, the screen will always be displayed with a part missing.
[0034]
Therefore, as shown in FIG. 4, when the shake amount is smaller than the constant value d1, an operation of gradually returning the display position on the display 26 to the default position is performed simultaneously with the correction of the display position. When the shake amount is between d1 and d2, the return speed to the default position decreases as the shake amount increases. When the shake amount exceeds d2, the return to the default position is not performed, and only the display position is corrected.
[0035]
This is because when the acceleration detected by the acceleration sensor 32 is small, the swinging speed is slow and it is easy to follow visually, so the display position is returned to the default and the display area of the display 26 is used effectively. In addition, when the acceleration is high, the change in the swing speed is also large, and the maximum correction is required, so the return to the default is not performed.
[0036]
Further, the CPU 30 may be instructed to turn on / off the correction with the operation button 24, stop the correction by the user's operation, and return the display position to the default.
[0037]
FIG. 5 is a diagram illustrating the relationship between the pixel position and the display density of the mobile terminal device according to the first embodiment.
[0038]
When the display 26 is an LCD or the like, the display position is determined discretely (digitally). Therefore, when correction is performed in units of one dot, so-called jaggy occurs, which is unnatural. For this reason, data is complemented between adjacent dots to obtain image display data.
[0039]
That is, as shown in FIG. 5A, even if the three dots originally show continuous density changes, if the xth dot is calculated as the density D1, there is a large step in the visual density as a result. it can. Therefore, if the x-1th density D3 and the x + 1th density D3 are intermediated and the xth density is set to D2, a density step does not occur and a natural gradation is reproduced.
[0040]
In this embodiment, both the display magnification correction that corrects the shake of the mobile terminal device in the front-rear direction and the display position correction that corrects the shake of the mobile terminal device in the vertical and horizontal directions are performed. Needless to say, the correction alone is effective.
[0041]
FIG. 6 shows an operation diagram of the mobile terminal device according to the second embodiment.
[0042]
As shown in FIG. 6, there may be a case where the mobile terminal device 11 swings and the angle viewed from the user changes. Therefore, by providing two or three or more acceleration sensors 32 inside the mobile terminal device 11 and arranging the acceleration sensors 32 so as not to line up on a straight line parallel to the connecting portion 18, the mobile terminal device 11 is shaken. A structure capable of detecting a change in angle at the time is used.
[0043]
As shown in FIG. 6A, when the user swings to an angle at which the screen 40 is looked down from above, the display image on the screen 40 is stretched vertically and corrected to enlarge toward the bottom of the screen so that it can be viewed from the user. The displayed image on the screen 40 is the same as before the image is shaken.
[0044]
Further, as shown in FIG. 6B, when the user swings to the angle at which the screen 40 is looked up from below, the display image on the screen 40 is stretched vertically, and the lower part of the screen is reduced and corrected so as to decrease toward the bottom. The display image of the screen 40 viewed from the user is the same as before the image is shaken.
[0045]
Although the embodiment of the present application is configured for the purpose of canceling the shake and stabilizing the display image, it is also possible to display an image having a size larger than the maximum area of the display screen by shaking the mobile terminal device vertically and horizontally. Furthermore, the image can be intentionally enlarged or reduced by shaking it back and forth.
[0046]
【The invention's effect】
Since the present invention is configured as described above, it is possible to provide a mobile terminal device that corrects screen shake due to vibration during walking by correcting the vertical and horizontal shakes at the display position and correcting the forward and backward shakes by the display magnification. did it.
[Brief description of the drawings]
FIG. 1 is a perspective view of a mobile terminal device according to a first embodiment.
FIG. 2 is a block diagram of the mobile terminal device according to the first embodiment.
3 is a shake amount / correction amount relationship diagram of the mobile terminal device according to the first embodiment; FIG.
4 is a shake amount / return speed relationship diagram of the mobile terminal device according to the first embodiment; FIG.
FIG. 5 is a pixel position / display density relationship diagram of the mobile terminal device according to the first embodiment.
FIG. 6 is a conceptual diagram of a mobile terminal device according to a second embodiment.
[Explanation of symbols]
DESCRIPTION OF SYMBOLS 10 Mobile terminal device 12 Display part 14 Operation part 16 Camera 18 Connection part 20 Display surface 22 Operation surface 24 Operation button 26 Display 30 CPU

Claims (6)

A first detecting means for detecting a near and far shake amount from the face to the image display unit;
First correction means for changing a display magnification of the image display unit in accordance with a near and far shake amount detected by the first detection means;
A portable terminal device comprising: The mobile terminal device according to claim 1, further comprising a second detection unit that measures an initial distance from the face to the image display unit. 2. The portable terminal device according to claim 1, wherein the first correction unit does not change a display magnification within a range of a predetermined near and near shake amount. Third detection means for detecting a vertical and horizontal shake amount of the image display section; a second correction means for changing the display position of the image display section in accordance with the shake amount detected by the third detection means;
A portable terminal device comprising: 5. The mobile terminal device according to claim 4, wherein the second correction unit does not change a display position within a predetermined range of up / down / left / right shake with respect to an initial measurement position. A first detecting means for detecting a near and far shake amount from the face to the image display unit;
Second detection means for measuring an initial distance from the face to the image display unit;
First correction means for changing a display magnification of the image display unit in accordance with a near and far shake amount detected by the first and second detection means;
Third detecting means for detecting the amount of shake of the image display unit in the vertical and horizontal directions;
Second correction means for changing the display position of the image display unit in accordance with the shake amount detected by the third detection means;
A portable terminal device comprising:

Images