JP2008083574A - Mobile information apparatus and video display method - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To attain equipment which displays images such that a screen is easy to see, even when the user moves together with the equipment. <P>SOLUTION: Information equipment, comprising a 1st case in which voice output part is housed and which is mounted on the head of the user, and a 2nd case in which a video display part is housed, measures the acceleration of the user's head by utilizing an acceleration sensor housed in the 1st case; measures the acceleration of a video display part by using an acceleration sensor housed in the 2nd case; obtains a relative positional relation between the 1st and 2nd cases from these pieces of information; and changes the display position of the video on the basis of the positional relation. <P>COPYRIGHT: (C)2008,JPO&INPIT

Description

  The present invention relates to an image display of a mobile information device, and more particularly, to an image display method for viewing a video displayed on the device without discomfort even while moving.

  Information devices of a portable size that can be used even when transporting such as trains and buses or walking are on the market. Some have a large LCD (Liquid Crystal Display) screen and can display moving images.

  When you carry such a device or display an image while traveling by transportation, the device or the user watching it may be shaken by the vibration caused by the movement, resulting in a situation that is very difficult to watch. Conceivable.

An invention has been disclosed in which the movement of the observer's head is detected and control is performed to change the display position of the display area in accordance with the movement of the observer's head when the device is stationary (see Patent Document 1).
JP 7-298165 A

  Even under a situation where the user himself / herself is shaken, it is possible to make the screen easier to see by moving the display area of the screen according to the movement of the user.

  However, when the user is shaken together with the device he / she carries, simply detecting the amount of movement of the user is not sufficient for controlling the display area.

  The present invention has been made in view of the above problems, and provides a device and a display method for displaying an image so that a user-friendly screen is displayed even when the user moves with the device.

With the mobile information device according to the present invention,
A mobile information device for viewing video during movement, comprising a first housing storing an audio output unit and a second housing storing a video display unit, the user's head A first acceleration sensor stored in the first casing mounted on the head and measuring an acceleration applied to a user's head; and a second acceleration sensor stored in the second casing. And the video display unit has a relative positional relationship between the first casing and the second casing obtained from the acceleration information of the first acceleration sensor and the acceleration information of the second acceleration sensor. Based on this, there is provided a mobile information device characterized by changing a display position of a video to be displayed.

If the video display method according to the present invention is implemented,
A video display method for displaying a moving video on an information device including a first casing mounted on a user's head storing an audio output unit and a second casing storing a video display unit The first acceleration sensor stored in the first casing is used to measure the first acceleration of the user's head and the second acceleration sensor stored in the second casing. Is used to measure the second acceleration of the video display unit, determine the relative positional relationship between the first and second housings from the information of the first and second accelerations, and determine the relative An information device is provided, wherein the display position of the video displayed on the video display unit is changed and displayed based on the positional relationship.

  Even when the user moves with the device, it is possible to realize a device and a display method for displaying an image so that the screen is easy to see.

  FIG. 1 is a diagram illustrating an example of a video display device according to the present embodiment. FIG. 1 shows an information device 100, a display screen 101, an earphone 102, and a user 103.

  The information device 100 is an information device capable of displaying an image that the user carries or moves with. Specifically, a mobile personal computer, a mobile phone, a PDA (Personal Digital Assistant), an in-vehicle personal computer, etc. can be considered. In addition, a three-dimensional acceleration sensor is provided inside the information device 100 so that the amount of movement of the information device 100 in the space can be detected.

  The display screen 101 is provided in the information device 100 and has a function of displaying an image. For example, LCD (Liquid Crystal Display) used in mobile devices can be considered because of its light weight and power saving characteristics.

  Earphone 102 is connected to information device 100 and has a function of converting a sound signal output from information device 100 into sound. Furthermore, a three-dimensional acceleration sensor is provided inside, and the amount of movement of the earphone 102 in the space is detected and notified to the information device 100. Normally, since the earphone 102 is used while being worn on the user's ear, detecting the amount of movement of the earphone 102 is nothing but detecting the amount of movement of the user's eyeball in space. If a 3D acceleration sensor capable of measuring the amount of movement of the user's head can be incorporated, the earphone shape is not particular.

  The user 103 moves with the information device 100 and views an image displayed on the display screen 101 while listening to the sound output from the earphone 102. At this time, it is assumed that the user 103 always wears the earphone 102 when viewing an image.

  Here, the information device 100 and the earphone 102 need to be provided in separate housings. For example, the user 103 refers to a usage mode in which the user wears the information device 100 and wears the earphone 102 so that each user 103 can move to some extent in the space. That is, the goggle-shaped information device 100 worn on the head and the earphone 102 similarly worn on the head are not included in this embodiment.

  FIG. 2 is a diagram illustrating an example of a display screen in the present embodiment. In FIG. 2, a display screen 101 and a window 200 are shown.

  The window 200 indicates an area where an image viewed by the user 103 displayed on the display screen 101 is displayed. In FIG. 2, the window 200 is displayed so as to be approximately the same as the size of the display screen 101. If the movement caused by movement such as transportation is not taken into consideration, it can be said that the display size is the easiest for the user 103 to view. This display size is called a standard size.

  FIG. 3 is a diagram showing an initial screen of the camera shake correction mode in the present embodiment.

  The window 300 is an initial screen that displays a reduced size of the window 200 when the camera shake correction function is turned on. By reducing the window 200, a gap where no video is displayed is formed around the window 300. The display size of the window 300 is referred to as a reduced size, and this display state is referred to as a reduced display. The state of the initial screen is called a reduced initial size and a reduced initial display.

(Screen shake)
FIG. 4 is a diagram illustrating an example of a display screen when shake is detected in the camera shake correction mode according to the present embodiment. FIG. 4A shows a difference in acceleration in the diagonally downward direction between the information device 100 and the earphone 102, that is, the head of the user 103, when the video is displayed in a reduced size as shown in FIG. The position of the window 400 when it is detected that it has occurred is shown. At this time, since the head of the user 103 is shaken in an obliquely lower right direction as compared with the information device 100, the window 300 is moved in the gap so as to follow the moving direction of the head. It is located at the tip of the line of sight. FIG. 4B shows a case where it is determined that the head has moved in the diagonally upward left direction as a result of being shaken. The difference between the position of the head of the user 103 detected at the position of the earphone 102 and the position of the information device 100 is a relative position shift between the two, and the head detects the difference by the amount detected above. It does not mean that it has moved in the direction.

  Such a configuration eliminates the need to sequentially change the line of sight and facilitates viewing.

  FIG. 5 is a diagram illustrating an example of a display screen when there is no shake in the camera shake correction mode according to the present embodiment. FIG. 5 shows that the positional relationship between the information device 100 and the earphone 102 has hardly changed after the display shown in FIG. 4B in the case where the head is relatively obliquely upward to the left. It shows the movement when Once the display state shown in FIG. 4B is reached, it is gradually moved to the position of the window 300 which is the initial screen so as not to cause discomfort to the user 103.

  With this configuration, the user 103 can be prepared for the next camera shake while suppressing a sense of discomfort during viewing.

(Gaze direction shake)
FIG. 6 is a diagram illustrating another example of a display screen when shake is detected in the camera shake correction mode according to the present embodiment. FIG. 6 shows an example in which the display screen 101 of the information device 100 and the eyeball 600 of the user 103 have received shakes that change the distance in the line-of-sight direction when looking at the display screen 101. The apparent size of an object changes depending on the distance between the human eye and the object. For example, objects that are far away are smaller and objects that are nearby appear larger. When such a shake is received, the apparent display size of the display screen 101 is not determined, resulting in an image that is difficult to see.

  Therefore, in the information device according to the present embodiment, the display size of the window 300 is changed based on the distance between the information device 100 and the information of the acceleration sensor built in the earphone 102. As shown in FIG. 6, when the display screen 101 approaches the eyeball 600, it is displayed as small as a window 601. On the other hand, when it moves away, it is displayed large like a window 602. The relationship between the distance between the display screen 101 and the eyeball 600 and the enlargement / reduction ratio of the window 300 is such that the enlargement / reduction of the window 300 is within a certain angle range with the eyeball 600 as a base point as shown in FIG. A ratio is selected. Then, the windows 601 and 602 viewed from the eyeball 600 both look like windows of the same size, and the user 103 can always view an easily viewable image having the same display size even if there is a shake in the line of sight.

  If the enlargement / reduction of the window 300 and the display method shown in FIG. 4 are used in combination, a more natural image display is possible even if the window 300 shakes in any direction.

Similarly to the case described with reference to FIG. 5, when it is determined that the positional relationship between the information device 100 and the earphone 102 is not substantially changed with respect to the display size of the window 300, the user 103 is not uncomfortable. The image may be gradually enlarged / reduced to the size of the initial display of reduction.

  Here, consider the positional relationship that the display screen 101 and the earphone 102 can take. Except for special cases, the user 103 is always located in the front direction of the display screen 101 during viewing. Therefore, it is not necessary to consider whether the direction is suitable for viewing, and it is sufficient if a three-dimensional acceleration sensor as disclosed in this embodiment is provided. Furthermore, the distance between the information device 100 and the user 103 can be limited to a range that does not hinder viewing and a range within which the earphone 102 can reach or a distance that allows the user 103 to identify an image. Therefore, an unnecessarily high-performance sensor is not necessary, and an acceleration sensor that functions in this relatively limited range is sufficient.

  FIG. 7 is a diagram illustrating an example of an operation flow in the present embodiment.

  First, it is checked whether or not the information device 100 is set (ON) to use the camera shake correction function (step S01). When the camera shake correction function is not used (No), since the displayed image is always displayed in the standard size, this operation flow ends without doing anything.

  When the camera shake correction function is used (Yes), the window 200 displayed on the display screen 101 is reduced and changed to the reduced initial display state of the window 300 (step S02).

  Next, acceleration information is acquired from an acceleration sensor built in each of the information device 100 and the earphone 102 (step S03).

  From the obtained acceleration information or by integrating the acceleration information, the current position of the information device 100 and the earphone 102 in the three-dimensional space is predicted, and it is checked whether there is a change in the positional relationship between the two ( Step S04). If it is an extent that it is recognized that there is no change in the positional relationship (No), the display of the window 300 is changed to approach the reduced initial display (step S05). At this time, since it is very unsightly to change the window display at a stretch, it is desirable to gradually return to the reduced initial display state so that the user 103 does not feel uncomfortable.

  If there is a change in the positional relationship in step S04 (Yes), the operation differs depending on in which direction it changes with respect to the display screen 101.

If there is a change in the direction parallel to the display screen 101 (Yes), the display position of the window 300 on the display screen 101 is moved (step S07). How much the window 300 is moved in which direction on the display screen 101 is determined by the relative positional relationship between the information device 100 and the earphone 102 obtained from the acceleration sensor. If it is determined that the head of the user 103 has moved to the right from the initial center at the front center of the display screen 101, the window 300 is moved to the right on the display screen 101. The larger the relative movement amount of the head is, the closer to the right is displayed on the display screen 101.

  Next, when there is a change in the direction perpendicular to the display screen 101, that is, the distance between the information device 100 and the earphone 102 (Yes in step S08), the display size of the window 300 is changed (step S09). As the enlargement / reduction ratio of the display size of the window 300 with respect to the change amount of the distance, a ratio is selected so that the apparent size of the window does not change for the user 103.

  Next, it is checked whether or not the setting to stop the camera shake correction function has been made (step S10). Thereafter, when the camera shake correction function is enabled (No), this operation flow is repeated again from step S03.

  When the camera shake correction function is invalidated (Yes), the image having the size of the window 300 on the display screen 101 is displayed in the size of the standard size window 200, and the series of operation flow is finished.

  With this configuration, it is possible to realize an information device that displays an image so that the screen is easy to see even when the user moves with the device.

  Note that the present invention is not limited to the above-described embodiment as it is, and can be embodied by modifying the constituent elements without departing from the scope of the invention in the implementation stage. In addition, various inventions can be formed by appropriately combining a plurality of components disclosed in the embodiment. For example, some components may be deleted from all the components shown in the embodiment. Furthermore, constituent elements over different embodiments may be appropriately combined.

It is a figure which shows an example of the video display apparatus in this embodiment. It is a figure which shows an example of the display screen in this embodiment. It is a figure which shows the initial screen of camera shake correction mode in this embodiment. It is a figure which shows an example of a display screen when shake is detected in the camera shake correction mode in this embodiment. It is a figure which shows an example of a display screen when there is no shake of the camera shake correction mode in this embodiment. It is a figure which shows another example of a display screen when shake is detected in camera shake correction mode in this embodiment. It is a figure which shows an example of the operation | movement flow in this embodiment.

Explanation of symbols

DESCRIPTION OF SYMBOLS 100 ... Information equipment, 101 ... Display screen, 102 ... Earphone, 103 ... User, 200 ... Window

Claims (8)

A mobile information device for viewing video during movement, comprising a first housing storing an audio output unit and a second housing storing a video display unit,
A first acceleration sensor that is stored in the first housing mounted on the user's head and that measures an acceleration applied to the user's head;
A second acceleration sensor stored in the second housing;
With
The video display unit is based on a relative positional relationship between the first casing and the second casing obtained from acceleration information of the first acceleration sensor and acceleration information of the second acceleration sensor. A mobile information device characterized by changing a display position of a video to be displayed.   In the video display unit, when the position of the first casing is shifted to the upper, lower, left, or right with respect to the center of the video display surface, the center of the video to be displayed is the position of the first casing. 2. The mobile information device according to claim 1, wherein the mobile information device is displayed by shifting the display position up, down, left, or right to match each other.   When the distance between the first casing and the second casing approaches or leaves, the video display unit displays the size of the video to be displayed small or large according to the change in the distance. The mobile information device according to claim 1.   The video display unit includes the first housing even when the positional relationship between the first housing and the second housing is not changed for a predetermined period of time and the positional relationship is not changed thereafter. The mobile information device according to claim 2 or 3, wherein an image is displayed so as to be close to a display position when there is no relative shift in a positional relationship between a body and the second casing. A video display method for displaying a moving video on an information device including a first casing mounted on a user's head storing an audio output unit and a second casing storing a video display unit Because
The first acceleration sensor stored in the first housing is used to measure the first acceleration of the user's head,
Using the second acceleration sensor stored in the second housing, the second acceleration of the video display unit is measured,
From the information on the first and second accelerations, the relative positional relationship between the first and second housings is obtained,
A video display method comprising: changing a display position of a video displayed on the video display unit based on the relative positional relationship. From the obtained positional relationship, it is determined in which direction the position of the first housing is shifted with respect to the center of the video display surface of the video display unit,
If it is shifted to the top, bottom, left or right, the display position is changed so that it is shifted to the top, bottom, left or right respectively so that the center of the image to be displayed matches the position of the first housing. The video display method according to claim 5, wherein display is performed. From the obtained positional relationship, a change in the distance between the first housing and the second housing is obtained,
6. The video display method according to claim 5, wherein, when approaching or moving away, the size of the video to be displayed is changed so as to be displayed smaller or larger according to the change in the distance. From the obtained positional relationship, a change in the positional relationship between the first housing and the second housing is obtained for a predetermined period,
Display when there is no relative deviation in the positional relationship between the first housing and the second housing, even if there is no change in the positional relationship and then there is no change in the positional relationship. 8. The video display method according to claim 6, wherein the image is displayed so as to be close to the position.

Images