JP2004271671A - Image display apparatus and terminal device equipped with the same - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide an image display apparatus with three-dimensional projected images visible from any optional direction with an easy operation, and magnifying/reducing the images. <P>SOLUTION: This image display apparatus 10 has a display part 14, an acceleration sensor, a movement detection part 15 detecting movement and rotational action, an information storage part 11 storing information about images, an attribute storing part 12 storing attribute about images, a display content generating part 13 generating images displayed on the display part 14 from information stored in the storage parts 11, 12, and a display switching part 16 switching the contents of the storage part 12 based on detection results of the detection part 15. When movement of the apparatus 10 is detected by the movement detection part 15 in a state of displaying images, images are generated by the generating part 13 based on the attribute of the images changed by the switching part 16, and the images displayed on the display part 14 are switched to the generated images. <P>COPYRIGHT: (C)2004,JPO&NCIPI

Description

[0001]
TECHNICAL FIELD OF THE INVENTION
The present invention relates to an image display device, and more particularly to a mobile terminal having a small display unit such as a mobile phone or a PDA.
[0002]
[Prior art]
Since the size of the display unit of the terminal device is limited, it may not be possible to display all information at once. This is often the case with a mobile terminal such as a mobile phone or a PDA having a small display unit. At this time, it is common to operate the input unit such as a key and a wheel provided in the terminal to scroll the screen and enlarge / reduce the screen.
Since the operation of the keys and the wheels needs to be performed more frequently as the display unit is smaller, it is inevitable that the operability is troublesome. Therefore, Patent Literatures 1 to 4 propose techniques for improving operability of screen scrolling.
In Patent Document 1, in order to display data that cannot be displayed on the display unit on the display unit by scrolling the screen of the display unit, the user tilts the main body in the scroll direction, and the tilt detection unit detects the tilt direction of the main body. A method is disclosed in which the degree of inclination is detected and the display screen after scrolling the screen from the CPU via the display control unit is displayed on the display unit.
Patent Literature 2 discloses a data display device and a storage medium that scroll display data in accordance with the movement or inclination of the device main body.
Patent Literature 3 discloses a user interface device of a portable terminal device that scrolls a screen display based on a tilt state detected by a tilt sensor.
Patent Literature 4 discloses a display screen control device of a mobile phone terminal in which a display screen is scrolled based on the number of tilts of a main body of the mobile phone terminal, and a scroll amount of the display screen changes according to the number of tilts. ing.
In Patent Documents 1 to 4, the screen is scrolled by an operation of tilting the main body. The operation of tilting the main body is also used in Patent Document 5.
Patent Literature 5 discloses a terminal device in which a screen display of a mobile terminal including a plurality of virtual planes is displayed so as to be overlapped so as to be distinguished / identifiable by shading of display colors for each virtual plane, and an angle / position sensor is used. There is disclosed a terminal device that obtains the usage status (posture (angle)) of the device and changes the order of the virtual planes when the usage status is changed.
Meanwhile, there is a device that displays a three-dimensional projected image on a display unit. Patent Literature 6 discloses a display device in which a three-dimensional projection direction change can be instructed by a small operation such as a two-dimensional position change, and a three-dimensional shape model is displayed on a display screen to perform interactive processing.
[0003]
[Patent Document 1]
JP-A-11-305918 [Patent Document 2]
JP-A-10-283160 [Patent Document 3]
Japanese Patent Application Laid-Open No. 2002-268622 [Patent Document 4]
JP 2001-136259 A [Patent Document 5]
Japanese Patent Application Laid-Open No. 2000-305691 [Patent Document 6]
JP-A-1-106179
[Problems to be solved by the invention]
In the above Patent Documents 1 to 4, the operation can be performed more easily than operating the keys and wheels, but it is difficult to tilt the main body slightly and for a short time when fine scrolling is required, and it is necessary to learn through training. .
In addition, Patent Document 5 requires training for tilting the main body in the same manner as described above, and is difficult to see because images are displayed in an overlapping manner.
Further, Patent Document 6 uses a displacement input unit to capture a two-dimensional position change amount, but does not describe a specific unit. Therefore, if the displacement input means is a key or a wheel, the operation is troublesome. On the other hand, assuming that the displacement means is an operation by tilting the main body as in Patent Documents 1 to 5, it is necessary to tilt the main body slightly and for a short time when it is desired to rotate it delicately. is there.
[0005]
In view of the above problems, the present invention provides an image display device that allows a three-dimensional projected image to be easily viewed from an arbitrary direction and to enlarge / reduce an image without learning through training. The purpose is to provide. Another object is to provide a terminal device provided with the image display device.
[0006]
[Means for Solving the Problems]
In order to achieve the above object, the present invention provides a display unit that displays an image, a movement detection unit that has an acceleration sensor and detects a movement and a rotation operation of the device, and an information storage unit that stores information about the image. An attribute storage unit that stores an attribute related to an image, a display content creation unit that creates an image to be displayed on the display unit from information stored in the information storage unit and the attribute storage unit, and a detection result of the movement detection unit. A display switching unit that changes the contents of the attribute storage unit, based on the image display device, when the movement of the device is detected by the movement detection unit while an image is displayed, An image is created by the display content creation unit based on an attribute of the image changed by the display switching unit, and an image displayed on the display unit is switched to the created image. A.
[0007]
According to this configuration, even if the user does not learn the image switching operation through training, the user can easily view the three-dimensional projected image from any direction by moving the device as if he were looking at the object through the display unit. And enlarge / reduce the image.
[0008]
In the above image display device, when the information stored in the information storage unit and the attribute storage unit is three-dimensional information, the display content creation unit creates an image converted from three-dimensional information into two-dimensional information. can do.
[0009]
Specifically, a projection operation (two-dimensional information) having a three-dimensional shape is created by performing a mapping operation. Thereby, an image from an arbitrary line of sight can be displayed.
[0010]
Further, in the above image display device, when a change in the surface direction of the display unit is detected by the movement detection unit, the image can be translated in the position change direction by the position change amount.
[0011]
In the above image display device, when a position change in a direction perpendicular to the surface of the display unit is detected by the movement detection unit, the image can be enlarged / reduced in accordance with the position change amount.
[0012]
In the above image display device, when the movement detecting section detects an angle change of the device, the image can be rotated by the angle change amount in the angle change direction.
[0013]
By updating the display image according to the detection results of these movement detection units, the point after the movement of the apparatus becomes the viewpoint. Therefore, a user can move the apparatus in a desired direction to obtain a desired display image, so that even a user who is not used to the apparatus can easily operate the apparatus.
[0014]
Further, the present invention is characterized in that the above-mentioned image display device is mounted on a terminal device.
[0015]
BEST MODE FOR CARRYING OUT THE INVENTION
Hereinafter, embodiments of the present invention will be described with reference to the drawings. FIG. 1 is a block diagram showing the configuration of the image display device, FIG. 2 is a flowchart showing the operation of the image display device when displaying and switching images, and FIG. 3 is a diagram for explaining image switching when the mobile phone is rotated. It is.
[0016]
As shown in FIG. 1, the image display device 10 includes an information storage unit 11, an attribute storage unit 12, a display content creation unit 13, a display unit 14, a movement detection unit 15, and a display switching unit 16. ing.
[0017]
The information storage unit 11 includes an electrically writable / readable memory, and stores three-dimensional information such as a three-dimensional character and two-dimensional information such as a document.
The attribute storage unit 12 includes an electrically writable / readable memory, and stores viewpoint information and the like used by the display content creation unit 13. The viewpoint information includes three pieces of information x_position, y_position, and z_position representing the viewpoint position, three pieces of information x_vector, y_vector, and z_vector representing the gaze direction, and arbitrary auxiliary attribute information. As the auxiliary attribute information, for example, there is a light source direction arbitrarily included in the three-dimensional information.
[0018]
The display content creation unit 13 includes an arithmetic unit, and creates an image to be displayed on the display unit 14 based on the information stored in the information storage unit 11 and the attribute storage unit 12. For example, when three-dimensional information is stored, a mapping operation is performed to create a three-dimensionally shaped projected image (two-dimensional information).
The display unit 14 includes an image memory for storing a display image and a display device for displaying an image on a two-dimensional surface such as an LCD (Liquid Crystal Display), and reads the contents of the image memory to display the two-dimensional image. I do. The image information created by the display content creation unit is stored in the image memory.
[0019]
The movement detection unit 15 includes an acceleration sensor, and detects movement and rotation of the image display device 10.
The display switching unit 16 includes an electrically writable / readable memory and an arithmetic unit, and stores the detection result of the movement detection unit 15. Further, at predetermined time intervals, information on the detection results stored within a predetermined time period is read out from the memory, and the amount and direction of movement of the image display device 10 are calculated from the information. Twelve viewpoint information and auxiliary attribute information are rewritten.
[0020]
Next, a case where three-dimensional information is displayed as a two-dimensional image will be described as an example. FIG. 2 shows a flowchart of the operation of the image display device 10.
[0021]
First, in step S10, electronic coordinates of three-dimensional information such as coordinates of points, a surface constituted by three or more points, coordinates of light sources, light source directions, initial viewpoint coordinates, and line-of-sight directions are read from an external storage device (not shown) or the like. Data is input to the information storage unit 11.
[0022]
Next, the process proceeds to step S11, and when the electronic attribute data of the three-dimensional information includes the initial attribute information including the initial viewpoint coordinates and the line-of-sight direction, the information is stored in the attribute storage unit 12. If the initial attribute information is not included, for example, the viewpoint coordinates (0, 0, 0) and the line-of-sight direction (1, 1, 1) are set as appropriate initial values. If the coordinates of the light source and the light source direction are included, the information is stored in the attribute storage unit 12 as auxiliary attribute information.
[0023]
Next, proceeding to step S12, the display content creation unit 13 creates an image to be displayed on the display unit 14 based on the information stored in the information storage unit 11 and the attribute storage unit 12. Specifically, a projection operation (two-dimensional information) having a three-dimensional shape is created by performing a mapping operation.
[0024]
Then, the process proceeds to step S13, where the created image is displayed on the display unit 14. Thereafter, the process proceeds to step S14, and the moving amount and moving direction of the image display device 10 for a certain period of time are detected. The acceleration sensor detects when the user rotates the image display device 10 up, down, left, and right, or moves it up, down, left, right, and up and down.
[0025]
Next, proceeding to step S15, the detection result in step S14 is stored in the display switching unit 16, and the movement detection unit 15 issues an instruction to the display switching unit 16 to switch the display.
[0026]
Next, proceeding to step S16, the display switching unit 16 determines the nature of the movement (parallel movement, rotation), the movement distance or the rotation angle based on the movement amount and the movement direction, and sets the viewpoint coordinates in the attribute storage unit 12. And the gaze direction is rewritten.
[0027]
Thereafter, the process returns to step S12, where a display screen is created based on the updated attribute information, and the image on the display unit 14 is updated. By repeating steps S12 to S16, the display image is updated in response to the user moving the image display device 10.
[0028]
Therefore, the user only has to move the image display device 10 until a desired image is displayed.
[0029]
FIG. 3 shows a case where the display image is rotated by rotating the mobile phone. 3A is a view of the display unit of the mobile phone as viewed from the front, FIG. 3B is a view of the mobile phone of FIG. 3A rotated about 45 ° so that the right side is away from the mobile phone, and FIG. (D) is a diagram illustrating a display image in the state of (b). FIG.
[0030]
When the state shown in FIG. 3A is rotated to the right by 45 ° to the state shown in FIG. 3B, the display image is updated from FIG. 3C to FIG. 3D. FIG. 3D shows a state in which the image of FIG. 3C is rotated 45 ° to the right.
[0031]
As described above, when an angle change is detected by the movement detection unit, the image is rotated by the angle change amount in the angle change direction, that is, the display image is rotated according to the rotation of the mobile phone, so that the image is moved. Since an image viewed from a desired direction is displayed simply by pointing the mobile phone in a desired direction without complicated key operation, a user who is not used to the mobile phone can easily operate the mobile phone.
[0032]
The displayed image is updated in accordance with the movement of the image display device 10 in addition to the rotation of the image as described above. For example, when the image display device 10 is moved in the plane direction of the display unit 14, the image is translated in the position change direction by a position change amount. Further, for example, when the image display device 10 is moved in a direction perpendicular to the surface of the display unit 14, the image is enlarged / reduced according to the position change amount.
[0033]
When two-dimensional information such as a document is displayed, it is assumed that only parallel movement and enlargement / reduction of an image are allowed, and rotation of the image is not executed. Thus, even when an image of a document or the like is larger than the display unit 14 and is only partially displayed, if the display unit 14 is moved in the plane direction, the image can be scrolled in that direction. Further, when the image is moved in a direction perpendicular to the surface of the display unit 14, the image can be enlarged. Therefore, the user can easily operate the image display device 10 without being conscious of reading the paper through the display unit 14.
[0034]
As the image display device of the present invention, various displays independent of the terminal device can be used. As the terminal device equipped with the image display device, a portable device such as a mobile phone, a PDA, and a notebook personal computer is preferably used. Can be used.
[0035]
【The invention's effect】
ADVANTAGE OF THE INVENTION According to this invention, even if it does not acquire the operation of image switching by training, by moving this apparatus as if seeing an object through a display part, a three-dimensional projection image can be easily viewed from any direction. And enlarge / reduce the image.
[Brief description of the drawings]
FIG. 1 is a block diagram illustrating a configuration of an image display device according to the present invention.
FIG. 2 is a flowchart showing the operation of the image display device when displaying and switching images according to the present invention.
FIG. 3A is a front view of a display unit of a mobile phone according to an example of the present invention.
FIG. 3B is a view in which the mobile phone of FIG. 3A is rotated by about 45 ° so that the right side is away from the mobile phone.
FIG. 3C is a diagram showing a display image in the state of FIG.
FIG. 3D is a diagram showing a display image in the state of FIG.
[Explanation of symbols]
Reference Signs List 10 image display device 11 information storage unit 12 attribute storage unit 13 display content creation unit 14 display unit 15 movement detection unit 16 display switching unit

Claims (6)

A display unit for displaying an image,
A movement detection unit that has an acceleration sensor and detects movement and rotation of the device;
An information storage unit that stores information about the image,
An attribute storage unit for storing attributes relating to the image,
A display content creation unit that creates an image to be displayed on the display unit from the information stored in the information storage unit and the attribute storage unit;
A display switching unit that changes the content of the attribute storage unit based on a detection result of the movement detection unit,
When a movement of the apparatus is detected by the movement detection unit while an image is displayed, an image is created by the display content creation unit based on an attribute of the image changed by the display switching unit, and the display is performed. An image display device that switches the image displayed on the unit to the created image. The information stored in the information storage unit and the attribute storage unit is three-dimensional information, and the display content creation unit creates an image converted from three-dimensional information into two-dimensional information. Image display device. 3. The image display device according to claim 1, wherein when the movement detecting unit detects a change in the surface direction of the display unit, the image is translated in the position change direction by the amount of the position change. 4. The image processing apparatus according to claim 1, wherein when the movement detecting unit detects a position change in a direction perpendicular to a surface of the display unit, the image is enlarged / reduced in accordance with the position change amount. Image display device. 3. The image display device according to claim 2, wherein when the movement detecting unit detects a change in the angle of the apparatus, the image is rotated in the angle change direction by the amount of the angle change. A terminal device comprising the image display device according to claim 1.

Images