JP2005251100A - Portable information processing terminal device, display control method, and display control program - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide a user interface capable of seamlessly displaying a large image (a content) without a sense of incongruity by using a display of a limited size of a portable information processing terminal device, and capable of causing an event even to an object on the displayed image (the content). <P>SOLUTION: In the portable information processing terminal device 100, an image larger than the display which will be an operation object is specified by a specification part 102 by operation received by an operation part 102, the specified image is stored in a storing part 104, and a segment control part 106 carries out control such that the image stored in the storing part 104 is segmented into an image size to be displayed in a display part 108 on the basis of a result of calculation by a calculating part 105 of a moving amount detected by a sensor part 101. The segmented image is expanded in a memory 107 for display, and it is displayed in the display part 108. <P>COPYRIGHT: (C)2005,JPO&NCIPI

Description

  The present invention relates to a portable information processing terminal device, a display control method, and a display control program, and in particular, uses a movement of the portable information processing terminal device to provide a simple image larger than a display screen of a display of the portable information processing terminal device. The present invention relates to a portable information processing terminal device, a display control method, and a display control program that can be scroll-displayed by operation.

  In general, when an image (content) with a large amount of information is displayed on a mobile terminal that is a portable information processing terminal device such as a portable telephone or a PDA (Personal Digital Assistants) having excellent portability, the image fits on the screen of the mobile terminal. In this way, the display size of the image (content) is reduced.

  However, the reduced image displayed on the screen of the mobile terminal is not always easy for the user to see. Furthermore, since only a poor interface such as a vertical scroll operation can be used to operate the display screen, only images (contents) that match the poor interface can be created.

  As an interface for freely operating a created image (content), there is one disclosed in Patent Document 1 as a conventional technique for detecting the angle and position of a terminal and scrolling a display area.

  In the prior art disclosed in Patent Document 1, a plurality of screens can be automatically switched by detecting the position and angle of the terminal and calculating the moving distance and moving speed.

Further, as a conventional technique that enables the automatic change of the virtual surface to be displayed by changing the number of virtual surfaces and the display attributes when the usage status of the terminal is changed, Patent Document 2 Is disclosed.
JP 11-65810 A JP 2002-306991 A

  However, in the prior art disclosed in Patent Document 1, it is possible to switch a plurality of images by calculating the moving distance and moving speed of the terminal device using the terminal device to which the position angle sensor is attached. There is a problem that an image (content) having a large display area cannot be displayed seamlessly.

  Further, in the prior art disclosed in Patent Document 2, the display attribute that is the number of virtual surfaces and the display information data of the virtual surfaces is the same as the device disclosed in Patent Document 1 with the position angle sensor. The virtual plane displayed on the terminal is automatically changed by changing the display, but since display attributes are set for each image that forms the virtual plane, it is not only laborious and expensive. There is a problem in operability because a plurality of virtual planes are switched.

  Therefore, the present invention provides a portable information processing terminal device and a display which can display a large image (content) seamlessly with a simple operation using a display of a limited size of the portable information processing terminal device. It is an object to provide a control method and a display control program.

  In order to achieve the above object, a first aspect of the present invention is directed to a portable information processing terminal device having a display, comprising: storage means for storing image information larger than the screen size of the display; and the device itself in a three-dimensional space. Detection means for detecting movement; and display control means for cutting out an image corresponding to the screen size of the display unit from image information stored in the storage unit corresponding to the detection output of the detection unit and displaying the image on the display unit It is characterized by comprising.

  According to a second aspect of the present invention, in the first aspect of the invention, the detection unit detects a movement of the device itself on a predetermined virtual plane in the three-dimensional space, and the display control unit detects the detection. The image displayed on the display in response to detection of movement of the device itself on the predetermined virtual plane in the three-dimensional space by means is a two-dimensional scroll image on the image indicated by the image information. An image corresponding to the screen size of the display device is cut out from the image information and displayed on the display device.

  According to a third aspect of the present invention, in the first aspect of the invention, the detecting means further detects a vertical movement of the device itself relative to a predetermined virtual plane in the three-dimensional space, and the image display control means. Is configured so that an enlargement / reduction ratio of an image displayed on the display changes according to detection of vertical movement of the device itself on a predetermined virtual plane in the three-dimensional space by the detection means. An image corresponding to the screen size is cut out and displayed on the display.

  According to a fourth aspect of the present invention, in the first aspect of the present invention, a pointer is displayed at a fixed position on the screen of the display device, and the pointer is displayed on the screen of the display device by movement of the device itself in the three-dimensional space. It further comprises object selection means for selecting a desired object displayed on the screen of the display unit by being superimposed on the desired object displayed above.

  According to a fifth aspect of the present invention, the movement of the device itself in a three-dimensional space is detected by the detection means, and the detection information of the detection means is converted from image information larger than the screen size of the display stored in the storage means. Correspondingly, an image corresponding to the screen size of the display is cut out, and the cut out image is displayed on the display.

  According to a sixth aspect of the present invention, there is provided a control program for causing a computer to execute display processing of a portable information processing terminal device having a display, the step of detecting movement of the device itself in a three-dimensional space, and a storage means A step of cutting out an image corresponding to the screen size of the display unit from the stored image information larger than the screen size of the display unit corresponding to the detection output of the detection unit; And a step of displaying.

  According to the present invention, the movement of the apparatus itself in the three-dimensional space is detected by the detection means, and the display is performed in accordance with the detection output of the detection means from the image information larger than the screen size of the display stored in the storage means. Since the image corresponding to the screen size of the display device is cut out and the cut image is scrolled and displayed on the display device corresponding to the detection output of the detection means, the size of the portable information processing terminal device is limited. With this display, a large image (content) can be displayed seamlessly with a simple operation.

  Hereinafter, an embodiment of a portable information processing terminal device, method and program according to the present invention will be described in detail with reference to the accompanying drawings.

  FIG. 1 is a system configuration diagram of an image display control system configured by applying a portable information processing terminal device, method and program according to the present invention.

  In FIG. 1, the portable information processing terminal device 100 includes a sensor unit 101, an operation unit 102, a designation unit 103, a content storage unit 104, a calculation unit 105, an image clipping control unit 106, a display memory 107, and a display unit 108. Configured.

  Here, the sensor unit 101 detects the movement of the portable information processing terminal device 100 from the initial position in the three-dimensional space, and includes an acceleration sensor and the like.

  The operation unit 102 has a numeric keypad and the like, and performs user input by the user.

  The designation unit 103 performs control for designating content to be displayed on the display unit 108 based on a user operation of the operation unit 102.

  The content storage unit 104 stores content to be displayed on the display unit 108. The content stored in the content storage unit 104 includes, for example, map information having a size larger than that of the display screen of the display unit 108.

  The calculation unit 105 calculates a scroll direction and a scroll amount of map information and the like displayed on the display unit 108 based on the detection output of the sensor unit 101.

  That is, the calculation unit 105 detects that the mobile information processing terminal device 100 has moved a predetermined amount, for example, in the right direction on the virtual plane including the display screen of the display unit 108 of the mobile information processing terminal device 100 by the sensor unit 101. Then, the right direction is set as the scroll direction of the map information or the like displayed on the display unit 108, and a value corresponding to the movement amount is calculated as the scroll amount in the right direction.

  Further, the calculation unit 105 is detected by the sensor unit 101 that the mobile information processing terminal device 100 has moved a predetermined amount in the left direction on the virtual plane including the display screen of the display unit 108 of the mobile information processing terminal device 100. Then, the left direction is set as the scroll direction of the map information or the like displayed on the display unit 108, and a value corresponding to the amount of movement is calculated as the scroll amount in the left direction.

  In addition, the calculation unit 105 calculates the enlargement / reduction ratio of the display screen of the display unit 108 based on the vertical movement detection output of the sensor unit 101 with respect to the virtual plane.

  Based on the calculation result of the calculation unit 105, the image extraction control unit 106 extracts an image to be displayed on the display screen of the display unit 108 from map information or the like having a size larger than the display screen of the display unit 108 stored in the content storage unit 104. And stored in the display memory 107, thereby displaying an image on the display screen of the display unit 108.

  Here, the image cutout by the image cutout control unit 106 is seamlessly performed based on the scroll direction, the scroll amount, and the enlargement / reduction ratio calculated by the calculation unit 105, and accordingly, the display stored in the content storage unit 104. A part of map information or the like having a size larger than that of the display screen of the unit 108 is seamlessly displayed on the display screen of the display unit 108.

  For example, when the scroll direction calculated by the calculation unit 105 is the left direction on the virtual plane including the display screen of the display unit 108 and the scroll amount changes sequentially, the display of the display unit 108 stored in the content storage unit 104 is displayed. A part of the map information having a size larger than the screen is sequentially cut out by the image cut-out control unit 106 and displayed seamlessly on the display screen of the display unit 108.

  Further, the size of a region to be cut out such as map information having a size larger than that of the display screen of the display unit 108 stored in the content storage unit 104 is changed according to the enlargement / reduction ratio calculated by the calculation unit 105, and as a result When the enlargement / reduction ratio calculated by the calculation unit 105 is small, a wide range of images is cut out and reduced and displayed. When the enlargement / reduction ratio is high, a narrow range of images is cut out and enlarged and displayed.

  According to such a configuration, the image displayed on the display screen of the display unit 108 can be scroll-displayed in an arbitrary direction in accordance with the movement of the mobile information processing terminal device 100. Further, the mobile information processing terminal device 100 If the portable information processing terminal device 100 is moved closer to the user, the image displayed on the display screen of the display unit 108 is enlarged, and if it is further away, the image is reduced to widen the display range. Display operation is also possible.

  FIG. 2 is a vector diagram when the portable information processing terminal device of the present invention moves in a three-dimensional space (XYZ space).

  In FIG. 2, when the portable information processing terminal device 100 is moved from the initial position (position A) to the destination (position B), the movement amount in the X direction is Δx, the movement amount in the Y direction is Δy, and the movement amount in the Z direction is The movement amount Δx in the X direction, the movement amount Δy in the Y direction, and the movement amount Δz in the Z direction are detected by the sensor unit 101 attached to the portable information processing terminal device 100. Then, based on the movement amount Δx in the X direction, the movement amount Δy in the Y direction, and the movement amount Δz in the Z direction detected by the sensor unit 101, the scroll direction and scrolling of the map information and the like displayed on the display unit 108 by the calculation unit 105 The amount and the enlargement / reduction ratio are calculated, and the image displayed on the display unit 108 is scrolled by controlling the extraction region from the map information or the like by the image extraction control unit 106 based on the scroll direction, the scroll amount, and the enlargement / reduction rate. Can be enlarged or reduced.

  FIG. 3 is a diagram showing a two-dimensional plane (XY plane) on which the portable information processing terminal device 100 according to the present invention moves.

  FIG. 3 shows a case where the portable information processing terminal device 100 is moved Δx in the X direction from the initial position (origin position) and Δy moved in the Y direction. In this case, an image such as map information displayed on the display unit 108 is scrolled by a distance corresponding to Δx in the X direction and Δy in the Y direction from the origin position.

  FIG. 4 is a diagram for explaining an image (content) cut out from the storage unit 104 by the image cut-out control unit 106 when the portable information processing terminal device 100 is moved in a two-dimensional plane (XY plane) as shown in FIG. It is.

  As shown in FIG. 4, an image 400 larger than the display screen size of the display unit 108 is stored in the storage unit 104. In FIG. 4, the display clipped by the image cropping control unit 106 in the initial state. An image of the size of the display unit 108 is shown by an image 401, and an image of the size of the display unit 108 cut out at the destination moved by the moving operation of the portable information processing terminal device 100 is shown by an image 402.

  In addition, an image 402 of the size of the display unit 108 that is cut out when the mobile information processing terminal device 100 is moved by the re-moving operation while the image 402 is displayed on the display unit 108 is shown as an image 402.

  In this way, the display device 103 sequentially displays and scrolls the images 400 larger than the display screen size of the display device 108 in accordance with the movement operation of the portable information processing terminal device 100.

  FIG. 5 is a diagram showing the movement of the portable information processing terminal device 100 according to the present invention in a two-dimensional plane (XZ plane).

  FIG. 5 shows a state in which the portable information processing terminal device 100 is moved in the three-dimensional space by Δx in the X direction and Δz in the Z direction on the two-dimensional plane (XZ plane).

  In this case, the cutout portion of the image displayed on the display unit 108 is moved by Δx in the X direction from the current initial position, and becomes an image that has been further enlarged or reduced corresponding to the distance Δz in the Z direction.

  FIG. 6 is a diagram showing movement of the portable information processing terminal device 100 according to the present invention in a two-dimensional plane (YZ plane).

  FIG. 6 shows a state in which when the portable information processing terminal device 100 is moved in a three-dimensional space, Δy is moved in the Y direction and Δz is moved in the Z direction on a two-dimensional plane (YZ plane).

  In this case, the cut-out portion of the image displayed on the display unit 108 is an image that is moved from the current initial position by Δy in the Y direction and is further enlarged or reduced corresponding to the distance Δz in the Z direction.

  FIG. 7 is a diagram illustrating an image displayed on the display screen of the display unit 108 when the portable information processing terminal device 100 is moved up and down (Z coordinate direction) when the image is regarded as a two-dimensional plane.

  In FIG. 7, an image of the display screen size of the display unit 108 in the initial state is displayed on the plane 701 (plane 2), and does not move in the XY direction (vertical direction, horizontal direction), but in the Z direction (vertical direction). ) And the image displayed on the display unit 108 when the portable information processing terminal device 100 is moved to the front is moved to move away from the portable information processing terminal device 100 on the plane 702 (plane 1). The image displayed on the display unit 108 in the case of the display is shown as a plane 703 (plane 3).

  That is, when the portable information processing terminal device 100 is moved forward, the image displayed on the display unit 108 is enlarged and the display range is reduced. Specifically, an image 704 with a reduced display range on the plane 2 (701) is enlarged and displayed on the plane 1 (702). On the other hand, when the mobile information processing terminal device 100 is moved so as to move away, the image displayed on the display unit 108 is reduced, and the display range is enlarged. Specifically, the display range of the plane 2 (701) is reduced as indicated by the plane 3 (703), and an image in which the range of the image displayed on the display unit 108 is increased is displayed.

  FIG. 8 is a diagram illustrating a movement locus of the portable information processing terminal device 100.

  In FIG. 8, the start point S (801) which is the initial position of the mobile information processing terminal device 100, the end point E (802) where the mobile information processing terminal device 100 is moved and reached, the moving direction (803) in the movement path of the mobile information processing terminal device 100 It is shown. The movement between the start point S (801) and the end point E (802) of the portable information processing terminal device 100 is geometrically minute, and the movement path is enlarged and displayed in order to measure the movement distance.

  The moving distance of the geometrical minute interval (minute time) [t + Δt] in the three-dimensional space is expressed as “f = F (x) = (Δx (t), Δy (t), Δz (t))” be able to. Therefore, the total movement distance of a specific minute section [S → E] can be obtained by the following calculation formula.

  Based on the moving distance obtained by the above calculation formula, the cut-out portion 401 of the display screen of the image (content) larger than the display screen size can be moved.

  FIG. 9 is a flowchart for displaying a screen on the display screen of the portable information processing terminal device 100 according to the present invention.

  In FIG. 9, when the user requests to display an image (content) larger than the display area of the display (step 901), the processing is started, and the image (content) at the initial position is cut out by the cut-out control unit 106. The size is displayed on the display unit 108 (step 902), and the movement of the two-dimensional plane (XY plane) determined by the posture state of the portable information processing terminal device 100 is detected by the sensor unit 101 (step 903). Based on the information such as the detected moving direction and moving amount, the calculating unit 105 calculates the moving direction and moving amount (step 904). Further, the portable information processing terminal device 100 is moved up and down to calculate the enlargement ratio or reduction ratio of the image (content) (step 905), and the image (content) is re-based based on the calculated enlargement ratio or reduction ratio. It is displayed (step 907).

  FIG. 10 is a diagram showing a case where an object on an image displayed on the display unit 108 of the portable information processing terminal device 100 according to the present invention is operated by a scanning line.

  FIG. 10 shows a state in which an image (content) selected by the user by moving the portable information processing terminal device 100 in the three-dimensional space is displayed on the display unit 108.

  In this image, objects to be operated (1001, 1002) are displayed. Here, a map is assumed as an image displayed on the display unit 108 of the portable information processing terminal device 100, and the objects (1001, 1002) include stations, rivers, and the like displayed on the map.

  In order to operate the objects (1001, 1002), the scanning lines (1003, 1004) are displayed vertically and horizontally, and the object (1001, 1002) is moved by moving the mobile information processing terminal device at the intersection of the scanning lines. ) Move up.

  In the example shown here, the scanning line (1003, 1004) displayed vertically and horizontally can be pointed by moving the apparatus over the object, and an event can be generated using the operation unit 102.

  As a method for detecting the movement distance and switching the display screen, a method using an acceleration sensor will be described.

  By using the acceleration sensor to detect the movement of the portable information processing terminal device 100, the moving direction and acceleration of the portable information processing terminal device 100 can be detected.

  Register the current state of mobile information processing terminal device 100 (posture, position in three-dimensional space) as an initial state, detect the moving direction and acceleration from the movement of mobile information processing terminal device 100 from the registered initial state, Based on the data, the moving direction and moving amount of the image (content) displayed on the display unit 108 are calculated. The amount of movement is not calculated from the moving distance, but is calculated based on the detected acceleration. By moving a short distance at high speed, the image range at a long distance can be slightly changed on the display area (cut-out screen) of the display screen. It can be displayed by moving.

  The example illustrated in FIG. 12 indicates that the image size 1101 cut out to the size of the display unit 108 of the portable information processing terminal device 100 is registered as the initial state. The portable information processing terminal device 100 is moved by a distance L, the moving direction and acceleration at this time are calculated by an acceleration sensor, and a cutout image 1102 corresponding to the calculation result is displayed.

  Even when an image (content) that can be displayed on a display device is large by detection using an acceleration sensor, it is possible to easily refer to an image at a long distance with a minimum movement.

  By the above processing, the image (content) on the display screen can be moved seamlessly by moving the portable information processing terminal device 100, and further, the intersection of the scanning lines is pointed on the object displayed on the screen. Makes it possible to manipulate objects.

  Therefore, by applying the present invention, the image (content) can be scrolled or enlarged / reduced by physically moving the portable information processing terminal device 100, so that an image (content) with a wide display range is displayed. In this case, it can be displayed seamlessly, and further, by providing a user interface such as a PC (Personal Computer), the operability can be improved.

  The present invention is not limited to the embodiment described above and shown in the drawings, and can be implemented by being appropriately modified within a range not changing the gist thereof.

  The present invention can be applied to a terminal equipped with a sensor capable of detecting position information in a three-dimensional space, and in particular, a mobile phone such as a mobile phone or a PDA that is excellent in portability for a part of an image (content) having a large display area. It is effective for displaying on the display screen of the terminal and allowing the user to move and display the display image seamlessly by moving the mobile terminal, and the user interface is improved by using scanning lines. It is also effective for easily manipulating objects on (content).

The block diagram of the portable information processing terminal device 100 concerning this invention. The figure which shows the movement information on the three-dimensional space of the portable information processing terminal device 100 concerning this invention. The figure which shows the two-dimensional plane (XY plane) of the portable information processing terminal device 100 concerning this invention. The figure which shows the movement of the image cut out on the two-dimensional plane (XY plane) concerning this invention. The figure which shows the two-dimensional plane (XZ plane) of the portable information processing terminal device 100 concerning this invention. The figure which shows the two-dimensional plane (YZ plane) of the portable information processing terminal device 100 concerning this invention. The figure which shows the vertical movement (Z coordinate direction) at the time of regarding the image (contents) of this invention as a two-dimensional plane. The figure which showed the movement locus | trajectory of the portable information processing terminal device 100 concerning this invention. The flowchart which displays a screen on the display screen of the portable information processing terminal device 100 concerning this invention. The figure which shows operating the object on the image displayed on the display part 108 of the portable information processing terminal device 100 concerning this invention by a scanning line. The figure which shows the movement by Example 2 of the cut-out image of the portable information processing terminal device 100 concerning this invention.

Explanation of symbols

DESCRIPTION OF SYMBOLS 100 Portable information processing terminal device 101 Sensor part 102 Operation part 103 Specification part 104 Content memory | storage part 105 Calculation part 106 Clipping control part 107 Display memory 108 Display part 200 An image larger than the display screen of a display

Claims (6)

In a portable information processing terminal device having a display,
Storage means for storing image information larger than the screen size of the display;
Detection means for detecting movement of the device itself in a three-dimensional space;
Display control means for cutting out an image corresponding to the screen size of the display from the image information stored in the storage means corresponding to the detection output of the detection means, and displaying the image on the display. Portable information processing terminal device. The detection means includes
Detecting the movement of the device itself on a predetermined virtual plane in the three-dimensional space;
The display control means includes
The image displayed on the display unit in response to detection of the movement of the device itself on the predetermined virtual plane in the three-dimensional space by the detection means becomes a two-dimensional scroll image on the image indicated by the image information. The mobile information processing terminal device according to claim 1, wherein an image corresponding to a screen size of the display is cut out from the image information and displayed on the display. The detection means includes
Further detecting the vertical movement of the device itself relative to a predetermined virtual plane in the three-dimensional space;
The image display control means includes
The screen size of the display is changed so that the enlargement / reduction ratio of the image displayed on the display changes according to the detection of the vertical movement of the device itself on the predetermined virtual plane in the three-dimensional space by the detection means. The mobile information processing terminal device according to claim 2, wherein an image corresponding to is cut out and displayed on the display. A pointer is displayed at a fixed position on the screen of the display, and the pointer is superimposed on a desired object displayed on the screen of the display by moving the device itself in the three-dimensional space. The portable information processing terminal device according to claim 1, further comprising: an object selecting unit that selects a desired object displayed on the screen. In a display control method for a portable information processing terminal device having a display,
The detection means detects the movement of the device itself in the three-dimensional space,
Cutting out an image corresponding to the screen size of the display unit corresponding to the detection output of the detection unit from the image information larger than the screen size of the display unit stored in the storage unit;
A display control method, wherein the cut image is scrolled and displayed on the display unit corresponding to the detection output of the detection means. A control program for causing a computer to execute display processing of a portable information processing terminal device having a display,
Detecting the movement of the device itself in a three-dimensional space;
Cutting out an image corresponding to the screen size of the display unit corresponding to the detection output of the detection unit from the image information larger than the screen size of the display unit stored in the storage unit;
Scrolling the cutout image corresponding to the detection output of the detection means and displaying the image on the display.

Images