JP2008026798A - Display processing method and mobile communication terminal apparatus - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To change the display content of a display element in a mobile communication terminal apparatus by simple operation. <P>SOLUTION: A sensor unit 25 detects the attitude and acceleration of a cell phone unit. In succession, an attitude data processing section 33 detects whether the detected attitude is either of a non-rotating state or rotating state. In the case of the rotating state, a region controller 36 changes the display target region in the display target image in correspondence to the rotating state. Also, an acceleration data processing section 34 detects whether the cell phone unit is in either state of the acceleration state or non- acceleration state by the detected acceleration. In the case of the acceleration state, a magnification controller 37 changes a display magnification based on the direction of the acceleration. Then, based on the display target region and display magnification reported from the region controller 36 and the magnification controller 37, a display data creation section 35 creates the display image and displays the same on the display element 13. <P>COPYRIGHT: (C)2008,JPO&INPIT

Description

  The present invention relates to a display processing method on a display unit of a mobile communication terminal device, and a mobile communication terminal device using the display processing method.

  Conventionally, mobile communication terminal devices such as mobile phone devices have been widely used. In recent years, there has been remarkable progress in technology related to mobile communication terminal devices, and in recent years, in addition to the normal call function and e-mail function, digital content acquired via a web browser function, a network, or via a recording medium. A model equipped with a function to display images has also been put into practical use.

When executing such a web browser function or digital content image function, in the mobile communication terminal device, as in the case of a personal computer or the like, first, part or all of the web page image or digital content image is displayed on the display unit. Is displayed. When displaying the contents of an area different from the display area of the image displayed on the display unit, the user generally operates the input device to change the display target area. It has been adopted. In the following Patent Document 1, an example in which the display target area is changed by scrolling the screen is shown. In addition, when the display magnification is to be changed, a method in which the user operates the input device to change the display target area is generally employed. In the following Patent Document 2, a method of enlarging and reducing display contents by a cross key and long press thereof is shown.
JP 2001-249658 A JP 2004-260431 A

  The above-described conventional technique is a technique that has a display unit having a sufficiently large display surface and is compatible with a personal computer or the like to which a keyboard and a mouse can be connected as standard. In addition, many web page images and digital content images are created so as to fit the size of the display surface in a personal computer.

  When displaying a display target image adapted to the size of the display surface in such a personal computer in an environment where only a small display surface can be used, such as a mobile communication terminal device such as a mobile phone device, only a small part of the display target image is displayed. Cannot be displayed. For this reason, in order to display a desired region in the display target image on the display surface of the mobile communication terminal device, a situation in which it is necessary to change the display target region often occurs.

  In such a case, if a pointing device such as a mouse can be used, it is considered that the display target area can be changed relatively easily. However, a small mobile communication terminal device such as a mobile phone device is usually used for input. The device generally has only a stroke device with a plurality of small keys. Accordingly, in order to change the display target area to a desired area in a small mobile communication terminal device such as a mobile phone device, it is often necessary to press a small key many times. It was very inconvenient for the user to press these small keys many times.

  The present invention has been made in view of the above circumstances, and an object of the present invention is to provide a display processing method capable of easily changing display contents on a display unit of a mobile communication terminal device.

  Another object of the present invention is to provide a mobile communication terminal device that can easily change the display content on the display unit.

  From a first aspect, the present invention is an image display processing method used in a mobile communication terminal device, the posture detection step of detecting the posture of the mobile communication terminal device; and detected in the posture detection step. An out-of-predetermined range determination step for determining whether the determined posture is outside a predetermined posture range including a reference posture; and the detected posture when the result of the determination in the posture determination step is affirmative And a region control step of continuously changing the display target region of the image displayed on the display unit of the mobile communication terminal device in correspondence with the relationship between the reference posture range and the reference posture range.

  Here, “the posture is inside the predetermined posture range” means, for example, when the predetermined posture range has an inclination angle of −10 ° or more and 10 ° or less from the reference posture of the mobile communication terminal device. The case where −10 ° ≦ θ ≦ 10 ° is satisfied when the inclination angle value is θ. Also, “the posture is outside the predetermined posture range” means that, for example, when the predetermined posture range has an inclination from the reference posture of the mobile communication terminal device of −10 ° or more and 10 ° or less, When the angle value is θ, θ <−10 ° or θ> 10 ° is satisfied. In this specification, the terms “inside the posture range” and “outside the posture range” are used in this sense.

  In this display processing method, the posture of the mobile communication terminal device is detected in the posture detection step. Subsequently, in the determination step outside the predetermined range, it is determined whether or not the posture detected in the posture detection step is outside the predetermined posture range. Here, the predetermined posture range is determined by experiments and experiences from the viewpoint of operability. The predetermined posture range may be fixedly set in advance or may be set by the user.

  If the result of the determination in the out-of-predetermined range determination step is affirmative, the display target region displayed on the display unit of the mobile communication terminal device is continuously displayed in the region control step corresponding to the change direction of the posture. To change. For this reason, the user can continuously change the display target area displayed on the display unit with a simple operation of changing the attitude of the mobile communication terminal device. Therefore, according to the display processing method of the present invention, it is possible to easily change the display target area continuously.

  In the display processing method of the present invention, in the region control step, along the direction corresponding to the difference value at a speed corresponding to the difference value from the posture detected in the posture detection step and the posture range from the inside. Thus, the display target area can be changed.

  Here, the “difference value” refers to an inclination corresponding to the boundary between the inner side of the posture range and the outer side of the posture range from the value of the inclination angle of the mobile communication terminal device when the mobile communication terminal device is outside the predetermined posture range. It is a signed value obtained by subtracting the corner value. For example, when the difference value is positive, it indicates that the mobile communication terminal device has rotated rightward from the reference posture, and when it is negative, the mobile communication terminal device has leftward from the reference posture. Shown rotated. In this specification, the term “difference value” is used in this sense.

  In this case, when the posture is outside the predetermined posture range, along the direction corresponding to the difference value at the speed corresponding to the difference value between the current posture and the reference posture in the region control step, The display target area in the display unit is continuously changed. Therefore, by adjusting the direction and magnitude of the inclination of the mobile communication terminal device from the reference posture, the display target area can be continuously changed in the desired direction at the desired speed.

  In the display processing method of the present invention, an acceleration detection step of detecting acceleration in a direction orthogonal to the display surface of the display unit; whether the magnitude of the acceleration detected in the acceleration detection step exceeds a predetermined value An acceleration determining step for determining whether the display magnification of the display unit of the mobile communication terminal device is changed corresponding to the direction of the acceleration when the determination result in the acceleration determining step is affirmative And a control step.

  In this case, in the acceleration detection step, acceleration in a direction orthogonal to the display surface of the display unit of the mobile communication terminal device is detected. Subsequently, in the acceleration determination step, it is determined whether or not the magnitude of the acceleration detected in the acceleration detection step exceeds a predetermined value. Here, the predetermined value is determined by experiment and experience from the viewpoint of operability. The predetermined value may be fixedly set in advance or may be set by the user.

  If the result of the determination in the acceleration determination step is affirmative, a new display magnification is first determined based on the current display magnification and the direction of acceleration in the magnification control step. Then, an image is displayed at a new display magnification. Therefore, the display magnification can be changed by a simple operation of moving the mobile communication terminal device in a direction orthogonal to the display surface at an acceleration exceeding a predetermined value.

  Here, in the magnification control step, the display magnification of the display unit of the mobile communication terminal device can be changed by a magnification corresponding to the magnitude of the acceleration. In this case, the amount of change in display magnification can be adjusted by adjusting the acceleration of movement along the direction orthogonal to the display surface of the mobile communication terminal device.

  In the display processing method of the present invention, a position detection step of detecting the position of the mobile communication terminal device in a direction orthogonal to the display surface of the display unit in the reference posture; and a position detected in the position detection step And a magnification control step for performing display at a corresponding display magnification.

  In this case, in the position detection step, a position in a direction perpendicular to the display surface of the mobile communication terminal device in the reference posture is detected, and the display on the display unit is continuously changed at a magnification corresponding to the position. For this reason, the display magnification can be continuously changed easily by changing the position in the direction orthogonal to the display surface of the mobile communication terminal device.

  Further, in the display processing method of the present invention, the rotation angle from the reference posture around at least one of the display vertical axis and the display horizontal axis in the reference posture of the mobile communication terminal device is less than or equal to a predetermined value. Range.

  Here, the reference posture can be a posture in which the display surface of the display unit is horizontal. Further, prior to the posture angle detecting step, an initial posture detecting step of detecting the initial posture of the mobile communication terminal device can be further provided, and the reference posture can be set as the initial posture.

  According to a second aspect of the present invention, a display unit that displays an image; attitude detection means that detects an attitude; and whether or not the attitude detected by the attitude detection means is outside a predetermined attitude range. A non-predetermined range determination unit; and a display target region of the display unit corresponding to a relationship between the posture and the predetermined posture range when a result of the determination by the out-of-predetermined range determination unit is affirmative And a region control means for continuously changing the mobile communication terminal device.

  In this mobile communication terminal device, the posture detection means detects the posture of the mobile communication terminal device. Subsequently, the out-of-predetermined range determination unit determines whether or not the posture detected by the posture detection unit is outside the predetermined posture range. If the result of the determination by the out-of-predetermined range determination means is affirmative, the area control means continuously changes the display target area on the display unit corresponding to the relationship between the posture and the predetermined posture range. Let

  That is, the mobile communication terminal apparatus of the present invention can continuously change the display target area of the display unit by using the display processing method of the present invention described above. Therefore, according to the mobile communication terminal device of the present invention, it is possible to easily change the display target area continuously in a desired direction.

  In the mobile communication terminal device according to the present invention, the area control unit may determine the difference between the posture detected in the posture detection step and the reference posture when the result of the determination by the out-of-predetermined range determination unit is positive. The display target area can be changed along a direction corresponding to the difference value at a speed corresponding to the value.

  In this case, when the result of the determination by the out-of-predetermined range determination unit is affirmative, the area control unit is at a speed corresponding to the difference value between the posture detected in the posture detection step and the reference posture. The display target area displayed on the display unit is continuously changed along the direction corresponding to the difference value. Therefore, by adjusting the direction and magnitude of the inclination of the mobile communication terminal device from the reference posture, the display target area can be continuously changed in the desired direction at the desired speed.

  In the mobile communication terminal device of the present invention, acceleration detection means for detecting an acceleration in a direction orthogonal to the display surface of the display unit of the mobile communication terminal device; and the magnitude of the acceleration detected by the acceleration detection means. , An acceleration determination unit that determines whether or not a predetermined value is exceeded; and a magnification control unit that changes a display magnification of the display unit in accordance with the direction of the acceleration. .

  In this case, the acceleration detection means detects the acceleration in the direction orthogonal to the display surface of the display unit of the mobile communication terminal device. Subsequently, the acceleration determination means determines whether or not the acceleration detected by the acceleration detection means exceeds a predetermined value. If the determination result is affirmative, the magnification control means changes the display magnification corresponding to the direction of acceleration of the mobile communication terminal device. Therefore, the display magnification can be changed by a simple operation of moving the mobile communication terminal device in a direction orthogonal to the display surface at an acceleration exceeding a predetermined value.

  Here, the magnification control means may determine the display magnification based on the magnitude of acceleration and the direction of acceleration. In this case, the amount of change in display magnification can be adjusted by adjusting the acceleration of movement along the direction orthogonal to the display surface of the mobile communication terminal device.

  Further, in the mobile communication terminal device of the present invention, position detection means for detecting the position of the mobile communication terminal device in a direction orthogonal to the display surface of the display unit in a reference posture; at the position detected by the position detection means Correspondingly, a magnification control means for changing a display magnification in the display section can be further provided.

  In this case, the position detection unit detects the position of the mobile communication terminal device in a direction orthogonal to the display surface of the display unit in the reference posture. Then, the magnification control unit displays an image on the display unit at a display magnification corresponding to the position detected by the position detection unit. For this reason, the display magnification can be continuously changed easily by changing the position in the direction orthogonal to the display surface of the mobile communication terminal device.

  As described above, according to the display processing method of the present invention, it is possible to easily change the display contents on the display unit in the mobile communication terminal device.

  In addition, according to the mobile communication terminal device of the present invention, there is an effect that the display content on the display unit can be easily changed.

  Hereinafter, an embodiment of the present invention will be described with reference to FIGS. In these drawings, the same or equivalent elements are denoted by the same reference numerals, and redundant description is omitted.

[Constitution]
FIG. 1 schematically shows an external configuration of a mobile phone device 10 which is a mobile communication terminal device. Here, FIG. 1A shows a front view of the appearance of the mobile phone device 10, and FIG. 1B shows a rear view of the appearance of the mobile phone device 10.

  As comprehensively shown in FIGS. 1A and 1B, the mobile phone device 10 includes: (a) a mobile phone main body 11; (b) a numeric keypad for inputting a telephone number; An operation unit 12 having function keys for inputting various commands such as mode switching to a control unit 21 (see FIG. 2) described later, and (c) a liquid crystal display for displaying operation guidance, operation status, received message, and the like. And a display unit 13 as display means having the device. In addition, the cellular phone device 10 includes (d) a call speaker 14 that reproduces an audio signal transmitted from a communication partner during a call, and (e) a sound input during sound collection or a sound input during a call. And (f) a guidance speaker 16 for generating ringtones and guidance sounds, and (g) an antenna 17 for transmitting and receiving radio signals to and from the base station. For the mobile phone device 10, a unique XYZ coordinate system represented by the X axis, the Y axis, and the Z axis is defined as shown in FIG.

  As shown in FIG. 2, the mobile phone body 11 includes (i) a control unit 21 that controls the overall operation of the mobile phone device 10, and (ii) a base station via an antenna 17. And (iii) a storage unit 23 having a read-only memory (ROM) element and a random access memory (RAM) element for storing a program executed by the control unit 21 and various data. And. The mobile phone main body 11 includes a sensor unit 25 (iv) as posture detecting means for measuring the posture of the mobile phone device 10 and the acceleration acting on the mobile phone device 10. Here, in the storage unit 23, a temporary storage area 24T and a display content storage area 24F are prepared. The temporary storage area 24T and the display content storage area 24F are writable and readable areas.

  The control unit 21 includes a central processing unit (CPU), a digital signal processing unit (DSP), and the like, performs various data processing to realize a general mobile phone function, and other configurations described above. It is designed to control the operation of elements. The program executed in the control unit 21 includes a measurement data collection processing unit 31 and a display control application 32 shown in FIG.

  The measurement data collection processing unit 31 processes a command from the display control application 32 and controls the measurement operation of the sensor unit 25. The measurement data collection processing unit 31 collects measurement data satisfying the collection data condition specified by the display control application 32 from the measurement raw data from the sensor unit 25 and stores it in a temporary storage area 24T described later. Then, the measurement data collection processing unit 31 reports measurement data that satisfies the notification data condition specified by the display control application 32 among the measurement data stored in the temporary storage area 24T to the display control application 32.

  The measurement data collection processing unit 31 includes information for offset correction measured in advance and information for converting physical quantities for converting the data after offset correction into data that directly reflects physical quantities such as angles and accelerations. Have. Then, the measurement data collection processing unit 31 sequentially performs offset correction and physical quantity conversion on the measurement raw data from the sensor unit 25 to calculate measurement data.

  The display control application 32 includes an attitude data processing unit 33 as an attitude detection unit and an out-of-predetermined range determination unit, and an acceleration data processing unit 34 as an acceleration detection unit and an acceleration determination unit. The display control application 32 includes a display data generation unit 35, a region control unit 36 as a region control unit, and a magnification control unit 37 as a magnification control unit.

  Prior to the description of the components 33 to 37 of the display control application 32 described above, the definition of the rotation state and the acceleration state of the mobile phone device 10 employed in the display control application 32 will be described.

First, the non-rotating state of the mobile phone device 10 relating to the rotation of the mobile phone device 10 about the Y _S axis in the coordinate system X _S Y _S Z _S which is the XYZ coordinate system when the mobile phone device 10 is in the XY reference posture, right The definition of the rotation state and the left rotation state will be described. These non-rotation state, right rotation state, and left rotation state are defined corresponding to the rotation angle θ _Y of the mobile phone device 10 around the Y _S axis, as shown in FIG. That is, the case where the rotation angle θ _Y around the Y _S axis of the mobile phone device 10 is clockwise (clockwise) between the angle θ _{Y0 and} 90 ° or less is defined as the right rotation state. Further, the case where the rotation angle θ _Y around the Y _S axis of the mobile phone device 10 is counterclockwise (counterclockwise) is an angle θ _Y0 or more and less than 90 ° is defined as a left rotation state. And the case where it is neither a right rotation state nor a left rotation state is defined as a non-rotation state.

Further, when the portable telephone apparatus 10 is in a rotating state, the Y _S axis of the mobile phone device 10 from the rotation angle theta _Y in FIG. 4 (A), the value obtained by subtracting the value of the angle theta _Y0, Y _S axis It is defined as the _rotation angle θ _YD around.

Next, a non-rotating state of the cellular telephone apparatus 10 relating to rotation of the X _S axis portable telephone apparatus 10 in the coordinate system X _S Y _S Z _S is a XYZ coordinate system when the cellular phone unit 10 is in the XY reference attitude, The definitions of the pre-rotation state and the post-rotation state will be described. These non-rotating state, pre-rotation state, and post-rotation state, as shown in FIG. 4 (B), are defined to correspond to the rotation angle theta _X of the portable telephone apparatus 10 X _S axis. That is, a case where the rotation angle θ _X around the _XS axis of the mobile phone device 10 is forward (clockwise in FIG. 4B) is an angle θ _X0 or more and 90 ° or less is defined as a pre-rotation state. Also, if X _S axis of the rotation angle theta _X of the portable telephone device 10 is Atomawari angle theta _X0 or less than 90 ° (counterclockwise in FIG. 4 (B)), it is defined as post-rotation state . And the case where it is neither a front rotation state nor a back rotation state is defined as a non-rotation state.

Further, when the portable telephone apparatus 10 is in a rotating state, the X _S axis of the mobile phone device 10 from the rotation angle theta _X in FIG. 4 (B), the value obtained by subtracting the value of the angle theta _X0, X _S axis Rotational displacement angle θ _XD is defined.

The angles θ _Y0 and θ _X0 are determined in advance by the designer of the display control application 32. In the present embodiment, the angles θ _Y0 and θ _X0 are set to 10 °. In the present embodiment, the coordinate system X _S Y _S Z _S is only required that the X _S Y _S plane is a horizontal plane. In the following description, the angle θ _Y and the angle θ _X are also referred to as an inclination angle θ _Y and an inclination angle θ _X.

Next, the acceleration state of the mobile phone device 10 employed in the display control application 32 will be described. As shown in FIG. 5, the acceleration state is defined corresponding to the acceleration along the Z _S axis in the coordinate system X _S Y _S Z _S when the mobile phone device 10 is in the XY reference posture. That is, the case where the magnitude of the acceleration α _s along the Z _S axis of the mobile phone device 10 exceeds α ₀ (m / s ² ) is defined as an acceleration state, and the magnitude of the acceleration α _s is α _0. The case of (m / s ² ) or less is defined as a non-accelerated state.

The acceleration α ₀ is predetermined by the designer of the display control application 32. In this embodiment, the value α ₀ is set to ² g (m / s ² ), where g is the gravitational acceleration.

The attitude data processing unit 33 calculates the tilt angle θ _Y and the tilt angle θ _X based on the measurement data from the measurement data collection processing unit 31. Subsequently, the posture data processing unit 33 determines that the mobile phone device 10 is in the non-rotation state, the right rotation state, the left rotation state, the front rotation state, and the rear rotation state based on the calculated inclination angle θ _Y and inclination angle θ _X. It is detected whether it corresponds to either. Then, when the mobile phone device 10 is in a state other than the non-rotating state, the posture data processing unit 33 calculates a displacement angle θ _YD or θ _XD corresponding to the rotating state of the mobile phone device 10. The type and displacement angle of the rotation state of the cellular phone device 10 obtained in this way are reported to the area control unit 36.

The acceleration data processing unit 34 calculates the acceleration α _s along the Z _S axis of the mobile phone device 10 based on the measurement data from the measurement data collection processing unit 31. Subsequently, based on the magnitude of the acceleration α _s , it is detected whether the mobile phone device 10 is in a non-accelerated state or an accelerated state. When the mobile phone device 10 is in the acceleration state, it is detected whether the direction of the acceleration α _s is the + Z _S direction or the −Z _S direction. The information indicating that “the mobile phone device 10 is in an acceleration state” and the acceleration direction thus obtained are reported to the magnification control unit 37.

The region control unit 36 calculates a display target region in the display target image based on the report result from the posture data processing unit 33. When calculating the display target area, the area control unit 36
Corresponding to the right rotation state, left rotation state, front rotation state, and rear rotation state, the display target area is continuously moved to the right, left, up, and down. Here, the speed of movement is a speed corresponding to the magnitude of the displacement angle θ _YD or θ _XD . The area control unit 36 reports the calculated display target area to the display data generation unit 35.

The magnification control unit 37 calculates the display magnification based on the report result from the acceleration data processing unit 34. In calculating the display magnification, when the acceleration direction is the + Z _S direction, the magnification control unit 37 sets the display magnification at a constant rate (for example, (1 / 1.5) times) than the current display magnification. Make it smaller. Further, when the acceleration direction is the + Z direction, the magnification control unit 37 increases the display magnification at a certain rate (for example, 1.5 times) than the current display magnification. The magnification control unit 37 reports the calculated display magnification to the display data generation unit 35.

  The display data generation unit 35 displays the display target image reported from the region control unit 36 at the display magnification reported from the magnification control unit 37 for the display target image stored in the display content storage region 24F. Generate display data. The display data generated in this way is sent to the display unit 13 and an image corresponding to the display data is displayed on the display unit 13.

  The sensor unit 25 detects the attitude angle of the mobile phone device 10 and the acceleration acting on the mobile phone device 10, and outputs the analog voltage signal as a sensor unit 26, and converts the voltage value of the voltage signal from the sensor unit 26 into a digital value. And an analog / digital (A / D) converter 27. Then, the digital data output from the A / D converter 27 is notified to the control unit 21 as measurement data. In addition, the sensor unit 25 starts to operate in response to a measurement start command from the control unit 21 and stops operating in response to a measurement stop command from the control unit 21.

The sensor unit 26 has a rotation angle (pitch) about the X _C axis of the mobile phone device 10 in the XYZ reference coordinate system X _C Y _C Z _C which is an XYZ reference posture in which the XY plane is a horizontal plane and the Y direction is a true north direction. Angle φ _X ), rotation angle around Y _C axis (roll angle φ _Y ), and rotation angle around Z _C axis (yaw angle φ _Z ) are detected. Further, the sensor unit 26 detects acceleration in the X direction (α _X ), acceleration in the Y direction (α _Y ), and acceleration in the Z direction (α _z ). The sensor unit 25 sets the pitch angle φ _X , roll angle φ _Y , yaw angle φ _Z , X-direction acceleration α _X , Y-direction acceleration α _Y and Z-direction acceleration α _z detected at each measurement time as one set. The control unit 21 is notified as measurement raw data.

[Operation]
Next, description will be given mainly focusing on display control on the display unit 13 by the display control application 32 in the mobile phone device 10 configured as described above.

  When the display control application 32 is activated, as shown in FIG. 6, the display control application 32 first performs posture measurement setting in step S11. Such setting is performed by the display control unit 35 sending a measurement data collection start command and a collection data condition to the measurement data collection processing unit 31.

  The measurement data collection processing unit 31 that has received the measurement start command sends an operation start command to the sensor unit 25. As a result, the sensor unit 25 starts an operation and starts an operation of periodically sending the measurement raw data to the control unit 21. Thereafter, in the control unit 21, the measurement data collection processing unit 31 receives the measurement raw data, performs offset correction and gain correction, and then starts an operation of storing the measurement data satisfying the collection data condition in the temporary storage area 24T. .

  Next, in step S <b> 12, the display data generation unit 35 displays the initial screen of the display unit 13. In this initial screen, content is acquired or referenced from a predetermined resource using data stored in the display content storage area 24F and displayed on the display unit 13.

  Next, in step S <b> 13, the display control application 32 determines whether or not the end key is pressed on the operation unit 12. If the result of this determination is affirmative, the display control application 32 ends the process. As a result, the execution of the display control application 32 ends.

  If the result of the determination in step S13 is negative, the process proceeds to step S14. In step S14, the rotation state and the acceleration state are detected. In the rotation state and the acceleration state, first, the display control application 32 sends a measurement data request specifying the notification data condition to the measurement data collection processing unit 31.

  The measurement data collection processing unit 31 that has received the measurement data request reports measurement data that satisfies the notification data condition to the display control application 32. In the display control application 32, the attitude data processing unit 33 and the acceleration data processing unit 34 receive measurement data reported from the measurement data collection processing unit 31, respectively.

Upon receiving the measurement data, the posture data processing unit 33 calculates the tilt angle θ _Y and the tilt angle θ _X of the mobile phone device 10. Subsequently, the posture data processing unit 33 determines that the mobile phone device 10 is in the non-rotation state, the right rotation state, the left rotation state, the front rotation state, and the rear rotation state based on the calculated inclination angle θ _Y and inclination angle θ _X. It is detected whether it corresponds to either. Then, when the mobile phone device 10 is in a state other than the non-rotating state, the posture data processing unit 33 calculates a displacement angle θ _YD or θ _XD corresponding to the rotating state of the mobile phone device 10. The type and displacement angle of the rotation state of the cellular phone device 10 obtained in this way are reported to the area control unit 36.

In addition, the acceleration data processing unit 34 that has received the measurement data calculates the acceleration α _s . Subsequently, the acceleration data processing unit 34 detects whether the mobile phone device 10 is in a non-accelerated state or an accelerated state based on the magnitude of the acceleration α _s . Then, when the mobile phone device 10 is in the acceleration state, the acceleration data processing unit 34 detects whether the direction of the acceleration α _s is the + Z _S direction or the −Z _S direction. The acceleration state of the mobile phone device 10 obtained in this way and the acceleration direction are reported to the magnification control unit 37.

  Next, in step S15, display control of the image on the display unit 13 by the display control application 32 is performed. In this display control process, as shown in FIG. 7, first, in step S21, the area control unit 36 determines whether or not the attitude data processing unit 33 reports that the mobile phone device 10 is in the right rotation state. judge.

If the result of the determination in step S21 is affirmative, the process proceeds to step S22. In step S22, the area control unit 36 changes the center point of the display target area to the right (+ X direction) by the amount of displacement when moving at a speed corresponding to the magnitude of the displacement angle θ _YD (hereinafter referred to as “+ X direction”). , Also called “right scroll”). Thereafter, the process proceeds to step S25.

  If the result of the determination in step S21 is negative, the process proceeds to step S23. In step S23, the area control unit 36 determines whether or not the attitude data processing unit 33 reports that the mobile phone device 10 is in the left rotation state.

If the determination result in step S23 is affirmative, the process proceeds to step S24. In step S24, the area control unit 36 changes the center point of the display target area to the left (−X direction) by the amount of displacement when moving at a speed corresponding to the magnitude of the displacement angle θ _YD ( (Hereinafter also referred to as “left scroll”). Thereafter, the process proceeds to step S25.

In step S <b> 25, the area control unit 36 determines whether or not the posture data processing unit 33 reports that the mobile phone device 10 is in the pre-rotation state. If the result of the determination in step S25 is affirmative, the process proceeds to step S26. In step S26, the area control unit 36 changes the center point of the display target area upward (+ Y direction) by the amount of displacement when moving at a speed corresponding to the magnitude of the displacement angle θ _XD (hereinafter referred to as “+ Y direction”). , Also called “up scroll”). Thereafter, the process proceeds to step S29.

  If the result of the determination in step S25 is negative, the process proceeds to step S27. In step S <b> 27, the area control unit 36 determines whether or not it is reported from the attitude data processing unit 33 that the vehicle is in the post-rotation state.

If the result of the determination in step S27 is negative, the process proceeds to step S29. On the other hand, if the result of the determination in step S27 is affirmative, the process proceeds to step S28. In this step S28, the area control unit 36 changes the center point of the display target area downward (−Y direction) by the amount of displacement when moving at a speed corresponding to the magnitude of the displacement angle θ _YD ( (Hereinafter also referred to as “down scroll”).

  When the center point of the display target area is obtained in this way, the area control unit 36 reports the obtained center point of the display target area to the display data generation unit 35. Thereafter, the process proceeds to step S29.

  In step S <b> 29, the magnification control unit 37 determines whether or not the acceleration data processing unit 34 has reported that it is in an acceleration state. If the determination result in step S29 is negative, the magnification control unit 37 reports the current display magnification to the display data generation unit 35. Thereafter, the process proceeds to step S31.

If the result of the determination in step S29 is affirmative, the process proceeds to step S30. In step S30, the magnification control unit 37 changes the display magnification. In changing the display magnification, when the acceleration direction is the + Z _S direction, the magnification control unit 37 reduces the display magnification at a certain rate from the current display magnification (hereinafter also referred to as “reduction”). . On the other hand, when the acceleration direction is the −Z _S direction, the magnification control unit 37 increases the display magnification at a constant rate (hereinafter also referred to as “enlargement”) than the current display magnification. Then, the magnification control unit 37 reports the changed display magnification to the display data generation unit 35. Thereafter, the process proceeds to step S31.

  In step S31, the display data generation unit 35 performs display processing on the display unit 13. In this display processing, the display data generation unit 35 should be displayed on the display unit 13 based on the center of the display target region reported from the region control unit 36 and the display magnification reported from the magnification control unit 37. Image data (display data) is generated. The display data generation unit 35 sends the display data generated in this way to the display unit 13. As a result, an image corresponding to the display data is displayed on the display unit 13.

  Display data is created as described above, and examples of changes in the image displayed on the display unit 13 are shown in FIGS. In FIG. 8, examples of right scroll (change in display image from FIG. 8 (A) to FIG. 8 (B)) and left scroll (change in display image from FIG. 8 (B) to FIG. 8 (A)). It is shown. Further, in FIG. 9, image enlargement (change in display image from FIG. 9A to FIG. 9B) and image reduction (change in display image from FIG. 9B to FIG. 9A). An example of is shown.

  Thus, when the display process on the display unit 13 ends, the process of step S15 ends, and the process returns to step S13 of FIG. Thereafter, the processes in steps S13 to S15 described above are repeated until the result of the determination in step S13 becomes affirmative.

As described above, in the present embodiment, the posture data processing unit 33 calculates the tilt angle θ _Y and the tilt angle θ _X of the mobile phone device 10 based on the detection result by the sensor unit 25. Subsequently, based on the calculated inclination angle θ _Y and inclination angle θ _X , the posture data processing unit 33 causes the mobile phone device 10 to rotate in the non-rotation state within the predetermined posture range and to the right rotation outside the predetermined posture range. It is detected whether it corresponds to the state, the left rotation state, the front rotation state, or the rear rotation state.

  Next, the region control unit 36 calculates the center point of the display target region in the display target image based on the detection result by the posture data processing unit 33. In calculating the display target area, the area control unit 36 continuously moves the display target area to the right, left, up, and down according to the right rotation state, the left rotation state, the front rotation state, and the rear rotation state. Let

  Then, the display data generation unit 35 creates display data based on the center point of the display target region reported from the region control unit 36 and sends it to the display unit 13. As a result, an image corresponding to the display data is displayed on the display unit 13.

  Therefore, according to the present embodiment, the display target area is continuously changed in a desired direction by a simple operation of tilting the mobile phone device in the rotation direction corresponding to the direction in which the user wants to move the display target area. Can be easily performed.

In the present embodiment, the posture data processing unit 33 calculates the displacement angle θ _YD or θ _XD corresponding to the rotation state of the mobile phone device 10 when the mobile phone device 10 is in a state other than the non-rotation state. To do. Then, the region control unit 36 changes the amount of displacement when the center of the display target region is moved at a speed corresponding to the magnitude of the displacement angle θ _YD or θ _XD . Therefore, the user can continuously change the display target area in a desired direction at a desired speed by adjusting the direction in which the mobile phone device 10 is tilted and the magnitude of the tilt.

In the present embodiment, the acceleration data processing unit 34 calculates the acceleration α _s along the Z _S axis of the mobile phone device 10 based on the measurement data from the measurement data collection processing unit 31. Subsequently, based on the magnitude of the acceleration α _s , it is detected whether the mobile phone device 10 is in a non-accelerated state or an accelerated state. When the mobile phone device 10 is in the acceleration state, it is detected whether the direction of the acceleration α _s is the + Z _S direction or the −Z _S direction.

  Then, the magnification control unit 37 calculates the display magnification based on the detection result by the acceleration data processing unit 34. In calculating the display magnification, when the acceleration direction is the + Z direction, the magnification control unit 37 reduces the display magnification at a certain rate from the current display magnification. In addition, when the acceleration direction is the + Z direction, the magnification control unit 37 increases the display magnification at a constant rate from the current display magnification.

  Then, the display data generation unit 35 creates display data corresponding to the display magnification reported from the magnification control unit 37 and sends it to the display unit 13. As a result, an image corresponding to the display data is displayed on the display unit 13. For this reason, the display magnification can be changed by a simple operation of moving the mobile communication terminal device in a direction orthogonal to the display surface at an acceleration exceeding a predetermined value. For this reason, the user can enlarge or reduce the image by adjusting the direction in which the mobile phone device 10 is given an acceleration exceeding a predetermined value.

[Modification of Embodiment]
In the above embodiment, the angle θ ₀ is 10 °, but it can be any angle of 90 ° or less.

Further, in the above embodiment, the magnitude of the acceleration α ₀ is 2 g (m / s ² ), but it can be an arbitrary value.

  In the above embodiment, the display magnification is changed at a constant rate based only on the acceleration direction. On the other hand, the display magnification can be determined based on the magnitude of acceleration and the direction of acceleration. In this case, the user can adjust the change amount of the display magnification by adjusting the acceleration of the movement of the mobile phone device 10.

In the above-described embodiment, the display magnification is changed when the magnitude of the acceleration α _{0 in} the Z _S axis direction of the mobile phone device 10 exceeds ² g (m / s ² ). On the other hand, the display screen can be enlarged or reduced corresponding to the position in the Z _S axis direction from the reference position of the mobile phone device 10.

  In the above embodiment, the present invention is applied to a mobile phone device. However, it is needless to say that the present invention can be applied to a mobile communication terminal device other than the mobile phone device.

  As described above, the display processing method of the present invention can be applied to changes in display contents in a mobile communication terminal device. The mobile communication terminal device of the present invention can be applied to a mobile communication terminal that changes display contents.

It is a figure which shows schematically the external appearance structure of the mobile telephone apparatus which concerns on one Embodiment of this invention. It is a block diagram for demonstrating the internal structure of the apparatus of FIG. It is a figure which shows roughly the structure of the software which operate | moves with the control part of FIG. It is a figure for demonstrating the non-rotation state, the right rotation state, the left rotation state, the front rotation state, and the back rotation state defined in the display control application of FIG. It is a figure for demonstrating the acceleration state and non-acceleration state defined in the display control application of FIG. It is a flowchart which shows the display change process by a display control application. It is a flowchart for demonstrating the display control process of FIG. It is a figure (the 1) which shows an example of a display change. It is a figure (the 2) which shows a display change example.

Explanation of symbols

  DESCRIPTION OF SYMBOLS 10 ... Mobile phone apparatus (mobile communication terminal device), 11 ... Mobile phone main body, 12 ... Operation part, 13 ... Display part (display means), 14 ... Speaker for call, 15 ... Microphone, 16 ... Speaker for guidance, 17 ... Antenna 21... Control unit 22. Transmission / reception unit 23 23 Storage unit 24 F Display content storage area 24 T Temporary storage area 25 Sensor unit (part of attitude detection means, part of acceleration detection means) 26 ... Sensor unit, 27 ... Analog-digital converter, 31 ... Measurement data collection processing unit (part of attitude detection means, part of acceleration detection means), 32 ... Display control application, 33 ... Attitude data processing unit (attitude detection) Part of means, out-of-predetermined range determination means), 34... Acceleration data processing unit (part of acceleration detection means, acceleration determination means), 35. (Area control means), 37 ... magnification control unit (ratio control means).

Claims (13)

An image display processing method used in a mobile communication terminal device,
An attitude detection step of detecting an attitude of the mobile communication terminal device;
An out-of-predetermined range determination step of determining whether the posture detected in the posture detection step is outside a predetermined posture range including a reference posture;
If the result of the determination in the posture determination step is affirmative, the image displayed on the display unit of the mobile communication terminal device corresponding to the relationship between the detected posture and the reference posture range is displayed. A display control method comprising: an area control step of continuously changing a display target area.   In the region control step, the display target region is changed along a direction corresponding to the difference value at a speed corresponding to the difference value between the posture detected in the posture detection step and the reference posture. The display processing method according to claim 1, wherein: An acceleration detecting step of detecting acceleration in a direction orthogonal to the display surface of the display unit;
An acceleration determination step of determining whether or not the magnitude of the acceleration detected in the acceleration detection step exceeds a predetermined value;
And a magnification control step of changing a display magnification on the display unit corresponding to the direction of the acceleration when a result of the determination in the acceleration determination step is affirmative. Item 3. The display processing method according to Item 1 or 2.   The display processing method according to claim 3, wherein in the magnification control step, the display magnification is determined based on the magnitude of the acceleration.   A position detecting step of detecting a position of the mobile communication terminal device in a direction orthogonal to the display surface of the display unit in the reference posture; a display magnification in the display unit corresponding to the position detected in the position detecting step; The display processing method according to claim 1, further comprising: a magnification control step of changing.   The predetermined posture range is a range in which a rotation angle from an initial posture around at least one of a display vertical axis and a display horizontal axis in the reference posture is a predetermined value or less. The display processing method as described in any one of Claims.   The display processing method according to claim 6, wherein the reference posture is a posture in which a display surface of the display unit is horizontal. Prior to the posture angle detection step, further comprising an initial posture detection step of detecting the initial posture of the mobile communication terminal device,
The display processing method according to claim 6, wherein the reference posture is the initial posture. A display for displaying an image;
Attitude detection means for detecting the attitude;
Out-of-predetermined range determining means for determining whether or not the posture detected by the posture detecting means is outside a predetermined posture range;
Area control means for continuously changing the display target area of the display unit corresponding to the relationship between the attitude and the predetermined attitude range when the result of the determination by the out-of-predetermined range determination means is affirmative And a mobile communication terminal device.   The region control means, when the attitude detected by the attitude detection means is in a state outside the predetermined attitude range, the speed corresponding to the attitude detected by the attitude detection means and the attitude and the predetermined The mobile communication terminal apparatus according to claim 9, wherein the display target area of the display unit is continuously changed corresponding to a relationship with a posture range. Acceleration detecting means for detecting acceleration in a direction orthogonal to the display surface of the display unit;
Acceleration determining means for determining whether the magnitude of the acceleration detected by the acceleration detecting means exceeds a predetermined value;
The mobile communication terminal device according to claim 9, further comprising: a magnification control unit that changes a display magnification of the display unit in accordance with the direction of the acceleration.   12. The mobile communication terminal apparatus according to claim 11, wherein the magnification control means determines the display magnification based on the magnitude of the acceleration. Position detecting means for detecting the position of the mobile communication terminal device in a direction orthogonal to the display surface of the display unit in a reference posture;
The mobile communication terminal apparatus according to claim 9, further comprising: a magnification control unit that changes a display magnification in the display unit corresponding to the position detected by the position detection unit.

Images