JP2006157127A - Method of displaying state, and mobile terminal - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide a mobile terminal that can be used for the evaluation of a dynamic state measurement environment, including an environment of measuring the attitude of the mobile terminal, while utilizing a sensor group that includes a magnetism sensor and mounted on the mobile terminal, whereby the user can intuitionally grasp the environment. <P>SOLUTION: A state estimate section 42 infers the dynamic state of the mobile terminal, including an inclination of a display screen of a display section 13, on the basis of a result of sensing by a sensor unit 25 under the assumption of the absence of noise magnetism. Then a state infer result display section 43 expresses the result of the inference of the dynamic state, including a result of the inclination inference by means of state indicators, including an inclination indicator in terms of an inclination symbol graphic so as to display the result of the inclination inference in such a way that the user can intuitionally grasp the result of the inclination inference. <P>COPYRIGHT: (C)2006,JPO&NCIPI

Description

  The present invention relates to a state display method and a mobile terminal device, and more particularly to a state display method for displaying a dynamic state of a mobile terminal device and a mobile terminal device using the state display method.

  2. Description of the Related Art Conventionally, mobile terminal devices that can operate while moving, typified by mobile phone devices, have been widely used. There has been remarkable progress in technology related to such mobile terminal devices, particularly mobile phone devices, and various types of applications such as games have been implemented in addition to the communication function via the mobile communication network, which is an essential function. ing.

  In such a mobile terminal device, various techniques for increasing the usefulness of the mobile terminal device have been proposed. For example, a mobile phone device that displays its own exercise state has been proposed (see Patent Document 1; hereinafter referred to as “Conventional Example 1”). In this conventional cellular phone device, a detection result by an installed acceleration or angular velocity sensor, an integrated value of the detection result, and the like are displayed. In addition, a mobile phone device has been proposed in which a magnetic sensor detects a magnetic flux density derived from geomagnetism, obtains an azimuth at the current position based on the detected magnetic flux density, and notifies the user (see Patent Document 2). Hereinafter referred to as “conventional example 2”).

JP 2001-272413 A JP 2003-90725 A

  The techniques disclosed in Conventional Example 1 and Conventional Example 2 described above are excellent techniques from the viewpoint of notifying the user of the dynamic state of the mobile terminal device. However, from the viewpoint of notifying the user about the inclination of the display surface of the mobile terminal device, which is a kind of attitude of the mobile terminal device, which is considered one of the most useful mechanical states for applications such as games, There are points to be improved.

  For example, in Conventional Example 1, in order to obtain the inclination of the display surface of the mobile terminal device with respect to the horizontal plane, first, the initial posture of the display surface of the mobile terminal device is set to the horizontal plane. Thereafter, the angle around the two axes on the horizontal plane is calculated on the basis of the change in the angular velocity around the two axes on the display surface, thereby obtaining the inclination of the display surface of the mobile terminal device with respect to the horizontal plane. For this reason, an operation that is troublesome for the user, that is, setting the initial posture of the display surface to the horizontal plane as the initial posture, is necessary.

  Further, in the conventional example 1, when displaying the inclination of the display surface of the mobile terminal device with respect to the horizontal plane, similarly to the angular velocity display explicitly disclosed, the symbol graphic display indicating which axis is around, and the angle value display It is thought that the display is performed in combination with the numerical display. Although such a display is accurate in terms of content, it cannot be said that the user can intuitively grasp the inclination of the display surface with respect to the horizontal plane, which is a two-dimensional inclination. For this reason, when the technique of Conventional Example 1 is used, the user interprets a plurality of pieces of posture information displayed on the display unit and newly grasps the two-dimensional inclination of the display surface with respect to the horizontal plane. It was necessary.

  In Conventional Example 2, since the magnetic flux density of the geomagnetism that can be regarded as having a certain size in the horizontal direction at the observation point is detected, noise magnetism other than the geomagnetism in the normal state is detected. When the derived magnetic flux density is sufficiently small, the orientation can be estimated accurately. However, even if the magnetic flux density is detected in three axis directions, if the direction of the magnetic flux density is substantially parallel to the display surface, even if it is known that the magnetic flux density is in the horizontal direction, The tilt with respect to the horizontal plane cannot be measured with high accuracy. For this reason, the case where the user cannot be notified of the accurate estimation result of the two-dimensional inclination with respect to the horizontal plane of the display surface may occur.

  By the way, while detecting geomagnetism as in Conventional Example 2 and specifying the predetermined direction intersecting the horizontal plane by some method, it is possible to move while avoiding the difficulty of setting the initial posture as in Conventional Example 1 In principle, it is possible to accurately estimate the inclination of the display surface of the terminal device with respect to the horizontal plane. However, in the conventional example, there is no suggestion about specifying the predetermined direction.

  In addition, even if a method of detecting the geomagnetism and specifying the predetermined direction intersecting the horizontal plane by any method is used, when detecting the magnetic flux density by the magnetic sensor, there is a large magnetic source near the mobile terminal device. If present, the magnetic flux density derived from geomagnetism cannot be detected with an acceptable accuracy. For example, in a subway vehicle or on a station platform, the magnetic flux density derived from the current required for vehicle operation becomes the noise magnetic flux density.

  The quality of a geomagnetic measurement environment that requires a quantitative understanding of noise magnetism cannot be determined by the perception of the user of the mobile terminal device because magnetism cannot be recognized by the human senses. . For this reason, when the user of the mobile terminal device tries to execute an application that uses the measurement result of magnetic flux density derived from geomagnetism using a sensor mounted on the mobile terminal device, the application can be executed effectively. Cannot judge whether it is in the environment. As a result, when the application is executed, an abnormal value of unknown cause occurs. Such an abnormal value whose cause is unknown can also be generated by the influence of noise magnetism that is manifested during the execution of the application.

  The present invention has been made in view of the above circumstances, and uses a sensor group mounted on a mobile terminal device including a magnetic sensor, and includes a measurement environment for a dynamic state including a measurement environment for the attitude of the mobile terminal device. It is an object of the present invention to provide a state display method that can be used for evaluation of a user and can be displayed for the user so that the user can intuitively grasp it.

  In addition, the present invention provides a display that can be used for evaluation of a measurement environment of a dynamic state including a posture measurement environment and can be intuitively grasped while using a sensor group including a mounted magnetic sensor. It is an object to provide a mobile terminal device that can be performed for a user.

  The state display method of the present invention is a state display method for displaying an estimation result of a mechanical state of a mobile terminal device, and includes a three-axis magnetic sensor and at least a two-axis acceleration sensor mounted on the mobile terminal device. An inclination estimation step of estimating an inclination of the display surface of the display unit of the mobile terminal device with respect to a horizontal plane based on a detection result by the sensor unit; and an inclination indicator including an inclination symbol figure for the inclination estimation result in the inclination estimation step; And a state display step of expressing and displaying on the display surface.

  In this state display method, the sensor unit having a triaxial magnetic sensor and at least a biaxial acceleration sensor detects the magnetic flux density and the acceleration derived from the force acting on the mobile terminal device. For this reason, when noise magnetism does not exist, the triaxial component of the magnetic flux density derived from geomagnetism is detected. Further, based on the detected triaxial component of the magnetic flux density and at least the biaxial component of the gravitational acceleration by the acceleration sensor, the gravitational direction (vertically below) orthogonal to the magnetic flux density is estimated. For this reason, when noise magnetism does not exist, the inclination of the display surface of the mobile terminal device with respect to a horizontal plane can be measured with high accuracy.

  Therefore, in the tilt estimation step, based on the detection result of the magnetic sensor and the acceleration sensor by the sensor unit under the assumption that no noise magnetism exists, the tilt of the display surface of the display unit of the mobile terminal device with respect to the horizontal plane is Presumed. Subsequently, in the state display step, the tilt estimation result is expressed by a tilt indicator including a tilt symbol graphic, and displayed on the display surface in a manner in which the user can easily grasp the tilt estimation result intuitively.

  The tilt indicator displayed in this manner indicates an accurate tilt of the display surface with respect to the horizontal plane when noise magnetism does not actually exist. When noise magnetism is present, the tilt indicator indicates a magnetic state reflecting the vertical component of the noise magnetism. For this reason, the user compares the display of the tilt indicator with the state of the tilt with respect to the surface that can be recognized visually, and the state of the tilt with respect to the plane that can be recognized, so that the noise of the magnetic flux density having the component in the vertical direction at that time The presence of magnetism can be recognized quantitatively.

  Therefore, according to the state display method of the present invention, the sensor group mounted on the mobile terminal device including the magnetic sensor is used to evaluate the measurement environment of the dynamic state including the posture measurement environment of the mobile terminal device. It is possible to display a status that can be intuitively grasped by the user.

  In the status display method of the present invention, the tilt indicator can be displayed in the system area on the display surface that can be displayed only by the basic processing unit for realizing the basic function of the mobile terminal device. In this case, when the application that operates using the function of the basic processing unit uses the detection result of the sensor unit, the sensor is independent of the display operation by the application before or during the startup of the application. It is possible to notify the user of the posture angle measurement environment using the unit. For this reason, before starting the application, the user can recognize that the application should be withheld. In addition, during the execution of the application, the user can recognize a promising candidate for the cause of an inexplicable application operation.

  In the state display method according to the present invention, the tilt indicator displays the tilt symbol graphic at a position corresponding to the tilt estimation result in the display area of the tilt indicator on the display surface. be able to. In this case, the estimation result of the two-dimensional tilt, that is, the tilt of the display surface with respect to the horizontal plane, can be displayed on the display surface in a manner that the user can easily grasp intuitively.

  Further, the state display method of the present invention further includes an azimuth estimation step for estimating the azimuth based on the detection result by the sensor unit, and in the state display step, the estimation result in the azimuth estimation step is expressed by an azimuth indicator. It can be expressed and displayed on the display surface together with the tilt indicator. In this case, in addition to the inclination of the display surface with respect to the horizontal plane described above, the orientation can be displayed on the display surface to notify the user.

  In the state display method of the present invention, a specific movement acceleration component along the display surface in a movement acceleration that is an acceleration contributing to the movement of the mobile terminal device is estimated based on a detection result by the sensor unit. A specific movement acceleration component estimation step is further provided. In the state display step, the specific movement acceleration component estimation result in the specific movement acceleration component estimation step is expressed by a specific movement acceleration component indicator including a symbol graphic for the specific movement acceleration component. Then, it can be displayed on the display surface together with the tilt indicator. In this case, in addition to the inclination of the display surface with respect to the horizontal plane, a specific movement acceleration component, which is a two-dimensional movement acceleration component in the direction along the display surface, is displayed on the surface and notified to the user. be able to.

  Here, in the specific movement acceleration component indicator, the specific movement acceleration component symbol graphic is displayed at a position corresponding to the specific movement acceleration component estimation result in the display area of the specific movement acceleration component indicator on the display surface. Can be decided. In this case, a two-dimensional movement acceleration component called a specific movement acceleration component along the display surface can be displayed on the display surface in a manner that the user can easily grasp intuitively.

  The display area of the specific movement acceleration component indicator can be the same area as the display area of the tilt indicator. In this case, the area of the display area can be saved, and the specific movement acceleration component indicator and the tilt indicator can be displayed on the display surface.

  The mobile terminal device of the present invention includes: a display unit having a display surface; a sensor unit having a triaxial magnetic sensor and at least a biaxial acceleration sensor; and a horizontal plane of the display surface based on a detection result by the sensor unit. A mobile terminal apparatus comprising: inclination estimation means for estimating inclination; and state display means for expressing an inclination estimation result by the inclination estimation means with an inclination indicator including an inclination symbol figure and displaying the result on the display surface. is there.

  In this mobile communication terminal device, the inclination estimation means is based on the assumption that noise magnetism does not exist, and the detection results of the magnetic sensor and the acceleration sensor by the sensor unit having the three-axis magnetic sensor and the at least two-axis acceleration sensor. Based on the above, the inclination of the display surface with respect to the horizontal plane in the display unit is estimated. Then, the state display means expresses the tilt estimation result by a tilt indicator including a tilt symbol graphic, and displays the tilt estimation result on the display surface in a manner that allows the user to easily grasp the tilt estimation result.

  That is, the mobile terminal apparatus of the present invention displays the estimation result of the mechanical state of the mobile terminal apparatus using the state display method of the present invention described above. Therefore, according to the mobile terminal device of the present invention, the sensor group including the mounted magnetic sensor can be used to evaluate the measurement environment of the dynamic state including the posture measurement environment, and intuitively grasped. Can be displayed for the user.

  The mobile terminal device according to the present invention further includes azimuth estimation means for estimating the azimuth based on the detection result by the sensor unit, and the state display means expresses the azimuth estimation result by the azimuth estimation means by an azimuth indicator. Thus, the display can be displayed on the display surface together with the tilt indicator. In this case, in addition to the inclination of the display surface with respect to the horizontal plane described above, the orientation can be displayed on the display surface to notify the user.

  Further, in the mobile terminal device of the present invention, based on the detection result by the sensor unit, a specific movement acceleration component along the display surface in the movement acceleration that is an acceleration contributing to the movement of the mobile terminal device is estimated. Specific movement acceleration component estimation means is further provided, and the state display means expresses a specific movement acceleration component estimation result by the specific movement acceleration component estimation means by a specific movement acceleration component indicator including a symbol graphic for the specific movement acceleration component. Thus, it can be configured to display on the display surface together with the tilt indicator. In this case, in addition to the inclination of the display surface with respect to the horizontal plane, a specific movement acceleration component, which is a two-dimensional movement acceleration component in the direction along the display surface, is displayed on the surface and notified to the user. be able to.

  Moreover, the mobile terminal apparatus of the present invention can be configured to further include a wireless communication unit for performing wireless communication with a base station of a mobile communication network. That is, the mobile terminal device of the present invention can be a mobile communication terminal device.

  As described above, according to the state display method of the present invention, a dynamic state measurement environment including a posture measurement environment of a mobile terminal device is used while using a sensor group mounted on the mobile terminal device including a magnetic sensor. It is possible to perform a display for the user that can be used for the evaluation and can be intuitively grasped by the user.

  Further, according to the mobile terminal device of the present invention, the sensor group including the mounted magnetic sensor can be used to evaluate the measurement environment of the dynamic state including the posture measurement environment, and intuitively grasped. There is an effect that the display that enables the user can be performed for the user.

  Hereinafter, an embodiment of the present invention will be described with reference to FIGS. In these drawings, the same or equivalent elements are denoted by the same reference numerals, and redundant description is omitted.

  FIG. 1 schematically shows an external configuration of a mobile phone device 10 that is a mobile information device. Here, FIG. 1A shows a front view of the appearance of the mobile phone device 10, and FIG. 1B shows a rear view of the appearance of the mobile phone device 10.

  As generally shown in FIGS. 1A and 1B, the mobile phone device 10 includes (a) a mobile phone main body 11, (b) a numeric keypad for inputting a telephone number, and an operation. An operation unit 12 having function keys for inputting various commands such as mode switching to a control unit 21 (see FIG. 2) described later, and (c) a display surface for displaying operation guidance, operation status, received message, and the like. And a display unit 13 of a liquid crystal display device having 18. In addition, the cellular phone device 10 includes (d) a call speaker 14 that reproduces an audio signal transmitted from a communication partner during a call, and (e) a sound input during sound collection or a sound input during a call. And (f) a guidance speaker 16 for generating ringtones and guidance sounds, and (g) an antenna 17 for transmitting and receiving radio signals to and from the base station.

  As shown in FIG. 2, the mobile phone body 11 includes (i) a control unit 21 that controls the overall operation of the mobile phone device 10, and (ii) a base station via an antenna 17. And (iii) a storage unit 23 having a read-only memory (ROM) element and a random access memory (RAM) element for storing a program executed by the control unit 21 and various data. And. The mobile phone main body 11 includes a sensor unit 25 for detecting (iv) magnetic flux density derived from geomagnetism and the like and acceleration acting on the mobile phone device 10.

  The storage unit 23 includes a temporary storage area 24 for temporarily storing the collected measurement data.

  The sensor unit 25 detects the attitude angle of the mobile phone device 10 and the acceleration acting on the mobile phone device 10, and outputs the analog voltage signal as a sensor unit 26, and converts the voltage value of the voltage signal from the sensor unit 26 into a digital value. And an analog / digital (A / D) converter 27. Then, the digital data output from the A / D converter 27 is notified to the control unit 21 as a detection result. Further, the sensor unit 25 starts to operate in response to a detection start command from the control unit 21 and stops operating in response to a detection stop command from the control unit 21.

Here, the sensor section 26, a row direction in a matrix of key arrangement of the operation unit 12 and X _S axis direction, the column direction and Y _S axis direction, the vertical direction of the key array surface as Z _S axis direction, X _S- axis direction magnetic flux density (B _XS ), Y _S -axis direction magnetic flux density (B _YS ) and Z _S -axis direction magnetic flux density (B _ZS ) are detected. Further, the sensor unit 26 detects the X _S axis direction acceleration (α _XS ) and the Y _S axis direction acceleration (α _YS ). Then, from the sensor unit 26, the voltage value V _Bp (p = X _S , Y _S , Z _S ) which is the detection result of the magnetic flux density and the voltage value V _αq (q = X _S , Y _S ) which is the detection result of the acceleration. ) As a set and notified to the control unit 21 as detected raw data.

  The control unit 21 includes a central processing unit (CPU), a digital signal processing unit (DSP), and the like, performs various data processing to realize a general mobile phone function, and other configurations described above. It is designed to control the operation of elements. The configuration of software such as a program executed in the control unit 21 is as shown in FIG.

  That is, the software in the control unit 21 includes a basic processing unit 31 and an application 33. Here, the basic processing unit 31 realizes a call function, a mail function, and a character input function, which are basic functions as a mobile phone device, and controls various hardware resources described above. It is assumed that the application 33 is an application that uses a measurement result obtained by the sensor unit 25.

  The basic processing unit 31 includes a measurement data processing unit 35. As shown in FIG. 4, the measurement data processing unit 35 (i) collects the command from the application 33, controls the measurement operation of the sensor unit 25, and controls the entire measurement data processing unit 35. The detection result correction value using the offset calibration value and the gain calibration value relating to the detection value of the sensor unit stored in the storage unit 23, received from the control unit 49 and (ii) the detection raw data from the sensor unit 25 The detection result correction | amendment part 41 which calculates is provided.

  Further, the measurement data processing unit 35 (iii) receives the detection result correction value from the detection result correction unit 41, and displays the inclination, orientation, and movement acceleration that contributes to the movement of the mobile phone device 10 with respect to the horizontal plane of the display surface 18. The state estimation part 42 which estimates the specific movement acceleration component which is a component along (iv) and the state estimation result display part 43 which displays the estimation result in the state estimation part 42 on the display part 13 are provided. Here, in the present embodiment, as shown in FIG. 5A, the display area on the display surface 18 includes system display areas SR1 and SR2 that can be displayed only by the basic processing unit 31, and the basic display area. A common area CR that can be displayed by both the processing unit 31 and the application 33 is included. Then, the state estimation result display unit 43 displays the state estimation result as the state indicator MSI in the system display region SR1.

As shown in FIG. 5B, the status indicator MSI includes an outer frame line ROL indicating the outer edge of the display area of the status indicator MSI, an inclination symbol figure SSM displayed in an area within the outer frame line ROL, and an outer frame. orientation indicators that appear on the line _{ROL (DSI N, DSI N,} DSI N, DSI N) and regions of the outer frame line ROL (hereinafter, also referred to as a "frame area") for a specific mobile acceleration component that appears in It consists of a symbol graphic ASM. Here, the inclination symbol graphic SSM is displayed at the position of the in-frame region corresponding to the estimation result of the inclination of the display surface 18 with respect to the horizontal plane by the state estimation unit 42. That is, the outer frame line ROL and the tilt symbol figure SSM constitute a tilt indicator. The specific movement acceleration component symbol graphic ASM is displayed at the position of the in-frame region corresponding to the estimation result of the specific movement acceleration component by the state estimation unit 42. That is, a specific movement acceleration component indicator is configured by the outer frame line ROL and the specific movement acceleration component symbol graphic ASM. As described above, the status indicator MSI functions as a composite indicator including a tilt indicator, a direction indicator, and a specific movement acceleration component indicator.

For example, when it is estimated that the display surface 18 and the horizontal plane are parallel, the + Y _S direction is the true north direction, and no force other than gravity acts on the mobile phone device 10, FIG. As shown in A), an inclination symbol figure SSM and a specific movement acceleration component symbol figure ASM are displayed at the center position of the in-frame region. Further, the on borders ROL of + Y _S direction of the center position of the frame within the region north direction symbol DSI _N is displayed, the center position of the frame in the area + X _S direction, -X _S direction and the -Y _S direction The east direction symbol DSI _E , the west direction symbol DSI _W and the south direction symbol DSI _S are displayed on the respective outer frame lines ROL.

Compared to the estimated state of FIG. 6A described above, it is estimated that the display surface 18 is inclined to the + Z _S direction side along the + X _S direction and the −Y _S direction with respect to the horizontal plane. Then, as shown in FIG. 6B, the tilt symbol figure SSM is displayed at a position shifted from the center position of the in-frame region in the + X _S direction and the −Y _S direction. The X _S position of the inclination symbol figure SSM corresponds to the estimated value of the X _S direction inclination amount, and the Y _S direction position of the inclination symbol figure SSM corresponds to the estimated value of the Y _S direction inclination amount. It has become.

Further, when it is estimated that the north direction is different from the -X _S direction as compared with the estimated state of FIG. 6A, as shown in FIG. together on the outer border ROL is north direction symbol DSI _N is displayed in the -X _S direction of the center position of the center position of the frame in the area + Y _S direction, -Y _S direction and + X _S each of the outer frame in a direction An east direction symbol DSI _E , a west direction symbol DSI _W, and a south direction symbol DSI _S are displayed on the line ROL.

Further, when it is estimated that the specific movement acceleration component is present along the −X _S direction and the + Y _S direction as compared with the estimation state of FIG. As shown in B), the specific movement acceleration component symbol graphic ASM is displayed at a position shifted in the −X _S direction and the + Y _S direction from the center position of the in-frame region. The X _S position of the symbol graphic ASM for the specific movement acceleration component corresponds to the estimated value of the X _S direction component of the movement acceleration, and the Y _S direction position of the symbol graphic ASM for the specific movement acceleration component is the movement acceleration component. It corresponds to the estimated value of the Y _S direction component.

  Returning to FIG. 4, the measurement data processing unit 35 (v) receives a detection result correction value from the detection result correction unit 41 and calculates notification data for notification to the application 33, and (Vi) a data notification unit 45 that sends notification data to the application 33.

In the present embodiment, the notification data calculation unit 44 has a horizontal key layout surface in the operation unit 12 and is defined as + Y _S in the above-described X _S Y _S Z _S coordinate system that is uniquely defined in the mobile phone device 10. The posture in which the direction is the true south direction is the reference posture. Using the X _S Y _S Z _S coordinate system at the time of the reference posture as a reference coordinate system (XYZ coordinate system), the notification data calculating unit 44 rotates the rotation angle (pitch angle θ _X ) around the X axis from the reference posture, A rotation angle around the Y axis (roll angle θ _Y ) and a rotation angle around the Z axis parallel to the vertical direction (yaw angle θ _Z ) are calculated. Then, the calculated pitch angle θ _X , roll angle θ _Y and yaw angle θ _Z , X _S direction acceleration α _XS and Y _S direction acceleration α _YS are used as measurement data as notification data, and the measurement environment evaluation at that time The result is stored in the temporary storage area 24. The temporary storage area 24 has measurement data areas MDR ₁ , MDR ₂ ,... As shown in FIG. In each measurement data area MDR _j (j = 1, 2,...), As shown in FIG. 8B, a set of measurement environment evaluation results, a pitch angle θ _X , a roll angle θ _Y , The yaw angle θ _Z , the X _S direction acceleration α _XS, and the Y _S direction acceleration α _YS are stored.

  Next, the detection result processing operation by the sensor unit 25 in the cellular phone device 10 configured as described above will be described.

  As a premise, it is assumed that the sensor unit 25 has started a detection operation and outputs detection raw data in a digital format periodically (for example, every 20 msec). Such detection operation of the sensor unit 25 is started by the collection control unit 49 sending a detection operation start command to the sensor unit in response to a request from the user via the operation unit 12 or the like.

<Measurement environment estimation processing>
When the detection raw data from the sensor unit 25 is received, the detection result correction unit 41 of the measurement data processing unit 35 receives the detection raw data, which is the calibration value of the sensor unit 25 in the storage unit 23, in step S11 of FIG. The detected raw data is corrected using the gain value and the offset value for each of the five types of raw data that are configured. As a result of this correction, the magnetic flux density B _p (p = X _S , Y _S , Z _S ) and acceleration α _q (q = X _S , Y _S ) corresponding to the detection result by the sensor unit 25 are calculated. The detection result correction unit 41 sends the magnetic flux density B _p (p = X _S , Y _S , Z _S ) and acceleration α _q (q = X _S , Y _S ) calculated in this way to the state estimation unit 42.

Receiving the notification result from the detection result correction unit 41, the state estimation unit 42 estimates the inclination of the display surface 18 with respect to the horizontal plane on the assumption that no noise magnetism exists based on the notification result in step S12. To do. In estimating the inclination, the state estimation unit 42 firstly determines the magnetic flux density B _p (p = X _S , Y _S , Z _S ) and the acceleration α _q (q = X _S ) as the notification result from the detection result correction unit 41. , Y _S ), the position direction along the horizontal plane (for example, the north direction) and the vertical direction orthogonal to the horizontal plane are estimated. As a result, an estimation result of the relationship between the X _S Y _S Z _S coordinate system and the XYZ coordinate system which is the reference coordinate system described above is obtained.

Subsequently, the state estimation unit 42 calculates the inclination of the display surface 18 (that is, the _XS Y _S plane) with respect to the estimated horizontal plane (XY plane). Here, the state estimation unit 42 includes an inclination component along the X _S axis (hereinafter also referred to as “X _S direction inclination component”) and an inclination component along the Y _S axis (hereinafter referred to as “Y _S direction inclination”). The component is also called “component”).

Next, in step S13, the state estimation unit 42, based on the relationship between the X _S Y _S Z _S coordinate system and the XYZ coordinate system estimated above is calculated compass direction. Then, the projection direction, which is the projection result on the surface in the east, west, north and south directions, is calculated.

Next, in step S14, the state estimation unit 42 determines the relationship between the X _S Y _S Z _S coordinate system and the XYZ coordinate system estimated above, the assumption that gravity is acting in the + Z direction, and the acceleration α _q. Based on (q = X _S , Y _S ), the movement acceleration contributing to the movement of the mobile phone device 10 is estimated. Subsequently, the state estimation unit 42 calculates the X _S direction component and the Y _S direction component of the estimated movement acceleration as a specific movement acceleration component that is a component along the display surface 18 of the movement acceleration.

The X _S direction inclination component, the Y _S direction inclination component, the projection direction, and the specific movement acceleration component thus obtained are sent from the state estimation unit 42 to the state estimation result display unit 43 as a state estimation result.

The state estimation result display unit 43 that has received the state estimation result from the state estimation unit 42 calculates the display position of the symbol symbol SSM for inclination based on the X _S direction inclination component and the Y _S direction inclination component. Further, the state estimation result display unit 43 based on the projection direction, and calculates azimuth symbol _{DSI N, DSI N, DSI N} , the display position of the DSI _N. The state estimation result display unit 43 calculates the display position of the specific movement acceleration component symbol figure ASM based on the specific movement acceleration component.

  Subsequently, the state estimation result display unit 43 controls the display unit 13 to display the outer frame line ROL on the display surface 18, and a corresponding symbol is arranged at each calculated display position of each symbol. The status indicator MSI is displayed. In this way, the estimation result of the specific movement acceleration component which is a component along the display surface 18 of the inclination, direction, and movement acceleration of the display surface 18 with respect to the horizontal plane is provided to the user.

  In the measurement data processing unit 35 described above, the estimation of the specific movement acceleration component, which is the component along the display surface 18 of the inclination, direction and movement acceleration of the display surface 18 with respect to the horizontal plane, and the display of the estimation result are started. Started with. Thereafter, the measurement data processing unit 35 repeats the estimation and display operations every time the detection raw data is received from the sensor unit 25.

  The user compares the estimation result of the inclination, the azimuth, and the specific movement acceleration component with respect to the horizontal plane of the display surface 18 indicated by the state indicator MSI displayed on the display surface 18 with the situation experienced at that time, thereby Recognizes the measurement environment of geomagnetism and acceleration using the unit 25. For example, even though the user intends to set the display surface 18 to be substantially horizontal in a stationary state, the display position of the tilt symbol graphic SSM or the specific moving acceleration component symbol graphic ASM is shifted from the center position of the in-frame region. In such a case, the user may indicate that there is noise magnetism other than geomagnetism, or that a force other than gravity is acting on the mobile phone device 10. Can be recognized.

  Further, when the display position of the symbol figure for inclination SSM or the symbol figure ASM for specific movement acceleration component is fixedly shifted from the center position of the in-frame region to a specific position, the user has a steady noise magnetism or the like. It can be recognized that On the other hand, when the display position of the inclination symbol graphic SSM or the specific movement acceleration component symbol graphic ASM is temporally fluctuating, the user recognizes that the noise magnetism and the like fluctuate with time. be able to.

<Measurement data collection process and measurement data notification process>
Next, measurement data collection processing in the measurement data processing unit 35 will be described.

The detection result correction unit 41 calculates the magnetic flux density B _p (p = X _S , Y _S , Z _S ) and the acceleration α _q (q = X _S , Y _S ), which are correction results of the detected raw data, as described above. To the state estimation unit 42 and to the notification data calculation unit 44. Upon receiving these, the notification data calculation unit 44 calculates the pitch angle θ _X , roll angle θ _Y , and yaw angle θ _Z based on the correction result. Subsequently, the notification data calculation unit 44 sequentially uses the temporary storage area 24 as a ring buffer, and sequentially determines the measurement environment evaluation result, the pitch angle θ _X , the roll angle θ _Y , the yaw angle θ _Z , and the X _S direction acceleration α _XS And Y _S direction acceleration α _YS are stored in the measurement data area MDR _j . Then, the notification data calculation unit 44 notifies the collection control unit 49 of the address information of the stored measurement data region MDR _j every time the measurement data region MDR _j is stored.

Thus, when the measurement data processing unit 35 collects measurement data and the application 33 issues a measurement data request, in the measurement data processing unit 35, the collection control unit 49 receives the measurement data request. The collection control unit 49 that has received the measurement data request notifies the data notification unit 45 of the address of the temporary storage area 24 in which the measurement data to be notified is stored and the number of measurement data to be notified. Upon receiving this notification, the data notification unit 45 refers to the notified address in the temporary storage area 24, and the measurement environment evaluation result, pitch angle θ _X , roll angle θ _Y , and yaw angle θ _Z that are data for notification. , X _S direction acceleration α _XS and Y _S direction acceleration α _YS are read out and sent to the application 33. Then, the application 33 performs a predetermined operation using the measurement environment evaluation result and measurement data received from the data notification unit 45.

  As described above, in the mobile phone device 10 of the present embodiment, the state estimation unit 42 displays on the display unit 13 based on the detection result of the sensor unit 25 under the assumption that no noise magnetism exists. The inclination of the surface 18 with respect to the horizontal plane is estimated. Then, the state estimation result display unit 43 expresses the inclination estimation result by an inclination indicator including the inclination symbol graphic SSM, and the user can intuitively grasp the inclination estimation result on the display surface 18 in an easy manner. indicate. Therefore, according to the present embodiment, a state display that can be used for evaluation of a measurement environment of a dynamic state including the measurement environment of the posture of the mobile phone device 10 and can be intuitively grasped by the user is performed. be able to.

  Further, since the tilt indicator is displayed in the system area on the display surface 18 that can be displayed only by the basic processing unit 31, the sensor is independent of the display operation by the application 33 before or during the start of the application 33. The user can be notified of the posture angle measurement environment using the unit 25. Therefore, before the application 33 is activated, the user can recognize that the activation of the application 33 should be withheld. Further, during execution of the application 33, the user can recognize a promising candidate for the cause of the operation of the mysterious application 33.

  In the tilt indicator, the tilt symbol graphic SSM is displayed at a position corresponding to the tilt estimation result in the in-frame region that is the display area of the tilt indicator on the display surface 18. For this reason, the two-dimensional inclination called the inclination of the display surface 18 with respect to the horizontal plane can be displayed on the display surface in a manner that the user can easily grasp intuitively.

  Moreover, while the state estimation part 42 estimates an azimuth | direction, the state estimation result display part 43 expresses the said azimuth | direction estimation result with an azimuth | direction indicator, and displays it on the display surface 18 with an inclination indicator. For this reason, in addition to the inclination of the display surface 18 with respect to the horizontal plane, the orientation can be displayed on the display surface 18 to notify the user.

  Further, the state estimation unit 42 estimates a specific movement acceleration component along the display surface 18 in the movement acceleration that is an acceleration contributing to the movement of the mobile phone device 10. Then, the state estimation result display unit 43 expresses the specific movement acceleration component estimation result by a specific movement acceleration component indicator including the specific movement acceleration component symbol graphic ASSM, and displays it on the display surface 18 together with the tilt indicator and the direction indicator. To do. For this reason, in addition to the inclination and the azimuth | direction with respect to the horizontal surface of the display surface 18, the specific movement acceleration component which is a two-dimensional movement acceleration component of the direction along the display surface 18 is displayed on the display surface 18, and it is to a user. You can be notified.

  Further, in the specific movement acceleration component indicator, the specific movement acceleration component symbol graphic ASM is located at a position corresponding to the estimation result of the specific movement acceleration component in the area in the frame which is the display area of the specific movement acceleration component indicator on the display surface 18. Is displayed. For this reason, the two-dimensional movement acceleration component called the specific movement acceleration component along the display surface can be displayed on the display surface in a manner that the user can easily grasp intuitively.

  Note that the tilt indicator, the azimuth indicator, and the specific acceleration indicator can be expressed by a graphic or a character having a different form from the above embodiment, or a combination thereof.

  In the above embodiment, the sensor unit 25 is a so-called 5-axis sensor that detects the magnetic flux density in the three-axis direction and detects the acceleration in the two-axis direction, but the acceleration is also in the three-axis direction like the magnetic flux density. The so-called 6-axis sensor can be used.

  In the above embodiment, the sensor unit 25 is mounted in the mobile phone device 10. On the other hand, the sensor unit 25 is arranged outside the mobile phone device 10 so that the sensor unit 25 and the mobile phone device 10 are connected via an external device connection interface port (not shown) of the mobile phone device 10. It may be.

  In the embodiment described above, a so-called straight-type mobile phone device in which the positional relationship between the operation unit 12 on which keys are arranged and the display unit 13 is fixed is used. On the other hand, in the case of a mobile phone device in which the positional relationship between the operation unit and the display unit is variable, such as a so-called clamshell type or revolver type, the sensor unit 25 may be disposed on the operation unit side. However, it may be arranged on the display unit side. Further, the axial direction serving as a reference for measurement in the sensor unit 25 can be determined in accordance with the position where the sensor unit 25 is disposed and the model of the mobile phone.

  In the above embodiment, the present invention is applied to the mobile phone device. However, the present invention is also applied to other types of mobile information devices such as a portable game machine, a car navigation device, and a PDA (Personal Digital Assistance). Of course, the invention can be applied.

  As described above, the state display method of the present invention provides a user of a measurement environment having a dynamic state including the measurement environment of the attitude angle of the mobile terminal device while using the magnetic sensor mounted on the mobile terminal device. Applicable to notifications. In addition, the mobile terminal device of the present invention can be applied to a mobile terminal device that measures a mechanical state including a posture angle measurement while using a mounted magnetic sensor.

It is a figure which shows schematically the external appearance structure of the mobile telephone apparatus which concerns on one Embodiment of this invention. It is a functional block diagram for demonstrating the structure of the mobile telephone apparatus of FIG. It is a figure for demonstrating the structure of the software performed by the control part of FIG. It is a functional block diagram for demonstrating the structure of the measurement data process part of FIG. FIG. 3 is a diagram (part 1) for explaining display of a measurement environment estimation result on the display unit of FIG. 1; FIG. 6 is a diagram (part 2) for explaining display of a measurement environment estimation result on the display unit of FIG. 1; FIG. 9 is a diagram (No. 3) for explaining display of a measurement environment estimation result on the display unit in FIG. 1; It is a figure for demonstrating the structure of the temporary memory part of FIG. It is a flowchart for demonstrating the process in the state estimation part and state display result display part of FIG.

Explanation of symbols

DESCRIPTION OF SYMBOLS 10 ... Mobile phone apparatus (mobile terminal device), 11 ... Mobile phone main body, 12 ... Operation part, 13 ... Display part, 14 ... Speaker for call, 15 ... Microphone, 16 ... Speaker for guidance, 17 ... Antenna, 18 ... Display Surface, 21 ... Control unit, 22 ... Transmission / reception unit, 23 ... Storage unit, 24 ... Temporary storage area, 25 ... Sensor unit, 26 ... Sensor unit, 27 ... A / D converter, 31 ... Basic processing unit, 33 ... Application 35 ... Measurement data processing unit 41 ... Detection result correction unit 42 ... State estimation unit (tilt estimation means, azimuth estimation means, specific movement acceleration component estimation means) 43 ... State estimation result display unit (state display means), 44 ... notification data calculating unit, 45 ... data notification unit, 46 ... correction unit, 49 ... collection controller, ASM ... particular movement acceleration component symbol _{graphic, DSI E, DSI W, DSI} S, DSI N Orientation symbols, SSM ... tilt symbol graphic, MSI ... status indicator, ROL ... borders.

Claims (11)

A state display method for displaying an estimation result of a mechanical state of a mobile terminal device,
Inclination estimation for estimating the inclination of the display surface of the display unit of the mobile terminal device with respect to the horizontal plane based on a detection result by a sensor unit having a triaxial magnetic sensor and at least a biaxial acceleration sensor mounted on the mobile terminal device Process and;
A state display method comprising: a state display step of displaying the inclination estimation result in the inclination estimation step on the display surface by expressing the inclination estimation result including an inclination symbol graphic.   The state according to claim 1, wherein the tilt indicator is displayed in a system area on the display surface that can be displayed only by a basic processing unit for realizing a basic function of the mobile terminal device. Display method.   The tilt symbol graphic is displayed at a position corresponding to the tilt estimation result in the display area of the tilt indicator on the display surface. Status display method. Based on the detection result by the sensor unit, further comprising an azimuth estimation step of estimating the azimuth,
The said state display process expresses the estimation result in the said azimuth | direction estimation process with an azimuth | direction indicator, and displays it on the said display surface with the said inclination indicator, It is any one of Claims 1-3 characterized by the above-mentioned. Status display method. A specific movement acceleration component estimation step for estimating a specific movement acceleration component along the display surface in a movement acceleration that is an acceleration contributing to movement of the mobile terminal device based on a detection result by the sensor unit;
In the state display step, the specific movement acceleration component estimation result in the specific movement acceleration component estimation step is expressed by a specific movement acceleration component indicator including a specific movement acceleration component symbol graphic on the display surface together with the tilt indicator. The state display method according to claim 1, wherein display is performed.   In the specific movement acceleration component indicator, the specific movement acceleration component symbol graphic is displayed at a position corresponding to the specific movement acceleration component estimation result in the display area of the specific movement acceleration component indicator on the display surface. The state display method according to claim 5.   The state display method according to claim 6, wherein a display area of the specific movement acceleration component indicator is the same area as a display area of the tilt indicator. A display unit having a display surface;
A sensor unit having a triaxial magnetic sensor and at least a biaxial acceleration sensor;
Inclination estimation means for estimating an inclination of the display surface with respect to a horizontal plane based on a detection result by the sensor unit;
A mobile terminal device comprising: state display means for displaying the inclination estimation result by the inclination estimation means on the display surface by expressing the inclination estimation result including an inclination symbol graphic. Based on the detection result by the sensor unit, further comprising azimuth estimation means for estimating the azimuth,
9. The mobile terminal apparatus according to claim 8, wherein the status display unit expresses a direction estimation result obtained by the direction estimation unit using a direction indicator and displays the result on the display surface together with the tilt indicator. A specific movement acceleration component estimating means for estimating a specific movement acceleration component along the display surface in a movement acceleration that is an acceleration contributing to movement of the mobile terminal device based on a detection result by the sensor unit;
The state display means expresses a specific movement acceleration component estimation result by the specific movement acceleration component estimation means by a specific movement acceleration component indicator including a symbol graphic for the specific movement acceleration component on the display surface together with the inclination indicator. The mobile terminal device according to claim 8 or 9, wherein the mobile terminal device is displayed. The mobile terminal apparatus according to claim 8, further comprising a wireless communication unit for performing wireless communication with a base station of a mobile communication network.

Images