WO2005096597A1

WO2005096597A1 - Portable information processing device, information processing system, control method for portable information processing device, control program for portable information processing device, and recording medium

Info

Publication number: WO2005096597A1
Application number: PCT/JP2005/005849
Authority: WO
Inventors: Yuji Ichikawa
Original assignee: Sharp Kabushiki Kaisha
Priority date: 2004-03-30
Filing date: 2005-03-29
Publication date: 2005-10-13
Also published as: JP3720346B2; JP2005286809A

Abstract

An acceleration sensor (11) outputs acceleration data according to the state of motion of a user. Based on the acceleration data, a user state analyzing section (12) calculates a walking speed in terms of the number of steps of the user and a user motion state (stationary, walking, running, moving by a vehicle, etc.). A user state processing section (14) integrates the walking speed to calculate the number of steps, and upon determining a variation in a user motion state, the user state processing section (14) memorizes in a life rhythm memorizing section (17) the user motion state having had the variation. When a portable telephone (1) is either in a state where it is being used or in a state where mail reception or incoming call is being notified and a manner mode is being set to ON, a device state managing section (15) causes a latch section (13) to hold data from a user state analyzing section (12) and stops both acceleration sensor section (11) and user state analyzing section (12). This results that plural functions using an output of detection by a motion sensor can be realized without requiring a complex construction and without causing misoperation.

Description

Specification

Portable information processing apparatus, information processing system, method for controlling portable information processing apparatus, control program for portable information processing apparatus, and recording medium

Technical field

The present invention relates to a portable information processing device that uses a motion sensor represented by an acceleration sensor or a gyro sensor for a plurality of purposes.

Background art

[0002] With the advancement of technologies such as MEMS (Micro Electro Mechanical Systems) and the miniaturization and low cost of acceleration sensors, a number of applications using acceleration sensors have begun to be proposed. Examples of applications include unrestricted pedometers that do not need to be fixed to the body, user interfaces such as a mouse using an acceleration sensor, drive mode detection, accident detection, and sports skill evaluation. Insomnia, attention deficit disorder (ADHD: Attention) like Ambulatory motioring's Actigraph

Some are used to diagnose Deficit / Hyperactivity Disorder) and dementia.

[0003] As described above, since various applications can be performed using a motion sensor such as an acceleration sensor, a device incorporating a motion sensor and using the motion sensor for a plurality of uses has been devised.

[0004] For example, a well-known document 1 [Japanese Patent Laid-Open Publication No. 2001-272413 (published on October 5, 2001)] discloses that an acceleration sensor and an angular velocity sensor are mounted on a mobile phone to obtain sensor data. It discloses a mobile phone that can display, control phone operations, send and receive data, and measure athletic performance.

[0005] Further, when combining a motion sensor with an irrelevant function (mobile phone) as in the above example, it is conceivable that the function of the motion sensor malfunctions due to the irrelevant function. For example, publicly known document 2 [Japanese Patent Laid-Open Publication No. 2002-261983 (published on September 13, 2002)] describes a mobile phone having a means for detecting the posture and the amount of activity of a holder and the mobile phone. Discloses a nursing care system using the Internet. In this publicly known document 2, the incoming call by vibration causes the posture and the amount of It has been pointed out that the accuracy of detection of the target decreases, and means for solving it have been proposed.

[0006] Further, a known document 3 [Japanese Patent Laid-Open Publication No. Hei 10-260055 (published on September 29, 1998)] discloses a portable navigation system that is not guaranteed to be held in a fixed orientation. A technology that enables detection of a moving speed and a moving direction of a pedestrian is disclosed.

[0007] However, when a motion sensor is mounted as an added value of a conventional device and used for multiple purposes, the following problems occur.

[0008] First, the built-in motion sensor may malfunction as a pedometer when used as a user interface in a configuration used for both a pedometer and a user interface. A similar problem occurs when the acceleration sensor is used for both user state detection (walking, running, riding, etc.) and the user interface. These problems stem from the fact that when an acceleration sensor is used for multiple purposes, the acceleration sensor does not always correspond to the intended movement of the application.

[0009] For example, if the operation control of the telephone and the measurement of the athletic ability are performed simultaneously, there is a possibility that the operation of the telephone is erroneously performed at the time of measuring the athletic ability. Known Document 1 describes the prevention of this malfunction.

[0010] Second, when a conventional device generates a physical movement such as a vibration function at the time of an incoming call of a mobile phone, a value-added function by a motion sensor may malfunction. In order to solve such a problem, according to the method disclosed in the publicly known document 2, the correction value of the output of the motion sensor is determined in advance based on the amplitude and frequency of the vibration and the time during which the vibration is continuous, and the generation of the vibration is performed. Is detected, an accurate motion sensor is obtained by subtracting the above correction from the output of the motion sensor. However, it is difficult to realize such a method because it is necessary to use very complex and high-speed real-time pattern matching technology to improve the correction accuracy.

[0011] Third, when a mobile phone is used for multiple purposes, it may be held by hand or immediately put into a bag or pocket after use depending on the usage scene. There is no. Therefore, the moving speed and moving direction of the pedestrian are accurately detected. I can't. Known Document 3 describes, as an apparatus including a motion sensor, an apparatus whose use is limited to a navigation system. This device solves the above problem by calculating the amount of correction related to the current attitude of the device by detecting and tracking the gravitational acceleration, and correcting the initial gravitational acceleration obtained in advance by the above amount of correction. Solved. However, this device requires a complicated configuration to solve the problem.

[0012] The present invention has been made in view of such a problem, and does not require complicated technology and configuration, and realizes a plurality of functions using detection outputs of a motion sensor without malfunctioning. It is an object of the present invention to provide an information processing device for causing the information processing device to perform the processing.

Disclosure of the invention

[0013] In order to solve the above-mentioned problems, a portable information processing device according to the present invention includes a motion sensor unit, processing means for performing predetermined processing on an output of the motion sensor unit, and a portable information processing device by a user. And a control unit for stopping at least one of the motion sensor unit and the processing unit when the use state is detected.

According to the above configuration, when the use state is detected by the use state detection unit, at least one of the motion sensor unit and the processing unit stops. If the motion sensor unit stops, the output cannot be obtained and the processing by the processing unit is not performed.If the processing unit stops, the processing unit performs the processing even if the output of the motion sensor unit is maintained. Absent. Then, if both the motion sensor unit and the processing unit are stopped, the above processing is not performed.

[0015] Thereby, when the main body of the portable information processing apparatus is in use, the inconvenience caused by the motion sensor unit and the processing unit being operated at the same time (that is, an error occurs in the output of the motion sensor unit, If the processing is performed by the processing means while including the error, the inconvenience can be avoided.

Here, the inconvenience in which the error occurs is more specifically described below.

[0017] When the motion of the user carrying the portable information processing device is detected by a motion sensor unit including an acceleration sensor and the like, the processing unit performs a predetermined operation based on the detected output. Is performed. For example, when the output of the acceleration sensor is used, by analyzing the movement of the user based on the detected acceleration, the user's activity state (e.g., walking state, running state, Medium etc.). In such processing, an error occurs in the processing result unless the output of the motion sensor unit is a value detected correctly.

Next, the portable information processing device is used by a user while carrying it. When the user carries the mobile phone in a pocket, the processing means can correctly analyze the activity of the user as described above. However, when the user removes the portable information processing device from the pocket and uses it (for example, removes the mobile phone from his pocket while walking and sends and receives e-mails), in addition to the vibration caused by walking, motion The output of the sensor unit will also include vibration components due to key operations, etc., which will cause errors in the analysis.

[0019] That is, by avoiding the above-described inconvenience in which an error occurs, a portable information processing apparatus capable of realizing a plurality of functions using detection outputs of a motion sensor with a simple configuration that does not cause erroneous operation. Can be provided.

Further, another portable information processing apparatus according to the present invention includes a motion sensor unit, processing means for performing a predetermined process on an output of the motion sensor unit, and detecting a use state of the portable information processing apparatus by a user. And a control means for stopping the processing means when the use state is detected.

In the above portable information processing apparatus, when the use state is detected, the control means stops at least one of the motion sensor unit and the processing means. To stop.

This makes it possible to prevent an error from being included in the output of the processing means when the portable information processing apparatus is in the use state, and to detect the motion while the use state is detected and the processing means is stopped. If there is a purpose to use the output of the sensor unit, it is possible to use the correct output of the motion sensor unit without error.

As a result, there is provided an information processing apparatus for realizing a plurality of functions using detection outputs of a motion sensor that do not require a separate complicated configuration without malfunctioning. You can do it.

[0024] Still other objects, features, and strengths of the present invention will be made clear by the description below. Also, the advantages of the present invention will become apparent in the following description with reference to the accompanying drawings.

Brief Description of Drawings

FIG. 1 is a block diagram showing a configuration of a main part of a mobile phone according to an embodiment of the present invention.

FIGS. 2 (a) to 2 (c) are diagrams showing state transitions of a mobile phone managed by a state machine of a device state management unit in the mobile phone.

FIG. 3 is a flowchart showing a processing procedure for a control unit of the device state management unit to realize control based on the state transition.

FIG. 4 is a block diagram showing a configuration of a user state analysis unit in the mobile phone.

FIG. 5 is a block diagram showing a configuration for realizing a status display Z transmission function of the mobile phone.

FIG. 6 is a block diagram showing a configuration of a main part of a mobile phone according to another embodiment of the present invention.

FIG. 7 is a view showing the appearance and the z-axis direction of the foldable mobile phone shown in FIG. 6 in a folded state.

FIG. 8 is a waveform diagram showing an output in the z-axis direction of an acceleration sensor with respect to an operation of tapping the mobile phone in FIG. 6.

FIGS. 9 (a) and (b) are diagrams showing state transitions of a mobile phone managed by a state machine of a device state management unit in the mobile phone.

FIG. 10 is a flowchart showing a processing procedure for a control unit of a device state management unit in the mobile phone of FIG. 6 to realize control based on the state transition of FIG.

BEST MODE FOR CARRYING OUT THE INVENTION

An embodiment of the present invention will be described below with reference to FIGS. 1 to 10.

[Embodiment 1]

FIG. 1 shows a configuration of a main part of a mobile phone 1 according to the present embodiment. This phone 1 The apparatus has (1) a pedometer function, (2) a vehicle detection function, (3) a life rhythm recording function, and (4) a state display Z communication function using an acceleration sensor 11a described later. The pedometer function is a function of measuring the number of steps of the user carrying the mobile phone 1. The vehicle detection function is a function of detecting that the user carrying the mobile phone 1 is moving on the vehicle. The activity rhythm recording function is a function of recording an activity state (for example, a moving state such as walking and running and a number of steps) of a user who carries the mobile phone 1. The status display Z communication function displays a user activity status (hereinafter, appropriately referred to as a user status), which will be described later, based on the output of the acceleration sensor 1 la on the mobile phone 1 and transmits it to the outside. Function. Note that the mobile phone 1 may have other functions that are not limited to these functions. Hereinafter, the configuration of the mobile phone 1 will be described.

[0028] The mobile phone 1 as a mobile information processing device has not only a telephone function but also an e-mail sending / receiving function, and further executes various application programs and realizes a user interface. And has a computer function. In addition, the mobile phone 1 includes an acceleration sensor unit 11, a user state analysis unit 12, a latch unit 13, a user state processing unit 14, and a device state management unit 15 in order to realize the functions (1) to (4) described above. , A clock section 16 and a living rhythm storage section 17.

[0029] The physical quantity to be analyzed for the output of the acceleration sensor unit 11, that is, the magnitude of the acceleration and the frequency band vary depending on the operation to be analyzed. The frequency band of the acceleration when the operation to be analyzed is performed is, for example, as follows, assuming that a person carries the device.

• Gravity detection: 1Hz or less

• Activity: 10Hz or less

'Walking Z running: l ~ 2Hz around

• Vehicle riding: 20Hz or less

• Gesture operation: 50Hz or less

The acceleration sensor unit 11 includes an acceleration sensor 11a, a low-pass filter (LPF in the figure) lib, and an analog-digital conversion (AZD in the figure) 11c.

In the present embodiment, the acceleration sensor 11a as a motion sensor is Any sensor that has a frequency response up to about 50 Hz may be used. The acceleration sensor 11a uses a type of sensor that can detect acceleration in three axes and can detect a DC component in order to use the direction of gravity in the vehicle detection function.

[0032] Generally, the resonance frequency of the acceleration sensor is in a band higher than the frequency response. For this reason, the low-pass filter lib cuts the frequency component higher than the frequency response at the output of the acceleration sensor 1 la prior to sampling in the AZD converter 11c.

[0033] According to the sampling theorem of Nyquist, the analog-digital converter (hereinafter referred to as the AZD converter) 1lc has a sampling rate twice as high as the frequency response of the acceleration sensor 11a and the acceleration sensor 11a having passed through the low-pass filter lib. The output is sampled and digital acceleration data is output.

[0034] The user state analysis unit 12 as a processing unit analyzes the user state and the vibration related to the large amplitude of the acceleration based on the acceleration data output from the acceleration sensor unit 11 in order to analyze the state of the user. And output the number. The above user states are forces that are stationary, walking (flat), walking (up), walking (down), running (flat), running (up), running (down), car movement, train movement and elevator movement. It is not limited to this. Since the vibration generated by walking or running appears as a large change (vibration) of the acceleration detected by the acceleration sensor unit 11, the cycle in which the acceleration changes (vibrates) coincides with the walking rhythm. . Therefore, the frequency, which is the number of times the acceleration vibrates, is expressed as the step speed (the number of steps per unit time). The user state analysis unit 12 has a gravitational direction estimating unit 12f for estimating the direction of gravity for detecting a vehicle. The details of the user state analysis unit 12 will be described later.

The latch unit 13 as a holding unit is a data latch that temporarily holds digital data (user state data of about several bits or walking speed data of about 8 bits) output from the user state analysis unit 12. It is. The latch unit 13 transmits the output of the user state analysis unit 12 to the user state processing unit 14 as it is, or stores the output of the user state analysis unit 12 at a specific time, until the next storage instruction is given. Then, the output is continuously transmitted to the user state processing unit 14. The latch unit 13 is controlled by the device state management unit 15 described later. , Perform one of the above two actions.

The latch unit 13 latches the time data from the clock unit 16 provided by the device state management unit 15 together with the output data when holding the output data of the user state analysis unit 12 at a specific time. . Therefore, the latch unit 13 has a time data latch circuit that latches time data, in addition to an output data latch circuit that latches output data of the user state analysis unit 12. The time data latch circuit receives a control signal for latching from the device state management unit 15 together with the output data latch circuit and latches the time data at the same time in order to latch the time data. The time data is the time when the device state management unit 15 instructs the latch unit 13 to latch, that is, the time when the device state management unit 15 outputs the control signal.

[0037] The user state processing unit 14 performs processing for realizing the functions (1) and (3) based on data from the user state analysis unit 12 input via the latch unit 13. This is the function block that is implemented by software. Hereinafter, each function of the user status processing unit 14 will be described.

[0038] When the user's state is walking or running, the user state processing section 14 as a post-processing means calculates the number of steps by integrating the number of steps (realizes the pedometer function). The user state processing unit 14 compares the user state stored in the life rhythm storage unit 17 with the user state newly input from the user state analysis unit 12, and when the user state changes. The current time output by the clock unit 16 is read, and the changed user state and the read time are stored in the powerful living rhythm storage unit 17 such as a memory (realizing the recording function of the living rhythm). . Further, the user status output from the user status processing unit 14 is displayed on the mobile phone 1 and transmitted to a server (not shown) (realizing a status display Z transmission function). The configuration for realizing this function will be described later in detail.

As described above, in order to realize the above four functions, the acceleration sensor unit 11, the user state analysis unit 12, and the user state processing unit 14 are required.

[0040] The clock unit 16 is a software clock that outputs time data.

The device state management unit 15 stores the acceleration sensor unit 11 and the user according to the usage state of the mobile phone 1. The state controller 12 and the latch 13 are controlled. The device state management unit 15 has a state machine 15a and a control unit 15b, and both are usually implemented by software.

[0042] The state machine 15a manages the overall state of the mobile phone 1, and monitors the transition state of each of the call-related state, the manner mode state, and the terminal use state. When the state machine 15a as the use state detecting means detects the use state of the mobile phone 1 in monitoring the transition status, the state machine 15a notifies the control unit 15b and other necessary parts of the mobile phone 1 of the detection.

FIGS. 2A to 2C are state transition diagrams of the state machine 15a. The call-related state transition diagram shown in Fig. 2 (a) simplifies the transition of a general mobile phone for calling, receiving, and receiving mail. In addition, as shown in FIGS. 2 (b) and (c), the state machine 15a performs a manner transition of a manner mode in which an incoming call is vibrated and a terminal use state independently of a state transition related to a call. Make a transition.

[0044] In the terminal use state, if there is a key input, the timer is reset and the state transits to the "in use" state. Transition to the 'unused' state. In addition, the use state of the mobile phone 1 such as an open (during use) and close (unused) operation of the foldable mobile phone 1 is also included in the terminal use state. Such a state transition is usually used for backlight control of a liquid crystal display, and turns off the backlight when there is no key operation or opening operation to reduce power consumption.

In these state transitions, particularly relevant to the present invention are “mail arrival notification”, “calling”, “manner on”, and “in use”.

The control unit 15b as a control unit controls the acceleration sensor unit 11, the user state analysis unit 12, and the latch unit 13 according to a predetermined algorithm according to the state transition of the mobile phone 1 managed by the state machine 15a. Specifically, when the mobile phone 1 is operating to realize the above-described four functions, the control unit 15b sends a predetermined value to the latch unit 13 so as to hold the latest data of the walking speed and the user state. A control signal for retaining data at each interval is sent. Further, the control unit 15b supplies the time data obtained from the clock unit 16 to the latch unit 13 together with a control signal as necessary.

[0047] The control unit 15b controls the power saving and prevents the user state processing unit 14 from malfunctioning. Also do. For this reason, when the state machine 15a is notified of the above-described states of “mail arrival notification”, “answering machine call”, “manner on”, and “in use”, the control unit 15b sends the user state analysis unit 12 At the same time, when the control unit 15b detects the operation state of the mobile phone 1 by the user as described above, the control unit 15b controls the latch unit 13 to stop the data holding operation so as to stop the data holding operation. Stop sending.

FIG. 3 is a flowchart showing a processing procedure for the control unit 15b to realize control based on the above state transition.

[0049] First, it is determined whether or not the state has transitioned (S1). If the state has transitioned, it is further determined whether or not the terminal state force V is in use (S2). Here, when the terminal state is not in use (NO in S2), it is determined whether the communication-related state is “mail arrival notification” or “calling” (S3). It is determined whether the manner mode is "manner on" or not (S4).

[0050] According to the above series of determinations, when the terminal status is in use (YES in S2), or when the communication-related status is "mail arrival notification" or "calling" and the manner mode is set. When is in the manner-on state (YES in S3 and YES in S4), it is checked whether or not the acceleration sensor 11a is stopped (S5), and the operation status related to the acceleration sensor unit 11 is checked. If the acceleration sensor 1 la has not stopped, the output data of the user state analysis unit 12 is latched by the latch unit 13 (S6). Then, the user state analysis unit 12 is stopped (S7), the acceleration sensor unit 11 is further stopped (S8), and the process returns to S1. The control unit 15b instructs a CPU or the like that controls the entire mobile phone 1 to stop supplying the sampling clock to the AZD variable _C in order to stop the acceleration sensor unit 11. As described above, by latching the data before the latch unit 13 stops, the data immediately before the output of the user state analysis unit 12 is stopped is held in the latch unit 13.

When the state managed by the state machine 15a transits to a state other than the above-mentioned state, that is, when the terminal state is not in use and the communication-related state is changed to a state other than “mail arrival notification” or “calling” in S3. When the transition is made (NO in S3), it is determined whether or not the acceleration sensor 1 la is stopped (S9). Here, if the acceleration sensor 11a is stopped (YES in S9), a predetermined instruction is given to return the operation of the user state analysis unit 12 (S10). Further, a control signal is provided so that the operation of the acceleration sensor unit 11 is also restored (S11). Then, the FIFO 12a described later in the user state analysis unit 12 is newly filled with the acceleration sensor data and the force is also released (S12), the holding state of the latch unit 13 is released, and the latest state output from the user state analysis unit 12 is output. The data is latched by the latch section 13 (S13).

[0052] Thereby, the operation of the sensor data processing system can be quickly restored, and the continuity of the processing in the user state can be maintained.

Here, the user state analysis unit 12 will be described in more detail.

FIG. 4 shows a block diagram of the user state analysis unit 12.

[0055] The user state analysis unit 12 includes a FIFO (First In First Out) 12a, a zero cross determination unit 12b, 12c, a zero cross counter 12d, an average Z variance Z saturation calculation unit 12e, a gravity direction estimation unit 12f, and a gravity direction storage unit. 12g and a user state determination unit 12h.

FIF012a is a data register that sequentially accumulates output data of the acceleration sensor unit 11, and outputs data in the order in which the data is satisfied and the force is accumulated. Since the human step speed is about one step per second, to calculate the step speed with sufficient accuracy, data of about 5 seconds should be stored in the FIF 012a. Since the sampling rate of the acceleration data is set to 100 Hz, the FIF012a has a size that can store data of about 500 samples in three directions.

[0057] The zero-cross determination unit 12b outputs a flag of "1" when the acceleration component in each direction of the acceleration data from the acceleration sensor unit 11 is equal to or greater than a predetermined threshold (zero-cross value). When the acceleration component in each direction is less than the threshold value, a flag of "0" is output. On the other hand, the zero-crossing determination unit 12c outputs a flag of “1” when the acceleration component in each direction of the acceleration data from the FIFO 12a is equal to or larger than the above threshold value, and the acceleration component in each direction described above is equal to the threshold value. Outputs a "0" flag when less than. The zero-cross determination units 12b and 12c are configured by, for example, comparators.

[0058] The zero-cross counter 12d counts the number of times that the acceleration data stored in the FIF012a changes (vibrates) with a certain amplitude or more. Specifically, the zero-cross counter 12d has a counter (not shown) for each one-direction component, and each counter counts by one when the flag of the corresponding direction component of the zero-cross determination unit 12b changes. Add. Also, Each counter of the zero-cross counter 12d subtracts 1 from the count value when the flag of the corresponding direction component of the zero-cross determination unit 12c changes, so that when all the data stored in the FIFO 12a is output, the counter of the zero-cross counter 12d is output. Output becomes 0. In other words, the operation in which the zero-cross counter 12d counts the change of the output flag of the zero-cross determining unit 12b while the acceleration data is accumulated in the FIFOl 2a is repeated. As described above, the output of the zero-cross counter 12d corresponds to the number of vibrations since the number of times of vibration with a certain amplitude or more during a period (cycle) of about 5 seconds corresponding to the capacity of the FIF012a. Therefore, a new frequency (walking speed) is output every cycle.

[0059] The average Z variance Z saturation calculator 12e calculates an average, a variance, and a saturation time that exceeds the measurement range with respect to data for a certain period of the acceleration data accumulated in the FIF012a. The average Z variance Z saturation calculator 12e is a functional block realized by software.

[0060] Increasing the period of time for a certain period may increase the accuracy of state determination, but reduce the response. On the other hand, shortening the period may decrease the accuracy of state determination, but improves the response. There is a trade-off. Since the human walking rhythm (walking cycle) is about 1 second, if the fixed period is set to about 1 second, the variance specific to walking can be calculated. In addition, since a vehicle may cause a change in acceleration of about 5 seconds, a certain period of time is preferably about 1 second in order to regard this change as a change in average value. Also, in order to find the average acceleration during walking, an average over a longer period of time is required compared to the walking rhythm. For these three reasons, in the present embodiment, the average (statistics) for one second and the average (statistics) for five seconds are calculated.

[0061] In the following, for each statistic, the former is distinguished as a short term and the latter as a long term.

When the output of the average Z variance Z saturation calculator 12e is also used for the user interface of the mobile phone 1, it is desirable to further calculate a statistical value of about 100 ms which is assumed from a human's sense of time.

[0062] The gravitational direction estimating unit 12f is a functional block realized by software for calculating (estimating) the gravitational direction based on the following method. Mean Z variance Z saturation calculator 1 2e The mean square (absolute value) of the short-term variance component, one of the outputs of the 2e, is a predetermined threshold If smaller, that is, if the fluctuation of the acceleration is small, it is considered that the mobile phone 1 is performing a substantially equal-acceleration motion. The gravity direction estimator 12f is smaller than the absolute value and the gravitational acceleration 9. value difference was previously constant because the 8m / s ² of the average, which is one of the outputs of the average Z variance Z saturation calculations unit 12e In that case, the acceleration is considered to be caused by gravity, and the value obtained by multiplying the average of acceleration by 1 is output as the direction of gravity. Thereby, the direction of gravity is detected based on the acceleration detection in three directions.

[0063] The gravity direction storage unit 12g is configured by a memory or the like, and stores the gravity direction output by the gravity direction estimation unit 12f. The gravitational direction stored in the gravitational direction storage unit 12g is read by the user state determination unit 12h as necessary.

[0064] The user state determination unit 12h is a functional block realized by software, and outputs the average, variance and saturation time output from the average Z variance Z saturation calculation unit 12e, and the gravity read from the gravity direction storage unit 12g. The user state is determined based on the direction value and the output of the zero-cross counter 12d. The judgment is made in more detail based on the following 24 parameters.

1.Short-term dispersion X component

2.short-term variance y component

3.Short-term variance z component

4.Long-term dispersion X component

5.Long-term variance y component

6.Long-term dispersion z component

7.Short-term average X component

8.Short-term average y component

9.Short-term average z component

10.Long term average X component

11.Long term average y component

12.Long term average z component

13. X component short-term saturation time

14. Short-term saturation time of y component 15. Short term z component saturation time

16. X component long-term saturation time

17.Y component long-term saturation time

18.Z component long-term saturation time

19.Gravity direction X component

20.gravity direction y component

21.gravity direction z component

22. Number of X-component zero crossings

23. Number of y-component zero crossings

24.Z component zero crossing number

Although various determination methods are conceivable, the present embodiment employs a state machine implemented by referring to a table. The outline is described below.

Assuming a 24-dimensional space with respect to the above 24 parameters, a 24-dimensional space is defined by preparing one or more thresholds for each parameter. The transition condition is that the output of each part 12d, 12e, 12f enters each section, and the stationary, walking (flat), walking (up), walking (down), running (flat), running (up), running (up) (Descent), car movement, train movement, elevator movement, and transition of state machine with 11 unknown states.

The details of the threshold value of each parameter and the details of transition are omitted.

[0068] An overview of the nature of the implemented state machine is described as follows.

(a) Stillness: Same as the gravity direction detection condition.

(b) Walking: The variance of a component having an acceleration is equal to or greater than a certain value, the number of zero crossings of the component is about 2 per second, and the saturation of the component is equal to or less than a certain value.

(c) Running: The variance of an acceleration component is equal to or greater than a certain value, the number of zero crossings of that component is about 2 per second, and the saturation of that component is equal to or greater than a certain value.

(d) Vehicle movement: acceleration perpendicular to the direction of gravity with low dispersion (high-frequency vibration).

(e) Train movement: Acceleration with low dispersion and perpendicular to the direction of gravity (low-frequency vibration).

(f) Elevator movement: acceleration with little dispersion and parallel to the direction of gravity. In the walking state and the running state, a long-term average value of the acceleration and the angle between the acceleration direction and the gravity direction are calculated, and upward, flat or downward is identified according to the angle. In addition, although it is possible to make the sections and states almost correspond to each other, since the movement of a car, the movement of a train, and the movement of an elevator all have an operation pattern of acceleration, stoppage, and deceleration, the state machine corresponds to these movement states. That is, this motion pattern is expressed.

As described above, the user state is realized by the average Z variance Z saturation calculator 12e, the gravitational direction estimator 12f, and the user state determiner 12h.

Further, a configuration for realizing the status display Z transmission function will be described. FIG. 5 shows a moving state monitoring system (information processing system) 100 including a configuration for realizing the status display Z transmission function and a configuration for realizing the reception function Z status display.

As shown in FIG. 5, moving state monitoring system 100 includes mobile phone 1 as a transmitter, terminal device 3 as a receiver, server 4, and communication network 5.

The mobile phone 1 further includes a display unit 101, a communication processing unit 102, and a state data processing unit 103. The terminal device 3 further includes a display unit 301, a communication processing unit 102, and a state data processing unit 103. Have.

[0074] The display unit 101 is provided to display various types of display information (character information, image information, and the like), and includes a display panel and a driving unit that drives the display panel. The display section 101 has a presence display section, and displays the current state of the user on this section. For example, by displaying the number of steps on the display unit 101, the mobile phone 1 can be used as a pedometer.

[0075] Communication processing section 102 performs various kinds of processing (modulation Z demodulation, packet conversion, and the like) necessary for communicating with another telephone or the like via communication network 5.

[0076] The state data processing unit 103 outputs the user state (stationary) output from the user state processing unit 14.

, Walking, running, car ride, train ride, elevator ride) and the user state processing unit output the number of steps output to the display unit 101.

The user state data output from the user state processing unit 14 is shown in FIG. As described above, the user state analyzing unit (moving state estimating means) 12 is data obtained by estimating the user state based on the output from the acceleration sensor unit (motion sensor unit) 11, This is input to the user state processing unit 14. The details of these components are the same as those of the mobile phone 1 shown in FIG. 1, and therefore description thereof is omitted here.

[0078] Further, state data processing section 103 performs connection processing to Sano to transmit user information (user state data and step count data) to server 4, and outputs transmission data to communication processing section 102. I do.

Further, in the mobile phone 1, when a transmission instruction is given in a mode in which the user information is displayed on another device, the state data processing unit 103 transmits the user's own device (mobile phone 1) to the data to be transmitted. Is added.

Further, in the terminal device 3, the status data processing unit 103 determines whether the user information transmitted from another device and received by the communication processing unit 102 is the user information of a pre-registered member. Judgment is made based on the user ID added to the received data, and the user information of the registered member is displayed on the display unit 301.

The state data processing unit 103 performs a process of adding data that prohibits transmission of each item of the user state and the number of steps to be transmitted to the server 4!, And a transmission instruction by a key operation of the user. When is input, user status data and step count data whose transmission is prohibited are not provided to the communication processing unit 102. Data for prohibiting transmission is input to the state data processing unit 103 by a user's key operation or the like. As a result, only the data permitted by the user is transmitted to the server 4, so that the data can not be transmitted as desired by the user and privacy can be considered.

The server 4 has a function as an instant message server, and stores user information data transmitted from the mobile phone 1. The terminal device 3 can download the user information from the server 4 via the communication network 5 if the destination of the user state is specified by the mail address. Therefore, the terminal device 3 can display the user information of the user of the mobile phone 1 on the display unit 301 of the terminal device 3.

[0083] In the above system, display unit 101, display unit 301, and status data processing unit 103 function as display means, and communication processing unit 102 and status data processing unit 103 function as senders. Functions as a stage or receiving means. Further, the information transmitted and received by the communication processing unit 102 may be both the number of steps and the user state, or may be either V or a deviation.

[0084] Further, terminal device 3 as a receiver is not limited to a fixed terminal device, and may be a portable information processing terminal device like mobile phone 1.

[0085] In the present embodiment, the mean Z variance Z saturation calculation unit 12e, the gravitational direction estimation unit 12f, the user state determination unit 12h, the user state processing unit 14, the device state management unit 15, the clock unit 16, and the state data processing unit 103, a predetermined program stored in storage means such as ROM (Read Only Memory) or RAM is executed by an arithmetic processing device such as a microprocessor, and input means such as keys, output means such as a display, or It is realized by controlling communication means such as an interface circuit. Therefore, the functions of the above-described units can be realized only by reading the recording medium on which the program is recorded by a computer device having these means and executing the program.

[0086] As the recording medium, a memory (not shown) for performing processing by a microcomputer, such as a ROM, may be a program medium, or V (not shown) may be an external storage device. It may be a program medium provided with a program reading device and readable by inserting a recording medium therein.

In any case, it is preferable that the stored program has a configuration in which the microprocessor accesses and executes the program. Further, it is preferable that the program is read, and the read program is downloaded to a program storage area of a microcomputer and the program is executed. It is assumed that this download program is stored in the main unit in advance.

The program medium is a recording medium configured to be separable from the main body, such as a tape system such as a magnetic tape or a cassette tape, a magnetic disk such as a flexible disk or a hard disk, or a disk such as a CDZMOZMDZDVD. Disk system, card system such as ic card (including memory card), or fixed including semiconductor memory such as mask ROM, EPROM (Erasable Programmable Read Only Memory), EEPROM (Electrically Erasable Programmable Read Only Memory), flash ROM, etc. There is a recording medium that carries the program. [0089] Further, if the system configuration is such that a communication network including the Internet can be connected, it is preferable that the recording medium be a recording medium that carries a program in a fluid manner so as to download the program.

Further, in the case where the communication network power also downloads a program as described above, it is preferable that the download program be stored in the main device in advance, or that another recording medium power be installed. .

[0091] Here, the operation of detecting the user state in the mobile phone 1 configured as described above will be described.

First, when the user is in a walking or running state, the acceleration sensor unit 11 detects an acceleration having a magnitude corresponding to the pace and outputs the acceleration as acceleration data. The user state analysis unit 12 obtains a vibration frequency (step speed) and a user state (walking state or running state) based on the acceleration data. In addition, when the user is stationary, no acceleration is detected, so that almost zero acceleration data is output. Therefore, the step speed is also zero. The data from the user state analysis unit 12 is latched by the latch unit 13 and provided to the user state processing unit 14.

[0093] At the time of walking or running, the user state determination unit 12h calculates flatness, ascending or descending according to the angle between the long-term average value of the acceleration and the direction of gravity. By taking this information into account as the user status, the status of walking (flat), walking (up), walking (up), running (flat), running (up) or running (down) can be obtained. .

[0094] The user state processing unit 14 calculates the number of steps by integrating the step speed data output from the latch. When the user state changes to another state force, the walking state or the running state force, the user state processing unit 14 stores the data in the walking state or the running state together with the time at that time in the life rhythm storage unit 17. It is memorized. As a result, the user state and the time when the user state has changed are stored, so that the change pattern of the user state can be confirmed.

[0095] When the user is moving by car or train, the acceleration sensor unit 11 detects mainly acceleration perpendicular to gravity and outputs the acceleration as acceleration data. User state solution The analysis unit 12 determines a user state (car moving state or train moving state) based on the acceleration data. Also, at this time, since there is no zero-cross point of the caro speed as in the case of walking or running, the step speed cannot be obtained. The user state data thus obtained is latched by the latch unit 13 and provided to the user state processing unit 14, as in the case of walking or running.

[0096] When the user state changes to another state force, the vehicle movement state or the train movement state force, the user state processing unit 14 outputs the data of the car movement state or the train movement state together with the time at that time. It is stored in the storage unit 17. As a result, the user state and the time when the user state has changed are stored, so that the pattern of the change in the user state can be confirmed.

[0097] Regardless of which state is detected, when the output data at a specific time (latch time) from the user state analysis unit 12 is latched, the time data and the output data provided from the device state management unit 15 are latched. At the same time, it is latched by the latch section 13.

[0098] The longer the latched state of the data latched by the latch unit 13 is, the more likely it is that the data is different from the current state. For this reason, the user state processing unit 14 confirms the latch time output by the latch unit 13 and changes the processing operation after a lapse of a predetermined time according to the reliability. For example, in the case of the pedometer function, it is unlikely that the user will continue walking at the same speed for more than 10 minutes after the mobile phone 1 is used. Therefore, when the state machine 15a confirms the state transition to the use state of the mobile phone 1 by the state machine 15a, the user state processing unit 14 stops integrating the step speed after 10 minutes from the detection. As a result, the user state processing unit 14 does not output the number of steps with reduced reliability.

[0099] When the state machine 15a confirms the transition to the "mail arrival notification", "calling", "manner on", and "in use" states, the control of the control unit 15b causes the user state analysis unit 12 Is latched by the latch unit 13 and the operation of the user state analysis unit 12 stops. If the acceleration sensor unit 11 is operating at this time, the operation is also stopped by the control of the device state management unit 15.

[0100] As described above, when the mobile phone 1 transitions to the above state, the operations of the acceleration sensor unit 11 and the user state analysis unit 12 are stopped, and the vibration motor for the manner mode is used. There is no inconvenience that the user state processing unit 14 malfunctions due to vibrations or user key input operation. In addition, since the number of steps and the user state before that are held by the latch unit 13, the continuity of the processing by the user state processing unit 14 can be maintained without the output of the user state being interrupted.

[0101] For example, when the user starts operating the mobile phone 1 to receive a user call while driving, the acceleration sensor 11a outputs the acceleration and vibration due to the user's operation of the mobile phone 1 along with the acceleration and vibration inherent during driving. Since vibration is detected, the state of the user cannot be accurately detected. At this time, since the latch unit 13 does not hold new data while holding the previous user state, the user state processing unit 14 based on erroneous data generated by the operation of the mobile phone 1 Can be prevented from malfunctioning.

As described above, in the present mobile phone 1, the latch unit 13 is provided between the user state analysis unit 12 and the user state processing unit 14, and the device state management unit 15 controls the acceleration sensor unit 11 and the user. The state analysis unit 12 and the latch unit 13 are controlled according to the state of the mobile phone 1. As a result, when the acceleration sensor unit 11 and the user state analysis unit 12 are stopped, the latch unit 13 retains the data acquired earlier, so that the latch unit 13 does not retain erroneous data. As a result, malfunction of the four functions can be prevented.

The number of steps and the user status output from the user status processing unit 14 are displayed on the display unit 101 by the status data processing unit 103 and transmitted to the other specified terminal device 3. Thereby, the user of the mobile phone 1 can check the determined number of steps and the user state on the display unit 101, and the user of the terminal device 3 can also determine the number of steps determined by the user of the mobile phone 1. And the user state can be confirmed on the display unit 301. Therefore, for example, a medical institution can grasp the user status in order to check the health status of the user of the mobile phone 1.

[Embodiment 2]

FIG. 6 shows a configuration of a main part of the mobile phone 2 according to the present embodiment.

This mobile phone 2 has (1) an activity meter function and (2) a user interface function. The activity meter function measures the user's activity for a predetermined period (for example, 24 hours) by analyzing the output of the acceleration sensor with various parameters. User The interface function is a function of determining a specific operation (gesture) of the user with respect to the mobile phone 2 and performing control according to the operation. For example, as a user interface function, a function of responding as an answering machine by tapping the mobile phone 2 lightly upon receiving a call is provided. The present embodiment may have other functions that are not limited to the above functions. Hereinafter, the configuration of the mobile phone 2 will be described.

[0106] The mobile phone 2 as the mobile information processing apparatus has not only a telephone function but also an e-mail transmission / reception function like the mobile phone 1, and further executes various application programs, It has a computer function to realize an interface. Further, the mobile phone 2 includes an acceleration sensor unit 21, an activity calculation unit 22, a gesture determination unit 23, and a device state management unit 24 in order to realize the above-described activity meter function and user interface function. .

The acceleration sensor unit 21 includes an acceleration sensor 21a, a variable low-pass filter (VLPF in the figure) 21b, and an analog-digital conversion (AZD in the figure) 21c.

[0108] In the present embodiment, the acceleration sensor 21a as a motion sensor is a sensor whose frequency response is up to about 50 Hz, like the acceleration sensor 11a of the first embodiment. The acceleration sensor 21a may be of a type that detects acceleration of the user in one axis direction (z-axis direction), and may be of a type that can detect acceleration in three axis directions.

[0109] The variable low-pass filter 21b switches the cutoff frequency under the control of the device state management unit 24 described later, and removes the high-frequency component of the analog output of the acceleration sensor 21a. Specifically, the variable low-noise filter 21b removes a component of about 5 Hz or more when operating the activity meter function, and removes a component of about 50 Hz or more when operating the user interface function.

[0110] The analog-to-digital converter (hereinafter referred to as AZD converter) 21c samples the output of the variable low-pass filter 21b at a variable sampling rate (sampling frequency), and converts it into digital data according to the Nyquist sampling theorem. This AZD variable 21c performs 10Hz sampling when operating the activity meter function, and performs 100Hz sampling when operating the user interface function.

[0111] The activity calculation unit 22 is configured to determine the user's activity based on the acceleration data from the acceleration sensor unit 21. It is a functional block implemented by software to calculate the activity. The activity calculating section 22 calculates a motion frequency, a motion period, a motion intensity, and the like as the activity calculation. The activity calculating unit 22 detects a zero-crossing point where the acceleration crosses the zero level as a measurement of the motion frequency, and counts up 〃1 ”for each detection.

Also, the average operating frequency is calculated for the number of zero-cross points within a predetermined time. In addition, the activity calculation unit 22 counts up 〃1 ”every predetermined time (for example, 0.1 second) while the acceleration exceeds a predetermined threshold as a measurement of a specific activity pattern, The time during which the acceleration exceeds a predetermined threshold value is measured based on the counted number, and the threshold value is set to a predetermined level for determining that a human is moving. As a measure of the strength, the motion strength is calculated by adding (integrating) the amount by which the detected value (voltage) of the acceleration is displaced from the OV every predetermined time (for example, 0.1 second).

[0112] In the activity calculating section 22, a portion for detecting a zero-cross point and performing a count process may be constituted by a logic circuit.

[0113] Such an activity calculation unit 22 may be realized by, for example, an actigraph of Ambulatory monitoring, which is approved by the Food and Drug Association (FDA). Since such an activity analysis focuses on the low-frequency component of the acceleration sensor 21a, when the acceleration sensor 21a is used for an activity meter, the variable low-pass filter 21b and the filter characteristic are set to 5 Hz. At the same time, set the sampling rate of AZD conversion 21c to 10Hz. These switching operations are performed by a device state management unit 24 described later.

[0114] The gesture determination unit 23 processes the acceleration data from the acceleration sensor unit 21 according to an algorithm described later, thereby recognizing a specific gesture performed by the user and outputting a command corresponding to the recognition. The gesture determination unit 23 is a functional block realized by software.

[0115] In the present embodiment, as an example of a gesture, it is assumed that, when an incoming call is received, if the mobile phone 2 is lightly tapped without taking out the mobile phone 2 in the pocket, the call is answered as an answering machine. If the mobile phone 1 is lightly tapped by the user when receiving an incoming call, the gesture determination unit 23 recognizes the gesture and outputs a command for instructing a transition to an answering machine call. Note that, of course, the gesture is not limited to the above example. FIG. 7 is a diagram showing the foldable mobile phone 2 in a folded state and the z-axis direction. FIG. 8 is a waveform diagram showing the output of the acceleration sensor 21a in the z-axis direction with respect to the operation of tapping the mobile phone 2 lightly. In the example shown in FIG. 8, a large change in acceleration occurs during the periods Tl and T2, indicating that the mobile phone 2 has been hit twice.

[0117] When tapping lightly, the mobile phone 2 is almost certainly hit on a wide surface, so in this embodiment, as shown in FIG. Only the acceleration in the z-axis direction perpendicular to the flat surface 2a is targeted for impact analysis. Since the impact of tapping causes a large acceleration to occur instantaneously at a constant interval, it is necessary to detect the high frequency component of the acceleration sensor 21a. Therefore, when using the acceleration sensor 21a for the user interface, the filter characteristic of the variable low-noise filter 21b is set to 50 Hz. AZD Transformation 21c sets the sampling rate to 100Hz. These switching are performed by the device state management unit 24 described later.

[0118] The algorithm used by the gesture determination unit 23 for determining the user's gesture is described below. This algorithm uses a plurality of thresholds (A, B) in the output waveform of the acceleration sensor 21a shown in FIG. These thresholds are determined based on the average impact of a mobile phone 2 being tapped lightly while in the pocket! RU

1. Detect acceleration equal to or greater than a predetermined magnitude A with respect to a reference level L during a predetermined period T1 (instantaneousness).

2. After detecting the acceleration, the variance of the acceleration is obtained in a predetermined period T2, and it is recognized that the value is within a predetermined value B (silence).

3. The acceleration of magnitude A or more is detected again in the predetermined period T3.

4. After detecting the above acceleration, it is recognized that the variance of the acceleration is within the predetermined value B in the predetermined period T4.

[0119] Furthermore, when the acceleration sensor 21a is of a type capable of detecting acceleration in the three-axis direction, the variance of the acceleration in the X-axis direction and the acceleration in the _y- axis method is within a certain range during execution of the above algorithm. , The probability of malfunction can be reduced.

[0120] The device state management unit 24 includes a state machine 24a and a state machine 24a in order to control the acceleration sensor unit 21, the activity calculation unit 22 and the gesture determination unit 23 according to the usage state of the mobile phone 2. And a control unit 24b. The state machine 24a and the control unit 24b are functional blocks realized by software.

[0121] FIGS. 9A and 9B are state transition diagrams of the state machine 24a. The call-related state transition diagram shown in FIG. 9 (a) is a simplified illustration of the transition of the general mobile phone also shown in FIG. 2 (a) regarding calling, receiving, and receiving mail. FIG. 9B shows a state transition of the manner mode in which the incoming call shown in FIG. 2B is performed by vibration. The state machine 24a as the use state detecting means manages the entire state of the mobile phone 2, and its function is equivalent to that of the above-described state machine 15a. Therefore, the description is omitted here.

[0122] The control unit 24b as control means is a mobile phone recognized by the state machine 24a.

The operations of the acceleration sensor unit 21, the activity calculation unit 22, and the gesture determination unit 23 are controlled according to the state transition of 2. The control unit 24b performs control according to the processing procedure of the flowchart shown in FIG. 10, as described below.

[0123] First, it is determined whether or not the state has changed (S21). If the state has changed, it is further determined whether the communication-related state is "mail arrival notification" or "calling". (S22). If it is determined that this is the case (YES in S22), since the gesture determination unit 23 only needs to function when an incoming call is received, the activity calculation unit 22 is stopped (S23). At this time, if the manner mode is “manner off” (S24), the filter characteristic of the variable low-pass filter 21b is set to 50 Hz (high frequency) (S25), and the sampling rate of the AZD translator 21c is set to 10 OHz. Is set (S26). Then, the gesture determination unit 23 is operated (S27), and the process returns to S21.

When the state managed by the state machine 24a transits to a state other than the above-mentioned state, that is, when the communication-related state transits to a state other than “mail arrival notification” or {ringing} in S22 (in S22 NO), the acceleration sensor 21a functions as a motion sensor for measuring the activity. In this state, the gesture determination unit 23 is stopped (S28). Then, the filter characteristic of the variable low-pass filter 21b is set to 5 Hz (low frequency) (S29), and the sampling rate of the AZD converter 21c is set to 10 Hz (S30). Further, the activity calculating section 22 is operated (S31), and the process returns to S21.

In the present embodiment, the activity calculation unit 22, the gesture determination unit 23, and the device status The processing unit 24 executes a predetermined program by an arithmetic processing device such as a microprocessor, similar to the above-described user state processing unit 14 and the like. Therefore, the function of each unit described above can be realized only by reading the recording medium on which the program is recorded by the mobile phone 1 and executing the program.

Next, the operation of the activity meter function and the user interface function in the mobile phone 2 shown in FIG. 6 configured as described above will be described with reference to the transition diagram of FIG.

[0127] First, if the state of the mobile phone 2 is not in the "mail arrival notification" or "calling", the activity meter function by the activity calculator 22 operates. The cutoff frequency of the variable low-pass filter 21b in the speed sensor unit 21 is switched to 5 Hz, and the sampling rate of the AZD converter 24c is switched to 10 Hz. The acceleration data of the low-frequency component suitable for the measurement of the degree is obtained, and the activity calculating unit 22 performs a process for calculating the activity based on the acceleration data obtained by this.

On the other hand, if the state of the mobile phone 2 changes to “mail arrival notification” and “ringing”, the user interface function operates. At this time, the variable of the acceleration sensor section 21 is controlled by the control section 24b. The cutoff frequency of the low-pass filter 21b is switched to 50 Hz, and the sampling rate of the AZD converter 24c is switched to 100 Hz. An impact due to the operation is detected as a change in acceleration by the acceleration sensor unit 21. By setting the sensitivity of the acceleration sensor 21a as described above, acceleration data of a high-frequency component suitable for determination of a gesture is obtained. The acceleration sensor 21a functions as an impact detector for detecting a gesture in which the user taps the mobile phone 2 lightly.

[0129] The gesture determination unit 23 performs processing for determining the gesture based on the acceleration data obtained as a result. When the gesture determination unit 23 determines that the user has performed an operation of tapping the mobile phone 2 by such processing, the gesture determination unit 23 outputs a command to shift to answering machine response or mail download. In response to this command, the mobile phone 2 starts a call using the answering machine function or starts downloading mail. Start.

[0130] Thereby, the user of mobile phone 2 can respond to an incoming call without requiring key operation or the like to answer a normal incoming call. In particular, if the user has forgotten the manner mode setting (manner on) and the ring tone sounds in a situation such as during a meeting where he / she cannot answer the incoming call, tapping lightly without taking out the mobile phone 2 will enable the answering machine. Can transition to telephone answering. Therefore, it is possible to provide a user interface for operating the mobile phone 2 with a simple operation by using the output of the acceleration sensor unit 21 to tap the mobile phone 2 lightly.

When the communication-related state is “mail arrival notification” or “calling”, if the manner mode is set, the acceleration data includes an error due to the vibration. However, at this time, since the activity calculation unit 22 is stopped under the control of the control unit 24b, a malfunction does not occur due to an error in the acceleration data. On the other hand, when the communication-related state is other than "mail notification" or "ringing", the gesture determination unit 23 is stopped by the control of the control unit 24b, so that the user accidentally The tapping action does not cause a malfunction such as outputting an answering machine response or mail download command.

As described above, in the present mobile phone 2, in order to realize the two functions as described above, according to the state of the mobile phone 2 grasped by the state machine 24a, the acceleration of the acceleration is controlled by the control unit 24b. The sensor unit 21, the activity calculation unit 22, and the gesture determination unit 23 are controlled. Thereby, the filter characteristics and the sampling rate in the acceleration sensor unit 21 are switched, and one of the activity calculation unit 22 and the gesture determination unit 23 operates. Therefore, it is possible to avoid malfunction of one of the activity calculation unit 22 and the gesture determination unit 23 that occurs when one of the two is operating. Further, it is possible to reduce the power consumption of the mobile phone 2 having a plurality of functions using the acceleration. In addition, when the mobile phone 2 is operated as an activity meter, power consumption can be reduced by lowering the sampling rate of the AZD converter 21c.

In the first and second embodiments, examples in which the present invention is applied to the mobile phones 1 and 2 as the mobile information processing devices have been described. The present invention is a mobile phone 1 However, the present invention can be applied to portable information processing devices such as PDA (Personal Digital Asistants), wearable information terminals, and dedicated data loggers (human activity pattern loggers). Further, in the first and second embodiments, examples in which the acceleration sensors 11a and 21a are employed as motion sensors have been described. As long as the motion sensor is capable of detecting the motion of a human or the motion of a vehicle, an angular velocity sensor, a piezoelectric sensor, or the like may be used.

[0134] Further, the first and second embodiments may be appropriately combined so that one mobile phone has the functions of the mobile phones 1 and 2. This configuration includes an acceleration sensor unit 21, a user state analysis unit 12, a latch unit 13, a user state processing unit 14, a clock unit 16, an activity calculation unit 22, and a gesture determination unit 23, as well as a device state management unit 15, Equipped with a new device status management unit that combines 24 functions. The mobile phone configured in this way has multiple functions using the acceleration sensor 21a, namely, a pedometer function, a vehicle detection function, a life rhythm recording function, a detailed presence display Z communication function, an activity meter function, and a user interface. It will have functions.

[0135] The portable information processing apparatus according to the present invention is a portable telephone having a vibration notification function of notifying an incoming call by vibration. In this portable information processing apparatus, the use state detecting means (state machines 15a and 24a) includes: The state in which the vibration notification function is operating is detected as a use state, and when the vibration notification function is detected, the control means (control units 15b, 24b) detects the motion sensor units (the acceleration sensor units 11, 21) and It is preferable to stop at least one of the processing means (user state analysis unit 12).

[0136] In such a configuration, the use state detecting means also detects the state in which the vibration notification function is operating as the use state, so that the control means can control the motion sensor unit and the Stop at least one of the processing means.

Thus, it is possible to prevent an error from being included in the processing result of the processing unit due to the vibration of the portable information processing apparatus at the time of an incoming call. That is, when there is an incoming call, the force of notifying the user of the incoming call due to vibration can be prevented from being included in the output of the motion sensor unit as an error. As a result, in addition to the functions of a normal mobile phone without the need to provide a complicated configuration, multiple functions using the output of the motion sensor unit are provided. This can be realized without malfunction.

[0138] The portable information processing apparatus further includes a holding unit (latch unit 13) for holding an output of the processing unit. When the control unit detects a use state, the output of the processing unit is further output. It is preferable to control the holding means so as to hold the output immediately before the interruption.

In such a configuration, the holding unit holds the output immediately before the output of the processing unit is stopped under the control of the control unit, so that the output of the processing unit is maintained even if the use state is no longer detected. You. Thereby, continuity of data can be maintained.

[0140] Further, the portable information processing apparatus includes post-processing means (user state processing unit 14) for performing predetermined processing based on the output of the processing means held by the holding means. It is preferable that the processor holds the output of the processing means together with the time at which the output is held, and changes the processing when a predetermined time elapses from the time at which the post-processing means is held by the holding means.

When further processing is required for the processing result obtained by the processing means, the processing is performed by the post-processing means. However, as described above, when the output of the processing unit is interrupted and the output immediately before is held by the holding unit, the longer the holding time, the more the output of the processing unit may be different from the current state. Higher, and the reliability of the held output decreases. For this reason, there is an inconvenience that the reliability of the result of processing by the post-processing means is reduced.

[0142] Therefore, it is possible to avoid the inconvenience that the reliability of the processing result is reduced by the post-processing means changing (for example, stopping) the processing based on such an output.

[0143] Preferably, the processing means calculates a step speed of the user based on the output of the motion sensor unit, and the post-processing means calculates the number of steps based on the step speed. In such a configuration, the number of steps can be obtained by the processing of the processing means and the post-processing means, so that the portable information processing device can be used as a pedometer.

[0144] Further, it is preferable that the processing unit estimates a moving state of the user based on an output of the motion sensor unit. In such a configuration, the moving state of the user is estimated by the processing means based on the output of the motion sensor unit reflecting the movement of the user. Examples of the moving state include stationary, walking, running, and moving a vehicle. Walking and In running, vibration occurs at a substantially constant frequency, and these states can be estimated by analyzing the vibration. In addition, when the user is moving by a vehicle, such vibrations are not so likely. The movement state can be estimated mainly by analyzing and processing a change in acceleration specific to the vehicle (car, train, etc.). it can. By estimating the moving state of the user as described above, the user's behavior pattern can be recorded.

[0145] Further, the motion sensor unit is an acceleration sensor unit that can measure acceleration in three axial directions, and the processing unit detects gravity in a gravity direction based on acceleration detected in three axial directions from the acceleration sensor unit. It is preferable to have direction detecting means. Regardless of the posture of the portable information processing device, the direction of gravity is detected by the processing means based on the acceleration in three directions detected by the acceleration sensor unit. Therefore, based on the direction of gravity, it is possible to obtain not only information about the user's movement but also information about the moving direction (up, flat, and down).

[0146] Further, the gravitational direction detecting means includes a calculating unit (mean Z variance Z saturation calculating unit 12e) for calculating an average and a variance of the acceleration for a certain time, and an absolute value of the variance being equal to or less than a predetermined value. A gravitational direction determining unit (gravity direction estimating unit 12f) that determines whether or not there is a force and a difference between the average absolute value and the gravitational acceleration is equal to or less than a predetermined value; The absolute value of the acceleration is equal to or less than a predetermined value, and the difference between the average absolute value and the gravitational acceleration is stored in the gravity direction storage unit that stores the average value of the acceleration determined to be equal to or less than the predetermined value. It is preferable to have a gravitational direction storage unit 12g).

[0147] With such a configuration, when the absolute value of the variance is smaller than a predetermined value, that is, when the fluctuation of the acceleration is small, it is considered that the portable information processing device performs a uniform acceleration motion. . Therefore, when the gravitational direction determining unit determines that the absolute value of the variance is equal to or less than a predetermined value and the difference between the average absolute value and the gravitational acceleration is equal to or less than a predetermined value, the acceleration is determined. Can be estimated to be due to gravity. By storing the acceleration caused by gravity in the gravity direction storage unit, the acceleration can be used for analyzing the moving state caused by gravity.

[0148] The portable information processing device may display the moving state of the user obtained by the processing means. It is preferable to include a transmission unit (communication processing unit 102, status data processing unit 103) for transmitting to the outside. In such a configuration, the moving state of the user is transmitted to the outside, so that the moving state of the user can be confirmed by the designated destination device.

[0149] Further, it is preferable that the portable information processing device includes display means (display unit 101, state data processing unit 103) for displaying a user's movement state obtained by the processing unit. In such a configuration, since the moving state of the user is displayed, the user can confirm the moving state as the analysis result on the portable information processing device.

[0150] Further, the portable information processing device is provided with a receiving unit (communication processing unit 102, state data processing unit 103) for receiving a moving state of another user transmitted from another portable information processing device, and Display means (display section 301, state data processing section 103) for displaying the information. With such a configuration, the user of the portable information processing device can receive and view the movement state of another user with the portable information processing device.

[0151] The mobile information processing apparatus is a mobile phone, and outputs an instruction to respond to the incoming call when a specific operation by the user on the mobile phone is detected based on the output of the motion sensor unit at the time of the incoming call. Response control means (gesture determination unit 23), wherein the use state detection means detects an incoming call as a use state, and the control means operates the response control means at the time of an incoming call, and the response control means other than at the time of an incoming call. It is preferable to stop the control means.

In such a configuration, for example, when the user performs a specific operation on the mobile phone at the time of an incoming call, the operation appears in the output of the motion sensor unit. A specific operation is, for example, an operation in which the user taps the body of the mobile phone. When the response control means detects the operation based on the output of the motion sensor unit, the response control means outputs an instruction for responding to the incoming call. As a result, the mobile phone can respond to an incoming call without requiring a key operation or the like for answering a normal incoming call.

[0153] Further, since the incoming call is detected as the use state by the use state detecting means, the processing means (activity calculation unit 22) is stopped by the control means when the incoming call is received. As a result, even if the vibration generated by the user performing an operation for answering the incoming call to the mobile phone at the time of the incoming call appears in the output of the motion sensor unit, an error due to the vibration is output from the processing unit. Can be prevented. Also, when there is no incoming call, the response control means is not required, so that it is stopped and the processing means is operated, so that power consumption can be reduced.

[0154] In the portable information processing apparatus as the portable telephone, it is preferable that the response control means outputs an answering machine answer as an instruction for answering an incoming call. Thus, for example, when the user cannot answer the telephone, the user performs the above-described specific operation on the mobile phone, and the response control means outputs an instruction for answering the answering machine. Answer the answering machine as instructed. Therefore, even if the mobile phone rings when the telephone cannot be answered, it is possible to answer with an answering machine that does not have to wait for switching to answering machine after a predetermined time.

[0155] Further, the motion sensor unit passes a low-frequency component in the output of the motion sensor, a low-pass filter whose cutoff frequency can be changed, and converts the output of the low-pass filter into digital. An analog-to-digital converter that converts the cutoff frequency of the low-pass filter and the frequency of a sampling clock supplied to the analog-to-digital converter when the response control unit operates and the processing. It is preferable to change the time when the means is operated.

[0156] Note that the physical quantity to be analyzed for the output of the motion sensor unit, for example, the magnitude of acceleration and the frequency band are different. The frequency band of the acceleration when the operation to be analyzed is performed is as follows, for example, assuming that a person carries the device.

• Gravity detection: 1Hz or less

• Activity: 10Hz or less

'Walking Z running: l ~ 2Hz around

• Vehicle riding: 20Hz or less

• Gesture operation: 50Hz or less

[0157] As described above, when detecting acceleration having different frequency bands, it is desirable to switch the frequency band of the sensor output (acceleration, etc.) to be analyzed according to the purpose of using the sensor output. For this reason, the cutoff frequency of the low-pass filter and the analog / digital conversion The frequency band of the sensor output can be switched by changing the frequency of the sampling clock supplied to the controller between the time when the response control means is operated and the time when the processing means is operated.

The specific embodiments or examples made in the section of the best mode for carrying out the invention clarify the technical contents of the present invention to the last, and Various modifications can be made within the spirit of the present invention, which should not be construed in a narrow sense, and is limited only to the examples, and the scope of the claims described below.

Industrial potential

[0159] The portable information processing device of the present invention, when detecting the state of use of the portable information processing device by the user, stops the processing means for performing a predetermined process on the output of the motion sensor unit, thereby allowing the user to perform the portable information processing device. Errors due to vibrations and the like while using the device are not included in the output of the processing means. Therefore, by using the motion sensor for functions to achieve multiple purposes, it is possible to realize an easy-to-use user interface, pedometer, life rhythm recording, etc., and to accurately operate each function. It has an effect.

[0160] Therefore, the portable information processing apparatus of the present invention can realize a plurality of functions using the detection output of the motion sensor without causing a malfunction, and thus detects the activity state of the user with a mobile phone or the like. Applicable to application.

Claims

The scope of the claims

[1] a motion sensor section,

Processing means for performing predetermined processing on the output of the motion sensor unit;

A use state detection unit for detecting a use state of the portable information processing apparatus by a user, and when the use state is detected, at least one of the motion sensor unit and the processing unit

A portable information processing device comprising: a control unit for stopping one of the devices.

[2] The mobile information processing device is a mobile phone having a vibration notification function of notifying an incoming call by vibration.

The use state detecting means detects a state in which the vibration notification function is operating as a use state,

2. The portable information processing apparatus according to claim 1, wherein the control unit stops at least one of the motion sensor unit and the processing unit when the vibration notification function is detected.

[3] a holding unit for holding an output of the processing unit,

The portable information processing apparatus according to claim 1, wherein, when a use state is detected, the control means controls the holding means so as to further hold an output immediately before the output of the processing means is interrupted. apparatus.

[4] Post-processing means for performing a predetermined process based on the output of the processing means held by the holding means,

The holding unit holds an output of the processing unit together with a time at which the output is held,

4. The portable information processing apparatus according to claim 3, wherein the post-processing means changes the processing when a predetermined time has elapsed from the time held by the holding means.

[5] The processing means calculates a step speed of the user based on an output of the motion sensor unit,

The portable information processing apparatus according to claim 4, wherein the post-processing unit calculates the number of steps based on the number of steps.

[6] The processing means detects a moving state of the user based on an output of the motion sensor unit. 2. The portable information processing device according to claim 1, wherein the estimation is performed.

[7] The motion sensor unit is an acceleration sensor unit capable of measuring acceleration in three axial directions. The processing unit detects the direction of gravity based on the detected acceleration in three axial directions from the acceleration sensor unit. 2. The portable information processing device according to claim 1, further comprising a direction detecting unit.

[8] The gravity direction detecting means,

An arithmetic unit that calculates an average and a variance of acceleration for a certain time;

A gravitational direction determining unit for determining whether or not a force whose absolute value of the variance is equal to or less than a predetermined value and whose difference between the average absolute value and the gravitational acceleration is equal to or less than a predetermined value; The direction determination unit calculates an average value of the accelerations, which is determined that the absolute value of the variance is equal to or less than a predetermined value and the difference between the average absolute value and the gravitational acceleration is equal to or less than the predetermined value. 8. The portable information processing device according to claim 7, further comprising a gravitational direction storage unit for storing.

[9] The portable information processing apparatus according to claim 6, further comprising a transmitting unit configured to transmit a moving state of the user obtained by the processing unit to the outside.

10. The portable information processing apparatus according to claim 6, further comprising a display unit that displays a user's moving state obtained by the processing unit.

[11] receiving means for receiving a moving state of another user transmitted from another portable information processing device;

7. The portable information processing apparatus according to claim 6, further comprising a display unit for displaying the received information.

[12] motion sensor section,

A portable information processing apparatus comprising: a use state detection unit that detects a use state of a portable information processing apparatus by a user; and a control unit that stops the processing unit when the use state is detected.

[13] The mobile information processing device is a mobile phone,

Response control means for outputting an instruction for responding to the incoming call when the user detects a specific operation on the mobile phone based on the output of the motion sensor unit at the time of the incoming call,

The use state detection means detects an incoming call as a use state,

13. The portable information processing apparatus according to claim 12, wherein the control unit operates the response control unit when an incoming call is received, and stops the response control unit except when an incoming call is received.

14. The portable information processing apparatus according to claim 13, wherein the response control means outputs an answering machine answer as an instruction for answering an incoming call.

[15] The motion sensor unit includes:

A motion sensor,

A low-pass filter that allows a low-frequency component in the output of the motion sensor to pass and a cutoff frequency to be changed;

Analog-to-digital conversion for converting the output of the low-pass filter to digital,

The control means changes a cutoff frequency of the low-pass filter and a frequency of a sampling clock supplied to the analog / digital conversion between when the response control means is operated and when the processing means is operated. 15. The portable information processing apparatus according to claim 13 or 14, wherein:

[16] In an information processing system including a portable information processing device that transmits information via a communication network and a terminal device that receives information from the portable information processing device,

The portable information processing device,

A motion sensor unit,

Moving state estimating means for estimating the moving state of the user based on the output of the motion sensor unit;

A use state detecting means for detecting a use state of the portable information processing apparatus by the user; and a use state detection means for detecting the use state of the portable information processing apparatus. Control means for stopping at least one;

Transmitting means for transmitting the user's moving state obtained by the moving state estimating means to the outside,

The terminal device,

An information processing system, comprising: receiving means for receiving a moving state of a user transmitted from the portable information processing device; and displaying means for displaying the received moving state of the user.

[17] In a control method of a portable portable information processing device capable of realizing a plurality of functions,

A first step of detecting movement of the device body and outputting information of the movement,

A second step of performing a predetermined process on the output motion information,

A third step of detecting a use state of the portable information processing apparatus by the user; and a fourth step of controlling so that at least one of the first step and the second step is not performed when the use state is detected. The control method of the portable information processing device included.

[18] A portable information processing device control program for controlling a portable information processing device capable of realizing a plurality of functions!

A first procedure of detecting movement of the portable information processing device and outputting movement information, and a second procedure of performing predetermined processing on the outputted movement information,

A third procedure for detecting the usage state of the portable information processing device by the user,

And a fourth step of controlling at least one of the first procedure and the second procedure not to be executed when the use state is detected.

[19] A computer-readable recording medium recording a control program of the portable information processing device according to claim 18.