JP6459834B2 - Electronic device and status notification program - Google Patents

Description

  The present invention relates to an electronic device and a status notification program.

  In recent years, various sensors are mounted on a device such as a mobile phone, a smartphone, a tablet terminal, or a wearable terminal, and it is possible to determine a state where the device is placed using a detection value of the sensor. For example, the movement state is discriminated using the detection value of the sensor. The moving state may be, for example, a moving state in which the device is placed, such as a state of riding a train, a state of riding a car, a state of riding a bicycle, a state of walking, and a stationary state. State may be included. Note that the state of movement in which the device is placed may correspond to the state of movement of the user holding the device, for example. For example, information on the determined movement state is used in an application for recording a life log for looking back on daily life, an application for health support, or the like. In addition, for example, applications that distribute information and advertisements suitable for the current state in which the device is placed have been developed.

  In this regard, a technique for accurately recognizing each action of a user is known (for example, see Patent Document 1). In addition, a technique for acquiring various detailed information by specifying the behavior of a person who carries it is known (for example, see Patent Document 2). A technique for knowing the current state of a communication partner user and performing processing according to the state is known (see, for example, Patent Document 3). Techniques for determining whether a user is moving in a car or in a train are more easily known (see, for example, Patent Document 4).

JP 2014-56585 A JP-A-10-24026 JP 2006-345269 A JP 2014-66638 A

  However, when using the detection value of the sensor to determine the movement state where the device is placed, a detection value similar to the movement state different from the actual movement state is generated, and the movement state is erroneously determined. was there. The objective which concerns on one side of this invention is to provide the technique which can improve the discrimination | determination precision of the movement state in which the apparatus is set | placed.

  An electronic device according to one aspect of the present invention includes an acquisition unit, a storage unit, and an output unit. The obtaining unit obtains a first feature amount from a first magnetic vector obtained by extracting a component in a first frequency range including a component having a frequency equal to or lower than a predetermined frequency from magnetism detected by a magnetic sensor. In addition, the acquisition unit acquires a second feature amount from a second magnetic vector obtained by extracting a component in the second frequency range that does not include a component equal to or lower than a predetermined frequency in the magnetism. The storage unit includes a set of representative values including a first representative value representing a tendency of the first feature value and a second representative value representing a tendency of the second feature value in each of the plurality of movement states. I remember it. The output unit outputs information indicating a movement state of the representative value set that matches the pattern indicated by the feature value set including the first feature value and the second feature value.

  According to one aspect, it is possible to improve the determination accuracy of the moving state where the apparatus is placed.

It is a figure which illustrates the block configuration of the apparatus which concerns on 1st Embodiment. It is a figure which shows the magnetism detected with a magnetic sensor. It is the figure which converted the magnetism into the frequency domain. It is a figure which illustrates the component of the 1st frequency range, and the component of the 2nd frequency range. It is a figure which illustrates the movement state information which concerns on 1st Embodiment. It is a figure which illustrates the notification process of the movement state which concerns on 1st Embodiment. It is a figure which illustrates the coincidence degree of each movement state. It is a figure which illustrates the block configuration of the apparatus which concerns on 2nd Embodiment. It is a figure which illustrates the movement state information which concerns on 2nd Embodiment. It is a figure which illustrates the notification process of the movement state which concerns on 2nd Embodiment. It is a figure which illustrates the discrimination process of the movement state which concerns on the modification of 2nd Embodiment. It is a figure which illustrates the hardware constitutions of the apparatus for implement | achieving the electronic device which concerns on embodiment, and an apparatus provided with an electronic device.

  Hereinafter, some embodiments of the present invention will be described in detail with reference to the drawings. In addition, the same code | symbol is attached | subjected to the corresponding element in several drawing.

<First Embodiment>
In the first embodiment, for example, components in the first frequency range including components below a predetermined frequency are extracted from the value of the three-axis magnetism (μT) detected by the three-axis magnetic sensor. The magnetic value of the first frequency range component obtained is acquired as the first magnetic vector. Similarly, the second frequency range obtained by extracting the component in the second frequency range that does not include the component below the predetermined frequency from the value of the triaxial magnetism detected by the triaxial magnetic sensor. The magnetic value of the range component is obtained as the second magnetic vector. Then, using the magnitude of the first magnetic vector as the first feature quantity and the magnitude of the second magnetic vector as the second feature quantity, a set of the first feature quantity and the second feature quantity is obtained. The movement state in which the device is placed is determined from the pattern (trend) shown. Note that the movement state in which the apparatus is placed is determined using the first feature amount and the second feature amount because, for example, the following may be considered.

  For example, when the apparatus is stationary, the magnetism detected by the magnetic sensor provided in the apparatus shows a constant value because the north direction relative to the apparatus does not change. In this case, the frequency component included in the magnetism detected by the magnetic sensor is, for example, an orthogonal component having a frequency of 0 Hz.

  Further, for example, when the device held by the user is moved, the north direction with respect to the device changes in accordance with the movement of the device, and thus the magnetism detected by the magnetic sensor provided in the device changes. For example, when the user walks, changes direction, shakes the device, or turns the device while holding the device, it is detected by the magnetic sensor provided in the device according to changes in the position and orientation of the device. The magnetism changes. In this case, since the change in magnetism is a change according to the speed at which the user can move the body, for example, it can be estimated that the change is within a change in frequency components below a predetermined frequency. Note that the predetermined frequency may be set so that, for example, a component that is equal to or lower than the predetermined frequency includes a magnetic change caused by moving the device held by the user. The predetermined frequency may be, for example, a frequency of 1 to 3 Hz.

  On the other hand, it is assumed that the moving state in which the device is placed is a moving state in which the apparatus is moving by a train or a car. In this case, for example, due to the magnetic force generated by a high-speed rotating motor such as 50 Hz existing in the vicinity, the magnetic component detected by the magnetic sensor has a change in the frequency component on the higher frequency side than the predetermined frequency. Arise. As another example, when the moving state where the device is placed is a moving state where the device is moving by a train or a car, the device has a plurality of wires with strong magnetic force or a plurality of magnetized wires. May pass at high speed under the steel frame. Thereby, in the magnetism detected by the magnetic sensor, a change occurs in the frequency component on the higher frequency side than the predetermined frequency. Then, such a change in magnetism of a frequency component on the higher frequency side than the predetermined frequency hardly occurs, for example, when the moving state of the apparatus is stationary or walking.

  In addition, when the moving state where the device is placed is a state where the device is moving by a train, an automobile, or the like, there are many situations where there are many objects that generate magnetic force, such as motors and electric wires, in the vicinity of the device. For this reason, in a state where the vehicle is moving by a train or an automobile, there is a tendency that frequency components equal to or lower than a predetermined frequency are generated more than in a stationary or walking state.

  Furthermore, when comparing the state of riding on a train and the state of riding on a car, for example, in a train, the wire passes frequently while moving, but the car is not limited to this, and the frequency is equal to or lower than a predetermined frequency. There is a tendency that more components are generated in the train. On the other hand, in the state of being in a car, for example, a plurality of motors provided in another car or motorcycle are often present in the vicinity. Therefore, there is a tendency that more frequency components on the higher frequency side than a predetermined frequency are generated when the vehicle is in a car.

  Similarly, for bicycles, the frequency component below a predetermined frequency is small compared to trains and automobiles, while on the other hand, there are more situations where objects that generate magnetic force exist in the vicinity than when walking or standing still, Become more. Further, the frequency component on the higher frequency side than the predetermined frequency is larger than, for example, a walking state or a stationary state due to the influence of the frame of the bicycle tire rotating at high speed.

  As a result, for example, when a frequency component equal to or lower than a predetermined frequency and a frequency component higher than the predetermined frequency are compared between the respective moving states, a difference is generated in the tendency indicated by the amount. Therefore, in the first embodiment, for example, a first frequency range obtained by extracting a component in a first frequency range including a component equal to or lower than a predetermined frequency from a magnetic value detected by a magnetic sensor. Is obtained as the first magnetic vector. Similarly, a component in the second frequency range that does not include a component below a predetermined frequency is extracted from the value of magnetism detected by the magnetic sensor, and the magnetic component of the component in the obtained second frequency range is extracted. The value is obtained as the second magnetic vector. Then, the moving state in which the apparatus is placed is determined using the first feature quantity that is the magnitude of the first magnetic vector and the second feature quantity that is the magnitude of the second magnetic vector. Thereby, the determination accuracy of the moving state can be improved.

Hereinafter, the first embodiment will be described in more detail with reference to FIGS.
FIG. 1 is a diagram illustrating a block configuration of an apparatus 10 according to the first embodiment. The apparatus 10 includes a magnetic sensor 20, a control unit 30, and an electronic device 100. In addition, the apparatus 10 may be an apparatus including the magnetic sensor 20 such as a mobile phone, a smartphone, a tablet terminal, or a wearable terminal. The electronic device 100 is connected to, for example, the magnetic sensor 20 and the control unit 30. The magnetic sensor 20 is, for example, a magnetic sensor such as a triaxial geomagnetic sensor.

  The electronic device 100 includes a control unit 101 and a storage unit 110, for example. The control unit 101 includes, for example, an acquisition unit 102 and an output unit 103. The storage unit 110 may store movement state information 500 and a program, which will be described later, for example. Details of the information stored in these functional units and the storage unit 110 will be described later.

  And the control part 101 of the electronic device 100 discriminate | determines the movement state in which the apparatus 10 is placed based on the magnetism detected by the magnetic sensor 20, for example. Note that the control unit 101 may notify the determined movement state to the control unit 30 of the apparatus 10, for example. For example, the control unit 30 of the apparatus 10 may operate an application by executing a program, and the application may use the notified movement state. The control unit 30 of the device 10 may control each unit of the device 10, for example.

  FIG. 2 is a diagram illustrating magnetism detected by the magnetic sensor 20. In FIG. 2, the magnetism of each of the X axis, the Y axis, and the Z axis is shown. For example, the X axis, the Y axis, and the Z axis may be axes orthogonal to each other taken in three different directions from the magnetic sensor 20. In FIG. 2, the vertical axis represents magnetism (μT: microtesla) and the horizontal axis represents time (s: seconds). In FIG. 2, magnetism in the X-axis, Y-axis, and Z-axis directions is detected by the magnetic sensor 20, and the detected magnetic values of the X-axis, Y-axis, and Z-axis are, for example, in the north direction. It can be used as the magnetic vector shown.

  FIG. 3 is a diagram in which the magnetism of each axis in the time domain shown in FIG. 2 is converted into the frequency domain. In FIG. 3, the vertical axis represents magnetism (μT: microtesla), and the horizontal axis represents frequency (Hz: hertz).

  In the first embodiment, the control unit 101 of the electronic device 100 includes, from the magnetism (μT) detected by the magnetic sensor 20, a first frequency range component including a component equal to or lower than a predetermined frequency, and a predetermined frequency A component in the second frequency range that does not include a component below the frequency is extracted. FIG. 4 is a diagram illustrating a first frequency range component including a component equal to or lower than a predetermined frequency and a second frequency range component not including a component equal to or lower than the predetermined frequency. Note that, as described above, the predetermined frequency may be set so that, for example, a frequency component equal to or lower than the predetermined frequency includes a magnetic change generated by moving the device 10 held by the user. The predetermined frequency may be, for example, a frequency of 1 to 3 Hz. The first frequency range including a component equal to or lower than the predetermined frequency may be, for example, a frequency range from 0 Hz to a predetermined frequency, or may be another frequency range. The second frequency range that does not include a component equal to or lower than the predetermined frequency may be a frequency range that is on the higher frequency side than the predetermined frequency. The second frequency range is generated due to, for example, passing under a motor rotating at a high speed such as 50 Hz, a plurality of electric wires with strong magnetic force, a plurality of magnetic steel frames, or the like at high speed. It may be set in a range in which a change in magnetism due to a disturbance can be detected. The upper limit frequency of the second frequency range may be, for example, 500 to 2 kHz.

  Then, the control unit 101 extracts the value of the first frequency range component from the magnetism of each axis detected by the magnetic sensor 20, and uses the obtained value of each axis as a vector component. To get. Similarly, the control unit 101 extracts the value of the second frequency range component from the magnetism of each axis detected by the magnetic sensor 20, and uses the obtained value of each axis as a vector component. Get the magnetic vector of. And the control part 101 acquires the magnitude | size of the obtained 1st magnetic vector as a 1st feature-value. Similarly, the control unit 101 acquires the magnitude of the obtained second magnetic vector as the second feature amount.

  In addition, the electronic device 100 stores, for example, movement state information 500 including a representative value indicating a tendency between the first feature amount and the second feature amount for each movement state to be determined in the storage unit 110. FIG. 5 is a diagram illustrating movement state information 500. In FIG. 5, the movement state information 500 indicates the first representative value indicating the tendency of the first feature amount and the tendency of the second feature amount in the movement states of stationary, walking, bicycle, automobile, and train. 2nd representative value to represent. Note that the first representative value and the second representative value may be values representative of the plurality of first feature amounts and the plurality of second feature amounts, respectively, measured in each moving state, for example. . For example, the first representative value for the state on the train is an average value or median value of the plurality of first feature amounts acquired from the plurality of magnetisms detected by the magnetic sensor 20 in the state of riding the train. Or a statistical value such as a mode value. Similarly, the second representative value for the state on the train is an average value of the plurality of second feature amounts acquired from the plurality of magnetisms detected by the magnetic sensor 20 while on the train, It may be a statistical value such as median or mode. Similarly, representative values can be acquired for other movement states.

  Then, for example, the control unit 101 of the electronic device 100 uses a combination of the first feature amount and the second feature amount acquired from the magnetism detected by the magnetic sensor 20 for each movement state included in the movement state information 500. Are compared with a set of the first representative value and the second representative value. Thereby, the moving state in which the apparatus 10 is placed is determined. Hereinafter, the movement state notification process according to the first embodiment will be described.

  FIG. 6 is a diagram illustrating a moving state notification process according to the first embodiment. The operation flow in FIG. 6 may be started, for example, when a signal instructing the determination of the movement state is input to the control unit 101 of the electronic device 100.

  In step 601 (hereinafter, “step” is described as “S”, for example, expressed as S601), the control unit 101 includes a component having a frequency equal to or lower than a predetermined frequency from the three-axis magnetic value input from the magnetic sensor 20. A component in a frequency range of 1 is extracted, and a first magnetic vector is specified. In addition, extraction of the component of the 1st frequency range from the value of the triaxial magnetism input from the magnetic sensor 20 can be implemented using a low-pass filter or a moving average, for example. In addition, the control unit 101 extracts a component in the second frequency range that does not include a component equal to or lower than a predetermined frequency from the three-axis magnetic value input from the magnetic sensor 20, and specifies the second magnetic vector. Extraction of the component in the second frequency range from the triaxial magnetism value input from the magnetic sensor 20 can be performed using, for example, a high-pass filter. As the filter, for example, a FIR (Finite Impulse Response) filter and an IIR (Infinite Impulse Response) filter can be used.

  In step S602, the control unit 101 acquires the magnitude of the first magnetic vector as a first feature amount. Further, the control unit 101 acquires the magnitude of the second magnetic vector as the second feature amount.

  In step S <b> 603, the control unit 101 uses the obtained first feature amount and second feature amount as a first representative value and a second representative value in each movement state included in the movement state information 500. Compare with the pair. Then, the control unit 101 specifies a movement state having a representative value set that matches the pattern indicated by the set of the first feature value and the second feature value.

The specification of the movement state having the representative value set that matches the pattern indicated by the set of the first feature value and the second feature value may be executed as follows, for example. First, the control unit 101 calculates the degree of coincidence of the first feature quantity and the degree of coincidence of the second feature quantity using Expression 1 below.
Consistency = | Representative value of moving state−Feature amount | / Representative value of moving state

  For example, assume that the first feature value obtained in S602 is 100. In this case, since the first representative value of the stationary state of the movement state information 500 is 80, the degree of coincidence of the first feature amount is | 80-100 | /80=0.25. Since the first representative value of walking in the movement state information 500 is 100, the degree of coincidence of the first feature amount is | 100-100 | / 100 = 0. For example, the degree of coincidence of the first feature amount in each moving state can be calculated in this way. Similarly, for the second feature amount obtained in S602, the degree of coincidence of the second feature amount in each movement state can be calculated using Equation 1 in the same manner.

  Subsequently, the control unit 101 obtains the degree of coincidence of the movement state using, for example, the degree of coincidence of the first feature amount calculated for each movement state and the degree of coincidence of the second feature amount. The degree of coincidence of the movement state may be, for example, a statistical value such as an average value of the degree of coincidence between the first feature quantity and the second feature quantity. FIG. 7 is a diagram illustrating the degree of coincidence of each movement state.

  And the control part 101 specifies the movement state which has the group of the representative value which matches the pattern which the group of the 1st feature amount and the 2nd feature amount shows by comparing the coincidence degree of each movement state. . For example, the control unit 101 identifies the movement state having the lowest degree of coincidence of movement states as a movement state having a set of representative values that matches the pattern indicated by the combination of the first feature amount and the second feature amount. It's okay.

  In step S604, the control unit 101 outputs information indicating the identified movement state. For example, the control unit 101 may output information indicating the specified movement state to an application (for example, a host program) that uses the movement state operated by the control unit 30 of the apparatus 10. When the information indicating the movement state specified by the control unit 101 is output, the operation flow ends. In addition, the application using the movement state operated by the control unit 30 of the apparatus 10 includes, for example, a life log function that looks back on changes in daily life, a health support function, and an advertisement suitable for the current movement state of the user. In order to deliver, the notified movement state may be used.

  In the operation flow of FIG. 6, in the processing of S601 to S602, the control unit 101 of the electronic device 100 functions as the acquisition unit 102, for example. In the processing of S603 to S604, the control unit 101 of the electronic device 100 functions as the output unit 103, for example.

  As described above, in the first embodiment, the first magnetic vector is acquired by extracting the component in the first frequency range including the component below the predetermined frequency from the magnetism detected by the magnetic sensor 20. In addition, a component in the second frequency range that does not include a component equal to or lower than a predetermined frequency is extracted from the magnetism detected by the magnetic sensor 20, and a second magnetic vector is acquired. Then, the movement having a set of representative values matching the pattern indicated by the set of the first feature quantity that is the magnitude of the first magnetic vector and the second feature quantity that is the magnitude of the second magnetic vector. By specifying the state, the moving state in which the apparatus 10 is placed is determined. As described above, the first feature amount is likely to reflect the magnetic fluctuation caused by moving the device 10 held by the user and the influence of an object that generates a nearby magnetic force. On the other hand, the second feature value reflects, for example, a change in magnetism due to a disturbance generated due to a high-speed rotation under a high-speed rotating motor, a plurality of magnetic wires or steel frames, etc. Easy to be. Therefore, it is possible to determine the movement state with high accuracy by determining the movement state in which the apparatus 10 is placed using the set of the first feature amount and the second feature amount.

<Second Embodiment>
As described above, for example, when the apparatus 10 is stationary, the direction of the magnetic vector indicating the north direction detected by the magnetic sensor 20 indicates a certain direction. However, the presence of an object that generates a magnetic force, such as a motor, changes the direction of the magnetic vector indicating the north direction measured by the magnetic sensor 20.

  For example, electric wires are laid in parallel with rails on trains. For this reason, the apparatus 10 frequently passes under the electric wire while riding on a train, and in this case, for example, the direction of the magnetic vector may change in the direction of gravitational acceleration. On the other hand, for example, in the case of a car, another car often runs around, and due to the influence of the magnetic force generated by the motor that rotates at a high speed, the direction of the magnetic vector changes in the horizontal direction. May appear. In other words, the direction of the magnetic vector can show a different tendency of change in the direction of gravitational acceleration and in the horizontal direction depending on the moving state.

  Therefore, in the second embodiment, in order to catch the change in the direction of the magnetic vector, the first magnetic vector and the second magnetic vector are divided into components of the direction of gravitational acceleration (gravity direction) and the horizontal direction (of gravitational acceleration). The feature amount is obtained by decomposing the component into components in a direction perpendicular to the direction.

  In the second embodiment, the acceleration vector detected by the acceleration sensor is also used for determining the movement state. Note that the direction in which the acceleration vector is likely to appear also varies depending on the movement state. For example, in the state of walking, the acceleration corresponding to the vertical movement of the body when the user holding the device 10 walks tends to appear in the direction of gravitational acceleration. There are few such up and down movements on bicycles. On the other hand, since the bicycle tends to move faster than walking, the horizontal acceleration tends to be greater for the bicycle than for walking.

  For this reason, in the second embodiment, the acceleration vector is also decomposed into a component in the direction of gravitational acceleration and a component in the horizontal direction to acquire the feature amount.

  In the second embodiment, the control unit 101 determines the feature amount of the component in the direction of gravitational acceleration and the feature of the component in the horizontal direction from each of the first magnetic vector, the second magnetic vector, and the acceleration vector. The quantity is extracted, and the moving state is discriminated using the obtained set of six feature values.

  FIG. 8 is a diagram illustrating a block configuration of the device 10 according to the second embodiment. The apparatus 10 shown in FIG. 8 further includes an acceleration sensor 40 in addition to the apparatus 10 according to the first embodiment of FIG. The electronic device 100 may be connected to the acceleration sensor 40, for example. The acceleration vector detected by the acceleration sensor 40 may be represented by, for example, a coordinate system of X axis, Y axis, and Z axis orthogonal to each other taken in three different directions from the acceleration sensor 40.

  The electronic device 100 includes a control unit 101 and a storage unit 110, for example. The control unit 101 includes, for example, an acquisition unit 102 and an output unit 103. The storage unit 110 may store movement state information 900 and a program, which will be described later, for example.

  FIG. 9 is a diagram showing movement state information 900 according to the second embodiment. The movement state information 900 includes, for each movement state, the first magnetic vector, the second magnetic vector, and the feature value in the direction of gravity acceleration of the acceleration vector and the representative value for the horizontal direction feature amount. Note that the representative values of these feature amounts may be, for example, values that represent a plurality of feature amounts acquired in the respective movement states. For example, the representative value of the direction of gravity acceleration of the first magnetic vector in the state of riding on the train is the direction of gravity acceleration of the plurality of first magnetic vectors acquired in the state of riding on the train. It may be a statistic such as an average value, median value, or mode value of feature quantities. Similarly, for example, the representative value of the horizontal feature amount of the second magnetic vector in the state of riding in the automobile is the horizontal direction of the plurality of second magnetic vectors acquired in the state of riding in the automobile. It may be a statistic such as an average value, median value, or mode value of feature quantities. The representative values for the movement states of other feature amounts can be obtained in the same manner.

  In addition, the feature amounts of the first magnetic vector, the second magnetic vector, and the acceleration vector in the direction of gravitational acceleration may be calculated as follows, for example. First, the control unit 101 calculates a gravitational acceleration vector representing the gravitational acceleration based on the detection value detected by the acceleration sensor 40. Subsequently, the control unit 101 calculates a gravitational acceleration unit vector obtained by normalizing the gravitational acceleration vector. The control unit 101 may calculate the inner product of the gravitational acceleration unit vector and the first magnetic vector, and may use the obtained value as a feature amount in the direction of the gravitational acceleration of the first magnetic vector. Similarly, the control unit 101 calculates the inner product of the gravitational acceleration unit vector and each of the second magnetic vector and the acceleration vector, and uses the obtained values for the gravitational acceleration of the second magnetic vector and the acceleration vector. Each may be used as a direction feature.

  Further, the horizontal feature amounts of the first magnetic vector, the second magnetic vector, and the acceleration vector may be calculated as follows, for example. For example, the control unit 101 may calculate the outer product of the gravitational acceleration unit vector and the first magnetic vector, and may use the magnitude of the obtained normal vector as the horizontal feature amount of the first magnetic vector. . Similarly, the control unit 101 calculates the outer product of the gravitational acceleration unit vector, the second magnetic vector, and the acceleration vector, and determines the magnitude of the obtained normal vector as the second magnetic vector and acceleration. Each may be used as a horizontal feature amount of the vector.

  FIG. 10 is a diagram exemplifying movement state notification processing according to the second embodiment. The operation flow in FIG. 10 may be started, for example, when a signal instructing the determination of the moving state is input to the control unit 101 of the electronic device 100.

  In step S <b> 1001, the control unit 101 of the electronic device 100 extracts a first frequency range component including a component having a frequency equal to or lower than a predetermined frequency from the triaxial magnetism values input from the magnetic sensor 20, and obtains the first magnetic vector. Identify. In addition, the control unit 101 extracts a component in the second frequency range that does not include a component equal to or lower than a predetermined frequency from the three-axis magnetic value input from the magnetic sensor 20, and specifies the second magnetic vector. Note that the process of S1001 may be executed in the same manner as in S601, for example. In step S <b> 1002, the control unit 101 acquires an acceleration vector and a gravitational acceleration unit vector from the detection value input from the acceleration sensor 40.

  In step S1003, the control unit 101 acquires a feature amount in the direction of gravitational acceleration from each of the first magnetic vector, the second magnetic vector, and the acceleration vector. For example, the control unit 101 calculates the inner product of each of the first magnetic vector, the second magnetic vector, and the acceleration vector and the gravitational acceleration unit vector. Thereby, the control unit 101 may acquire the feature amounts of the first magnetic vector, the second magnetic vector, and the acceleration vector in the direction of gravity acceleration.

  In step S1004, the control unit 101 acquires a horizontal feature amount from each of the first magnetic vector, the second magnetic vector, and the acceleration vector. For example, the control unit 101 calculates the outer product of each of the first magnetic vector, the second magnetic vector, and the acceleration vector and the gravitational acceleration unit vector, and acquires each normal vector. And the control part 101 may acquire the magnitude | size of each obtained normal vector as a feature-value of the horizontal direction of a 1st magnetic vector, a 2nd magnetic vector, and an acceleration vector.

  In step S <b> 1005, the control unit 101 includes each of the obtained first magnetic vector, second magnetic vector, and acceleration vector, each set of gravitational acceleration direction and horizontal feature amount included in the movement state information 900. It is compared with a set of representative values of feature values in the moving state. Then, the control unit 101 specifies a movement state having a representative value set that matches the pattern indicated by the obtained feature value set.

  Note that the identification of the movement state having the representative value pair that matches the pattern indicated by each feature value pair in S1005 may be executed by calculating the degree of coincidence in the same manner as in S603, for example. First, the control unit 101 determines the degree of coincidence between the gravitational acceleration direction and the horizontal feature amount of each of the first magnetic vector, the second magnetic vector, and the acceleration vector and the representative value of each moving state as described above. Calculation is performed using Equation 1.

  Subsequently, the control unit 101 uses, for example, the degree of coincidence between the direction of gravity acceleration and the horizontal direction feature amount of each of the first magnetic vector, the second magnetic vector, and the acceleration vector calculated for each movement state. To obtain the degree of coincidence of the movement state. The degree of coincidence of the moving state is, for example, a statistic such as an average value of the degree of coincidence between the direction of gravity acceleration and the horizontal direction of each of the first magnetic vector, the second magnetic vector, and the acceleration vector for each moving state. May be a value. FIG. 7 is a diagram illustrating the degree of coincidence for each movement state.

  Then, the control unit 101 compares the degree of coincidence between the movement states, so that the combination of the gravity acceleration direction and the horizontal feature amount of each of the first magnetic vector, the second magnetic vector, and the acceleration vector is obtained. A movement state having a set of representative values matching the pattern to be shown is specified. For example, the control unit 101 determines a moving state having the lowest matching degree of moving states as a set of gravity acceleration directions and horizontal feature amounts of the first magnetic vector, the second magnetic vector, and the acceleration vector. You may specify as a movement state which has the set of the representative value which corresponds to the pattern to show.

  In S1006, the control unit 101 outputs information indicating the identified movement state, and the operation flow ends. In S1006, for example, the control unit 101 may output information indicating the specified movement state to an application that uses the movement state operated by the control unit 30 of the apparatus 10.

  In the operation flow of FIG. 10, in the processing of S1001 to S1004, the control unit 101 of the electronic device 100 functions as the acquisition unit 102, for example. In the processing of S1005 to S1006, the control unit 101 of the electronic device 100 functions as the output unit 103, for example.

  As described above, in the second embodiment, the control unit 101 includes the first magnetic vector, the feature amount indicating the magnitude of the component in the direction of gravitational acceleration from the second magnetic vector, and the horizontal direction. A feature amount representing the size of the component is extracted. Furthermore, the control unit 101 extracts a feature amount that represents the magnitude of the component in the direction of gravitational acceleration and a feature amount that represents the magnitude of the component in the horizontal direction from the acceleration vector. And the control part 101 discriminate | determines the movement state in which the apparatus 10 is set | placed using each feature-value of the direction of gravity acceleration and the horizontal direction which were obtained. As described above, the directions of the first magnetic vector, the second magnetic vector, and the acceleration vector may show different change trends depending on the movement state. Therefore, by decomposing each feature quantity into a component in the direction of gravitational acceleration and a component in the horizontal direction, it is possible to further improve the determination accuracy of the moving state in which the apparatus 10 is placed.

  In the second embodiment, the movement state is determined using the first magnetic vector, the second magnetic vector, and the feature quantity of the acceleration vector in the direction of gravitational acceleration and the feature quantity of the horizontal component. The case where it discriminate | determines is illustrated. However, the embodiment is not limited to this. For example, some of these feature values may not be used for determining the movement state, and may not be acquired. That is, for example, the moving state according to the second embodiment is determined using the feature amount of the first magnetic vector and the second magnetic vector in the direction of gravitational acceleration and the feature amount of the horizontal component. May be executed. However, for example, by determining the movement state according to the second embodiment using a larger amount of these feature amounts, the determination accuracy of the movement state in which the apparatus 10 is placed is improved. Can be made.

<Modification of Second Embodiment>
The modification of the second embodiment further illustrates a case where the movement state is limited to a predetermined movement state using the movement state output last time. For example, when the user holding the device 10 is in a moving state where he / she is moving on a vehicle, it is estimated that the transition to the next moving state occurs when the user gets off the vehicle. In this case, it can be estimated that the next moving state is, for example, a walking state and a stationary state. On the other hand, when the user holding the device 10 is in a moving state where he / she is moving on a vehicle, for example, a direct transition to a moving state where he / she is moving on another vehicle is unlikely to occur. It is done. That is, for example, it can be estimated that a direct transition from a state of riding a car to a state of riding a train or a bicycle does not occur.

  Therefore, in the modified example of the second embodiment, when the previous movement state is the movement state by the vehicle, the transition destination of the movement state where the device 10 is placed is, for example, other than the movement state on the vehicle, for example, Limited to a stationary moving state or a walking moving state.

  In addition, in the modification of 2nd Embodiment, the apparatus 10 may have the block configuration of FIG. The storage unit 110 may store the movement state information 900 in FIG. And in the modification of 2nd Embodiment, the control part 101 may perform the notification process of the movement state of FIG. However, in the modification of the second embodiment, the control unit 101 executes, for example, the operation flow of FIG. 11 instead of the process of S1005.

  FIG. 11 is a diagram illustrating a moving state determination process that is executed instead of the process of S1005 of the second embodiment in the modification of the second embodiment. The operation flow in FIG. 11 may be started when the process proceeds to S1005 in FIG.

  In S1101, the control unit 101 calculates the degree of coincidence for each movement state. The degree of coincidence with respect to each moving state may be calculated as exemplified in the description of S1005.

  In step S1102, the control unit 101 acquires the movement state output last time. The movement state output last time may be stored in the storage unit 110 when, for example, the process 1105 described later is executed last time. And the control part 101 may read the movement state output last time from the memory | storage part 110 in the process of S1102.

  In S1103, the control unit 101 determines whether or not the movement state with the lowest degree of coincidence among the movement degrees calculated in S1101 is the same as the movement state output last time. When the movement state with the lowest degree of coincidence is the same as the movement state output last time (Yes in S1103), the flow proceeds to S1104. In step S1104, the control unit 101 determines that the movement state is the same movement state as the movement state output last time. In step S1105, the control unit 101 records the determined movement state in the storage unit 110.

  On the other hand, in S1103, when the movement state with the lowest matching degree is different from the movement state output last time (S1103 is No), the flow proceeds to S1106. In step S <b> 1106, the control unit 101 determines whether the movement state output last time is a walking state or a stationary state. When the movement state output last time is a walking state or a stationary state (Yes in S1106), the flow proceeds to S1107. In step S1107, the control unit 101 determines whether or not the degree of coincidence of the moving state of the automobile is the highest. If the degree of coincidence of the moving state of the car is the highest in S1107 (Yes in S1107), the flow proceeds to S1108, the control unit 101 determines that the moving state is in the car, and the flow proceeds to S1105. . On the other hand, if the degree of coincidence of the moving state of the vehicle is not the highest in S1107 (S1107 is No), the flow proceeds to S1109.

  In step S1109, the control unit 101 determines whether or not the degree of coincidence of the moving state of the train is the highest. When the coincidence degree of the moving state of the train is the highest in S1109 (Yes in S1109), the flow proceeds to S1110, the control unit 101 determines that the moving state is on the train, and the flow proceeds to S1105. . On the other hand, if the degree of coincidence of the moving state of the train is not the highest in S1109 (No in S1109), the flow proceeds to S1111.

  In S1111, the control unit 101 determines whether or not the degree of coincidence of the movement state of the bicycle is the highest. When the degree of coincidence of the movement state of the bicycle is the highest in S1111 (S1111 is Yes), the flow proceeds to S1112, the control unit 101 determines that the movement state is riding on the bicycle, and the flow proceeds to S1105. . On the other hand, if the degree of coincidence of the movement state of the bicycle is not the highest in S1111 (S1111 is No), the flow proceeds to S1113.

  In step S <b> 1113, the control unit 101 determines whether the matching degree of the walking movement state is higher than the matching degree of the stationary movement state. When the coincidence degree of the walking movement state is higher than the coincidence degree of the stationary movement state in S1113 (Yes in S1113), the flow proceeds to S1114, and the control unit 101 determines that the movement state is the walking state. Then, the flow proceeds to S1105. On the other hand, if the coincidence degree of the walking movement state is not higher than the coincidence degree of the stationary movement state in S1113 (No in S1113), the flow proceeds to S1115. In S1115, the control unit 101 determines that the moving state is a stationary state, and the flow proceeds to S1105.

  In addition, when the movement state output last time in S1106 is not a walking state or a stationary state (No in S1106), the movement state is considered to be a state of riding a vehicle. In this case, it is considered that no direct transition to a moving state where the vehicle is moving on another vehicle occurs. Therefore, the control unit 101 advances the flow to S1113 and limits the next movement state to a state where the vehicle is not on a vehicle such as a walking state and a stationary state.

  Then, as described above, in S1105, the control unit 101 records the determined movement state in the storage unit 110, the operation flow ends, and the flow proceeds to S1006. And in the modification of 2nd Embodiment, the control part 101 outputs the information which shows the movement state discriminate | determined by one of S1104, S1108, S1110, S1112, S1114, and S1115 in S1006.

  In the operation flow of FIG. 11, the control unit 101 of the electronic device 100 functions as, for example, the output unit 103.

  As described above, in the modified example of the second embodiment, when the previous movement state is a movement state on the vehicle, the vehicle is placed on the transition destination of the movement state on which the device 10 is placed. For example, the moving state is limited to a stationary moving state or a walking moving state. Thereby, the discrimination accuracy of the moving state where the apparatus 10 is placed can be further improved.

  Therefore, according to the above-described embodiment, it is possible to improve the determination accuracy of the moving state where the apparatus 10 is placed. For example, when the moving state is determined using the acceleration detected by the acceleration sensor 40 as it is, the moving state may be determined to be different from the actual moving state when the user shakes the device 10 by hand. . Alternatively, for example, when the movement state is determined using the magnetism detected by the magnetic sensor 20 as it is, the movement state may be erroneously determined due to the influence of a disturbance such as magnetism generated by a fan or a washing machine. However, according to the above-described embodiment, the determination accuracy of the moving state in which the apparatus 10 is placed is improved, and thus it is possible to suppress erroneous determination of the moving state even in such a case.

  In the above, although embodiment was illustrated, embodiment is not limited to these. For example, the above-described operation flow is an example, and the embodiment is not limited to this. If possible, the operation flow may be executed by changing the order of processing, may include additional processing, or some processing may be omitted. For example, in another embodiment, the process of S1003 and the process of S1004 may be executed in a reversed order.

  Further, the moving state may include other different moving states such as a state of riding on an airplane, a state of riding on a ship, and a state of riding on a motorcycle. In addition, the above-described calculation of feature quantity coincidence, calculation of movement state coincidence, and identification of the movement state of a set of matching representative values using the coincidence are examples, and the degree of coincidence can be determined using other methods. And the identification of the movement state of a set of matching representative values may be executed.

  FIG. 12 is a diagram illustrating a hardware configuration of a device 1200 for realizing the electronic device 100 according to the embodiment and the device 10 including the electronic device 100. The hardware configuration for realizing the device 1200 of FIG. 12 includes, for example, a processor 1201, a memory 1202, a communication device 1203, an output device 1204, a magnetic sensor 20, an acceleration sensor 40, and an electronic device 1220. Note that the processor 1201, the memory 1202, the communication device 1203, the output device 1204, and the electronic device 1220 are connected to each other via a bus 1210, for example.

  The processor 1201 may operate as the above-described control unit 30 by executing a program using the memory 1202. The processor 1201 may operate, for example, an application that records a life log for looking back on the daily life of the user, a health support application, an application that distributes information and advertisements suitable for the current state of the user, and the like. Then, the processor 1201 may use the movement state of the device 1200 input from the processor 1221 described later in the running application. The processor 1201 may control each unit of the device 1200.

  The memory 1202 is a semiconductor memory, for example, and may include a RAM area and a ROM area. Note that RAM is an abbreviation for Random Access Memory. ROM is an abbreviation for Read Only Memory. The communication device 1203 transmits / receives data via the network in accordance with instructions from the processor 1201. The output device 1204 may include, for example, a display device such as a display and an audio device such as a speaker.

  Moreover, the apparatus 1200 includes the magnetic sensor 20, for example. The magnetic sensor 20 is, for example, a triaxial geomagnetic sensor. Further, the device 1200 may include an acceleration sensor 40, for example.

  The electronic device 1220 may be a microcontroller and a microcomputer, for example. In another embodiment, the electronic device 1220 may be a digital signal processor (DSP), for example. The electronic device 1220 includes, for example, a processor 1221 and a memory 1222.

  The processor 1221 may operate as the control unit 101 described above by executing, for example, a state notification program describing the procedure of the above-described operation flow using the memory 1222, and a part of each functional unit of the electronic device 100. Or provide full functionality. The processor 1221 is connected to, for example, the magnetic sensor 20 and the acceleration sensor 40, and detection values may be input from these sensors. Further, the processor 1221 may output a result of analyzing the detection value input from the sensor to the processor 1201. For example, the processor 1221 may output information indicating the determined movement state to the processor 1201 in the above-described S604 and S1006.

  The memory 1222 is a semiconductor memory, for example, and may include a RAM area and a ROM area. The storage unit 110 described above may be a memory 1222, for example. The memory 1222 may store information such as the above-described movement state information 500 and movement state information 900, for example. The memory 1222 may store the movement state output last time in S1105 described above.

  The hardware configuration of the device 1200 described with reference to FIG. 12 is an exemplification, and the embodiment is not limited to this. For example, some or all of the functions of the above-described functional units may be implemented as hardware such as FPGA and SoC. Note that FPGA is an abbreviation for Field Programmable Gate Array. SoC is an abbreviation for System-on-a-chip. Further, for example, the acquisition of the first magnetic vector and the second magnetic vector from the magnetism detected by the magnetic sensor 20 is executed by the processor 1221 operating as a low-pass filter, a high-pass filter, a band-pass filter, and the like. Good. In another embodiment, the acquisition of the first magnetic vector and the second magnetic vector from the magnetism detected by the magnetic sensor 20 is performed by a hardware-installed low-pass filter, high-pass filter, band-pass filter, or the like. May be performed using

  In the above, several embodiments have been described. However, the embodiments are not limited to the above-described embodiments, and should be understood as including various modifications and alternatives of the above-described embodiments. For example, it will be understood that various embodiments can be embodied by modifying the components without departing from the spirit and scope thereof. It will be understood that various embodiments can be made by appropriately combining a plurality of components disclosed in the above-described embodiments. Further, various embodiments may be implemented by deleting or replacing some components from all the components shown in the embodiments, or adding some components to the components shown in the embodiments. Those skilled in the art will appreciate that this can be done.

10 Device 20 Magnetic Sensor 30 Control Unit 40 Acceleration Sensor 100 Electronic Device 101 Control Unit 102 Acquisition Unit 103 Output Unit 110 Storage Unit 1200 Device 1201 Processor 1202 Memory 1203 Communication Device 1204 Output Device 1210 Bus 1220 Electronic Device 1221 Processor 1222 Memory

Claims (7)

Obtaining a first feature amount from a first magnetic vector obtained by extracting a component in a first frequency range including a component having a frequency equal to or lower than a predetermined frequency out of magnetism detected by a magnetic sensor; and An acquisition unit that acquires a second feature amount from a second magnetic vector obtained by extracting a component in a second frequency range that does not include a component equal to or lower than the predetermined frequency;
Storing a set of representative values including a first representative value representing a tendency of the first feature value and a second representative value representing a tendency of the second feature value in each of a plurality of movement states; A storage unit,
An output unit that outputs information indicating a movement state of the set of representative values that matches a pattern indicated by a set of feature values including the first feature value and the second feature value;
Including electronic equipment.   2. The electron according to claim 1, wherein the first feature amount is a magnitude of the first magnetic vector, and the second feature amount is a magnitude of the second magnetic vector. machine. The acquisition unit further specifies the direction of gravity acceleration from the acceleration vector detected by the acceleration sensor,
The first feature amount is a magnitude of a component in a direction of gravitational acceleration of the first magnetic vector,
The electronic device according to claim 1, wherein the second feature amount is a magnitude of a component of the second magnetic vector in a direction of gravitational acceleration. The acquisition unit further acquires a magnitude of a component perpendicular to the direction of gravity acceleration from the first magnetic vector as a third feature amount, and a component perpendicular to the direction of gravity acceleration from the second magnetic vector. Is obtained as the fourth feature amount,
The storage unit includes a first representative value, a second representative value, a third representative value representing a tendency of the third feature amount, and a fourth representative value in each of the plurality of movement states. A set of representative values including a fourth representative value representing a tendency of the feature amount of
The output unit matches the pattern indicated by the set of feature quantities including the first feature quantity, the second feature quantity, the third feature quantity, and the fourth feature quantity. Output information indicating the movement status of the set of representative values.
The electronic device according to claim 3. The acquisition unit further acquires the magnitude of a component of the acceleration vector in the direction of gravitational acceleration as a fifth feature amount, and sets the magnitude of a component perpendicular to the direction of gravitational acceleration of the acceleration vector as a sixth feature. Get as quantity,
The storage unit includes the first representative value, the second representative value, the third representative value, the fourth representative value, and the fifth representative value in each of the plurality of movement states. Storing a set of representative values including a fifth representative value representing a tendency of a feature quantity and a sixth representative value representing a tendency of the sixth feature quantity;
The output unit includes the first feature value, the second feature value, the third feature value, the fourth feature value, the fifth feature value, and the sixth feature. Output information indicating the movement state of the set of representative values that matches the pattern indicated by the set of feature quantities including the quantity;
The electronic device according to claim 4. The plurality of movement states include a stationary movement state, a walking movement state, a movement state riding on a first vehicle, and a movement state riding on a second vehicle,
The storage unit further stores information indicating a movement state output by the output unit last time,
When the information indicating the movement state output last time is information indicating the movement state riding on the first vehicle, the output unit outputs the information indicating the movement state to be output as the stationary movement state. The electronic apparatus according to claim 1, wherein the electronic apparatus is limited to information indicating or information indicating the moving state of walking. Obtaining a first feature amount from a first magnetic vector obtained by extracting a component in a first frequency range including a component having a frequency equal to or lower than a predetermined frequency out of magnetism detected by a magnetic sensor; and Among them, a second feature amount is obtained from a second magnetic vector obtained by extracting a component in a second frequency range that does not include a component below the predetermined frequency,
Of a set of representative values including a first representative value that represents the tendency of the first feature value and a second representative value that represents the tendency of the second feature value in each of a plurality of movement states. Outputting information indicating the movement state of the set of representative values that matches the pattern indicated by the set of feature values including the first feature value and the second feature value;
A status notification program that causes an electronic device to execute processing.

Images