JP2017108345A - Information processing apparatus, information processing system and program - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide a technology for calculating an activity amount of a user while suppressing a positioning error caused by a state of a portable terminal in the case where the portable terminal is held by the user.SOLUTION: A first portable terminal 10 is held by a user while being held in the hand or put in a bag. The first portable terminal 10 acquires physical quantities measured by autonomous navigation sensors such as an acceleration sensor, an azimuth sensor and an atmospheric pressure sensor. A second portable terminal 20 is wristband-shaped, for example, and mounted on an arm 50 of a user. The second portable terminal 20 transmits physical quantities measured by autonomous navigation sensors such as an acceleration sensor, an azimuth sensor and an atmospheric pressure sensor to the first portable terminal 10. Based on the physical quantities measured in the terminals, the first portable terminal 10 estimates an activity (e.g., a movement) that the user performs and a holding state of the first portable terminal 10. In accordance with a calculation method corresponding to an estimation result, the physical quantities measured in the terminals are used to calculate a moving amount of the user, and a location of the user is calculated.SELECTED DRAWING: Figure 1

Description

  The present invention relates to a technique for calculating a user's activity amount using a mobile terminal.

  A technique for measuring the position of a user using a portable terminal held by the user is widely used. Patent Documents 1 and 2 describe outputting position information based on positioning errors. In Patent Document 1, a plurality of types of position information having different accuracy and measurement time are acquired for a certain moving object, and the position information of the moving object at an arbitrary time and its accuracy are displayed as an error range on a map. It is described. In Patent Document 2, a parameter value related to a process for estimating an error included in an inertial navigation calculation value is set based on a determination result of a user's movement state (for example, walking, riding, and stationary), and the estimated error is set. It is described that the calculation value of the inertial navigation calculation is used to correct the calculation value.

JP 2002-257564 A JP 2013-108865 A

  In a positioning technique employing autonomous navigation, a movement amount including a movement distance and a movement direction of a user is calculated based on signals from various sensors such as an acceleration sensor and a direction sensor, and the position of the user is obtained from the movement amount. For this reason, positioning errors are accumulated as the positioning process proceeds. In the techniques described in Patent Documents 1 and 2, a GPS (Global Positioning System) function is used in combination in order to reduce the influence of such accumulated errors.

As a cause of positioning error in autonomous navigation, there is a state when the user holds the portable terminal. For example, a portable terminal such as a smartphone may be held while being held in a hand, or may be held while being put in a bag, and the holding state is various. In particular, when the user puts the mobile terminal in a bag, the vibration that acts on the mobile terminal with the movement of the user is small compared to the case where the user holds the mobile terminal, which causes the positioning error to increase. May be.
Therefore, the present invention is to provide a technique for calculating an activity amount of a user while suppressing a positioning error caused by the state of the mobile terminal when held by the user.

  In order to solve the above-described problem, an information processing apparatus according to the present invention includes a first acquisition unit configured to acquire a first physical quantity corresponding to a movement of a user's body measured by a first sensor included in the first mobile terminal. Second acquisition means for acquiring a second physical quantity corresponding to the movement of the body measured by a second sensor provided in a second portable terminal attached to a part of the user's body, and the acquired second An estimation means for estimating the activity performed by the user and the holding state of the first mobile terminal based on the physical quantity of 1 and the second physical quantity, and a calculation method according to the estimated activity and the holding state, Calculating means for calculating the activity amount of the user using at least one of the first physical quantity and the second physical quantity.

  In the information processing apparatus of the present invention, the calculation means may calculate the activity amount using the second physical quantity when the estimated activity and the holding state satisfy a condition in advance.

  In the information processing apparatus of the present invention, the information processing apparatus includes a reliability specifying unit that specifies the reliability of the estimation of the activity and the holding state, and the calculation unit calculates the activity amount based on the specified reliability. Also good.

In the information processing apparatus of the present invention, the calculation unit may calculate a movement amount representing a movement distance and a movement direction of the user as the activity amount.
The information processing apparatus may include output processing means for outputting map data in which the position of the user obtained from the movement amount is drawn on a map.

  The information processing apparatus of the present invention may further comprise output processing means for outputting notification data for notifying that the activity amount satisfies a predetermined condition.

  In the information processing apparatus of the present invention, the frequency of measurement in one of the first sensor and the second sensor is reduced or stopped in a period in which the estimated activity and the holding state satisfy a predetermined condition. Measurement control means may be provided.

  In the information processing apparatus of the present invention, the first mobile terminal or the second mobile terminal may be provided.

  An information processing system according to the present invention includes a first portable terminal that includes a first short-range wireless communication unit that performs short-range wireless communication, and a first sensor that measures a first physical quantity according to a movement of a user's body. A second short-range wireless communication means for performing short-range wireless communication, a mounting unit mounted on a part of the user's body, and a second sensor that measures a second physical quantity according to the movement of the body A first acquisition means for acquiring the first physical quantity, a second acquisition means for acquiring the second physical quantity, the first mobile terminal and the second mobile terminal. Estimating the activity performed by the user and the holding state of the first portable terminal based on the first physical quantity and the second physical quantity measured when the short-range wireless communication is performed between Means, and the estimated activity and the holding state In Flip calculation method, and a calculating means for calculating an activity amount of the user using at least one of said first physical quantity and the second physical quantity.

  The program according to the present invention is attached to a computer, a step of acquiring a first physical quantity corresponding to a movement of a user's body measured by a first sensor included in the first portable terminal, and a part of the user's body. Based on the step of acquiring the second physical quantity according to the movement of the body measured by the second sensor included in the second mobile terminal, and the acquired first physical quantity and the second physical quantity, At least one of the first physical quantity and the second physical quantity in the step of estimating the activity performed by the user and the holding state of the first mobile terminal, and the calculation method according to the estimated activity and the holding state And a step of calculating the amount of activity of the user using.

  ADVANTAGE OF THE INVENTION According to this invention, the technique which suppresses the error of positioning resulting from the state of the portable terminal when hold | maintained by the user, and calculates the activity amount of the said user can be provided.

The figure which shows the whole structure of the information processing system which concerns on 1st Embodiment of this invention. The block diagram which shows the hardware constitutions of the 1st portable terminal which concerns on the same embodiment. The block diagram which shows the hardware constitutions of the 2nd portable terminal which concerns on the same embodiment. The block diagram which shows the function structure of the 1st portable terminal and 2nd portable terminal which concern on the embodiment. Explanatory drawing of the specific example of the status which concerns on the embodiment. Explanatory drawing of the estimation method of the status A which concerns on the embodiment. Explanatory drawing of the estimation method of the status B which concerns on the embodiment. Explanatory drawing of the estimation method of the status C which concerns on the embodiment. Explanatory drawing of the estimation method of the status D which concerns on the embodiment. Explanatory drawing of the estimation method of the status E which concerns on the embodiment. The sequence chart which shows the process regarding the positioning performed with the information processing system which concerns on the embodiment. Explanatory drawing of the position notification service which concerns on the embodiment. Explanatory drawing of the output example of the map data which concerns on the same embodiment. The block diagram which shows the function structure of the 1st portable terminal and 2nd portable terminal which concern on 2nd Embodiment of this invention. The sequence chart which shows the process regarding the positioning performed with the information processing system which concerns on the embodiment. The block diagram which shows the function structure of the 1st portable terminal which concerns on the modification 2 of this invention, and a 2nd portable terminal. The sequence chart which shows the process regarding the measurement by the sensor performed with the information processing system which concerns on the modification.

Hereinafter, embodiments of the present invention will be described with reference to the drawings.
[First Embodiment]
FIG. 1 is a diagram showing an overall configuration of an information processing system 1 according to the first embodiment of the present invention. In the information processing system 1, information processing for obtaining the position of the user is performed using autonomous navigation (inertial navigation). As shown in FIG. 1, the information processing system 1 includes a first mobile terminal 10, a second mobile terminal 20, a service server 30, a position beacon 40, and a third party terminal 45. The first mobile terminal 10, the service server 30, the location beacon 40, and the third party terminal 45 have a function of connecting to the network 100 and communicating. The network 100 is a public communication line including, for example, a mobile communication network, a gateway device, and the Internet.

  The first portable terminal 10 and the second portable terminal 20 are carried (held) by the same user. The first mobile terminal 10 is a smartphone in the present embodiment. In FIG. 1, the first portable terminal 10 is held in a state of being held in the user's hand, but may be held in a state other than this. As a holding state by the user of the first mobile terminal 10, in addition to a state held by the user's hand, a state in which the user has a bag (for example, a handbag) or a baggage cart used by the user There is a state that has been.

  The second portable terminal 20 is a so-called wearable terminal, and is a wristband type or wristwatch type portable terminal in the present embodiment. The second mobile terminal 20 includes a belt-shaped mounting part 201 for mounting on a part of the user's body. The second mobile terminal 20 is mounted on the arm 50 by the mounting unit 201 being wound around the user's arm 50 (the forearm of the left hand in FIG. 1). The 2nd portable terminal 20 is normally used in the state with which the user's body part was mounted | worn.

  The first mobile terminal 10 and the second mobile terminal 20 have a function of performing short-distance wireless communication when they are close to each other within a predetermined communicable distance. Short-range wireless communication is wireless communication performed without going through the network 100. In this embodiment, the short-range wireless communication is Bluetooth (registered trademark) 4.0 (so-called Bluetooth Low Energy), but other methods such as ANT may be adopted.

  The service server 30 is a server device that provides a predetermined service to the first mobile terminal 10 by communicating with the first mobile terminal 10 via the network 100. In the present embodiment, the service server 30 provides a location notification service that notifies the user or a third party of the location of the user of the first mobile terminal 10. In the present embodiment, the service server 30 is managed and operated by an operator who has installed the position beacon 40.

  The position beacon 40 is a transmitter that is installed in a predetermined space and transmits a beacon signal including position information. The position beacon 40 transmits, for example, by short-range wireless communication using the identification information assigned to the own device as position information. The space in which the position beacon 40 is installed is not particularly limited, but an indoor space is assumed in the present embodiment. An example of an indoor space is a public place such as an airport. The position beacon 40 is used to specify a reference position for positioning by autonomous navigation.

  The third party terminal 45 is used by a third party viewed from the users of the first mobile terminal 10 and the second mobile terminal 20. In the present embodiment, the third party terminal 45 is used by an operator who has installed the position beacon 40. Although the case where the third party terminal 45 is a smartphone is shown in FIG. 1, it may be another terminal device having a communication function and a display function.

FIG. 2 is a block diagram illustrating a hardware configuration of the first mobile terminal 10. As shown in FIG. 2, the first mobile terminal 10 includes a control unit 11, a sensor unit 12, a network communication unit 13, a short-range wireless communication unit 14, a UI (User Interface) unit 15, and a storage unit 16. And a power supply unit 17.
The control unit 11 includes a microcomputer including a CPU (Central Processing Unit) as an arithmetic processing unit and a memory including a ROM (Read Only Memory) and a RAM (Random Access Memory). The control unit 11 functions as an information processing apparatus of the present invention. The CPU controls each unit of the first portable terminal 10 by reading the program stored in the ROM or the storage unit 16 into the RAM and executing the program.

  The sensor unit 12 includes a sensor for measuring the position of the first mobile terminal 10 by autonomous navigation. In the present embodiment, the sensor unit 12 includes an acceleration sensor 121, a gyro sensor (angular velocity sensor) 122, an orientation sensor 123, and an atmospheric pressure sensor 124. Each sensor of the sensor unit 12 measures and measures a physical quantity (first physical quantity) according to the movement of the first mobile terminal 10 (in other words, the user holding the first mobile terminal 10) at a predetermined frequency. The physical quantity is output to the control unit 11. Here, the frequency of measurement refers to the number of times a physical quantity is measured per unit time.

  The acceleration sensor 121 is a triaxial acceleration sensor, and measures the acceleration acting on the first portable terminal 10. The gyro sensor 122 is a triaxial angular velocity sensor, and measures the angular velocity applied to the first mobile terminal 10. The azimuth sensor 123 is, for example, a triaxial geomagnetic sensor, and measures the azimuth to which the own sensor (first mobile terminal 10) is directed by measuring the direction of geomagnetism. The direction sensor 123 is used to specify the moving direction of the user. The atmospheric pressure sensor 124 is a sensor that measures atmospheric pressure. The atmospheric pressure sensor 124 is used to measure the height of the position where the first mobile terminal 10 is present.

  The network communication unit 13 includes, for example, a wireless communication circuit and an antenna, and performs communication by connecting to the network 100 (wireless connection). The short-range wireless communication unit 14 includes, for example, a wireless communication circuit and an antenna, and performs short-range wireless communication by connecting to an external device set as a communication partner (that is, paired). The near field communication unit 14 functions as the first near field communication unit of the present invention. The UI unit 15 is a user interface that includes a display unit that displays an image on a display surface, and a touch sensor that is provided on the display surface of the display unit so as to perform an input operation by a user's contact. The first portable terminal 10 may further include other operation means such as a physical key or may have a function of accepting a voice input operation.

  The storage unit 16 includes a storage device such as an EEPROM (Electronically Erasable and Programmable ROM) and a flash memory, and stores a program executed by the control unit 11. The power supply unit 17 includes a secondary battery as a power supply, supplies power to each unit of the first mobile terminal 10, and measures the remaining battery level of the secondary battery.

FIG. 3 is a block diagram illustrating a hardware configuration of the second mobile terminal 20. As shown in FIG. 3, the second mobile terminal 20 includes a control unit 21, a sensor unit 22, a short-range wireless communication unit 23, an operation unit 24, a storage unit 25, and a power supply unit 26. The control unit 21, the short-range wireless communication unit 23, the storage unit 25, and the power supply unit 26 have the same hardware configuration as the means having the same name of the first mobile terminal 10.
The CPU of the control unit 21 controls each unit of the second portable terminal 20 by reading the program stored in the ROM or the storage unit 25 into the RAM and executing it.

  The sensor unit 22 includes a sensor for measuring the position of the second portable terminal 20 by autonomous navigation. In this embodiment, the sensor unit 22 includes an acceleration sensor 221, a gyro sensor 222, an orientation sensor 223, an atmospheric pressure sensor 224, and a biological sensor 225. Each sensor of the sensor unit 22 measures a physical quantity (second physical quantity) according to the movement of the body of the user wearing the second mobile terminal 20 at a predetermined frequency, and outputs the measured physical quantity to the control unit 21. . The configurations and applications of the acceleration sensor 221, the gyro sensor 222, the azimuth sensor 223, and the atmospheric pressure sensor 224 may be the same as the sensors of the same name in the first mobile terminal 10. The biological sensor 225 is a sensor that measures the user's biological information, and is a sensor that measures, for example, the amount of perspiration of the user.

  The short-range wireless communication unit 23 connects to an external device set as a communication partner and performs short-range wireless communication. The near field communication unit 23 functions as a second near field communication unit of the present invention. The operation unit 24 is an operation unit that includes, for example, a physical key and is operated by a user. The storage unit 25 includes a storage device such as an EEPROM or a flash memory, and stores a program executed by the control unit 21. The power supply unit 26 includes a secondary battery as a power supply, supplies power to each unit of the second mobile terminal 20, and measures the remaining battery level of the secondary battery.

  The service server 30 is a computer device that includes a control unit, a storage unit, and a communication unit. The control unit includes a microcomputer including a CPU, a ROM, and a RAM. The CPU controls each unit of the service server 30 by reading the program stored in the ROM or the storage unit into the RAM and executing the program. The storage unit includes, for example, an HDD (Hard Disk Drive), and stores programs executed by the CPU and various data. The communication unit includes a modem, for example, and communicates with an external device via the network 100.

FIG. 4 is a block diagram illustrating functional configurations of the first mobile terminal 10 and the second mobile terminal 20.
The control part 21 of the 2nd portable terminal 20 implement | achieves the function corresponded to the acquisition part 211 and the transmission part 212 by running a program.
The acquisition unit 211 functions as an acquisition unit that acquires a physical quantity (second physical quantity) measured by each sensor of the sensor unit 22. The sensor of the sensor unit 22 functions as the second sensor of the present invention. The transmission unit 212 functions as a transmission unit that transmits the physical quantity acquired by the acquisition unit 211 to the first mobile terminal 10 via the short-range wireless communication unit 23. For example, the transmission unit 212 may sequentially transmit (for example, transmit in real time) the measured physical quantity, or may accumulate the physical quantity obtained by measurement in a predetermined period and transmit it at a predetermined timing.

The control unit 11 of the first mobile terminal 10 corresponds to the first acquisition unit 111, the second acquisition unit 112, the estimation unit 113, the calculation unit 114, and the output processing unit 115 by executing a program. Realize the function.
The first acquisition unit 111 functions as a first acquisition unit that acquires a physical quantity (first physical quantity) measured by each sensor of the sensor unit 12. The sensor of the sensor unit 12 functions as the first sensor of the present invention.
The second acquisition unit 112 functions as a second acquisition unit that acquires the physical quantity transmitted by the transmission unit 212 of the second mobile terminal 20 via the short-range wireless communication unit 14.

  The estimation unit 113 functions as an estimation unit that estimates the status related to the first mobile terminal 10 based on the physical quantities acquired by the first acquisition unit 111 and the second acquisition unit 112. The status regarding the first mobile terminal 10 includes an activity performed by a user using the first mobile terminal 10 and a holding state of the first mobile terminal 10. In the present embodiment, the activity refers to an activity performed by the user moving a body part, such as manual work, exercise, and daily activities. The activity of this embodiment includes user movement. In this case, the estimation unit 113 estimates the presence / absence of the user's movement and the movement method when the user is moving. Examples of movement methods include walking and vehicles (eg, escalators, elevators, moving walkways, etc.). The holding state of the first portable terminal 10 is a state when the first portable terminal 10 is held by the user. As described above, the holding state of the first mobile terminal 10 is a state of being held by the user's hand, a state of being put in a bag held by the user, or a state of being placed in a baggage cart used by the user. Etc.

  The calculation unit 114 is a calculation method according to the status regarding the first mobile terminal 10 estimated by the estimation unit 113, and is at least one of the physical quantity acquired by the first acquisition unit 111 and the physical quantity acquired by the second acquisition unit 112. And function as a calculation means for calculating the amount of activity of the user. The user activity amount is a numerical value obtained by quantifying the status of the user activity. In this embodiment, the calculation unit 114 calculates a movement amount representing a movement distance and a movement direction of the user in order to obtain the position of the user by autonomous navigation. That is, the movement amount of the user is represented by a movement vector representing the movement of the user. The calculation unit 114 calculates the moving distance of the user based on the physical quantities measured by the acceleration sensor 221, the gyro sensor 222, and the atmospheric pressure sensor 224. For example, the calculation unit 114 calculates the moving distance (displacement) of the user in the direction by second-order integrating the acceleration in the predetermined direction with time. Further, the calculation unit 114 calculates the movement distance in the vertical direction based on the change in atmospheric pressure. The calculation unit 114 obtains the moving direction of the user based on the physical quantity measured by the direction sensor 223.

  The output processing unit 115 functions as an output processing unit that performs a process of outputting data corresponding to the amount of activity calculated by the calculation unit 114. In this embodiment, the output processing unit 115 obtains the user's position based on the reference position specified using the position beacon 40 and the movement amount calculated by the calculation unit 114, and the user's position is displayed on the map. The map data drawn in is output. The output processing unit 115 outputs map data via, for example, the UI unit 15 or the network communication unit 13.

Next, a more specific relationship between the status estimation method and the movement amount calculation method will be described.
FIG. 5 is an explanatory diagram of statuses according to the present embodiment. In the present embodiment, five “status A” to “status E” described below are assumed.

<Status A>
Holding state of the first mobile terminal 10: held in hand.
Holding state of second mobile terminal 20: worn on arm 50.
User activity: Walking Status estimation method:
As shown in FIG. 5, consider a case where the first mobile terminal 10 and the second mobile terminal 20 are held by the same hand of the user. As shown in FIG. 6A, the horizontal axis is the time axis, and the vertical axis is the acceleration in the vertical direction (“+” is the acceleration in the vertical direction, “−” is the acceleration in the vertical direction. The same applies hereinafter). When the temporal change in acceleration is expressed, the time waveform of acceleration of the first mobile terminal 10 and the second mobile terminal 20 is, for example, a sine having approximately the same phase and substantially the same amplitude according to the user's hand swing. Become a wave. When the first mobile terminal 10 and the second mobile terminal 20 are held by different hands, they become sine waves having substantially the same amplitude and almost the same phase according to the user's hand swing.
How to calculate the movement amount:
In the case of status A, the vibrations acting on the first mobile terminal 10 and the second mobile terminal 20 in accordance with the movement of the user are substantially the same. For this reason, the calculation unit 114 may calculate the movement amount using either the physical quantity measured by the sensor unit 12 or the physical quantity measured by the sensor unit 22. For example, when the sensor unit 12 is equipped with a sensor with higher performance (higher accuracy) than the sensor unit 22, the calculation unit 114 calculates the movement amount using the physical quantity measured by the sensor unit 12. .

<Status B>
Holding state of the first portable terminal 10: put on a cart.
Holding state of second mobile terminal 20: worn on arm 50.
User activity: Walking Status estimation method:
As shown in FIG. 5, a case is considered where a bag containing the first portable terminal 10 is placed on the cart 60 and the user presses the cart 60 with both hands. As shown in FIG. 6B, when the horizontal axis represents the time axis and the vertical axis represents the acceleration in the vertical direction, the time of acceleration between the first mobile terminal 10 and the second mobile terminal 20 is expressed. The waveform is, for example, a waveform indicating vibrations that act on each of the first mobile terminal 10 and the second mobile terminal 20 when the cart 60 travels. This time waveform has a smaller amplitude and a higher frequency than in the case of status A.
How to calculate the movement amount:
In the case of status B, the vibrations acting on the first mobile terminal 10 and the second mobile terminal 20 in accordance with the movement of the user are substantially the same. Therefore, the calculation unit 114 may calculate the activity amount using either the physical quantity measured by the sensor unit 12 or the physical quantity measured by the sensor unit 22 as in the case of the status A. The physical quantity measured by the sensor unit 22 is used. When the first portable terminal 10 is put on the cart 60 as in status B, the first portable terminal 10 and the first portable terminal 10 are moved according to the movement of the user as compared with the case where the first portable terminal 10 is held in the hand like status A. The vibration acting on the second portable terminal 20 is small. For this reason, the calculation part 114 makes the moving distance when a certain acceleration is measured larger than the case of status A, for example.

<Status C>
Holding state of the first mobile terminal 10: held in hand.
Holding state of second mobile terminal 20: worn on arm 50.
User activity: Movement by vehicle Status estimation method:
As shown in FIG. 5, consider a case where a user is moving on an escalator 70 that is an example of a vehicle. As shown in FIG. 6C, when the horizontal axis represents the time axis and the vertical axis represents the acceleration in the vertical direction, the user himself / herself is not walking. 2 The acceleration indicating the swing of the hand is zero in both the portable terminal 20. If the vehicle is moving at a constant speed, the acceleration of the first mobile terminal 10 and the second mobile terminal 20 is zero.
Note that the time waveform shown in FIG. 6C is also shown when the user is moving on another vehicle such as an elevator or a moving walk instead of the escalator, although the moving direction and moving speed are different.
How to calculate the movement amount:
In the case of status C, the vibrations acting on the first mobile terminal 10 and the second mobile terminal 20 in accordance with the movement of the user are substantially the same. Therefore, the calculation unit 114 may calculate the activity amount using either the physical quantity measured by the sensor unit 12 or the physical quantity measured by the sensor unit 22 as in the case of the status A. The physical quantity measured by the sensor unit 22 is used. When the user is moving by a vehicle as in status C, it is not necessary to consider moving in a direction other than the moving direction of the vehicle. Therefore, when calculating the movement amount, the calculation unit 114 calculates the movement amount using the acceleration value in the moving direction of the vehicle, and sets the acceleration in other directions to zero.

<Status D>
Holding state of the first portable terminal 10: put in a bag.
Holding state of second mobile terminal 20: worn on arm 50.
User activity: Walking Status estimation method:
As shown in FIG. 5, consider a case where the first mobile terminal 10 and the second mobile terminal 20 are held by another user's hand. As shown in FIG. 6D, when the horizontal axis represents a time axis and the vertical axis represents acceleration in the vertical direction, the time change of acceleration between the first mobile terminal 10 and the second mobile terminal 20 is represented. The waveform is, for example, substantially in reverse phase according to the user's hand swing. The swing of the hand holding the handbag 80 in which the first mobile terminal 10 is put is considered to be smaller than the swing of the hand wearing the second mobile terminal 20. For this reason, the amplitude of the time waveform of the acceleration of the first mobile terminal 10 is smaller than the amplitude of the time waveform of the acceleration of the second mobile terminal 20. When the first mobile terminal 10 and the second mobile terminal 20 are held by the same hand, the temporal change in acceleration is, for example, approximately the same phase and approximately the same amplitude according to the user's hand swing. It becomes a sine wave. However, the amplitude of this time waveform is smaller than that of status A.
How to calculate the movement amount:
In the case of status D, when the vibrations acting on the first portable terminal 10 and the second portable terminal 20 according to the movement of the user are compared, the vibrations acting on the second portable terminal 20 are large. Therefore, the calculation unit 114 calculates an activity amount using the physical quantity measured by the sensor unit 22. In the calculation of the movement amount, for example, the calculation unit 114 sets the movement distance when a certain acceleration is measured to be the same as that in the status A.

<Status E>
Holding state of first mobile terminal 10: placed on a desk.
Holding state of second mobile terminal 20: worn on arm 50.
Activity performed by the user: Working with the hand attached to the second mobile terminal 20.
Status estimation method:
As shown in FIG. 5, consider a case where the user is performing some manual work on the desk 90. As shown in FIG. 6E, when the temporal change in acceleration is expressed with the horizontal axis as the time axis and the vertical axis as the acceleration in the vertical direction, for example, the change in acceleration at a timing with no regularity in the second mobile terminal 20. Is measured, while the acceleration measured by the first mobile terminal 10 is zero.
How to calculate the movement amount:
In the case of status E, the user has not moved. Therefore, the calculation unit 114 calculates the moving distance of the user as zero during the status E period.

  As described above, the estimation unit 113 relates to the first mobile terminal 10 based on the relationship between the temporal change in the physical quantity measured by the sensor unit 12 and the temporal change in the physical quantity measured by the sensor unit 22. Estimate status. However, the status estimation method and the movement amount calculation method described here are merely examples. For example, the estimation unit 113 may estimate the status using a physical quantity measured by the biological sensor 225 mounted on the second mobile terminal 20. When the biological sensor 225 includes a sweat sensor, it is possible to estimate whether the movement is only the user's hand or the entire body of the user using the physical quantity measured by the sweat sensor.

FIG. 7 is a sequence chart showing processing related to positioning executed in the information processing system 1.
First, the control unit 11 of the first mobile terminal 10 performs position registration based on the position beacon 40 (step S1). Here, as shown in FIG. 8, a position beacon 40 is installed at the entrance of the lobby R of the airport. When the control unit 11 receives a beacon signal from the position beacon 40 via the short-range wireless communication unit 14, the control unit 11 inquires of the service server 30 about the reference position via the network communication unit 13. When the base position corresponding to the position information included in the beacon signal is notified from the service server 30, the control unit 11 registers this position as a reference position. Here, the control unit 11 registers that there is a user at the entrance of the lobby R.

  Next, the first mobile terminal 10 and the second mobile terminal 20 set each other as a communication partner for short-range wireless communication and perform pairing (step S2). When pairing is performed and a short-distance communication path is established between the first mobile terminal 10 and the second mobile terminal 20, they are considered to be carried by the same user. Thereafter, whether or not pairing is maintained is confirmed at a predetermined frequency.

  If pairing is performed, the control part 11 of the 1st portable terminal 10 will start the measurement by the sensor part 12 (step S3A). And the control part 11 acquires a physical quantity with the sensor part 12, and memorize | stores it in RAM or the memory | storage part 16 (step S4A). If pairing is performed, the control part 21 of the 2nd portable terminal 20 will start the measurement by the sensor part 22 (step S3B). And the control part 21 acquires a physical quantity from the sensor part 22, and memorize | stores it in RAM or the memory | storage part 25 (step S4B). The control unit 21 transmits the physical quantity acquired from the sensor unit 22 to the first mobile terminal 10 via the short-range wireless communication unit 23 (step S5). The control unit 11 acquires the physical quantity received from the second mobile terminal 20 via the short-range wireless communication unit 14 (step S6).

  Next, the control part 11 estimates the status regarding the 1st portable terminal 10 based on the physical quantity acquired from the sensor part 12, and the physical quantity acquired from the 2nd portable terminal 20 (step S7). The control unit 11 estimates the status using physical quantities measured within a predetermined period in the order from the latest measurement time. The control unit 11 estimates the current status based on the status estimation method described for each of the statuses A to E described above.

  Next, the control unit 11 selects a movement amount calculation method according to the estimated status (step S8). Next, the control unit 11 performs the calculation using at least one of the physical quantity acquired from the sensor unit 12 and the physical quantity acquired from the second mobile terminal 20 based on the selected calculation method, thereby moving the user movement amount. Is calculated (step S9). The control unit 11 calculates the movement amount based on the movement amount calculation method described for each of the statuses A to E described above.

  Next, the control part 11 calculates | requires a user's position based on the result of position registration of step S1, and the movement amount calculated at step S9, and produces | generates map data (step S10). And the control part 11 outputs map data (step S11). For example, the control unit 11 displays the map image P shown in FIG. 9 by outputting the map data to the UI unit 15. The map image P includes an image M1 representing the user's movement trajectory and an image M2 representing the user's current position. The control unit 11 may transmit the map data to the service server 30 via the network communication unit 13. In this case, the service server 30 provides a service for notifying the position of the user of the first mobile terminal 10 by transmitting the map data to the third party terminal 45. For example, at the airport, the staff of the airport can grasp the position of the passenger by using the third party terminal 45.

  In 1st Embodiment demonstrated above, the 1st portable terminal 10 estimates the status regarding the 1st portable terminal 10 using the physical quantity measured with the sensor part of the own terminal, and the sensor part of the 2nd portable terminal 20. FIG. Since the holding state of the second mobile terminal 20 is fixed to the state worn on the arm 50, the physical quantity measured only by the first mobile terminal 10 by referring to the physical quantity measured by the second mobile terminal 20. As compared with the case of referring to only the status estimation accuracy. As a result, the first mobile terminal 10 calculates the movement amount of the user by a calculation method according to the status estimation result, thereby reducing the positioning error due to the state of the mobile terminal when held by the user. be able to.

[Second Embodiment]
The information processing system 1 of this embodiment is different from the first embodiment described above in that the status is estimated by each of the first mobile terminal 10 and the second mobile terminal 20. In this embodiment, the element which attached | subjected the same code | symbol as 1st Embodiment mentioned above functions equivalent to 1st Embodiment mentioned above. Elements that correspond to the elements described in the first embodiment are denoted by “A” at the end of the reference numerals. Since the hardware configuration of each device of the present embodiment is the same as that of the first embodiment described above, description thereof is omitted.

FIG. 10 is a block diagram illustrating functional configurations of the first mobile terminal 10 and the second mobile terminal 20.
The control part 21 of the 2nd portable terminal 20 implement | achieves the function corresponded to the acquisition part 211, the estimation part 213, and the transmission part 212A by running a program.
The acquisition unit 211 functions as an acquisition unit that acquires the physical quantity measured by each sensor of the sensor unit 22. The estimation unit 213 functions as an estimation unit that estimates the status related to the second mobile terminal 20 based on the physical quantity acquired by the acquisition unit 211. The status regarding the second mobile terminal 20 includes an activity performed by a user using the second mobile terminal 20 and a holding state of the second mobile terminal 20. In this estimation, the holding state is estimated to be a state worn on the user's arm 50.

  The transmission unit 212A transmits the physical quantity acquired by the acquisition unit 211 and the status data indicating the status estimated by the estimation unit 213 to the first mobile terminal 10 via the short-range wireless communication unit 23.

The control unit 11 of the first portable terminal 10 executes the program, thereby causing the first acquisition unit 111, the second acquisition unit 112, the estimation unit 113A, the reliability specifying unit 116, the calculation unit 114A, and the output A function corresponding to the processing unit 115 is realized.
The first acquisition unit 111 acquires physical quantities measured by the sensors of the sensor unit 12. The second acquisition unit 112A acquires the physical quantity and status data transmitted from the second portable terminal 20 by the transmission unit 212A via the short-range wireless communication unit 14.

  The estimation unit 113A estimates the status regarding the first mobile terminal 10 based on the physical quantity acquired by the first acquisition unit 111. If the uniquely estimated statuses of the first mobile terminal 10 and the second mobile terminal 20 match, the estimation unit 113A determines that the status is final or an estimation result. When the estimated status differs between the first mobile terminal 10 and the second mobile terminal 20, the estimation unit 113A uses the status estimation result of the second mobile terminal 20 as the status estimation result of the first mobile terminal 10. to correct. For example, when the estimation unit 213 estimates the user's activity as “walking”, the estimation unit 113 </ b> A has a high possibility of actually walking even if the estimation unit 113 </ b> A estimates the user's activity as “still”. Therefore, the estimation unit 213 estimates the user's activity as “walking”. In addition, when estimating a plurality of status candidates, the estimation unit 113A may use a status with higher accuracy as a final status estimation result.

  The reliability specifying unit 116 specifies the reliability of status estimation in the estimation unit 213 and the estimation unit 113A. Although the estimation unit 213 and the estimation unit 113A estimate the status from the time waveform, there are cases where the estimation result is sufficiently reliable by the time waveform and cases where the estimation result is not reliable. Therefore, the reliability specifying unit 116 specifies the reliability of the status estimation based on the physical quantity used for the status estimation. For example, the reliability specifying unit 116 compares the time waveform of the physical quantity with the pattern of the time waveform of the physical quantity corresponding to each status prepared in advance to obtain the reliability. At this time, the reliability specifying unit 116 calculates the similarity between the time waveform of the physical quantity and the pattern of the time waveform of the physical quantity corresponding to each status, and increases the reliability as the similarity is higher. As algorithms for calculating similarity, there are Angular Metrics for Shape Similarity (AMSS), Dynamic Time Warping (DTW), etc., but various similarity calculation algorithms can be adopted.

  The calculation unit 114A calculates the amount of activity of the user based on the reliability specified by the reliability specifying unit 116. The calculation unit 114 </ b> A performs a calculation using the measured physical quantity by a calculation method according to the status of the first mobile terminal 10, calculates the activity amount of the user, and calculates according to the status of the second mobile terminal 20. The method uses the measured physical quantity to calculate the amount of activity of the user. Then, the calculation unit 114A calculates a final activity amount by performing a statistical process (for example, calculating an average value) after weighting the calculated activity amount according to the reliability. Here, the calculation unit 114A increases the weight value as the reliability is higher. The method of reflecting the reliability in the calculation is not limited to this. For example, the calculation unit 114A may not adopt the activity amount when the reliability is equal to or lower than the threshold.

FIG. 11 is a sequence chart showing processing related to positioning executed in the information processing system 1.
First, the control unit 11 of the first mobile terminal 10 performs position registration based on the position beacon 40 (step S1). Next, the first mobile terminal 10 and the second mobile terminal 20 set each other as a communication partner for short-range wireless communication and perform pairing (step S2). If pairing is performed, the control part 11 of the 1st portable terminal 10 will start the measurement by the sensor part 12 (step S3A). And the control part 11 acquires a physical quantity with the sensor part 12, and memorize | stores it in RAM or the memory | storage part 16 (step S4A). Based on the acquired physical quantity, the control unit 11 estimates a status related to the first mobile terminal 10 (step S7A). If pairing is performed, the control part 21 of the 2nd portable terminal 20 will start the measurement by the sensor part 22 (step S3B). And the control part 21 acquires a physical quantity from the sensor part 22, and memorize | stores it in RAM or the memory | storage part 25 (step S4B). The control unit 21 estimates the status related to the second mobile terminal 20 based on the acquired physical quantity (step S7B). And the control part 21 transmits the physical quantity acquired from the sensor part 22, and the status data which shows the estimated status to the 1st portable terminal 10 via the near field communication part 23 (step S5A). The control unit 11 acquires the physical quantity and status data received from the second portable terminal 20 via the short-range wireless communication unit 14 (step S6A).

  Next, the control part 11 specifies the reliability of the estimation of the status regarding the first mobile terminal 10 and the status regarding the second mobile terminal 20 (step S12). Next, the control unit 11 selects a movement amount calculation method according to the estimated status (step S8). Next, the control unit 11 calculates the movement amount of the user by performing calculation based on the selected calculation method and the specified reliability (step S9A). The calculation of the movement amount using the reliability is as already described. Next, the control part 11 produces | generates map data based on the user's position calculated | required from the movement amount calculated by step S9A (step S10). Processing for outputting map data is performed (step S11).

  According to the second embodiment described above, in addition to the operational effects described in the first embodiment, the first mobile terminal 10 reflects the reliability of the status estimation in the calculation of the activity amount. The amount of activity of the user close to can be calculated.

[Modification]
The present invention can be implemented in a form different from the above-described embodiment. The present invention can also be implemented in the following forms, for example. Further, the following modifications may be combined as appropriate.
(Modification 1)
The status estimated by the first mobile terminal 10 is not limited to the status described in the above-described embodiment. For example, as a holding state of the first mobile terminal 10, there may be a holding state in which the first mobile terminal 10 is placed in a breast pocket. In this case, the relationship between the acceleration time waveforms of the second mobile terminal 20 and the first mobile terminal 10 is the relationship between the phases when they are held by the same hand and the phases when they are held by different hands. It becomes the middle. In addition, sleep may be included as an activity performed by the user. In this case, the stationary state continues in both the second portable terminal 20 and the first portable terminal 10, but the second portable terminal 20 measures a movement corresponding to turning over.

(Modification 2)
When the status is estimated by both the first portable terminal 10 and the second portable terminal 20 as in the second embodiment described above, the estimation results of both are basically the same. Moreover, when the same sensor is contained in the 1st portable terminal 10 and the 2nd portable terminal 20, the measured physical quantity may become substantially the same. Since measuring the same physical quantity between the first mobile terminal 10 and the second mobile terminal 20 in this way may be useless from the viewpoint of power consumption, either one of the mobile terminals (here, the second mobile terminal 20). ) Measurement frequency may be lowered.

  In this modification, the control unit 11 realizes a function corresponding to the measurement control unit 117 as shown in FIG. The measurement control unit 117 performs control to reduce or stop the frequency of measurement in the sensor unit 12 or the sensor unit 22 during a period in which the estimated status satisfies a predetermined condition. Below, the case where the frequency of measurement in the sensor part 22 is changed is demonstrated.

FIG. 13 is a sequence chart showing processing related to measurement by a sensor executed in the information processing system 1 of the present modification.
The control unit 11 of the first mobile terminal 10 determines whether or not the status estimation results match between the first mobile terminal 10 and the second mobile terminal 20 (step S21). When it is determined that the status estimation results match (step S21; YES), the control unit 11 transmits measurement control data for reducing the frequency of measurement by the sensor unit 22 via the short-range wireless communication unit 14. 2 Transmit to the portable terminal 20 (step S22). In accordance with this measurement control data, the control unit 21 makes the frequency of measurement by the sensor unit 22 lower than normal (step S23). Thereafter, the control unit 11 of the first mobile terminal 10 determines whether or not the status estimation results are different between the first mobile terminal 10 and the second mobile terminal 20 (step S24). When it is determined that the status estimation results are different (step S24; YES), the control unit 11 transmits measurement control data for returning the measurement frequency of the sensor unit 22 to the original state via the short-range wireless communication unit 14. It transmits to the 2nd portable terminal 20 (step S25). In response to the measurement control data, the control unit 21 returns the frequency of measurement by the sensor unit 22 to the normal frequency (step S26).
In addition, when changing the frequency of measurement in the sensor unit 12, the control unit 11 may perform a process of changing the frequency of measurement in the sensor unit 12 instead of the process of transmitting measurement control data.

In addition to this, when the period during which the status does not change continues for a predetermined period based on the biological signal detected by the biological sensor 225 of the second portable terminal 20, the control unit 11 reduces the frequency of measurement, and the status is If it is determined that there has been a change, the original measurement frequency may be restored. Moreover, the control part 11 may change the frequency of measurement according to the estimated status. For example, the control unit 11 may increase the frequency of measurement in the order that the activity included in the status is running>walking> sleeping. In addition, when the control unit 11 determines that the user exists in a predetermined area (for example, an airport baggage inspection area) as a result of the location registration or using the GPS function of the first mobile terminal 10, The frequency of measurement in the second portable terminal 20 may be made higher than normal.
In this modification, a configuration for stopping the measurement may be employed instead of the configuration for reducing the frequency of measurement at the sensor unit.

(Modification 3)
The present invention can also be applied to systems other than an information processing system that provides a location notification service.
The output processing unit 115 may output notification data for notifying that the calculated activity amount satisfies a predetermined condition. For example, when a maintenance worker such as a railway is a user, the output processing unit 115 performs notification by the first method when an object such as a train approaches and a vibration caused by the object is detected. The notification data is output. For example, the output processing unit 115 outputs notification data for performing notification by outputting a predetermined sound. When it is detected based on the amount of activity that the user's work is continued after the notification, the output processing unit 115 outputs notification data for performing notification by the second method. For example, the output processing unit 115 outputs notification data for performing notification by combining the output of a predetermined sound and the occurrence of vibration in the second portable terminal 20.
The amount of activity is not limited to the amount of movement, and may be any numerical value that quantitatively represents the activity performed by the user, such as calorie consumption or the number of steps.

(Modification 4)
In the embodiment described above, the process performed on the first mobile terminal 10 and the process performed on the second mobile terminal 20 may be reversed. In this case, the physical quantity is transmitted from the first mobile terminal 10 to the second mobile terminal 20. Then, the second portable terminal 20 performs physical quantity acquisition, status estimation, and activity amount calculation. In this case, the control unit 21 of the second mobile terminal 20 functions as the information processing apparatus of the present invention. In addition, the service server 30 may perform acquisition of physical quantities, estimation of status, and calculation of activity quantities. In this case, the control unit of the service server 30 functions as the information processing apparatus of the present invention. Thus, the information processing apparatus of the present invention may be realized by any apparatus.

(Modification 5)
The first portable terminal 10 is not limited to a smartphone, and may be another portable terminal having a plurality of holding states, such as a feature phone.
The second portable terminal 20 is, for example, a portable terminal that is worn on the user's head, such as a headphone type or an earphone type, a necklace type portable terminal that can be worn on the user's neck, and a user's It may be a clip-type portable terminal that can be worn on the body. That is, the 2nd portable terminal 20 should just be a portable terminal used in the state with which the body part of the user was mounted | worn.
The sensors included in the first mobile terminal 10 and the second mobile terminal 20 described in the above-described embodiments are merely examples. It is only necessary to provide a sensor necessary for calculating the amount of activity. In addition, the type of sensor provided in the first mobile terminal 10 and the type of sensor provided in the second mobile terminal 20 may be different.

(Modification 6)
The functions realized by the control unit 11 of the first mobile terminal 10 and the control unit 21 of the second mobile terminal 20 according to the above-described embodiment are realized by a combination of a plurality of programs or by a combination of a plurality of hardware resources. Can be done. When the functions of the control units 11 and 21 are realized using a program, the program can be a magnetic recording medium (magnetic tape, magnetic disk (HDD (Hard Disk Drive), FD (Flexible Disk), etc.)), an optical recording medium. (Such as an optical disc), a magneto-optical recording medium, a semiconductor memory, or other computer-readable recording medium may be provided and may be distributed via a network. The present invention can also be understood as a positioning processing method.

DESCRIPTION OF SYMBOLS 1 ... Information processing system, 10 ... 1st portable terminal, 11, 21 ... Control part, 111 ... 1st acquisition part, 112,112A ... 2nd acquisition part, 113,113A ... Estimation part, 114, 114A ... Calculation part, DESCRIPTION OF SYMBOLS 115 ... Output processing part, 116 ... Reliability specification part, 12, 22 ... Sensor part, 121, 221 ... Acceleration sensor, 122, 222 ... Gyro sensor, 123, 223 ... Direction sensor, 124, 224 ... Pressure sensor, 13 ... Network communication unit 14, 23 ... Short-range wireless communication unit, 15 ... UI unit, 16, 25 ... Storage unit, 17, 26 ... Power supply unit, 20 ... Second mobile terminal, 201 ... Mounting unit, 211 ... Acquisition unit, 212, 212A ... transmission unit, 213 ... estimation unit, 225 ... biosensor, 24 ... operation unit, 30 ... service server, 40 ... location beacon, 45 ... third party terminal, 50 ... arm

Claims (10)

First acquisition means for acquiring a first physical quantity corresponding to the movement of the user's body measured by a first sensor included in the first portable terminal;
Second acquisition means for acquiring a second physical quantity corresponding to the movement of the body measured by a second sensor provided in a second portable terminal attached to the body part of the user;
Estimating means for estimating an activity performed by the user and a holding state by the user of the first mobile terminal based on the acquired first physical quantity and the second physical quantity;
An information processing apparatus comprising: calculation means for calculating the activity amount of the user using at least one of the first physical quantity and the second physical quantity by a calculation method according to the estimated activity and the holding state. The calculating means includes
The information processing apparatus according to claim 1, wherein the activity amount is calculated using the second physical quantity when the estimated activity and the holding state satisfy a condition in advance. A reliability specifying means for specifying the reliability of the estimation of the activity and the holding state;
The information processing apparatus according to claim 1, wherein the calculation unit calculates the activity amount based on the specified reliability. The information processing apparatus according to any one of claims 1 to 3, wherein the calculation unit calculates a movement amount representing a movement distance and a movement direction of the user as the activity amount. The information processing apparatus according to claim 4, further comprising: an output processing unit that outputs map data in which the position of the user obtained from the movement amount is drawn on a map. The information processing apparatus according to any one of claims 1 to 4, further comprising output processing means for outputting notification data for notifying that the amount of activity satisfies a predetermined condition. A measurement control means for reducing or stopping the frequency of measurement in one of the first sensor and the second sensor in a period in which the estimated activity and the holding state satisfy a predetermined condition. The information processing apparatus according to any one of claims 1 to 6, wherein the information processing apparatus is characterized. The information processing apparatus according to any one of claims 1 to 7, wherein the information processing apparatus is provided in the first portable terminal or the second portable terminal. A first portable terminal having a first short-range wireless communication means for performing short-range wireless communication, and a first sensor for measuring a first physical quantity according to the movement of the user's body;
A second short-range wireless communication means for performing short-range wireless communication; a mounting unit to be mounted on a part of the user's body; and a second sensor for measuring a second physical quantity according to the movement of the body. A second portable terminal having
First acquisition means for acquiring the first physical quantity;
Second acquisition means for acquiring the second physical quantity;
Activities performed by the user based on the first physical quantity and the second physical quantity measured when the short-range wireless communication is performed between the first mobile terminal and the second mobile terminal And an estimating means for estimating a holding state by the user of the first portable terminal;
An information processing system comprising: calculation means for calculating the activity amount of the user using at least one of the first physical quantity and the second physical quantity by a calculation method according to the estimated activity and the holding state. On the computer,
Obtaining a first physical quantity corresponding to a user's body movement measured by a first sensor included in the first portable terminal;
Obtaining a second physical quantity corresponding to the movement of the body measured by a second sensor provided in a second portable terminal attached to the body part of the user;
Estimating the activity performed by the user and the holding state of the first mobile terminal by the user based on the acquired first physical quantity and the second physical quantity;
A program for executing the step of calculating the activity amount of the user using at least one of the first physical quantity and the second physical quantity by a calculation method according to the estimated activity and the holding state.

Images