JP6083799B2 - Mobile device location determination method, mobile device, mobile device location determination system, program, and information storage medium - Google Patents

Description

  The present invention relates to a mobile device location determination method, a mobile device, a mobile device location determination system, a program, and an information storage medium.

  In recent years, not only mobile phones, but also heat stroke warning meters, calorie consumption meters, pedometers, and other devices for notification or measurement in pockets are increasing. Such a portable device is stored (carried) in various places depending on the day or time depending on the presence or absence and shape of a pocket of clothing worn simultaneously with the belt. However, when such a portable device is hung from the neck and stored in the pocket of the pants, there is a difference in the noticeability and the measurement accuracy, and sometimes even the risk of life is exposed. For this reason, the mobile device itself needs to detect the location (portable location) and adapt the behavior.

  Conventionally, techniques for determining the location of a portable device (portable location) that can be put in a pocket or provided from the neck during periodic exercise such as during walking have been proposed (Non-Patent Documents 1 to 4). These use the property that the force received by the inertial sensor (acceleration / gyro sensor) built in the mobile device varies depending on the mobile location. In addition, there is an example in which location determination is performed using a specific movement that occurs when moving a portable place under the condition that a rest time of 3 seconds is around before and after walking (Non-Patent Document 5). .

K. Kunze, et al. Where am I: Recognizing On-body Positions of Wearable Sensors. In Proc. Of International Workshop on Location- and Context-Awareness (LoCA 2005), LNCS 3479, pp.264-275, 2005. A. Vahdatpour, et al. On-body Device Localization for Health and Medical Monitoring Applications.In Proc. Of the 201l IEEE International Conference on Pervasive Computing and Communications (PERCOM '11), pp.37-44, 2011. Y. Shi, Y. Shi, and J. Liu.A Rotation based Method for Detecting On-body Positions of Mobile Devices.In Proc. Of the 13th international conference on Ubiquitous computing (UbiComp '11), pp. 559-560, 2011. K. Fujinami, S. Kouchi, and Y Xue; “Design and Implementation of an On-body Placement-aware Smartphone”, In Proceedings of the 32nd International Conference on Distributed Computing Systems Workshops (presented in International Workshop on Sensing, Networking, and Computing with Smart Phones (PhoneCom 2012)), pp.69-74, Macau, June 18, 2012. Kim, Fujinami; “Determining the location of a mobile phone using stored movement patterns”, IPSJ Ubiquitous Computing System 21st Conference (UB21), IPSJ 2009-UB-21, pp. 23-30, 4 March 2009. K. Murao and T. Terada; “A motion recognition method by constancy-decision”, In Proceedings of the 14th International Symposium on Wearable Computers (ISWC2010), pp.69-72, 2010. S.-J.Cho, et al. Two-stage Recognition of Raw Acceleration Signals for 3-D Gesture-Understanding Cell Phones. In Proc. Of the Tenth International Workshop on Frontiers in Handwriting Recognition, 2006. Y. Xue, S. Hosokawa, S. Murata, S. Kouchi and K. Fujinami; “An On-body Placement-aware Heatstroke Alert on a Smartphone”, In Proceedings of the 2012 International Conference on Digital Contents and Applications (DCA 2012 ), pp.226-234, South Korea, 16 December 2012.

  First, in the conventional technology only for periodic exercise, when the place where the portable device is carried is changed when standing or sitting, it cannot be detected immediately. For example, when an operation (gesture) of moving a portable device from a breast pocket to a front pocket of trousers is performed, it is not detected during this gesture, and it is not known that the location has changed unless it starts moving again. On the other hand, Non-Patent Document 5 attempts to identify a movement (gesture) peculiar to a storage destination by extracting a single change in signal at the time of movement. Need before and after. In other words, a section for performing a destination specifying process called “segment” is further cut out from a “window” composed of 15 seconds of data, but requires a stationary section of 3 seconds before and after. However, it is practically unrealistic to provide such a stationary section.

  Non-Patent Document 6 proposes to detect the presence or absence of periodic motion as a segment cutout method. In other words, during a walk that is a periodic motion, a similar acceleration waveform appears repeatedly, so the peak of the autocorrelation of the acceleration signal appears, but in the case of a gesture, it is a single shot and no peak appears. Identify the segment. However, with this method, it is necessary that the rhythm of walking (movement of the mobile device) does not change significantly, so it has been experimentally confirmed that it cannot cope with the following two states.

1) Starting to climb the stairs, changing direction, and when walking down to the flat ground from the stairs, the gait changes from the stationary state to the start of walking and vice versa 2) Irregular as seen when walking with the device held around the neck Movement of portable device These are erroneous determinations as “gesture segments” despite walking, and are cases that need to be resolved in consideration of expanding the usable range of portable location determination.

  The present invention has been made in view of the above-described problems, and according to some aspects of the present invention, the portable device can be easily grasped not only when walking but also when stationary. It is possible to provide a portable location determination method, a portable device, a portable location determination system for a portable device, a program, and an information storage medium that can be continued.

(1) A portable device determination method for a portable device according to the present invention includes:
A method for determining a portable location of a portable device on a portable device's body, comprising:
A data acquisition step of continuously acquiring data from an inertial sensor provided in the portable device;
A determination target data extraction step for extracting at least part of the data acquired in the data acquisition step as determination target data;
A plurality of gestures for obtaining a magnitude of variation of data included in the determination target data and changing a portable place of the portable device by the portable person in the determination target data based on the magnitude of the variation. A gesture determination step for determining whether or not a gesture pattern corresponding to any of the patterns exists;
A portable place determination step of determining a portable place of the portable device based on a determination result in the gesture determination step.

  According to the portable location determination method according to the present invention, the mobile device is not focused on the irregularity of the rhythm of the movement of the mobile device as in the conventional method, but by focusing on the variation in the data acquired from the inertial sensor. It is possible to cut out a gesture pattern corresponding to a gesture for changing the portable location of the natural and highly accurate. Thereby, it becomes possible to keep grasping the portable place of the portable device not only while walking but also when stationary.

(2) In the mobile device location determination method of the mobile device according to the present invention,
The portable place determination step includes
If it is determined in the gesture determination step that the gesture pattern is present, a first determination is made as to whether or not the current portable location of the portable device is in hand based on a previous determination result of the portable location of the portable device. A portable location determination step may be included.

  In the mobile location determination method according to the present invention, paying attention to the fact that the mobile location of the mobile device changes whenever the mobile location is changed, the current mobile location is in hand based on the previous determination result of the mobile location. Or not. By performing the determination in consideration of the context regarding the transition of the portable place, the determination accuracy of the portable place can be improved.

(3) In the portable place determination method of the portable device according to the present invention,
The portable place determination step includes
If it is determined in the first portable location determination step that the current portable location of the portable device is not in hand, the gesture pattern corresponds to which of the plurality of gestures, and based on the identification result, You may make it further include the 2nd portable place determination step which determines the present portable place of a portable device.

  According to the portable location determination method according to the present invention, when the portable location of the portable device is changed, attention is always given to passing through the hand, and the specific portable location is determined only when the current portable location is not available. (Identify. By performing the determination in consideration of the context regarding the transition of the portable place, the determination accuracy of the portable place can be improved. Furthermore, by determining the specific mobile location only when the current mobile location is not in hand, efficient mobile location determination can be performed without waste.

(4) In the portable device portable location determination method according to the present invention,
In the second portable place determination step,
You may make it hold | maintain the determination result of the present portable place of the said portable device.

  In the portable device portable place determination method according to the present invention, if a gesture pattern exists and the portable place is not in hand, even if the most likely portable place is determined (specified) based on the gesture pattern, the portable place is determined. Considering the possibility of being indistinguishable from the case where the device is not carried around, the determination result is temporarily suspended without being fixed immediately. Thereby, it is possible to prevent the mobile device from being erroneously determined as being carried without being carried, and to improve the determination accuracy of the portable location.

(5) In the portable place determination method of the portable device according to the present invention,
In the first portable place determination step,
If the previous determination result of the portable location of the portable device is in hand and there is no pending determination result in the second portable location determination step, the current portable location of the portable device is not in hand. In other cases, it may be determined that the current portable location of the portable device is in hand.

  In the mobile location determination method according to the present invention, paying attention to the fact that the mobile location of the mobile device changes whenever the mobile device is changed, whether the mobile device has moved from the hand or not based on past determination results. Determine whether it was done. By performing the determination in consideration of the context regarding the transition of the portable place, the determination accuracy of the portable place can be improved.

(6) In the mobile device location determination method of the mobile device according to the present invention,
The portable place determination step includes
When it is determined in the gesture determination step that the gesture pattern does not exist, the state of the portable device is based on the determination target data, and includes a plurality of states including a stationary state and a movement state associated with the movement of the wearer. A device state determination step for determining which is,
If it is determined in the device state determination step that the state of the portable device is a stationary state, the portable device is in the portable state if the second portable location determination step is performed on the previous determination target data. And a third portable place determination step for determining that the person is not carried on the person's body.

  In the portable place determination method according to the present invention, when a gesture for changing the portable place of a portable device is performed, even if a specific portable place is determined (specified) in the previous determination, the portable place is determined after the gesture ends. If the device is stationary, it is determined that the portable device is not carried. As a result, it is possible to prevent a mobile device from being erroneously determined as being carried even though the gesture is finished and until the next gesture is performed. Accuracy can be increased.

(7) In the mobile device location determination method of the mobile device according to the present invention,
The portable place determination step includes
If it is determined in the device state determination step that the state of the portable device is a moving state, the determination target data of this time is not performed unless the second portable location determination step is performed on the previous determination target data. A fourth portable place determination step for determining the portable place of the portable device based on the above may be further included.

  In the mobile location determination method according to the present invention, when the mobile device is in a moving state, the specific mobile location is continuously determined. As a result, it is possible to continue to identify the portable place even when the portable person is walking, and when the portable person starts determining the portable place while walking, the portable place can be specified even before the first gesture is performed. .

(8) In the mobile device location determination method of the mobile device according to the present invention,
In the portable place determination step,
When it is determined in the device state determination step that the state of the mobile device is a moving state, the fourth mobile location is also determined when the second mobile location determination step is performed on the previous determination target data. A determination step may be performed.

(9) In the portable device portable place determination method according to the present invention,
The portable place determination step includes
If it is determined in the device state determination step that the state of the mobile device is not stationary, the second mobile location determination is performed if the second mobile location determination step is performed on the previous determination target data. You may make it further include the pending | holding determination result confirmation step which fixes the pending | holding determination result in a step.

In the portable place determination method according to the present invention, after it is determined that the portable device is not in a stationary state, a specific portable place determination result of the portable device associated with the immediately preceding gesture is determined. Accordingly, it is possible to prevent erroneous determination that the mobile device is actually carried when the mobile device is not carried, so that the determination accuracy of the mobile location can be improved.

(10) In the portable device portable place determination method according to the present invention,
In the second portable place determination step,
At least one feature quantity of a quartile range, a third quartile, a root mean square, a standard deviation, and an absolute value of a maximum value is calculated for the determination target data, and the gesture is based on the calculation result. It may be possible to specify which of the plurality of gestures corresponds to the pattern.

(11) In the mobile device location determination method of the mobile device according to the present invention,
The gesture determination step includes:
Smoothing data included in the determination target data;
Calculating a local standard deviation for each of the smoothed data;
Comparing each of the local standard deviations with a predetermined threshold.

  According to the portable location determination method according to the present invention, it is possible to extract a variation in data acquired from an inertial sensor and realize a highly accurate gesture determination.

(12) In the portable device portable place determination method according to the present invention,
At least a part of the inertial sensor may be an acceleration sensor.

(13) The portable device according to the present invention is
A portable device having a function of determining a portable place on a body of a wearer,
An inertial sensor;
A data acquisition unit for continuously acquiring data from the inertial sensor;
A determination target data extraction unit that extracts at least part of the data acquired by the data acquisition unit as determination target data; and
A plurality of gestures for obtaining a magnitude of variation of data included in the determination target data and changing a portable place of the portable device by the portable person in the determination target data based on the magnitude of the variation. A gesture determination unit for determining whether or not a gesture pattern corresponding to any one of them exists,
A portable location determination unit that determines a portable location of the portable device based on a determination result of the gesture determination unit.

In the portable device according to the present invention,
The portable location determination unit includes processing of the first portable location determination step (first portable location determination processing), processing of the second portable location determination step (second portable location determination processing), and device state determination. Step processing (device state determination processing), third portable location determination step processing (third portable location determination processing), fourth portable location determination step processing (fourth portable location determination processing), and pending You may make it perform at least 1 of the process of a determination result confirmation step (pending determination result confirmation process).

  According to the mobile device according to the present invention, the mobile device can be carried by not focusing on the irregularity of the movement rhythm of the mobile device as in the conventional method, but by focusing on the variation in the data acquired from the inertial sensor. A gesture pattern corresponding to a gesture for changing a place can be cut out naturally and with high accuracy. Thereby, it becomes possible to keep grasping the portable place of the portable device not only while walking but also when stationary.

(14) The portable device according to the present invention is
A warning information generating unit that generates warning information according to the current mobile location of the mobile device determined by the mobile location determination unit;
A warning information output control unit that controls an output method of the warning information according to the portable location of the portable device determined by the portable location determination unit.

  According to the portable device according to the present invention, the warning information and the output method thereof can be changed according to the portable place of the portable device. Therefore, for example, the warning information is output by one or both of sound and vibration depending on the portable place, and the volume information and the vibration intensity are changed depending on the portable place, so that the carrier can use the warning information regardless of the portable place. It can be easily noticed.

(15) A portable device according to the present invention includes:
It further includes a measurement unit that measures a predetermined physical quantity,
The warning information generation unit
The measurement value of the measurement unit may be corrected according to the portable location of the portable device determined by the portable location determination unit, and the warning information including the information of the corrected measurement value may be generated.

  According to the portable device according to the present invention, it is possible to appropriately correct the measurement value according to the portable place of the portable device and bring it close to the true value. Accordingly, it is possible to prevent erroneous information due to an inappropriate portable place from being output regarding a predetermined phenomenon or symptom determined from a measured value.

(16) A portable device portable place determination system according to the present invention includes:
A system for determining a portable location of a portable device on a body of a portable device carrier,
The portable device provided with an inertial sensor;
An information processing apparatus that communicates with the portable device,
The portable device and the information processing apparatus cooperate with each other,
A data acquisition process for continuously acquiring data from the inertial sensor;
A determination target data extraction process for extracting at least part of the data acquired in the data acquisition process as determination target data;
A plurality of gestures for obtaining a magnitude of variation of data included in the determination target data and changing a portable place of the portable device by the portable person in the determination target data based on the magnitude of the variation. Gesture determination processing for determining whether or not a gesture pattern corresponding to any one of them exists,
And a portable location determination process for determining a portable location of the portable device based on a determination result in the gesture determination processing.

  According to the portable location determination system according to the present invention, the portable device and the information processing apparatus cooperate with each other, and data obtained from an inertial sensor is used instead of focusing on irregularities in the rhythm of movement of the portable device as in the conventional method. By paying attention to the variation of the gesture pattern, the gesture pattern corresponding to the gesture for changing the portable place of the portable device can be cut out naturally and with high accuracy. Thereby, it becomes possible to keep grasping the portable place of the portable device not only while walking but also when stationary.

(17) A program according to the present invention includes:
A program that is executed in a mobile device or an information processing apparatus that communicates with the mobile device, and that determines a mobile location of the mobile device on a body of a mobile user of the mobile device,
In the portable device or the information processing apparatus,
A data acquisition step of continuously acquiring data from an inertial sensor provided in the portable device;
A determination target data extraction step for extracting at least part of the data acquired in the data acquisition step as determination target data;
A plurality of gestures for obtaining a magnitude of variation of data included in the determination target data and changing a portable place of the portable device by the portable person in the determination target data based on the magnitude of the variation. A gesture determination step for determining whether or not a gesture pattern corresponding to any of the patterns exists;
And a portable location determination step of determining a portable location of the portable device based on a determination result in the gesture determination step.

(18) An information storage medium according to the present invention provides:
A computer-readable information storage medium in which the above program is stored.

The figure which shows the structural example of the portable device of this embodiment. The figure which shows an example of the external appearance of the portable device of this embodiment. Explanatory drawing of a data queue. The flowchart figure which shows an example of the determination procedure of the portable place of a portable device. The flowchart figure which shows the detailed procedure of a gesture determination process. The figure which shows the experimental result regarding a gesture determination process. The figure which shows the transition of the portable place of a portable device. The flowchart figure which shows the detailed procedure of a portable place determination process at the time of determining with a gesture pattern by a gesture determination process. The figure which shows the contribution order of the feature-value in a 2nd portable place determination process. The flowchart figure which shows the detailed procedure of a portable place determination process at the time of determining with a gesture pattern not having a gesture pattern. The figure which shows the structural example of the portable place determination system of this embodiment. The figure which shows the structural example of the portable warning device of this embodiment. The flowchart figure which shows an example of the procedure of the output process of warning information. The flowchart figure which shows the modification of the detailed procedure of a portable place determination process at the time of determining with a gesture pattern not having a gesture pattern. The flowchart figure which shows the modification of the detailed procedure of a portable place determination process at the time of determining with a gesture pattern by a gesture determination process. The flowchart figure which shows the other modification of the detailed procedure of the portable place determination process at the time of determining with a gesture pattern not having a gesture pattern.

  DESCRIPTION OF EMBODIMENTS Hereinafter, preferred embodiments of the present invention will be described in detail with reference to the drawings. The embodiments described below do not unduly limit the contents of the present invention described in the claims. Also, not all of the configurations described below are essential constituent requirements of the present invention.

1. Mobile device and method for determining mobile location
[Configuration of mobile device]
FIG. 1 is a diagram illustrating a configuration example of a portable device according to the present embodiment. FIG. 2 is a diagram illustrating an example of the appearance of the portable device according to the present embodiment. As shown in FIG. 1, the portable device 1 of this embodiment includes a processing unit 10, an inertial sensor 20, an operation unit 30, a visual transmission unit 40, an auditory transmission unit 50, a tactile transmission unit 60, a storage unit 70, and an information storage medium. 80 and the communication part 90 are comprised.

  As the inertial sensor 20, an acceleration sensor, an angular velocity sensor, an angular acceleration sensor, or the like can be considered. The portable device 1 may include a plurality of different types of inertial sensors 20 such as an acceleration sensor and an angular velocity sensor, for example. Although the number of detection axes of the inertial sensor 20 is arbitrary, three or more axes are preferable. Hereinafter, an example in which a triaxial acceleration sensor is used as the inertial sensor 20 will be described. In the present embodiment, as shown in FIG. 2, the inertial sensor 20 is configured such that the z axis is substantially perpendicular to a plane (display surface) including the display unit of the mobile device 1, and the x axis and the y axis are short of the display surface. It is attached to the inside of the portable device 1 so as to be substantially parallel to the side and the long side, respectively. However, the inertial sensor 20 may be attached so that a part or all of the inertial sensor 20 is exposed to the outside (surface) of the portable device 1.

  The operation unit 30 performs a process of acquiring an operation signal corresponding to an operation by a portable person (hereinafter referred to as a user) of the mobile device 1 and sending the operation signal to the processing unit 10. The operation unit 30 is, for example, a touch panel display, buttons, keys, a microphone, and the like.

  The visual transmission unit 40 outputs visual information such as characters, figures, colors, and blinks to the outside, and examples thereof include a display and an LED. In addition, you may make it use the operation part 30 and the visual transmission part 40 by one touchscreen type display.

  The auditory transmission unit 50 outputs auditory information such as sound and voice to the outside, and is, for example, a speaker.

  The tactile transmission unit 60 outputs tactile information such as vibration to the outside, and is, for example, a vibrator.

  The storage unit 70 includes a ROM and stores various data and basic programs (OS). The storage unit 70 includes a RAM, and is also used as a work area for the processing unit 10 to perform various calculation processes and control processes. The storage unit 70 reads application programs and application data read from the information storage medium 80, and the inertial sensor 20. It is also used to temporarily store the acquired data and the calculation results executed by the processing unit 10 according to various programs.

  In particular, in the present embodiment, the storage unit 70 is provided with a data queue 72 that is a storage area for storing data acquired by the processing unit 10 from the inertial sensor 20.

  The information storage medium 80 is a computer-readable storage medium for storing programs and data. In particular, in the present embodiment, a program for determining the portable location of the portable device 1 is stored. In addition, the information storage medium 80 may function as a recording unit that records data that needs to be stored for a long time among the data generated by the processing of the processing unit 10. The information storage medium 80 can be realized by, for example, an optical disk (CD, DVD, BD), a magneto-optical disk (MO), a magnetic disk, a hard disk, a magnetic tape, or a memory (ROM, flash memory, etc.).

  The communication unit 90 performs data communication with a server via a network such as the Internet or a LAN, or performs data communication with another portable device by short-range communication.

The processing unit 10 is, for example, a CPU, and is acquired from a process according to an operation signal from the operation unit 30 or from the inertial sensor 20 according to a program stored in the storage unit 70 or a program stored in the information storage medium 80. Various control processes such as a process based on the processed data, an output control of the visual transmission unit 40, an auditory transmission unit 50, and a tactile transmission unit 60 and a communication control of the communication unit 90 are performed.

  In particular, in the present embodiment, the processing unit 10 executes a program stored in the information storage medium 80, whereby a data acquisition unit 11, a determination target data extraction unit 12, a gesture determination unit 13, and a mobile phone described below are executed. It functions as the place determination unit 14. Alternatively, the program may be received via a communication unit 90 from a server connected to a wired or wireless communication network, stored in the storage unit 70 or the information storage medium 80, and executed. However, at least some of the data acquisition unit 11, the determination target data extraction unit 12, the gesture determination unit 13, and the portable place determination unit 14 may be realized by hardware (a dedicated circuit).

The data acquisition unit 11 performs processing (data acquisition processing) for acquiring data (three-axis acceleration data) continuously from the inertial sensor 20. Specifically, as shown in FIG. 3, the data acquisition unit 11, each time to obtain the three-axis acceleration data at a predetermined sampling period Delta] t _s, the data contained in the data queue 72 (previously acquired 3 The time index of (axis acceleration data) is shifted to the previous position, and the acquired three-axis acceleration data is (x _N−1 , y _N−1 , z _N) at the end of the data queue 72 whose time index is t _{N−1. -1} ). Therefore, when the triaxial acceleration data is acquired N times after the data acquisition unit 11 starts processing, the data queue 72 includes the acceleration data acquired from the first time to the Nth time. When the data acquisition unit 11 acquires the triaxial acceleration data for the (N + 1) th time, the triaxial acceleration data acquired for the first time is expelled from the data queue 72, and the acceleration data acquired for the (N + 1) th time from the second time is stored in the data queue 72. It will be included.

  The determination target data extraction unit 12 performs a process (determination target data extraction process) of extracting at least a part of the data acquired by the data acquisition unit 11 as determination target data.

  The gesture determination unit 13 obtains the magnitude of variation in the data included in the determination target data extracted by the determination target data extraction unit 12, and based on the magnitude of the variation, the gesture determination unit 13 includes a mobile phone by the user. A process (gesture determination process) for determining whether or not there is a gesture pattern corresponding to any of a plurality of gestures for changing the portable location of the device 1 is performed.

  In the present embodiment, the gesture determination process includes a process of smoothing data included in the determination target data, a process of calculating a local standard deviation for each of the smoothed data, and the local standard. Comparing each of the deviations with a predetermined threshold.

  The portable place determination unit 14 performs a process of determining the portable place of the portable device 1 (portable place determination process) based on the determination result of the gesture determination unit 13.

  In particular, in the present embodiment, when the mobile location determination unit 14 determines that the gesture pattern is present by the gesture determination unit 13, the current mobile location of the mobile device 1 based on the previous determination result of the mobile location of the mobile device 1. A process for determining whether or not the user is in the hands of the user (first portable place determination process) is performed.

Moreover, the portable location determination part 14 specifies which gesture pattern corresponds to a gesture pattern, when it determines with the present portable location of the portable device 1 not being in a user's hand in a 1st portable location determination process. The process of determining the current mobile location of the mobile device 1 based on the identification result (second mobile location determination process) may be performed. For example, the portable location determination unit 14 determines the absolute values of the quartile range, the third quartile, the root mean square, the standard deviation, and the absolute value of the determination target data in the second portable location determination process. At least one feature amount may be calculated, and it may be specified which of the plurality of gestures corresponds to the gesture pattern based on the calculation result.

  In addition, the mobile location determination unit 14 may further perform a process of holding the determination result of the current mobile location of the mobile device 1 in the second mobile location determination process. In this case, the mobile location determination unit 14 determines that the previous determination result of the mobile location of the mobile device 1 is “in the hands of the user”, and the determination result suspended in the second mobile location determination process (the determination result on hold). ), It is determined that the current mobile location of the mobile device 1 is not in hand, and in other cases (the previous determination result of the mobile location of the mobile device 1 is not “user's hand” or is pending) If there is a result), the current mobile location of the mobile device 1 may be determined to be “in the hands of the user”.

  In addition, when the gesture determination unit 13 determines that the gesture pattern does not exist, the portable location determination unit 14 determines that the state of the portable device 1 is a stationary state and a movement state associated with the movement of the user based on the determination target data. It is also possible to perform processing (device state determination processing) for determining which state is one of a plurality of states including.

  In addition, when the mobile location determination unit 14 determines that the state of the mobile device 1 is a stationary state in the device state determination process, the mobile location determination unit 14 performs the second mobile location determination process on the previous determination target data. You may make it perform the process (3rd portable place determination process) which determines with the portable device 1 not being carried on a user's body.

  Moreover, when it is determined that the state of the mobile device 1 is the moving state in the device state determination process, the mobile location determination unit 14 does not perform the second mobile location determination process on the previous determination target data. You may make it perform the process (4th portable place determination process) which determines the portable place of the portable device 1 based on this determination object data. Furthermore, when the mobile location determination unit 14 determines that the state of the mobile device 1 is the moving state in the device state determination process, the mobile location determination unit 14 may have performed the second mobile location determination process on the previous determination target data. The fourth portable place determination process may be performed.

  In addition, when the mobile location determination unit 14 determines that the state of the mobile device 1 is not stationary in the device status determination process, the mobile location determination unit 14 holds the second mobile location determination process for the previous determination target data. You may make it perform the process (Pending determination result confirmation process) which confirms the inside determination result.

  In addition, the portable location determination unit 14 determines that the current portable location of the portable device 1 is in the user's hand, or determines that the portable device 1 is not carried on the user's body, or When the pending determination result determination process is performed, a process of deleting the pending determination result (pending determination result erasing process) may be performed.

  Further, the processing unit 10 may perform a predetermined process based on the determination result of the portable location of the portable device 1. For example, the processing unit 10 may perform a process of externally outputting information on the portable location of the mobile device 1 from some or all of the visual transmission unit 40, the auditory transmission unit 50, and the tactile transmission unit 60. The information (characters, graphics, color, blinking, sound, voice, vibration, etc.) output from the unit 40, the auditory transmission unit 50, and the tactile transmission unit 60 is corrected or changed according to the portable location of the portable device 1. Also good. Further, for example, the processing unit 10 selects which of the visual transmission unit 40, the auditory transmission unit 50, and the tactile transmission unit 60 (one or two or more may be selected) and outputs information. You may perform the process changed according to the portable place of the portable device 1. FIG.

  Note that the mobile device 1 of the present embodiment may have a configuration in which some of the elements illustrated in FIG. 1 are omitted or changed, or other elements are added.

[Determine procedure for mobile location]
Next, an example of the procedure for determining the portable location of the portable device 1 will be described with reference to the flowchart shown in FIG. Note that the data acquisition unit 11 operates independently of the determination target data extraction unit 12, the gesture determination unit 13, and the portable place determination unit 14, and in parallel with the processing of FIG. Data acquisition to 72 continues.

As shown in FIG. 4, first, the processing unit 10 (determination target data extraction unit 12) performs window generation processing (an example of determination target data extraction processing) (S10). In the present embodiment, the processing unit 10 acquires N data (in short, all data) from the data queue 72 and collects them as a processing unit called a window (an example of determination target data). As the number of data (window size) N in one window increases, the amount of information related to the characteristics of each portable place increases, so that the performance of portable place determination described later improves. However, since the determination is performed on the window, it is desirable to be configured in a uniform state such as walking or standing upright. This includes the time required for one change (storage and retrieval) of the portable place. Considering the above, when the sampling period △ _{t s} of the output data of the inertial sensor 20 to assume that 40 msec (25 Hz sampling frequency), for example, can be 256 samples (10.24 seconds) as the window size N .

Prior to data acquisition from the data queue 72, the processing unit 10 acquires the time and stores it in the variable t _start .

  Next, the processing unit 10 (gesture determination unit 13) performs a gesture determination process for determining whether or not a gesture pattern exists in the window generated in step S10 (S12). The action (gesture) to be detected by the gesture determination is an action of changing (moving) the portable place of the portable device 1 by the user, the action of storing the portable device 1 in a predetermined place, and the portable device 1 from the portable place. It includes an operation of taking out, an operation of placing the mobile device 1 on a desk, and an operation of taking up the mobile device 1 from the desk. In the present embodiment, an operation of changing the portable location of the mobile device 1 by the user and other operations, for example, an operation in which the user walks without changing the mobile location of the mobile device 1 or the user does not carry the mobile device 1. In order to distinguish the operation performed in step 1, the gesture determination process focusing on the variation of the triaxial acceleration data is performed. Details of the gesture determination processing in step S12 will be described later.

  When it is determined in the gesture determination process in step S12 that there is no gesture pattern (N in S14), the processing unit 10 performs a process of removing the gravitational acceleration component from the triaxial acceleration data in the window generated in step S10 (S16). . Since the triaxial acceleration data obtained from the inertial sensor 20 includes a gravitational acceleration component, it is removed in step S16. For removing the gravitational acceleration component, a known method, for example, a method proposed in Non-Patent Document 7 can be used.

  Next, the processing unit 10 (portable location determination unit 14) performs the mobile location determination process of the mobile device 1 using the triaxial acceleration data (N samples) from which the gravitational acceleration component is removed in step S16 ( S18). Details of the portable place determination process in step S18 (mobile place determination process when it is determined that there is no gesture pattern) will be described later.

Next, the processing unit 10 calculates a waiting time (Δt _w ) until the next window generation (S20), waits for Δt _w (S32), and then performs the processing after step S10 again. The processing unit 10 needs to wait for a time obtained by subtracting the processing time required for the processes of steps S10 to S18 when performing the portable location determination process of step S18 for each predetermined interval Δt _decision . In step S20, this waiting time (Δt _w ) is calculated. If the start time of step S20 is t _now , Δt _w can be calculated by the following equation (1). Note that Δt _decision is set to a sufficiently short time (eg, 320 milliseconds (corresponding to 8 samples)) with respect to the window size N (eg, 256 samples (10.24 seconds)).

  If it is determined in the gesture determination process in step S12 that there is a gesture pattern (Y in S14), the processing unit 10 performs a gesture pattern cut-out process (S22). That is, the processing unit 10 acquired during the operation of changing the portable location of the mobile device 1 from the three-axis acceleration data in the window generated in step S10 based on the calculation result in the gesture determination process in step S12. Is extracted as a gesture pattern. Details of the gesture pattern cut-out processing in step S22 will be described later.

  Next, the processing unit 10 performs a process of removing the gravitational acceleration component from the gesture pattern (triaxial acceleration data) cut out in step S22 (S24). Since the gravitational acceleration component is included in the triaxial acceleration data obtained from the inertial sensor 20, it is removed from the gesture pattern in step S24. For removing the gravitational acceleration component, a known method, for example, a method proposed in Non-Patent Document 7 can be used.

  Next, the processing unit 10 (portable place determination unit 14) performs a portable place determination process of the portable device 1 using the gesture pattern (triaxial acceleration data) from which the gravitational acceleration component is removed in step S24 (S26). . The details of the portable location determination process in this step S26 (mobile location determination process when it is determined that there is a gesture pattern) will be described later.

Next, the processing unit 10 calculates the time (ΔT _remove ) for the gesture pattern to flow out of the data queue 72 (S28). In order to perform the gesture pattern cut-out process of step S22 only once for one gesture, the next window generation process (S10) until the already detected gesture pattern disappears from the data queue 72. Need to wait. In step S28, a time Δt _remove until this gesture pattern flows from the data queue 72 and disappears is calculated. When the last data of the gesture pattern is k-th from the head of the data queue 72 (time index is t _k−1 ), when the data is newly acquired from the inertial sensor 20 k times, the gesture pattern flows out of the data queue 72 and disappears. Therefore, Δt _remove can be calculated by the following equation (2).

Next, the processing unit 10 calculates a waiting time (Δt _w ) until the next window generation (S30), waits for Δt _w (S32), and then performs the processing after step S10 again. The processing unit 10 has only to wait for the time obtained by subtracting the processing time required for the processing of steps S10 to S28 from Δt _remove . In step S30, this waiting time (Δt _w ) is calculated.

If the end time of the gesture pattern is t _fin and the start time of step S30 is t _now , Δt _w can be calculated by the following equation (3). However, when Δt _w becomes a negative value, Δt _w = 0. Note that _tfin can be calculated based on the time index of the last data of the gesture pattern.

[Detailed steps for gesture determination processing]
FIG. 5 is a flowchart showing a detailed procedure of the gesture determination process (the process of S12 in FIG. 4). As shown in FIG. 5, the processing unit 10 first performs a calculation for smoothing the triaxial acceleration data present in the window generated in step S <b> 10 of FIG. 4 (S <b> 121). This smoothing is a so-called moving average. Based on the following equation (4), an average value of acceleration data of each axis is calculated for _a minute section (2d _a +1 sample) in the window, and this is calculated as 1 The sample is moved sample by sample to remove high frequency components including noise. That is, carried out by the average value calculation of the acceleration A [i] and their front and rear _{d a} sample in添宇i [0, N-1] of the formula (4). A [i] represents an acceleration signal array on an arbitrary axis (corresponding to the 2nd to 4th row days of the data queue 72 shown in FIG. 3). It is necessary to determine d _a by conducting experiments so that it does not become too large.

In Equation (4), the vicinity of both ends of the array A [i] (i <d _a or i ≧ N−d _a ) cannot secure a minute section of 2d _a +1 samples. Street. That is, when the i _{<d a} adds the A [k] in the interval 0 ≦ k ≦ i + _{d a} divide by k _{+ d} a +1. Similarly, when i ≧ N−d _a , A [k] is added in a section of i−d _a ≦ k ≦ N−1 and divided by d _a + N−k.

Next, the processing unit 10 calculates the standard deviation of the triaxial acceleration data smoothed in step S121 (S122). Specifically, the following equation (5) is applied to the acceleration data A ′ [i] of each axis smoothed by the equation (4), and the standard deviation of the acceleration data of the minute interval (2d _v +1 sample) is applied. (Moving standard deviation) sd [i] is calculated. For d _v, a longer interval to calculate the standard deviation as large, calculation results waveforms seen by plotting becomes gradually overall low in step S123. For this reason, it becomes difficult to separate the gesture patterns that are close in time, or it is easy to erroneously determine the presence or absence of the gesture pattern in the processing after step S125. Therefore, it is necessary to determine by experiments or the like so as not to become too large for d _v.

In Equation (5), the vicinity of both ends of the array A ′ [i] (i <d _v or i ≧ N−d _v ) cannot secure a minute section of 2d _v +1 samples, but the processing in step S121 Similarly, i _{<d v} calculates the sd [i] in the interval 0 ≦ k ≦ i + _{d v} when, when i ≧ _{N-d v} is _{i-d v} ≦ k ≦ with N-1 interval sd [I] is calculated.

  Next, the processing unit 10 applies the following equation (6), and calculates the average value of the standard deviation of the triaxial acceleration data calculated in step S122 (S123).

Next, the processing unit 10 multiplies the average value SD [i] of the standard deviation of the triaxial acceleration data calculated in step S123 by a correction count R [i] expressed by the following equation (7). Thus, SD [i] is corrected (S124). By this correction calculation, distortion due to a small number of samples near both ends (i <d _v or i ≧ N−d _v ) can be removed during the standard deviation calculation in step S122. In the equation (7), lack is a shortage for sd [i] number of samples regular small section near the ends of the _(2d v +1), when i _{<d v} is lack = _{d v} - i, when i ≧ _{N-d v} is _{lack = i + d v - (} N-1), when _{d v ≦ i <N-d} v is lack = 0.

  Next, the processing unit 10 compares the average value SD [i] × R [i] of the standard deviation corrected and calculated in step S124 with the threshold th, and searches for i that is equal to or greater than the threshold th (S125).

  Then, if there is a SD [i] × R [i] pattern that is equal to or greater than the threshold th for i consecutive in M or more times (Y in S126), the processing unit 10 determines that “there is a gesture pattern. ”(S127). If such a pattern does not exist (N in S126), it is determined that“ no gesture pattern ”(S128).

  Note that the higher the threshold th, the lower the possibility that a slight movement will be erroneously determined as a gesture, but accordingly, a section shorter than the original section of the operation of changing the mobile location of the mobile device 1 is determined as a gesture. There is a possibility that the determination in the second portable place determination process described later tends to fail. For this reason, the threshold th needs to be determined through experiments and the like so as not to be too high. Further, it is necessary to appropriately determine M according to the threshold value th so as not to make an erroneous determination.

  If the processing unit 10 determines that “there is a gesture pattern”, SD [i] × R [i] continues for M times or more in the window in the above-described gesture cutout process (the process in step S22 in FIG. 4). Then, the triaxial acceleration data A [j] to A [k] are cut out as gesture patterns for i = j to k that is equal to or greater than the threshold th.

When the gesture pattern extends over two windows, there is a possibility that one gesture is erroneously determined as two gestures. Therefore, the processing unit 10 uses SD [i] × R [
i] is greater than or equal to the threshold th from the beginning of the window (i = 0) (when SD [0] × R [0] ≧ th), or SD [i] × R [i] is the end of the window ( When i is greater than or equal to the threshold th until i = N−1 (when SD [N−1] × R [N−1] ≧ th), “no gesture pattern” is determined in the window. In this way, the window size N (for example, 256 samples (10.24 seconds)) is sufficiently longer than the time required for one gesture, so all the gesture patterns are within the window (except for the first and last). When entering, it is determined that “there is a gesture pattern”, and erroneous determination can be prevented.

  FIG. 6 is a diagram illustrating an experimental result regarding the gesture determination processing. In this experiment, the subject took out the mobile device in the front pocket of the trousers and took it out from the walking state, and then stored it in the front pocket of the trousers again, and the three-axis acceleration obtained from the mobile device during this series of operations. Gesture determination processing was performed on the data. The top graph in FIG. 6 is a graph of triaxial acceleration data (raw data) acquired from the mobile device. The middle graph of FIG. 6 is a graph of triaxial acceleration data that is smoothed by applying Equation (4) to triaxial acceleration data (raw data). The graph at the bottom of FIG. 6 is a graph of the data after performing the correction calculation by multiplying the smoothed triaxial acceleration data by Expression (5), Expression (6), and Expression (7). It is. The horizontal axis of the three graphs is time.

In this experiment, _{d a} 20 sample of the formula (4), Equation (5), _{d v} a 25 sample of the formula (7), the threshold value th (corresponding to 1.0 seconds) to 90, M 25 sample and did. In this experimental result, for example, it is determined that there is no gesture pattern in the window (n-2) and the window (n-1), and it is determined that there is a gesture pattern in the subsequent window (n). This gesture pattern 1 corresponds to an operation in which the subject takes out the portable device from the front pocket of the pants. In the next window (n + 1) started after the end of gesture pattern 1, it is determined again that there is a gesture pattern. This gesture pattern 2 corresponds to an operation in which the subject stores the portable device in the front pocket of the pants. In the next window (n + 2) started after the end of the gesture pattern 2, it is determined that there is no gesture pattern. From this experimental result, it is possible to calculate the location of the portable device by performing the calculation of Equation (4), Equation (5), Equation (6) and the correction calculation by multiplying Equation (7) focusing on the variation of the triaxial acceleration data. It can be seen that the operation to be changed can be clearly distinguished from other operations.

[Detailed procedure for mobile location determination]
Typical portable places of the portable device 1 are “hands”, “neck”, “chest pocket”, “chest pocket”, “jacket pocket”, “trouser front pocket”, “trouser rear pocket”, etc. Can be considered. Therefore, in the present embodiment, the processing unit 10 determines that the current mobile location of the mobile device 1 is “hand”, “neck”, “chest pocket”, “jacket pocket”, “trousers” in the mobile location determination process. It is determined whether it is “front pocket” or “rear pants pocket”, and when the user places the portable device 1 on a desk or the like, it is determined as “not portable”. However, some of these portable places may be excluded from the determination target, and other portable places may be added to the determination target.

  By the way, the change of the portable place of the portable device 1 is always performed via the user's hand. That is, as shown in FIG. 7, if the current mobile location is other than “hand”, the mobile location should be “hand” by the next gesture. Therefore, if the processing unit 10 determines that “there is a gesture pattern” in the gesture determination process, the processing unit 10 always adds a restriction that the route passes “hand”, and pays attention to the determination result of the previous mobile location, Determine the location.

First, details of the portable place determination process when it is determined that there is a gesture pattern in the gesture determination process will be described. FIG. 8 is a flowchart showing a detailed procedure of the portable place determination process (the process of S26 in FIG. 4) when it is determined that there is a gesture pattern in the gesture determination process.

  As illustrated in FIG. 8, the processing unit 10 first determines the current determination result based on the previous determination result (the determination result of the portable location for the previous window) and the presence / absence of the determination result on hold in the process of step S263 described later. A process of determining whether the portable place is “handy” (first portable place determination process) is performed (S261). Specifically, the processing unit 10 determines that the current mobile location is not “handy” when the immediately preceding judgment result is “handy” and there is no pending judgment result (Y in S261). . The processing unit 10 refers to the determination result immediately before to determine whether the gesture is “movement from the hand” or “movement to the hand”.

  If the processing unit 10 determines in step S261 that the current portable place is not “handy”, the portable part determination process (second portable place) focusing on the storing operation (the changing operation from the hand of the portable place) is performed. Judgment processing) is performed (S263). That is, the processing unit 10 identifies the type of gesture from the gesture pattern (triaxial acceleration data) from which the gravitational acceleration component has been removed in step S24 of FIG. 4 and determines the current portable location of the portable device 1. Specifically, the processing unit 10 performs a gesture from “hand” to “neck”, a gesture stored from “hand” to “chest pocket”, a gesture stored from “hand” to “jacket pocket”, “hand” ”To store in the front pocket of trousers, or the gesture to store from“ hands ”to“ back pocket of trousers ”, and the current mobile location is“ neck ”or“ chest pocket ” , “Chest pocket”, “jacket pocket”, “trouser front pocket”, or “trouser rear pocket”.

  As this method, a method using a feature amount obtained by ignoring a time-series feature or a method reflecting a time-series feature (waveform) can be considered. The former corresponds to a technique using a classifier such as a neural network or a support vector machine (SVM), and the latter corresponds to a technique using a hidden Markov model (HMM) or Dynamic Time Warping (DTW). Any method can be selected based on the calculation amount and accuracy.

  The processing unit 10 puts the determination result obtained in the process of step S263 on hold without immediately confirming the determination result of the current window. This is because if the previous determination result (the determination result of the previous window) is “hand”, the mobile location has been changed from “hand” to another location or placed on a desk or the like as the current state. This is because the two patterns of the mobile phone can be considered, but these two patterns cannot be distinguished at the time of the determination process in step S263. As a general rule, this determination result is determined in the determination process for the next window.

  In step S261, the processing unit 10 determines that the current mobile location is “hand” if the previous determination result is not “hand” or there is a pending determination result (N in S261) (S262). ), A process of erasing the pending judgment result (pending judgment result erasing process) is performed (S264).

Note that, in the process of step S263 (second portable place determination process), when a technique using a classifier such as a neural network or a support vector machine (SVM) is employed, for example, a gesture pattern from which the gravitational acceleration component has been removed. The total of 21 types of feature quantities calculated from the three-axis acceleration data included in the following can be given as an input to the classifier. In the following description of the feature quantity, the “gesture pattern from which the gravitational acceleration component is removed” is simply referred to as “gesture pattern”. In addition, it is assumed that the size of the gesture pattern is L, and the acceleration values of the respective axes included in the gesture pattern are A _x [k], A _y [k], A _z [k] (k = 0 to L−1).

[1] Standard deviation of each of the x-axis, y-axis, and z-axis The standard deviation of the x-axis, the standard deviation of the y-axis, and the standard deviation of the z-axis are expressed by the following equations (8x), (8y), and (8z), respectively. Calculated.

[2] Absolute value of the minimum value of each of the x-axis, y-axis, and z-axis The absolute value of the minimum value of the acceleration of each axis included in the gesture pattern.

[3] Absolute value of the maximum value of each of the x-axis, y-axis, and z-axis This is the absolute value of the maximum value of the acceleration of each axis included in the gesture pattern.

[4] Third quartile of each of the x-axis, y-axis, and z-axis 75% position (L × 0.75th) when the acceleration values of each axis included in the gesture pattern are arranged in ascending order Acceleration value.

[5] Quartile range of each of the x-axis, y-axis, and z-axis The acceleration value at a position of 25% (L × 0.25th) when the acceleration values of each axis included in the gesture pattern are arranged in ascending order And the acceleration value at the 75% position (L × 0.75th).

[6] Root mean square of each of x axis, y axis, and z axis The root mean square of x axis, the root mean square of y axis, and the root mean square of z axis are respectively expressed by the following equations (9x), (9y), Calculated by (9z).

[7] Correlation coefficient between x-axis and y-axis, between y-axis and z-axis, and between z-axis and x-axis Correlation coefficient between x-axis and y-axis, correlation coefficient between y-axis and z-axis The correlation coefficients between the z axis and the x axis are calculated by the following equations (10xy), (10yz), and (10zx), respectively.

  According to the experiment, the contribution order of these 21 feature amounts in the determination in step S263 is as shown in FIG. From FIG. 9, in order to increase the determination accuracy, the quartile range (especially the x axis), the third quartile (especially the x axis), the root mean square (especially the x axis), and the standard deviation (especially the x axis). It is considered effective to input a feature quantity including at least one of the absolute values (in particular, the z axis) of the maximum value to the classifier.

  Next, details of the portable place determination process when it is determined that there is no gesture pattern in the gesture determination process will be described. FIG. 10 is a flowchart showing a detailed procedure of the portable place determination process (the process of S18 in FIG. 4) when it is determined that there is no gesture pattern in the gesture determination process.

  As shown in FIG. 10, the processing unit 10 first determines the state of the mobile device 1 from the triaxial acceleration data (N samples in the window) from which the gravitational acceleration component is removed in step S16 of FIG. Processing (device state determination processing) is performed (S181). In step S181, the processing unit 10 determines that the state of the mobile device 1 is “stationary state”, “movement state” associated with the user's walking, and “other state” (irregular movement that is neither stationary nor movement associated with walking). It is determined which one is. For this determination, a known method, for example, the method proposed in Non-Patent Document 6 can be used.

  If the processing unit 10 determines in step S181 that the state of the mobile device 1 is “still state” (Y in S182), the processing unit 10 immediately before (in the previous window) the processing in step S263 in FIG. If the portable place determination process is being executed (Y in S183), a process (third portable place determination process) for determining that the portable device 1 is “not being carried” on the user's body is performed (S184). Further, a process of deleting the pending determination result (pending determination result deleting process) is performed (S185). If the process of step S263 (second portable place determination process) was executed in the previous window, it means that there was some gesture immediately before. Then, the “still state” immediately after that means that it is taken out from any portable place and placed in a place (desktop or in a bag) unrelated to human movement.

  If the processing unit 10 has not performed the process of step S263 (second mobile location determination process) immediately before (N of S183), the processing unit 10 does not determine the mobile location in this window (S186), and the previous determination Take over the results.

In addition, when the processing unit 10 determines in step S181 that the state of the mobile device 1 is “moving state” (N in S182 and Y in S187), the processing unit 10 immediately before (in the previous window) in step S263. The process (second portable place determination process) is not executed (S18)
8) and the previous determination (of the previous window) is not “handy” (N in S189), the mobile location determination process (fourth mobile location determination processing) focusing on the user's walking motion is performed. Perform (S190). That is, the processing unit 10 pays attention to the fact that the periodic movement of the mobile device 1 that appears due to the user's walk varies depending on the mobile location, and the triaxial acceleration data (N pieces of data) from which the gravitational acceleration component is removed in step S16 of FIG. The current portable location of the portable device 1 is determined from the sample. Specifically, in the processing unit 10, the portable device 1 has any of the following locations: “neck”, “chest pocket”, “jacket pocket”, “trouser front pocket”, and “trouser rear pocket”. Determine whether.

  For this determination, a known method, for example, a pattern recognition method using a neural network (multilayer perceptron (MLP)) or a support vector machine (SVM) as proposed in Non-Patent Documents 1, 2, and 4. Etc. can be used. For example, when using a multilayer perceptron (MLP), the feature amount given as an input to the classifier can be as proposed in Non-Patent Document 4.

  The processing unit 10 has not executed the process of step S263 (second mobile location determination process) immediately before (in the previous window) (N in S188), and the previous determination (in the previous window) is not performed. If it is “hand” (Y in S189), the mobile location is not determined in this window (S186), and the previous determination result is taken over.

  If the processing unit 10 has executed the process of step S263 (second portable location determination process) immediately before (Y of S188), the processing unit 10 performs the process of determining the pending determination result (the pending determination result determination process). (S192), and further, a process of deleting the pending determination result (pending determination result deleting process) is performed (S193). When the process of step S263 (second portable place determination process) is executed immediately before, the process of step S192 is performed even though the mobile device 1 is originally moved to a new portable place. This is to prevent the erroneous determination of “hand” from continuing for a while after the user walks.

  In addition, when the processing unit 10 determines in step S181 that the state of the mobile device 1 is “other state” (N in S182 and N in S187), the processing unit 10 immediately before (in the previous window), step S263. If the process (second portable place determination process) is executed (Y in S191), a process for determining the pending determination result (pending determination result determination process) is performed (S192), and further pending. The process of deleting the determination result (pending determination result deletion process) is performed (S193).

  If the processing unit 10 has not performed the process of step S263 (second mobile location determination process) immediately before (N of S191), the processing unit 10 does not determine the mobile location in the current window (S186), and determines immediately before. Take over the results.

[effect]
According to the portable device portable location determination method of the present embodiment described above, the data obtained from the inertial sensor 20 is not focused on the irregularity of the movement rhythm of the portable device 1 as in the conventional method. By paying attention to the variation, a gesture pattern corresponding to a gesture for changing the portable location of the portable device 1 can be cut out naturally and with high accuracy. Thereby, it becomes possible to keep track of the portable place of the portable device 1 not only when the user is walking but also when the user is stationary.

  Further, according to the portable device portable place determination method of the present embodiment, paying attention to the fact that the portable place of the portable device 1 is changed without fail, the portable place as shown in FIG. By performing the determination in consideration of the transition, the determination accuracy of the portable place can be increased.

  Further, according to the portable device portable place determination method of the present embodiment, for example, the presence of the portable device 1 in a representative portable place (neck, chest pocket, jacket pocket, trouser front pocket, trouser rear pocket). Can be detected.

  Further, according to the portable device location determination method of the portable device of the present embodiment, it is possible to detect that the portable location has changed even when the user is stationary in addition to walking while the user is walking. For this reason, the application using the information on the portable location of the portable device 1 can operate without any breaks.

  In addition, according to the portable device location determination method of the present embodiment, a conscious stationary time of 3 seconds or more has been conventionally required when performing the portable location determination process when the user is stationary, but this is not necessary. And natural judgment becomes possible.

  In addition, according to the portable device portable place determination method of the present embodiment, it is possible to prevent erroneous determination as a “gesture” during walking with a rhythm of movement of the portable device 1 that is difficult with the conventional method. Is possible.

  Further, according to the portable device portable place determination method of the present embodiment, the inertial sensor 20 can be realized with only a three-axis acceleration sensor, and thus can be applied to a pedometer as well as a portable telephone.

2. In the above-described embodiment, the mobile device itself determines the mobile location. However, the mobile device and the information processing apparatus cooperate to construct a system for determining the mobile device's mobile location. Is possible. FIG. 11 is a diagram illustrating a configuration example of the portable place determination system according to the present embodiment. In FIG. 11, the same components as those in FIG. As shown in FIG. 11, the portable location determination system 2 of the present embodiment includes a portable device 1 </ b> A and an information processing apparatus 3.

  The portable device 1A includes a processing unit 10A, an inertial sensor 20, an operation unit 30, a visual transmission unit 40, an auditory transmission unit 50, a tactile transmission unit 60, a storage unit 70, an information storage medium 80, and a communication unit 90. Yes.

  The functions of the inertial sensor 20, the operation unit 30, the visual transmission unit 40, the auditory transmission unit 50, the tactile transmission unit 60, the storage unit 70, the information storage medium 80, and the communication unit 90 are the same as those of the mobile device 1 (FIG. 1). Therefore, the description thereof is omitted.

  The processing unit 10 </ b> A is, for example, a CPU, and is acquired from processing according to an operation signal from the operation unit 30 or the inertial sensor 20 according to a program stored in the storage unit 70 or a program stored in the information storage medium 80. Various control processes such as a process based on the processed data, an output control of the visual transmission unit 40, an auditory transmission unit 50, and a tactile transmission unit 60 and a communication control of the communication unit 90 are performed.

  In particular, in the present embodiment, the processing unit 10A executes a program stored in the information storage medium 80, whereby the data acquisition unit 11, the determination target data extraction unit 12, the gesture determination unit 13, and the portable location determination unit 14A. Function as. Alternatively, the program may be received from a server connected to a wired or wireless communication network, stored in the storage unit 70 or the information storage medium 80, and executed. However, at least a part of the data acquisition unit 11, the determination target data extraction unit 12, the gesture determination unit 13, and the portable place determination unit 14A may be realized by hardware (a dedicated circuit).

  Since the functions of the data acquisition unit 11, the determination target data extraction unit 12, and the gesture determination unit 13 are the same as those of the mobile device 1 (FIG. 1), description thereof is omitted.

  The portable place determination unit 14A performs the first portable place determination process, the third portable place determination process, the device state determination process, the pending determination result determination process, and the pending determination result deletion process described above. The portable place determination process and the fourth portable place determination process are not performed.

  The information processing device 3 performs the second portable place determination process and the fourth portable place determination process. Therefore, the processing unit 10A transmits information necessary for the second portable location determination process and the fourth portable location determination process to the information processing device 3 via the communication unit 90. Information transmitted from the processing unit 10A to the information processing device 3 includes identification information for identifying either the second portable location determination process or the fourth portable location determination process, and is subject to the second portable location determination process. And the data of the window to be subjected to the fourth portable place determination process. The processing unit 10A calculates a feature amount necessary for the second portable location determination process or the fourth portable location determination process from the gesture pattern, and transmits the feature amount data instead of the gesture pattern or window data. Also good. Whether to transmit a gesture pattern or window data or feature amount data may be determined in consideration of, for example, the feature amount calculation cost and the transmission cost.

  The information processing apparatus 3 includes a processing unit 210, a storage unit 270, an information storage medium 280, and a communication unit 290. The functions of the storage unit 270, the information storage medium 280, and the communication unit 290 are the same as those of the storage unit 70, the information storage medium 80, and the communication unit 90 of the portable device 1A.

  The processing unit 210 is, for example, a CPU, and performs various calculations such as processing based on data acquired via the communication unit 290 according to a program stored in the storage unit 270 or a program stored in the information storage medium 280. Various control processes such as processing and communication control of the communication unit 90 are performed.

  In particular, in the present embodiment, the processing unit 210 functions as the portable location determination unit 214 by executing a program stored in the information storage medium 280. Alternatively, the program may be received from a server connected to a wired or wireless communication network, stored in the storage unit 270 or the information storage medium 280, and executed. However, at least a part of the portable place determination unit 14 may be realized by hardware (dedicated circuit).

  The portable place determination unit 214 performs the above-described second portable place determination process and fourth portable place determination process using various types of information received from the portable device 1 via the communication unit 290.

  The processing unit 210 transmits information on the mobile location determined in the second mobile location determination process or the fourth mobile location determination process to the mobile device 1A via the communication unit 290. The mobile device 1A receives the mobile location information via the communication unit 90, and performs mobile location determination processing excluding the second mobile location determination processing and the fourth mobile location determination processing.

  The communication between the communication unit 90 and the communication unit 290 may be wired communication, but wireless communication is preferable in order not to limit the movement of the user. For example, when the user also carries the information processing apparatus 3, the communication unit 90 and the communication unit 290 may perform short-range wireless communication such as Bluetooth (registered trademark). The information processing device 3 may be a server connected to a network such as the Internet or a LAN. In this case, the communication unit 90 and the communication unit 290 perform wireless communication via a network access point. Just do it.

Note that the portable location determination system 2 of the present embodiment may be configured such that some of the elements illustrated in FIG. 11 are omitted or changed, or other elements are added.

  According to the portable location determination system of the present embodiment, by delegating the second portable location determination process and the fourth portable location determination process, which have a high calculation cost, to the information processing apparatus 3 having sufficient battery and computational resources, Even if the portable device 1A is a small device (a device with low processing capability), the portable location information can be used.

  The portable device 1A and the information processing apparatus 3 may perform the above-described data acquisition process, determination target data extraction process, gesture determination process, and portable place determination process in cooperation with each other. The method of dividing the processing performed by the information processing device 3 is not particularly limited. For example, the mobile device 1A performs data acquisition processing, determination target data extraction processing, and gesture determination processing (without performing mobile location determination processing), and the information processing device 3 performs all processing of the mobile location determination processing. Also good. Further, for example, the mobile device 1A may perform data acquisition processing, and the information processing device 3 may perform determination target data extraction processing, gesture determination processing, and mobile location determination processing.

3. Application Example The portable device 1 according to the above-described embodiment can be used for various purposes because the portable device 1 can keep track of the portable place not only when the user is walking but also when stationary. Can do. For example, the following uses can be considered.

Application 1: Information notification Information notification plays an important role in transmitting information to the user by means other than vision, such as notification of incoming calls of mobile phones and mails, and environmental risk warnings described later, when the mobile device is carried. In the preliminary investigations so far, it has been found that the volume at which the user notices the notification varies depending on the place where the portable device is carried. By using the information on the portable place, it is possible to notify the user with an optimum volume. If you always notify at the maximum volume so that you can notice even the hardest to notice, it can be a nuisance to the surroundings. However, this problem is unlikely to occur when notification is made at the optimum volume according to the place where the mobile phone is carried. It is also known that there is a difference in time until the notice by vibration is noticed for each portable place. For this reason, at the beginning of the manner mode, it is noticed by vibration, but if the user's action is not seen even after the “awareness time”, it can be forcibly notified by sound. Become. This makes it possible to reliably transmit important warnings while respecting the act of setting the notification method to the manner mode.

Use 2: Environmental Risk Monitoring / Warning In recent years, due to the need for power saving in conjunction with the summer heat, the number of people suffering from heat stroke is increasing, and various personal portable heat stroke warning meters are being sold. In such a commercial product, the degree of danger is calculated from the temperature and relative humidity, and it is assumed that the product can be provided with a strap from the neck to touch the outside air. However, the user does not always follow this premise, and may carry it in another place for various reasons. An experiment was conducted to see the difference in temperature and humidity depending on the location of the mobile phone. When placed in a pants pocket, a higher level of heatstroke warning is issued due to body temperature and sweat. It was confirmed that “underestimation” and vice versa could occur. In order for the warning device to be effective while respecting the user's transportation style, it is necessary to appropriately use the portable place information. As usage, 1) correction to the value measured in the ideal state, 2) presenting the WBGT value and the mobile location information at the current location, and leaving the judgment to the user 3) going out to the user Warning. Non-Patent Document 8 shows applicability to heat stroke warning. In addition to heat stroke, it can be applied to a portable alarm device that warns of diseases related to temperature and humidity. Influenza is said to have a rapid increase in morbidity when the absolute humidity falls below 11 g. The absolute humidity is calculated using temperature and (relative) humidity, and the above-described correction technique based on the portable place can be applied here. Also, the discomfort index can be expressed in terms of temperature and temperature and is applicable. Furthermore, since the temperature (WCI) related to the risk of frostbite in the severe winter season can be calculated from the air temperature and the wind speed, if the wind speed information can be obtained by any method, the air temperature can be corrected and an accurate WCI can be calculated.

Use 3: Action recognition Research is being conducted to recognize human actions using sensors centered on acceleration sensors. In action recognition, a recognition feature amount is calculated from raw data obtained from a sensor, input to a recognizer (or classifier), and an action name is obtained as an output. At this time, it is conceivable to switch the recognition method to the optimum one for each portable place of the sensor. It is considered that a technique specialized for a portable place has higher performance than a general-purpose technique that does not depend on a portable place. On the other hand, there are pros and cons of recognition for each place where the sensor is carried. Sensors from the neck have been found to be effective in distinguishing between brushing behavior and sitting behavior (such as reading). When using an application that recognizes tooth brushing behavior and uses that information, if the sensor is in the pocket of the pants for some reason, it will not be able to be recognized normally and will lead to waste of power. For this reason, it is necessary to notify the user of the movement to an identifiable location, or to stop the processing if the notification is not followed, and the portable location information is considered useful as meta information for that purpose. .

[Concrete example]
As an application example of the portable device 1 of the above-described embodiment, a portable warning device that realizes the usage 1 and the usage 2 will be described below.

  FIG. 12 is a diagram illustrating a configuration example of the portable warning device according to the present embodiment. 12, the same components as those in FIG. 1 are denoted by the same reference numerals. As shown in FIG. 12, the portable warning device 1B of this embodiment includes a processing unit 10B, an inertial sensor 20, an operation unit 30, a visual transmission unit 40, an auditory transmission unit 50, a tactile transmission unit 60, a storage unit 70, and information. A storage medium 80, a communication unit 90, and a measurement unit 100 are included. The functions of the inertial sensor 20, the operation unit 30, the visual transmission unit 40, the auditory transmission unit 50, the tactile transmission unit 60, the storage unit 70, the information storage medium 80, and the communication unit 90 are the same as those in FIG. Is omitted.

  The measuring unit 100 measures a predetermined physical quantity that affects the phenomenon to be warned. In the present embodiment, the measurement unit 100 includes a temperature sensor 101 and a humidity sensor 102, and can measure temperature and humidity. For example, heat stroke and influenza are affected by temperature and humidity.

  The processing unit 10B is, for example, a CPU, and performs processing according to an operation signal from the operation unit 30 according to a program stored in the storage unit 70 or a program stored in the information storage medium 80, and is acquired from the inertial sensor 20. Various calculation processes such as processing based on the acquired data, processing based on data acquired from the measurement unit 100, various output control such as visual transmission unit 40, auditory transmission unit 50, tactile transmission unit 60 and communication control of the communication unit 90 The control process is performed.

  In particular, in the present embodiment, the processing unit 10B executes a program stored in the information storage medium 80, whereby the data acquisition unit 11, the determination target data extraction unit 12, the gesture determination unit 13, and the portable location determination unit 14 are executed. , Functions as a warning information generation unit 15 and a warning information output control unit 16. Alternatively, the program may be received via a communication unit 90 from a server connected to a wired or wireless communication network, stored in the storage unit 70 or the information storage medium 80, and executed. However, at least a part of the data acquisition unit 11, the determination target data extraction unit 12, the gesture determination unit 13, the portable place determination unit 14, the warning information generation unit 15, and the warning information output control unit 16 is realized by hardware (dedicated circuit). May be.

The functions of the data acquisition unit 11, the determination target data extraction unit 12, the gesture determination unit 13, and the portable place determination unit 14 are the same as those in FIG.

  The warning information generation unit 15 acquires information on the measurement data (temperature data, humidity data) measured by the measurement unit 100 and the determination result of the portable location determination unit 14 (portable location of the portable warning device 1B). Based on the location information, measurement data is interpreted, and processing for generating warning information corresponding to the portable location of the portable warning device 1B (warning information generation processing) is performed.

  For example, the warning information generation unit 15 may correct the measurement data of the measurement unit 100 according to the portable place of the portable warning device 1B, and generate warning information including information on the corrected measurement data. Specifically, the warning information generation unit 15 measures the measurement value of the measurement unit 100 in an ideal state (for example, a state in which the portable warning device 1B is hung from the neck outdoors) using a predetermined correction formula. The correction value may be corrected to a value regarded as having been included, and the correction value may be included in the warning information.

  Further, for example, when it is difficult to obtain the correction formula or the reliability of the correction value is estimated to be low, the warning information generation unit 15 together with the measurement value of the measurement unit 100, the current portable location Warning information including a message indicating that there is a possibility that there is a possibility that the measurement value is not in an ideal state may be generated.

  In addition, for example, the warning information generation unit 15 displays warning information including a message that prompts the measurement to be performed in an ideal state, instead of the measurement value of the measurement unit 100 and a message indicating that the measurement value may be erroneous. It may be generated.

  The warning information generated by the warning information generation unit 15 is output from some or all of the visual transmission unit 40, the auditory transmission unit 50, and the tactile transmission unit 60, and is presented to the user of the portable warning device 1B.

  The warning information output control unit 16 controls the output method of the warning information generated by the warning information generation unit 15 according to the determination result of the portable location determination unit 14 (portable location of the portable warning device 1B) (warning information). Output control processing).

  Since it is already known that the volume and the vibration length noticed by the user differ depending on the portable place, for example, the warning information output control unit 16 determines the auditory transmission unit 50 according to the portable place of the portable warning device 1B. It may be controlled to output warning information by changing the sound volume or the vibration time of the tactile transmission unit 60.

  In addition, even if the sound is low in consideration of the surrounding environment during normal times, if a serious warning is required, the volume may be increased so as to be surely noticed (at the portable place). Therefore, for example, the warning information output control unit 16 changes the volume of the auditory transmission unit 50 and outputs the warning information according to the relationship between the portable place of the portable warning device 1B and the importance of the warning information. You may control.

  Note that the portable warning device 1B of the present embodiment may have a configuration in which some of the elements illustrated in FIG. 12 are omitted or changed, or other elements are added.

  FIG. 13 shows an example of the procedure of warning information output processing by the processing unit 10B of the portable warning device 1B.

  As illustrated in FIG. 13, first, the processing unit 10B (warning information generation unit 15) acquires the measurement value of the measurement unit 100 (S50).

Next, the processing unit 10B (warning information generation unit 15) acquires information on the portable location of the portable warning device 1B (S52).

  Next, the processing unit 10B (warning information generation unit 15) generates warning information using the measurement value of the measurement unit 100 acquired in step S50 and the portable location information acquired in step S52 (S54).

  Next, the processing unit 10B (warning information output control unit 16) determines a warning information output method according to the portable location information acquired in step S52, and outputs the warning information (S56).

  Next, the processing unit 10B stands by until the next measurement by the measuring unit 100 is completed (S58), and performs the processing after S50 again.

  According to the portable warning device of the present embodiment, it is possible to keep track of the portable location not only when the user is walking but also when the user is stationary. The output method can be changed appropriately. Therefore, for example, warning information is output by one or both of sound and vibration depending on the portable location, and the user notices the warning information regardless of the portable location by changing the volume and vibration intensity depending on the portable location. It can be made easier.

  Further, according to the portable warning device of the present embodiment, it is possible to appropriately correct the measurement value according to the portable location and bring it close to the true value, and regarding a predetermined phenomenon or symptom determined from the measurement value, It is possible to prevent output of incorrect information due to an inappropriate portable location.

  In addition, the portable device 1 of this embodiment mentioned above can be applied to a mobile phone, a smart phone, PDA, a calorie consumption meter, a pedometer, etc. other than a portable warning device (warning meter).

4). The present invention is not limited to this embodiment, and various modifications can be made within the scope of the present invention. Moreover, each embodiment mentioned above is an example, Comprising: It is not necessarily limited to these. For example, the embodiments can be appropriately combined.

  For example, in the present embodiment, an example in which a triaxial acceleration sensor is used as the inertial sensor 20 has been described. However, for example, an angular velocity sensor may be used instead of the acceleration sensor, or an angular velocity sensor may be further added to the acceleration sensor. May be used. In the latter case in particular, it can be expected that the determination accuracy is further improved by comprehensively determining the portable location of the portable device 1 from the acceleration data and the angular velocity data.

Further, for example, in the flowchart of FIG. 10, when the processing unit 10 determines that the state of the mobile device 1 is “moving state” (N in S182 and Y in S187), immediately before (in the previous window) ) The process of step S263 (second portable place determination process) is not executed (N in S188), and the previous determination (in the previous window) is not “handy” (N in S189), Although the fourth portable place determination process is performed (S190), the present invention is not limited to this. For example, as illustrated in FIG. 14, when the processing unit 10 determines that the state of the mobile device 1 is “moving state” (N in S182 and Y in S187), the processing unit 10 immediately before (the previous window). If the determination is not “handy” (N in S189), the fourth mobile location determination process is also performed when the process of Step S263 (second mobile location determination processing) is executed immediately before (in the previous window). The flowchart of FIG. 10 may be modified so as to be performed (S190). In the case of this modification, if the processing unit 10 has executed the process of step S263 (second mobile location determination process) immediately before (in the previous window) (Y in S188), the determination result on hold is displayed. Erasing is performed (S193). Immediately before (in the previous window) the process of step S263 (second
Even if the mobile phone location determination process) is executed, the pending result is deleted without being reflected, but it is merely a timing problem that is not reflected, and the process of step S190 (fourth) Since the current portable place is determined by the portable place determination process), there is no particular problem.

  In this embodiment, if the accuracy of the gesture determination (step S12 in FIG. 4) is not very high, the user may be walking while operating the mobile device 1 (for example, typing an email) or the mobile device. When walking while swinging 1 on the side of the body, the processing unit 10 erroneously determines that “there is a gesture pattern” and performs the process of step S263 (second portable place determination process). There is a possibility of erroneous determination as any of “pocket”, “chest pocket”, “jacket pocket”, “trouser front pocket”, and “trouser rear pocket”. At this time, the processing unit 10 holds the result of the erroneous determination, but determines that there is no gesture pattern in the next window (N in S14 in FIG. 4), and the state of the mobile device 1 is “moving state”. (N in S182 in FIG. 10 and Y in S187), the processing in step S263 is performed immediately before (in the previous window) (Y in S188), so that the process is on hold in step S192. The result of misjudgment is fixed.

  Therefore, as a method of dealing with this erroneous determination, for example, “hand 1” is used as a determination target in the mobile location determination processing (fourth mobile location determination processing) focused on the user's walking motion in step S190 of FIG. The user is walking while operating the mobile device 1, “hand 2”: the user is walking while swinging the mobile device 1 on the body side, and the processing unit 10 carries the mobile device 1 It is determined whether the place is “neck”, “chest pocket”, “jacket pocket”, “trouser front pocket”, “trouser rear pocket”, “hand 1”, or “hand 2” You may deform | transform into. In this case, for example, as illustrated in FIG. 15, the processing unit 10 is only when the immediately preceding determination result is “hand”, “hand 1”, or “hand 2”, and there is no pending determination result ( What is necessary is just to deform | transform so that the process (2nd portable place determination process) of step S263 (Y of S261) may be performed. In the case of this modification, the determination in step S189 in FIG. 10 (determination as to whether or not the previous determination is “hand”) is unnecessary.

  As another method for dealing with this erroneous determination, for example, as illustrated in FIG. 16, when the processing unit 10 determines that the state of the mobile device 1 is “moving state” (N in S <b> 182, and Further, the flowchart of FIG. 10 is modified so as to determine whether or not the movement state is associated with “hand walking in hand” (walking with the user holding the mobile device 1) (S194). May be. If the processing unit 10 determines “walking in hand” (Y in S194), if the processing in step S263 is executed immediately before (Y in S191), the pending determination result is confirmed (S192) and deleted. If the process of step S263 is not executed immediately before (S193) (N of S191), the determination of the portable place is not performed (S186), and the previous determination result is taken over. If the processing unit 10 determines that the walking is not “hand walking” (N in S194), if the processing of step S263 is executed immediately before (Y in S188), the pending determination result is confirmed (S192) and deleted. If the process of step S263 is not executed immediately before (S193) (N of S188), the process of step S190 (fourth portable place determination process) is performed.

  Further, for example, the portable warning device 1B shown in FIG. 12 can be modified to a warning system to which the portable place determination system 2 of the present embodiment shown in FIG. 11 is applied. In this warning system, the portable warning device and the information processing device cooperate with each other, and the above-described data acquisition processing, determination target data extraction processing, gesture determination processing, portable location determination processing, warning information generation processing, warning information output control Execute the process. In short, the information processing apparatus executes a part of the process performed by the processing unit 10B illustrated in FIG. 12, and the portable warning apparatus executes the other part. Then, the portable warning device and the information processing device generate warning information while performing data communication on the processing result data, and the portable warning device outputs the warning information.

  The present invention includes configurations that are substantially the same as the configurations described in the embodiments (for example, configurations that have the same functions, methods, and results, or configurations that have the same objects and effects). In addition, the invention includes a configuration in which a non-essential part of the configuration described in the embodiment is replaced. In addition, the present invention includes a configuration that exhibits the same operational effects as the configuration described in the embodiment or a configuration that can achieve the same object. Further, the invention includes a configuration in which a known technique is added to the configuration described in the embodiment.

1, 1A portable device, 1B portable warning device, 2 portable location determination system, 3 information processing device, 10, 10A, 10B processing unit, 11 data acquisition unit, 12 determination target data extraction unit, 23 gesture determination unit, 14, 14A portable place determination unit, 15 warning information generation unit, 16 warning information output control unit, 20 inertial sensor, 30 operation unit, 40 visual transmission unit, 50 auditory transmission unit, 60 tactile transmission unit, 70 storage unit, 72 data queue, 80 information storage medium, 90 communication unit, 100 measurement unit, 101 temperature sensor, 102 humidity sensor, 210 processing unit, 214 portable place determination unit, 270 storage unit, 280 information storage medium, 290 communication unit

Claims (17)

A method for determining a portable location of a portable device on a portable device's body, comprising:
A data acquisition step of continuously acquiring data from an inertial sensor provided in the portable device;
A determination target data extraction step for extracting at least part of the data acquired in the data acquisition step as determination target data;
A plurality of gestures for obtaining a magnitude of variation of data included in the determination target data and changing a portable place of the portable device by the portable person in the determination target data based on the magnitude of the variation. A gesture determination step for determining whether or not a gesture pattern corresponding to any of the patterns exists;
Based on the determination result of the gesture determination step, seen including and a portable location determining step of determining a mobile location of the mobile device,
The portable place determination step includes
If it is determined in the gesture determination step that the gesture pattern is present, a first determination is made as to whether or not the current portable location of the portable device is in hand based on a previous determination result of the portable location of the portable device. A portable place determination method for a portable device, including a portable place determination step . In claim 1 ,
The portable place determination step includes
If it is determined in the first portable location determination step that the current portable location of the portable device is not in hand, the gesture pattern corresponds to which of the plurality of gestures, and based on the identification result, A mobile device location determination method for a mobile device, further comprising a second mobile location determination step of determining a current mobile location of the mobile device. In claim 2 ,
In the second portable place determination step,
A method for determining a portable location of a portable device, wherein a determination result of the current portable location of the portable device is held. In claim 3 ,
In the first portable place determination step,
If the previous determination result of the portable location of the portable device is in hand and there is no pending determination result in the second portable location determination step, the current portable location of the portable device is not in hand. A method for determining a portable location of a portable device, wherein the method determines and otherwise determines that the current portable location of the portable device is in hand. In any one of Claims 2 thru | or 4 ,
The portable place determination step includes
When it is determined in the gesture determination step that the gesture pattern does not exist, the state of the portable device is based on the determination target data, and includes a plurality of states including a stationary state and a movement state associated with the movement of the wearer. A device state determination step for determining which is,
If it is determined in the device state determination step that the state of the portable device is a stationary state, the portable device is in the portable state if the second portable location determination step is performed on the previous determination target data. And a third portable place determination step for determining that the portable device is not carried on the person's body. In claim 5 ,
The portable place determination step includes
If it is determined in the device state determination step that the state of the portable device is a moving state, the determination target data of this time is not performed unless the second portable location determination step is performed on the previous determination target data. The portable location determination method of a portable device further including the 4th portable location determination step which determines the portable location of the said portable device based on. In claim 6 ,
In the portable place determination step,
When it is determined in the device state determination step that the state of the mobile device is a moving state, the fourth mobile location is also determined when the second mobile location determination step is performed on the previous determination target data. A method for determining a portable place of a portable device, wherein a determination step is performed. In any one of Claims 5 thru | or 7 ,
The portable place determination step includes
If it is determined in the device state determination step that the state of the mobile device is not stationary, the second mobile location determination is performed if the second mobile location determination step is performed on the previous determination target data. A portable location determination method for a portable device, further comprising a pending determination result determination step for determining a determination result that is pending in the step. In any one of Claims 2 thru | or 8 ,
In the second portable place determination step,
At least one feature quantity of a quartile range, a third quartile, a root mean square, a standard deviation, and an absolute value of a maximum value is calculated for the determination target data, and the gesture is based on the calculation result. A method for determining a portable location of a portable device, wherein a pattern corresponds to any of the plurality of gestures. In any one of Claims 1 thru | or 9 ,
The gesture determination step includes:
Smoothing data included in the determination target data;
Calculating a local standard deviation for each of the smoothed data;
Comparing each of the local standard deviations with a predetermined threshold value. In any one of Claims 1 thru | or 10 ,
A method for determining a portable place of a portable device, wherein at least a part of the inertial sensor is an acceleration sensor. A portable device having a function of determining a portable place on a body of a wearer,
An inertial sensor;
A data acquisition unit for continuously acquiring data from the inertial sensor;
A determination target data extraction unit that extracts at least part of the data acquired by the data acquisition unit as determination target data; and
A plurality of gestures for obtaining a magnitude of variation of data included in the determination target data and changing a portable place of the portable device by the portable person in the determination target data based on the magnitude of the variation. A gesture determination unit for determining whether or not a gesture pattern corresponding to any one of them exists,
Based on the determination result of the gesture determination unit, a mobile location determination unit determines cellular location of the mobile device, only including,
The portable location determination unit
When the gesture determination unit determines that the gesture pattern is present, a first determination is made as to whether or not the current portable location of the portable device is in hand based on a previous determination result of the portable location of the portable device. A mobile device that performs mobile location determination processing . In claim 12 ,
A warning information generating unit that generates warning information according to the current mobile location of the mobile device determined by the mobile location determination unit;
A portable information device including: a warning information output control unit configured to control an output method of the warning information according to a portable location of the portable device determined by the portable location determination unit; In claim 13 ,
It further includes a measurement unit that measures a predetermined physical quantity,
The warning information generation unit
A portable device that corrects a measurement value of the measurement unit according to a portable location of the portable device determined by the portable location determination unit, and generates the warning information including information on the corrected measurement value. A system for determining a portable location of a portable device on a body of a portable device carrier,
The portable device provided with an inertial sensor;
An information processing apparatus that communicates with the portable device,
The portable device and the information processing apparatus cooperate with each other,
A data acquisition process for continuously acquiring data from the inertial sensor;
A determination target data extraction process for extracting at least part of the data acquired in the data acquisition process as determination target data;
A plurality of gestures for obtaining a magnitude of variation of data included in the determination target data and changing a portable place of the portable device by the portable person in the determination target data based on the magnitude of the variation. Gesture determination processing for determining whether or not a gesture pattern corresponding to any one of them exists,
A portable location determination process for determining a portable location of the portable device based on a determination result in the gesture determination process ;
In the portable place determination process,
When it is determined in the gesture determination process that the gesture pattern exists, a first determination is made as to whether or not the current portable location of the portable device is in hand based on a previous determination result of the portable location of the portable device. A portable device determination system for a portable device that executes a portable device determination process . A program that is executed in a mobile device or an information processing apparatus that communicates with the mobile device, and that determines a mobile location of the mobile device on a body of a mobile user of the mobile device,
In the portable device or the information processing apparatus,
A data acquisition step of continuously acquiring data from an inertial sensor provided in the portable device;
A determination target data extraction step for extracting at least part of the data acquired in the data acquisition step as determination target data;
A plurality of gestures for obtaining a magnitude of variation of data included in the determination target data and changing a portable place of the portable device by the portable person in the determination target data based on the magnitude of the variation. A gesture determination step for determining whether or not a gesture pattern corresponding to any of the patterns exists;
A portable location determination step for determining a portable location of the portable device based on a determination result in the gesture determination step ;
The portable place determination step includes
If it is determined in the gesture determination step that the gesture pattern is present, a first determination is made as to whether or not the current portable location of the portable device is in hand based on a previous determination result of the portable location of the portable device. A program including a portable place determination step . A computer-readable information storage medium storing the program according to claim 16 .