JP6670710B2 - Information processing method, information processing apparatus and program - Google Patents

Description

  The present invention relates to an information processing method, an information processing device, and a program.

  There is known a technique for obtaining a walking signature of a subject from a signal indicating a head acceleration (for example, see Patent Document 1).

US Patent Application Publication No. 2009/0030350

  However, when a user wearing a motion sensor including an acceleration sensor and an angular velocity sensor runs or walks, the user can easily understand at a glance what state his or her running or walking form is in. There is nothing.

  Then, the art of an indication aims at making a state of a form at the time of run or walk easily grasp.

  An information processing method according to an aspect of the disclosed technology is an information processing method executed by a computer having a control unit and a storage unit, wherein the control unit detects each detection data from an acceleration sensor and an angular velocity sensor mounted on a human body. At least one of first data indicating a front-back blur of the human body, second data indicating a left-right shake of the human body, and third data indicating a posture including a direction and a magnitude of a tilt of a body axis of the human body based on Acquiring one of the threshold values of the front-back blur, the left-right blur, and the posture stored in the storage unit, a reference object formed on the basis of the obtained data, The display control is performed on the coordinates, and the display control of the target object formed based on the acquired data is performed on the predetermined coordinates.

  According to the disclosed technology, it is possible to easily grasp the state of the form during running or walking.

FIG. 1 is a diagram illustrating an example of an information processing system according to an embodiment. FIG. 2 is a schematic configuration diagram illustrating a hardware configuration of an information processing apparatus according to an embodiment. FIG. 2 is a block diagram illustrating an example of a configuration of a processing device according to the embodiment. FIG. 2 is a diagram illustrating an example of a configuration of an information processing apparatus according to an embodiment. FIG. 4 is a diagram illustrating an example of a configuration of a setting unit according to the embodiment. FIG. 4 is a diagram illustrating an example of a configuration of an execution processing unit according to the embodiment. FIG. 4 is a diagram illustrating an example of a configuration of a post-processing unit according to the embodiment. It is a figure showing an example of a set of a threshold. FIG. 4 is a diagram showing an example of each data recorded in a case of a mode A. FIG. 9 is a diagram showing an example of each data recorded in a case of a mode B. It is a figure showing the relation between a subclass and a score. It is a figure showing the relation between a total score and a class. It is a figure showing an example of information on a training part. It is a figure showing an example of a setting screen. It is a figure showing an example of a screen displayed during running. It is a figure showing the example where object RF of the right foot is displayed. It is a figure showing the example where the object LF of the left foot is displayed. It is a figure showing the example where object RF of the right foot is displayed. It is a figure showing the example where the object LF of the left foot is displayed. It is a figure showing an example of a display screen of a table which is a result of running. It is a figure showing an example of a display screen of a route which is a result of running. It is a figure which shows an example of the enlarged view of the lower part in the display screen of a route. It is a figure which shows the other example of the enlarged view of the lower part in the display screen of a route. It is a figure showing an example of a display screen of a map which is a result of running. It is a figure showing an example of a display screen of a graph which is a result of running. It is a figure showing an example of a display screen which shows a training part. 5 is a flowchart illustrating an example of an entire process of an application according to the embodiment. 9 is a flowchart illustrating an example of an execution screen display control process according to the embodiment. 9 is a flowchart illustrating an example of a breakpoint determination process according to the embodiment.

  Hereinafter, embodiments of the present invention will be described with reference to the drawings. However, the embodiment described below is merely an example, and there is no intention to exclude various modifications and application of technology not explicitly described below. That is, the present invention can be variously modified and implemented without departing from the spirit thereof. In the following description of the drawings, the same or similar parts are denoted by the same or similar reference numerals. The drawings are schematic and do not always match actual dimensions and ratios. The drawings may include portions having different dimensional relationships and ratios between drawings.

[Example]
In the embodiment, eyewear will be described as an example on which an acceleration sensor and an angular velocity sensor are mounted. FIG. 1 is a diagram illustrating an example of an information processing system 1 according to the embodiment. The information processing system 1 shown in FIG. 1 includes an external device 10 and an eyewear 30, and the external device 10 and the eyewear 30 are connected via a network so that data communication is possible.

  The eyewear 30 has the processing device 20 mounted on a temple portion, for example. The processing device 20 includes a three-axis acceleration sensor and a three-axis angular velocity sensor (a six-axis sensor may be used). Further, the eyewear 30 may have bioelectrodes 31, 33, and 35 on a pair of nose pads and a bridge portion, respectively. When the eyewear 30 is provided with bioelectrodes, electro-oculography signals obtained from these bioelectrodes are transmitted to the processing device 20.

  The installation position of the processing device 20 does not necessarily need to be a temple, but may be determined in consideration of the balance when the eyewear 30 is mounted.

  The external device 10 is an information processing device having a communication function. For example, the external device 10 is a mobile communication terminal such as a mobile phone and a smartphone owned by the user, a PC (Personal Computer), or the like. The external device 10 displays an object indicating a state of the form when the user runs or walks (hereinafter, also referred to as running or running) based on a sensor signal or the like received from the processing device 20. At this time, the object indicating the ideal or target state of the form is displayed superimposed on the object indicating the current form, so that the user can easily grasp the current state of his / her form. Will be able to Hereinafter, the external device 10 will be described as an information processing device 10.

<Hardware configuration of information processing apparatus 10>
FIG. 2 is a schematic configuration diagram illustrating a hardware configuration of the information processing apparatus 10 according to the embodiment. A typical example of the information processing apparatus 10 is a mobile phone such as a smartphone. A general-purpose device capable of displaying a screen while performing data processing while communicating with the device may also correspond to the information processing apparatus 10 in the embodiment.

  The information processing apparatus 10 according to the embodiment includes, for example, a rectangular thin housing (not shown), and a touch panel 102 is formed on one surface of the housing. In the information processing device 10, each component is connected to the main control unit 150. The main control unit 150 is, for example, a processor.

  The main control unit 150 includes a mobile communication antenna 112, a mobile communication unit 114, a wireless LAN communication antenna 116, a wireless LAN communication unit 118, a storage unit 120, a speaker 104, a microphone 106, a hard button 108, and a hard key 110. And a six-axis sensor 111 are connected. Further, the touch panel 102, the camera 130, and the external interface 140 are further connected to the main control unit 150. The external interface 140 includes an audio output terminal 142.

  The touch panel 102 has both functions of a display device and an input device, and includes a display (display screen) 102A having a display function and a touch sensor 102B having an input function. The display 102A is configured by a general display device such as a liquid crystal display and an organic EL (Electro Luminescence) display. The touch sensor 102B includes an element for detecting a contact operation, which is arranged on the upper surface of the display 102A, and a transparent operation surface laminated thereon. As a contact detection method of the touch sensor 102B, any method among known methods such as a capacitance type, a resistive film type (pressure-sensitive type), and an electromagnetic induction type can be adopted.

  The touch panel 102 as a display device displays an image of an application generated by the main control unit 150 executing the program 122. The touch panel 102 as an input device detects an operation of a contact object (including a finger or a stylus of a player, which will be described below as a representative example) that contacts the operation surface. , And receives information on the contact position to the main control unit 150. The movement of the finger is detected as coordinate information indicating the position or area of the contact point, and the coordinate information is represented, for example, as coordinate values on two axes in the short side direction and the long side direction of the touch panel 102.

  The information processing device 10 is connected to the network N through the mobile communication antenna 112 and the wireless LAN communication antenna 116, and can perform data communication with the processing device 20. The storage unit 120 stores the program 122, and the storage unit 120 may be separate from the external device 10, and may be a recording medium such as an SD card or a CD-RAM.

<Configuration of the processing device 20>
FIG. 3 is a block diagram illustrating an example of a configuration of the processing device 20 according to the embodiment. As illustrated in FIG. 3, the processing device 20 includes a processing unit 202, a transmission unit 204, a six-axis sensor 206, and a power supply unit 208. Each of the bioelectrodes 31, 33, and 35 is connected to the processing unit 202 using, for example, an electric wire via an amplification unit. In addition, each part of the processing apparatus 20 may not be provided on one temple but may be provided separately on a pair of temples.

  The six-axis sensor 206 is a three-axis acceleration sensor and a three-axis angular velocity sensor. Further, each of these sensors may be provided separately. The six-axis sensor 206 outputs the detected sensor signal (also referred to as detection data) to the processing unit 202.

  The processing unit 202 is, for example, a processor, processes a sensor signal obtained from the six-axis sensor 206 as necessary, and outputs the processed signal to the transmission unit 204. For example, the processing unit 202 uses the sensor signal from the six-axis sensor 206 to generate first data indicating a pitch angle, second data indicating a roll angle, and the direction and magnitude of the inclination of the body axis. The third data indicating the attitude including the height is generated. The pitch angle indicates, for example, the front and back of the head, the roll angle indicates, for example, the right and left of the head, and the inclination and direction of the body axis indicate, for example, the direction and magnitude of the inclination of the head. The pitch angle, the roll angle, and the attitude may be calculated using a known technique. Further, the processing unit 202 may simply amplify a sensor signal obtained from the six-axis sensor 206 or the like.

  The transmission unit 204 transmits each data including the first data to the third data processed by the processing unit 201 to the information processing device 10. For example, the transmission unit 204 transmits the sensor signal or each data to the information processing apparatus 10 by wireless communication such as Bluetooth (registered trademark) and wireless LAN, or by wired communication. The power supply unit 208 supplies power to the processing unit 202, the transmission unit 204, the six-axis sensor 206, and the like.

<Configuration of Information Processing Apparatus 10>
Next, the configuration of the information processing apparatus 10 will be described. FIG. 4 is a diagram illustrating an example of a configuration of the information processing apparatus 10 according to the embodiment. The information processing device 10 includes a storage unit 302, a communication unit 304, and a control unit 306.

  The storage unit 302 can be realized by, for example, the storage unit 120 illustrated in FIG. The storage unit 302 stores data relating to the running application in the embodiment, for example, data received from the processing device 20, screen information displayed on the screen, and the like.

  The communication unit 304 can be realized by, for example, the mobile communication unit 114, the wireless LAN communication unit 118, and the like. The communication unit 304 receives data from the processing device 20, for example. In addition, the communication unit 304 may transmit data processed in the information processing device 10 to a server (not shown). That is, the communication unit 304 has functions as a transmission unit and a reception unit.

  The control unit 306 can be realized by, for example, the main control unit 150 or the like. The control unit 306 executes a running application. The running application in the embodiment has a function of easily grasping the state of the form of the runner in addition to the function of the normal running application. To realize this function, the control unit 306 includes an acquisition unit 312, a setting unit 314, an execution processing unit 316, a post-processing unit 318, and a display control unit 320.

  The acquisition unit 312 includes first data indicating the front-back blur of the human body based on the detection data from the six-axis sensor 206 mounted on the human body, second data indicating the left-right blur of the human body, and the inclination of the body axis of the human body. At least one of third data indicating a posture including a direction and a size is acquired. Being worn on the human body includes not only being directly worn, but also being indirectly worn using a wearable device including the eyewear 30 and the like.

  The display control unit 320 sets the threshold value corresponding to the acquired first data, second data, and / or third data among the threshold values of front and rear blur, left and right blur, and posture stored in the storage unit 302. The display control of the reference object formed based on the predetermined coordinates in the screen is performed. Each threshold may be stored in the storage unit 302 in advance, or may be obtained and stored from the first data, the second data, and / or the third data measured for a predetermined time.

  The display control unit 320 controls the display of the target object formed based on the first data, the second data, and / or the third data acquired by the acquisition unit 312 on the same predetermined coordinates as the reference object. As a result, the target object based on the data measured during the running can be superimposed on the ideal or target reference object for the own form, and the user can easily grasp the objective index for the own form. Can be done. In addition, since the target object indicating the state of the form is formed and displayed so as to be superimposed on the reference object, the visibility of the state of the form can be improved. In the example described below, it is assumed that the first data, the second data, and the third data have been obtained by the obtaining unit 312.

  In addition, the display control unit 320 may make it possible to identify a region outside or inside the reference object among target objects displayed on the screen. For example, the display control unit 320 may change the portion of the target object that protrudes from the reference object from the original color to another color or change the pattern. This allows the user to easily determine the part of the target object that exceeds the threshold value, easily grasp the bad points of his / her form, and also reflect it on his / her form. Become.

  The setting unit 314 sets a threshold value for each item of front-back blur, left-right blur, and posture. For example, the setting unit 314 sets a threshold corresponding to each item set by the user as a comparison target of each data acquired each time. More specifically, the setting unit 314 prepares a plurality of sets of thresholds corresponding to the user's target and the location where the user runs, and sets each threshold according to the set target and the location by using each data acquired each time. Set as comparison target. As a result, the setting of the threshold can be made variable, and a more appropriate threshold can be used according to the level of the runner and the environment. The details of the setting unit 314 will be described later with reference to FIG.

  The execution processing unit 316 mainly has a function of processing data obtained during running or the like. The execution processing unit 316, for example, forms a target object indicating the state of the form from data obtained at the time of running or the like, determines the possibility of injuries, etc., and determines the time when it is considered that stable running etc. can no longer be performed. Or make a decision. Details of the execution processing unit 316 will be described later with reference to FIG.

  The post-processing unit 318 mainly has a function of processing a result of traveling or the like. The result referred to here indicates, for example, a result of tabulating the pace of running or the like, the distance of running or the like, the trajectory of running or the like, and the state of the form at the time of running or the like in a time series. The post-processing unit 318 will be described later with reference to FIG.

  The display control unit 320 controls display of a screen displayed on the touch panel 102. For example, as described above, the display control unit 320 generates screen information in a running application or controls the display based on the screen information to be displayed.

≪Setting section≫
FIG. 5 is a diagram illustrating an example of a configuration of the setting unit 314 according to the embodiment. The setting unit 314 illustrated in FIG. 5 includes a receiving unit 3142 and a reference setting unit 3144.

  The receiving unit 3142 receives a selection of one set from a plurality of sets including the respective thresholds stored in the storage unit 302. For example, the receiving unit 3142 allows the user to select a target pace, a place such as running (indoor or outdoor), and the like on the setting screen of the running application, and receives the selection result.

  The reference setting unit 3144 acquires one set corresponding to the accepted places such as pace and running, and sets parameters of the reference object based on each threshold in the acquired one set. For example, the reference setting unit 3144 sets the threshold values of the front-back blur, the left-right blur, and the posture in one-to-one correspondence so as not to overlap the vertical width, the horizontal width, and the center range of the reference object. . Thus, an appropriate threshold can be set according to the item set by the user.

≪Execution processing unit≫
FIG. 6 is a diagram illustrating an example of a configuration of the execution processing unit 316 according to the embodiment. The execution processing unit 316 includes a first forming unit 3162, a second forming unit 3164, an identifying unit 3166, and a determining unit 3168.

  The first forming unit 3162 forms a reference object based on each threshold set by the setting unit 314. For example, the threshold values of the front and rear blur, the left and right blur, and the posture are set in one-to-one correspondence so as not to overlap the vertical width, the horizontal width, and the center range of the reference object. Thus, an object serving as a reference for running the user can be formed using a simple shape. As a specific example, the threshold value for the front and rear shake is set to the intuitively corresponding vertical width, the left and right shake threshold value is set to the intuitively corresponding horizontal width, and the posture threshold value is set to the intuitively corresponding center width. Good to be. The threshold may have a range.

  The second forming unit 3164 converts each of the first data, the second data, and the third data acquired by the acquiring unit 312 into a corresponding relationship of the reference object with respect to the vertical width, the horizontal width, and the center range of the target object. Based on the settings, a target object is formed. The formed reference object and target object are displayed using the same coordinate system in the screen. This allows the user to easily grasp the state of his / her form based on the size and shape of the object, and makes it possible to easily compare the form with a threshold value for determining stable running or the like.

  Further, the acquisition unit 312 may further acquire fourth data indicating an impact ratio when the left and right feet touch the ground based on the acceleration data in the vertical direction of the acceleration sensor.

  At this time, the display control unit 320 may display and control a screen that notifies which of the left and right feet is in contact with the ground based on the vertical acceleration data and the second data indicating the roll angle. For example, the display control unit 320 uses a pair of objects representing the left and right feet to control to notify which of the left and right feet is in contact with the ground. Note that the control unit 306 recognizes the ground contact with the vertical acceleration data, and recognizes the lateral swing width based on the roll angle. As a knowledge of the roll angle, it is known that the vehicle swings right when the right foot lands, and swings left when the left foot lands.

  Therefore, the control unit 306 determines that the right foot touches the ground if it can recognize that the right foot swings at the roll angle, and determines that the left foot touches the ground if it can recognize that the right foot swings to the left. By recognizing the impact when the foot touches the ground and determining in which direction the roll angle is inclined, it is possible to determine which foot touches the ground. Since it is conceivable that the feet touch the ground alternately during the running, the determination of which foot touches the ground may be performed periodically at intervals. Thereby, power saving can be achieved.

  When the fourth data indicating the impact ratio of the left and right feet at the time of touching the ground satisfies the predetermined condition regarding the injury, the identification unit 3166 identifies the object having the possibility of injury from the pair of objects representing the left and right feet. to enable. The object is, for example, a footprint or a sole shape. The identification unit 3166 determines that there is no possibility of injury if the ratio of the vertical acceleration data of each of the left and right feet is within a predetermined range. For example, if the value of the vertical acceleration data of the right foot / the value of the vertical acceleration data of the left foot is 0.95 or more and 1.05 or less, the identification unit 3166 has no possibility of injury. If it is less than 0.95, it is determined that the right foot may be injured. If it exceeds 1.05, it is determined that the left foot may be injured. This is based on the finding that the potential contact time of a foot that may be injured is shortened while protecting a foot that may be injured.

  The identification unit 3166 notifies the user of the possibility of injury by changing and emphasizing the color or pattern of the object determined to be likely to be injured. In other words, the user can unconsciously know which foot is being covered and so on.

  Further, the acquisition unit 312 is configured to perform fourth data indicating an impact ratio when the left and right feet touch the ground based on vertical acceleration data of the acceleration sensor, and / or detection data from a GPS (Global Positioning System) sensor or an acceleration sensor. May be further obtained based on the fifth data indicating a pace of moving a predetermined distance.

  At this time, the determination unit 3168 determines a point (hereinafter, also referred to as a breakpoint) at which a problem regarding the stability of the form has occurred based on at least one of the data from the first data to the fifth data, for example. I do. The break point is a point in time when it is considered that it is no longer possible to travel in a stable form.

  For example, the determination unit 3168 determines whether each of the data from the first data to the fifth data has exceeded the threshold value for each data. When there is data exceeding the threshold, the determination unit 3168 may determine that a breakpoint has occurred. In addition, the determination unit 3168 may determine the occurrence of a breakpoint when the conditions for the first to fifth data are satisfied. Breakpoint occurrence conditions in the embodiment will be described later with reference to FIGS. 9 and 10.

  When a breakpoint occurs, the display control unit 320 controls so that information indicating the breakpoint is displayed on the screen. Note that the information indicating the breakpoint may not only be displayed on the screen but also be notified by voice or the like. Thereby, the user can grasp the break point during traveling or the like, and can grasp at what point his or her form has collapsed. In addition, when a breakpoint occurs, the determination unit 3168 stores the breakpoint point, the travel distance, the travel time, the value of each data, and the like in the storage unit 302. This allows the user to analyze the occurrence of a breakpoint or the like after traveling or the like.

≪Post-processing unit≫
FIG. 7 is a diagram illustrating an example of a configuration of the post-processing unit 318 according to the embodiment. In the example illustrated in FIG. 7, the post-processing unit 318 includes a result collection unit 3182 and a training acquisition unit 3184.

  The result collection unit 3182 collects result data such as traveling. The result collection unit 3182 evaluates the running and the like based on the result data of the running and the like. The evaluation result is displayed on a screen or notified to the user by voice or the like.

  The result collection unit 3182 also notifies the user of information indicating a time point (breakpoint) at which stable driving or the like is no longer possible on the result screen. The information indicating the breakpoint includes information on main data resulting from the occurrence of the breakpoint. This allows the user to be informed mainly of what caused the breakpoint.

  The training acquisition unit 3184 acquires a training site corresponding to main data from, for example, the storage unit 302. It suffices that one or more training sites are associated with each of the first to fifth data. Information on the acquired training site is controlled to be displayed on the screen. The training site may be notified by voice or the like. Thereby, the user can know the training site for his / her weakness discovered by actually exercising.

<Example of data>
Next, examples of various data used for a running application in the embodiment will be described. FIG. 8 is a diagram illustrating a set example of threshold values. In the example shown in FIG. 8, for example, the target time of the full marathon is set on the horizontal axis, and the location of the run is set on the vertical axis.

  As the horizontal axis, “Sub3”, “Sub4”, and “Sub5” are set, and represent within 3 hours, within 4 hours, and within 5 hours of the full marathon, respectively. As the vertical axis, “indoor” or “outdoor” represents a running place.

  At this time, it is assumed that the set of thresholds includes thresholds for the front and rear blur of the head, the right and left blur of the head, and the posture (the direction and size of the head tilt). Each threshold value is set based on data acquired at that time by having the runner corresponding to each item run with the eyewear 30 attached thereto in advance.

  It is preferable that the setting unit 314 can set an item on the horizontal axis and an item on the vertical axis on the setting screen of the running application. The horizontal axis may include an item (for example, “Free”) for which the goal of the full marathon is not set. At this time, the threshold value may be set based on each data acquired at a predetermined time or a predetermined number of steps at the beginning of running. For example, the control unit 306 sets, as a threshold, an average of each data (particularly, first data, second data, and third data) acquired at a predetermined time or a predetermined number of steps at the beginning of running.

  In the example shown in FIG. 8, the reason why the running place is divided indoors or outdoors is that most of the indoors run using a treadmill, and since the running space is limited in the treadmill, it is better than running outdoors. This is because it is known that the shake of the form is small. Therefore, in order to reflect this difference, the user is made to select between indoor and outdoor, and an appropriate threshold is set according to the selected item.

  FIG. 9 is a diagram illustrating an example of each data recorded in the case of the mode A. Mode A shown in FIG. 9 is, for example, a mode of the item “Free” that does not use a preset threshold, and FIG. 9 shows an example of data recorded at this time. In the example illustrated in FIG. 9, Pitch, Roll, left / right balance, pace, posture, and total score are associated with each determination section.

  The determination section shown in FIG. 9 represents one determination section with 20 steps. “Pitch” indicates the swing width of the shake before and after the running form. Roll represents the swing width of the foam during running. The left-right balance indicates the ratio of the magnitude of the impact (shock) when the right and left feet touch the ground. The pace represents the running time in one kilometer. The posture indicates the direction and magnitude of the inclination of the body axis.

Using the data shown in FIG. 9, the determination unit 3168 determines a breakpoint. First, the following processing is performed by the processing unit 202 or the control unit 306 as basic processing.
・ Pitch, Roll and left / right balance values are calculated for each step. ・ Pitch, Roll and left / right balance values are averaged for 20 steps, and the pace time is calculated based on distance and time for 20 steps. Calculation: The average value of 20 steps is set as one determination section. Only the posture is calculated in 10 determination sections (200 steps). If one step is not detected within one second, it is determined that the vehicle is not running. The execution processing unit 316 performs processing according to the following flow.

(1) From start to 40 judgment section (about 1 km) 800 steps (40 judgment section ≒ 1 km) from the start are threshold value judgment sections, so threshold judgment is not performed. The reference value is a value obtained by the user traveling at an initial stage or the like, and is a value that is a base of the initially formed target object. Further, the execution processing unit 316 compares a threshold value set for the created reference value with a value in a subsequent determination section. If 800 steps are less than 1 km, the first feedback is when the vehicle reaches 1 km. In the case of the “Free” mode, the threshold is set based on the reference value. For example, the reference value may be set as a threshold, or a value changed from the reference value using a predetermined reference may be set as the threshold.

(2) After 41 judgment sections If the four items (Pitch, Roll, left / right balance, and pace) calculated for each judgment section exceed the threshold value, the judgment unit 3168 adds points for each item.
-Pitch: 1 point-Roll: 1 point-Left / right balance: 0.5 point-1.5 points of pace Note that the posture has a different calculation cycle. For example, the determination unit 3168 determines the posture once every 10 determination sections, and adds points if the posture exceeds the threshold.
-Posture: 0.5 points

  The total score represents the total score of the corresponding row. When the total score is 2.5 points or more for three consecutive sections, the determination unit 3168 determines the third section as a break point and records it. In the case illustrated in FIG. 9, the determination unit 3168 determines the 53 section as a breakpoint. At this time, the time, the traveling distance, and various data may be recorded in the storage unit 302 in association with the break point.

  Note that the execution processing unit 316 may feed back the pace and the form to the user about every 1 km (a multiple of 40 sections). The pace is fed back, for example, by voice, and the form is fed back, for example, by displaying an object indicating the state of the form.

  FIG. 10 is a diagram showing an example of each data recorded in the case of mode B. Mode B shown in FIG. 10 is, for example, a mode using a preset threshold value, and FIG. 10 shows an example of data recorded at this time. In the example illustrated in FIG. 10, Pitch, Roll, left / right balance, pace, posture, total score, and class are associated with each determination section. The basic processing is the same as the basic processing described in FIG. The execution processing unit 316 performs processing according to the following flow.

(1) Subclass determination The determination unit 3168 determines which subclass of a to d the four items (Pitch, Roll, left / right balance, and pace) calculated for each determination section. For example, the determining unit 3168 determines the subclasses a to d according to the threshold value determined for each factor.

(2) Point addition The determination unit 3168 adds points according to the determined subclasses a to d. FIG. 11 is a diagram showing the relationship between subclasses and scores. In the example shown in FIG. 11, when the subclass of Pitch is b, the determination unit 3168 adds 0.5 point. Note that the posture has a different calculation cycle. The determination unit 3168 determines the posture once every 10 determination sections, determines a to d in the same manner as in (1), and adds points.

(3) Calculation of Total Point The determination unit 3168 calculates a total point for each determination section, and makes a comprehensive determination of the classes A to D. FIG. 12 is a diagram illustrating the relationship between the total score and the class. In the example illustrated in FIG. 12, when the total score is 1.75, the determination unit 3168 determines that the class is the class B and adds points.

(4) Breakpoint determination The determination unit 3168 determines that the overall determination result (class) has dropped to A → B, A → C, A → D, B → C, B → D, or C → D, and from that state. When the down or maintenance is continued without going up for three determination sections, the third section is determined as a break point and recorded. At this time, the time, the traveling distance, and various data may be recorded in the storage unit 302 in association with the break point. When each item in the table shown in FIG. 9 or FIG. 10 is viewed along the time axis in the vertical direction, it is possible to detect the occurrence of an abnormality in that item.

  Next, an example of a training site displayed on the screen after the end of running will be described. FIG. 13 is a diagram illustrating an example of information on a training site. In the example illustrated in FIG. 13, the presentation of the training site differs depending on whether or not a breakpoint has occurred. The main item indicates the item with the highest score among the items. For example, in the case of the example shown in FIG. 10, Roll having the highest average score of each item is regarded as the main item. The main items are not limited to those having the highest average score.

  For example, when Roll is the main item, the training sites are the transverse abdominal muscle, the oblique muscle, and the hamstrings. At this time, all the parts may be displayed on the screen, or any one part may be selected on a predetermined order or randomly and displayed on the screen. When one training site is selected, it is possible to prevent the training site from being the same every time, even if the main item becomes the same each time.

  Note that the comment is a sentence displayed on the display screen after the end of the running or the content of the output voice.

<Screen example>
Next, a screen example of a running application in the embodiment will be described. FIG. 14 is a diagram illustrating an example of the setting screen. The screen shown in FIG. 14 is, for example, a screen displayed in an initial stage after the execution of the application, and is a screen for allowing the user to select a target (TARGET) and a running place (LOCATION).

  For example, when the target “Sub4” and the place “outdoor” are selected, for example, the setting unit 314 acquires the set 22 illustrated in FIG. 8 and sets each threshold included in the set 22 as a parameter of the reference object. When the Start button is pressed on the screen shown in FIG. 14, measurement and / or recording of various data for running starts.

  FIG. 15 is a diagram illustrating an example of a screen displayed during running. In the example illustrated in FIG. 15, items displayed in a general running application such as a running distance, an average pace, and calorie consumption, as well as a point where a breakpoint occurs and an object related to a running form are displayed.

  In the example illustrated in FIG. 15, the display control unit 320 displays the reference object S10 generated by the first forming unit 3162 and the target object T10 generated by the second forming unit 3164 on the screen using the same coordinate system. Control. The center C10 of the target object T10 can be obtained using the third data.

  Each object is represented by, for example, a circular (including elliptical) object, the center of each object represents the center of the body axis, the horizontal width represents the width of the left and right sides of the form, and the vertical width represents the front and rear of the form. Represents the blur width.

  In addition, the display control unit 320 makes the area outside the reference object S10 within the area of the target object T10 identifiable from other areas by performing highlighting, for example, changing the color. With this, the user can travel in an ideal form that can achieve the goal if the target object is not highlighted, or if the target object is highlighted, what is wrong with the form It can be easily grasped at a glance that the vehicle cannot be driven in an ideal form.

  The screen shown in FIG. 15 can also inform the user of the current state of the center of the form posture based on the center C10 of the target object T10. For example, in the case shown in FIG. 15, the fact that the body is leaning right forward is displayed on the screen.

  FIG. 16 is a diagram illustrating another example of a screen displayed during running. The screen shown in FIG. 16 can be switched with the screen shown in FIG. FIG. 16A is a diagram illustrating an example in which the right foot object RF is displayed. FIG. 16B is a diagram illustrating an example in which the left foot object LF is displayed. The screen shown in FIG. 16B is displayed next to the screen shown in FIG. 16A.

  FIG. 16C is a diagram illustrating an example in which the object RF of the right foot is displayed. The screen shown in FIG. 16C is displayed next to the screen shown in FIG. 16B. FIG. 16D is a diagram illustrating an example in which the left foot object LF is displayed. The screen shown in FIG. 16D is displayed next to the screen shown in FIG. 16C.

  In the example illustrated in FIG. 16D, it is assumed that the identification unit 3166 detects imbalance between the left and right feet, and further determines that there is a possibility of injury to the left foot. In this case, the identification unit 3166 notifies the user of the abnormality by changing the color or pattern of the displayed left foot object LF. As a result, it is possible to quickly determine an action of protecting a foot that the user himself does not notice and notify the user.

  FIG. 17 is a diagram illustrating an example of a display screen of a table that is a result of running. In the example shown in FIG. 17, the average pace, the front-back blur, and the left-right blur are displayed every 1 km. The example shown in FIG. 17 indicates that a breakpoint has occurred at 7.2 km. In addition, as shown in FIG. 17, an item related to a travel distance at which a breakpoint has occurred may be displayed in an identifiable state. Regarding the breakpoint, the storage unit 302 records each data corresponding to the breakpoint, so that the display shown in FIG. 17 can be performed.

  FIG. 18 is a diagram illustrating an example of a display screen of a route that is a result of running. By sliding the lower part of the screen shown in FIG. 18 left or right, it is possible to check the average pace at that time, the shape of the object with respect to the form, and the like while changing the traveling distance. Alternatively, the display control unit 320 may display a mark B10 that indicates the location of the break point, as shown in FIG.

  FIG. 19 is a diagram illustrating an example of an enlarged view of a lower portion of the route display screen. In the example shown in FIG. 19, a map button M10 is displayed. When the map button M10 is pressed, the running route obtained using the GPS function is displayed (see FIG. 21).

  FIG. 20 is a diagram illustrating another example of an enlarged view of the lower portion of the route display screen. In the example shown in FIG. 20, a mark B10 indicating a breakpoint and a button D10 for deleting a breakpoint are displayed. When detecting that the button D10 is pressed, the control unit 306 deletes the data relating to the breakpoint at this point stored in the storage unit 302.

  FIG. 21 is a diagram illustrating an example of a display screen of a map that is a result of running. In the example illustrated in FIG. 21, a route acquired using the GPS function or the GPS sensor is displayed as a running route on a map, and a pin B12 is displayed at a point where a breakpoint has occurred. This makes it possible to see at a glance where the breakpoint occurred.

  FIG. 22 is a diagram illustrating an example of a display screen of a graph that is a result of running. In the example illustrated in FIG. 22, each of the front-back blur, the left-right blur, the left-right balance, and the running pace is represented by a line graph with the horizontal axis representing time. In the example shown in FIG. 22, a mark B10 indicating a break point is also displayed. This makes it possible to see at a glance when the breakpoints occur in the values of various data.

  FIG. 23 is a diagram illustrating an example of a display screen showing a training site. In the example illustrated in FIG. 23, it is assumed that a breakpoint has occurred and the main items are running results of posture (front) and pace. At this time, the training acquisition unit 3184 acquires the latissimus dorsi muscle corresponding to the posture (front), and further acquires the rectus abdominal muscle corresponding to the pace. Then, the acquired rectus abdominal muscle and latissimus dorsi are displayed at the corresponding positions of the human body object displayed on the screen. This means that information indicating each muscle can be associated with each part of the human body object. Thereby, the user can easily grasp which part should be trained. Further, by training the part, the user can recognize the form in which the user can run, and can actively encourage the training.

<Operation>
Next, an operation of the information processing apparatus 10 according to the embodiment will be described. FIG. 24 is a flowchart illustrating an example of the entire process of the application according to the embodiment. The flowchart shown in FIG. 24 is a process performed when the user wears the eyewear 30, operates the information processing apparatus 10, and starts the above-described application. The connection between the processing device 20 and the information processing device 10 may be performed in advance.

  In step S102 illustrated in FIG. 24, the control unit 306 determines whether there is a start instruction based on a user operation. For example, when the icon of this application is touched, it is determined that there is a start instruction. If there is a start instruction (step S102-YES), the process proceeds to step S104, and if there is no start instruction (step S102-NO), the process returns to step S102.

  In step S104, the setting unit 314 instructs the display control unit 320 to display the setting screen, and the display control unit 320 controls to display the setting screen (see FIG. 14).

  In step S106, the setting unit 314 receives a target (target) setting. For example, the setting unit 314 receives setting of items such as Free and Sub4 based on a user operation on the setting screen described with reference to FIG.

  In step S108, the setting unit 314 accepts the setting of the location (location such as traveling). For example, the setting unit 314 receives a setting of an indoor or outdoor item based on a user operation on the setting screen described in FIG.

  In step S110, the setting unit 314 sets each threshold for forming the reference object based on the received target and location. The setting unit 314 acquires a set of each threshold using the table described with reference to FIG. 8 and sets each acquired threshold.

  In step S112, control unit 306 determines whether traveling or the like (hereinafter, also referred to as “movement”) has been started. The start of the movement is determined by, for example, whether or not the “Start” button displayed on the screen illustrated in FIG. 14 has been pressed. When the “Start” button is pressed, the countdown starts, and when the count reaches 0, the movement is started. If the movement has been started (step S112-YES), the process proceeds to step S114. If the movement has not been started (step S112-NO), the process returns to step S112.

  In step S114, the execution processing unit 316 acquires, tabulates, processes, and the like various types of data while moving, and instructs the display control unit 320 to appropriately display an execution screen. The display control unit 320 controls to display the instructed execution screen (see FIG. 15 or FIGS. 16A to 16D). Display control processing during application execution will be described later with reference to FIGS. 25 and 26.

  In step S116, control unit 306 determines whether or not the movement has been completed. The end of the movement is determined by, for example, whether or not the end of the movement has been executed by a user operation after the “slide and pause” displayed in FIG. 15 has been executed. If the movement has been completed (step S116-YES), the process proceeds to step S118. If the movement has not been completed (step S116-NO), the process returns to step S114.

  In step S118, the post-processing unit 318 instructs the display control unit 320 to perform counting, processing, and the like of various data after the movement, and to display a result screen as appropriate. The display control unit 320 controls to display the instructed execution screen (see FIGS. 17 to 23). Thereafter, the processing is terminated by an instruction to stop the activation of the application.

  FIG. 25 is a flowchart illustrating an example of an execution screen display control process according to the embodiment. In step S202 illustrated in FIG. 25, the first forming unit 3162 forms a reference object based on the threshold set by the setting unit 314. For example, the reference object is represented by the object S10 shown in FIG. 15, but is not limited to this shape.

  In step S204, the display control unit 320 displays the reference object formed by the first forming unit 3162 on the screen using a predetermined coordinate system.

  In step S206, the acquiring unit 312 determines whether or not at least the first data, the second data, and the third data have been acquired based on the detection data measured by the six-axis sensor 206. In this case, the acquisition unit 312 may acquire various data for a predetermined number of steps or a predetermined period. If the data has been acquired (step S206-YES), the process proceeds to step S208, and if the data has not been acquired (step S206-NO), the process returns to step S206.

  In step S208, the second forming unit 3164 forms a target object based on the acquired data. For example, the target object is represented by an object T10 shown in FIG. 15, but is not limited to this shape. After this processing, the processing after step S210 and the processing after step S216 are executed separately.

  In step S210, the identification unit 3166 determines whether at least one of the acquired data values is equal to or greater than a threshold. For example, the identification unit 3166 determines whether the target object protrudes outside the area of the reference object. If at least one of the data is greater than or equal to the threshold (step S210-YES), the process proceeds to step S212, and if all of the data is less than the threshold (step S210-NO), the process proceeds to step S214.

  In step S212, the display control unit 320 controls to display the execution screen A so that an area outside the reference object among the target objects can be identified. For example, the execution screen A is the screen shown in FIG.

  In step S214, the display control unit 320 controls to display the execution screen B in which the target object is displayed in the reference object.

  In step S216, the determination unit 3168 determines whether a breakpoint has occurred. For example, the determination unit 3168 determines the occurrence of a breakpoint by performing processing using the data illustrated in FIGS. 9 and 10. If a breakpoint has occurred (step S216-YES), the process proceeds to step S218, and if no breakpoint has occurred (step S216-NO), the process proceeds to step S116. The details of the breakpoint determination process will be described with reference to FIG.

  In step S218, the display control unit 320 controls to display on the screen that a breakpoint has occurred. In addition, the occurrence of the breakpoint may be output to the user by voice instead of displaying on the screen to notify the user. This allows the user to easily know the current state of his / her form while moving.

  FIG. 26 is a flowchart illustrating an example of a breakpoint determination process according to the embodiment. In step S302 illustrated in FIG. 26, the determination unit 3168 determines whether a determination section including a predetermined step has been detected. The predetermined step is, for example, 20 steps. When the determination section of the predetermined step is detected (step S302-YES), the process proceeds to step S304, and when the determination section of the predetermined step is not detected (step S302-NO), the process returns to step S302.

  In step S304, the determination unit 3168 determines whether a predetermined number of determination sections has elapsed. The predetermined number is, for example, 10. If the predetermined number of determination sections have elapsed (step S304-YES), the process proceeds to step S306, and if the predetermined number of determination sections has not elapsed (step S304-NO), the processing proceeds to steps S310, S312, S314, and Proceed to S320.

  In step S306, the determination unit 3168 acquires postures in a predetermined number of determination sections and calculates an average thereof. For example, the acquisition unit 312 calculates the average (posture) of the direction and the magnitude of the inclination of the body axis in the 10 determination sections.

  In step S308, the determination unit 3168 calculates a posture point corresponding to the average of the postures in the ten determination sections. The posture point is calculated using, for example, the table shown in FIG. As a result of clearing the count of the determination section after the calculation, steps S306 and S308 are calculated every time 10 determination sections elapse.

  In step S310, the determination unit 3168 calculates a Pitch point corresponding to the average of Pitch acquired in one determination section. The Pitch point is calculated using, for example, the table shown in FIG.

  In step S312, the determination unit 3168 calculates a Roll point corresponding to an average of Roll acquired in one determination section. The Roll point is calculated using, for example, the table shown in FIG.

  In step S314, the determination unit 3168 determines whether the landed foot is the left or right foot. As described above, the determination unit 3168 can determine that the foot touches the ground based on the value of the acceleration data in the vertical direction, and can determine which foot touches the ground at the Roll angle.

  In step S316, the determination unit 3168 calculates a left / right balance value that is an average in one determination section. The left and right balance values are, for example, the average of the right foot impact value (vertical acceleration data value) / the left foot impact value in one determination section as the left and right balance value.

  In step S318, determination section 3168 calculates a left / right balance point corresponding to the left / right balance value. The left and right balance points are calculated using, for example, the table shown in FIG.

  In step S320, determination section 3168 calculates a pace. A known method may be used for calculating the pace.

  In step S322, determination section 3168 calculates a pace point corresponding to the average of the paces in one determination section. The pace point is calculated using, for example, the table shown in FIG.

  In step S324, the determination unit 3168 stores the calculated point of each item in the storage unit 302.

  In step S326, determination unit 3168 calculates the total score by summing the points of each item.

  In step S328, determination unit 3168 determines whether or not the total score is equal to or greater than the threshold value for a predetermined number of consecutive times. The predetermined number of times is, for example, three times. If the total score is equal to or greater than the threshold value for a predetermined number of consecutive times (step S328-YES), the process proceeds to step S218. If the total score is not equal to or greater than the threshold value for a predetermined number of consecutive times (step S328-NO), the process is terminated. Proceed to step S116.

  Each processing step included in the processing flow described with reference to FIGS. 24 to 26 can be arbitrarily changed in order or performed in parallel within a range that does not cause inconsistency in the processing content. Other steps may be added in between. Also, steps described as one step for convenience can be executed in a plurality of steps, while those described in a plurality of steps for convenience can be understood as one step.

  As described above, according to the embodiment, the user can easily grasp the state of the form during running or walking. Further, according to the embodiment, a more appropriate threshold value can be set by separately providing indoor and outdoor threshold values as a reference for form determination. Further, according to the embodiment, based on the left and right balance values, it is possible to quickly determine a foot with a possibility of injury and notify the user. Further, according to the embodiment, it is possible to easily understand at which point the form has collapsed by determining the point (break point) at which stable running or the like cannot be performed. Further, according to the embodiment, at the break point, it is possible to identify the main factor that the form has collapsed, and to present a part for training the main factor.

  In the embodiment, the case where the eyewear 30 is glasses is described. However, eyewear is not limited to this. The eyewear may be any eye-related equipment, such as eyeglasses, sunglasses, goggles, and head-mounted displays, as well as face or headwear such as these frames.

  In the embodiment, the eyewear 30 may be provided with the bioelectrode. However, the gaze movement and the blink may be detected based on the electro-oculogram signal obtained from the bioelectrode. At this time, each data that can be obtained from the six-axis sensor 206 may be stored in association with the movement of the line of sight and the blink. This makes it possible to analyze blinks and eye movement during exercise.

  In the embodiment, the description has been made using the detection data from the six-axis sensor 206 mounted on the eyewear 30. However, the embodiment may be performed using the detection data from the six-axis sensor 111 mounted on the information processing apparatus 10. It is possible to execute the application described in the example. That is, the six-axis sensor need only be worn at any position on the human body, not just the head.

  As described above, the present invention has been described using the embodiments. However, the technical scope of the present invention is not limited to the scope described in the above embodiments. It is apparent to those skilled in the art that various changes or improvements can be made to the above-described embodiment. It is apparent from the description of the appended claims that embodiments with such changes or improvements can be included in the technical scope of the present invention.

Hereinafter, the following supplementary notes will be disclosed with respect to the embodiments.
[Appendix 1]
An information processing method executed by a computer having a storage unit and a control unit,
The control unit includes:
Accepting indoor or outdoor choices;
An indoor room received from a plurality of sets including thresholds of posture including front and rear blur of the human body, left and right blur of the human body, and the direction and size of the tilt of the human body stored in the storage unit. Or to get one set for outdoor use,
Each of the thresholds in the obtained set is set as first data indicating a front-to-back blur of the human body based on detection data from an acceleration sensor and an angular velocity sensor attached to the human body, and a second data indicating a left-right shake of the human body. Setting the data and third data indicating the posture of the human body as comparison targets;
Information processing method for executing.
[Appendix 2]
An information processing method executed by a computer having a control unit,
The control unit includes:
First data indicating the front and rear blur of the human body based on the detection data from the acceleration sensor and the angular velocity sensor mounted on the human body, second data indicating left and right blur of the human body, and the direction and size of the tilt of the human body. Third data indicating the posture including the acceleration data, fourth data indicating the impact ratio of the right and left legs when the left and right legs touch the ground based on vertical acceleration data of the acceleration sensor, and / or detection data from the GPS sensor or the acceleration sensor. Acquiring fifth data indicating a pace of moving a predetermined distance;
Determining at least one of the first data to the fifth data based on at least one of the data, when a problem relating to the pace or the stability of the form when moving has occurred;
Controlling the display of the information indicating the time on a screen;
Information processing method for executing.
[Appendix 3]
An information processing method executed by a computer having a control unit,
The control unit includes:
Acquiring vertical acceleration data, second data indicating right and left blurring of the human body, and fourth data indicating an impact ratio of the left and right legs when the left and right legs are in contact, based on the vertical acceleration data of the acceleration sensor;
Based on the acceleration data and the second data, for a pair of objects corresponding to the left and right legs, display control to display a screen that notifies which one is in contact with the ground,
When the fourth data satisfies a predetermined condition relating to an injury, for the pair of objects, it is possible to identify an object having a possibility of injury,
Information processing method for executing.

Reference Signs List 10 information processing device 20 processing device 30 eyewear 302 storage unit 304 communication unit 306 control unit 312 acquisition unit 314 setting unit 316 execution processing unit 318 post-processing unit 320 display control unit

Claims (8)

An information processing method executed by a computer having a control unit and a storage unit,
The control unit includes:
First data indicating the front-back blur of the human body based on each detection data from the acceleration sensor and the angular velocity sensor mounted on the human body, second data indicating left-right blur of the human body, and inclination of the body axis of the human body. Obtaining at least one of third data indicating a posture including a direction and a size,
The reference object formed based on the threshold value corresponding to the acquired data among the threshold values of the front / rear shake, the left / right shake, and the posture stored in the storage unit is displayed on a predetermined coordinate in the screen. Controlling display,
Display control of the target object formed based on the acquired data on the predetermined coordinates,
Of before Symbol first data of each data up to the third data, based on at least one, to determine the point at which stability problems of the foam during the movement of the human body is generated,
Controlling the display of the information indicating the time on the screen;
Information processing method for executing. An information processing method executed by a computer having a control unit and a storage unit,
The control unit includes:
First data indicating the front-back blur of the human body based on each detection data from the acceleration sensor and the angular velocity sensor mounted on the human body, second data indicating left-right blur of the human body, and inclination of the body axis of the human body. Obtaining at least one of third data indicating a posture including a direction and a size,
The reference object formed based on the threshold value corresponding to the acquired data among the threshold values of the front / rear shake, the left / right shake, and the posture stored in the storage unit is displayed on a predetermined coordinate in the screen. Controlling display,
Display control of the target object formed based on the acquired data on the predetermined coordinates,
Based on the acceleration data in the vertical direction of the acceleration sensor, further acquiring fourth data indicating an impact ratio when the left and right feet touch the ground,
Based on the vertical acceleration data and the second data, using a pair of objects corresponding to the left and right feet, display control to display a screen that notifies which is in contact with the ground,
When the fourth data satisfies a predetermined condition relating to an injury, for the pair of objects, it is possible to identify an object corresponding to an injured foot.
Information processing method for executing. An information processing method executed by a computer having a control unit and a storage unit,
The control unit includes:
First data indicating the front-back blur of the human body based on each detection data from the acceleration sensor and the angular velocity sensor mounted on the human body, second data indicating left-right blur of the human body, and inclination of the body axis of the human body. Obtaining at least one of third data indicating a posture including a direction and a size,
The reference object formed based on the threshold value corresponding to the acquired data among the threshold values of the front / rear shake, the left / right shake, and the posture stored in the storage unit is displayed on a predetermined coordinate in the screen. Controlling display,
Display control of the target object formed based on the acquired data on the predetermined coordinates,
Accepting indoor or outdoor choices;
From a plurality of sets including each threshold stored in the storage unit, based on each threshold in one set corresponding to the received indoor or outdoor, forming the reference object,
Information processing method for executing. The control unit includes:
Of the target objects displayed in the screen, to be able to identify a region outside or inside the reference object,
The information processing method according to any one of claims 1 to 3, further comprising: The control unit includes:
The threshold value of the front and rear blur, the threshold value of the left and right blur, and the threshold value of the posture are set in a one-to-one correspondence so as not to overlap the vertical width, the horizontal width, and the center range of the reference object, Forming the reference object;
Setting each of the obtained first data, the second data, and the third data with respect to a vertical width, a horizontal width, and a center range of the target object based on the correspondence relationship of the reference object; Forming the target object,
The information processing method according to any one of claims 1 to 4, further performing the method.   The information processing method according to claim 1, wherein the information indicating the time point includes information on main data resulting from the occurrence of the time point. The control unit includes:
The information processing method according to claim 6, further comprising: controlling to display on the screen information relating to training corresponding to the main data from the first data to the third data.   An information processing method executed by a computer having a control unit and a storage unit,
  The control unit includes:
  First data indicating the front-back blur of the human body based on each detection data from the acceleration sensor and the angular velocity sensor mounted on the human body, second data indicating left-right blur of the human body, and inclination of the body axis of the human body. Obtaining at least one of third data indicating a posture including a direction and a size,
  The reference object formed based on the threshold value corresponding to the acquired data among the threshold values of the front-back blur, the left-right blur, and the posture stored in the storage unit is displayed on a predetermined coordinate in the screen. Controlling display,
  Display control of the target object formed based on the acquired data on the predetermined coordinates,
  Further acquiring data indicating a pace of moving a predetermined distance based on GPS function or detection data from the acceleration sensor;
  Determining at least one of the data from the first data to the third data, and data indicating the pace, at which point the problem relating to the stability of the form at the time of the pace or movement has occurred; ,
  Controlling the display of the information indicating the point on the screen;
  Information processing method for executing.

Images