JP6067148B1 - Information processing method, information processing apparatus, and program - Google Patents

Abstract

An information processing method in the disclosed technology is an information processing method executed by a computer having a control unit and a storage unit, and the control unit is configured to detect a human body based on each detection data from an acceleration sensor and an angular velocity sensor attached to the human body. Obtaining at least one of first data indicating back and forth blur, second data indicating left and right blur of a human body, and third data indicating a posture including a direction and a magnitude of a tilt of a human body axis, Display control of reference objects formed on the basis of threshold values corresponding to acquired data among the threshold values of front and rear blur, left and right blur, and posture stored in the storage unit on predetermined coordinates on the screen. The display control of the target object formed based on the acquired data is performed on predetermined coordinates.

Description

  The present invention relates to an information processing method, an information processing apparatus, and a program.

  A technique for obtaining a walking signature of a subject from a signal indicating head acceleration is known (see, for example, Patent Document 1).

US Patent Application Publication No. 2009/0030350

  However, when a user wearing a motion sensor including an acceleration sensor and an angular velocity sensor travels or walks, it is possible to easily grasp at a glance what state the form of his / her travel or walk is in. There is nothing.

  Therefore, the disclosed technique aims to easily grasp the state of the form during running or walking.

  An information processing method according to an aspect of the disclosed technology is an information processing method executed by a computer having a control unit and a storage unit, and the control unit detects each detection data from an acceleration sensor and an angular velocity sensor attached to a human body. At least one of the first data indicating the blur before and after the human body based on the second data, the second data indicating the left and right blur of the human body, and the third data indicating the posture including the direction and magnitude of the inclination of the body axis of the human body A reference object formed on the basis of the acquired data among the threshold values of the front and rear blur, the left and right blur, and the posture stored in the storage unit. Display control on the coordinates and display control of the target object formed based on the acquired data on the predetermined coordinates are executed.

  According to the disclosed technology, it is possible to easily grasp the state of the foam during running or walking.

It is a figure which shows an example of the information processing system in an Example. It is a schematic block diagram which shows the hardware constitutions of the information processing apparatus in an Example. It is a block diagram which shows an example of a structure of the processing apparatus in an Example. It is a figure which shows an example of a structure of the information processing apparatus in an Example. It is a figure which shows an example of a structure of the setting part in an Example. It is a figure which shows an example of a structure of the execution process part in an Example. It is a figure which shows an example of a structure of the post-processing part in an Example. It is a figure which shows the example of a set of a threshold value. It is a figure which shows an example of each data recorded in the case of mode A. It is a figure which shows an example of each data recorded in the case of mode B. It is a figure which shows the relationship between a subclass and a score. It is a figure which shows the relationship between a comprehensive point and a class. It is a figure which shows an example of the information of a training site | part. It is a figure which shows an example of a setting screen. It is a figure which shows an example of the screen displayed during running. It is a figure which shows the example by which the object RF of a right leg is displayed. It is a figure which shows the example in which the object LF of a left foot is displayed. It is a figure which shows the example by which the object RF of a right leg is displayed. It is a figure which shows the example in which the object LF of a left foot is displayed. It is a figure which shows an example of the display screen of the table | surface which is a result of running. It is a figure which shows an example of the display screen of the route which is the result of running. It is a figure which shows an example of the enlarged view of the lower part in the display screen of a route. It is a figure which shows the other example of the enlarged view of the lower part in the display screen of a route. It is a figure which shows an example of the display screen of the map which is a result of running. It is a figure which shows an example of the display screen of the graph which is a result of running. It is a figure which shows an example of the display screen which shows a training site | part. It is a flowchart which shows an example of the whole process of the application in an Example. It is a flowchart which shows an example of the display control process of the execution screen in an Example. It is a flowchart which shows an example of the determination process of the break point in an Example.

  Embodiments of the present invention will be described below with reference to the drawings. However, the embodiment described below is merely an example, and there is no intention to exclude various modifications and technical applications that are not explicitly described below. That is, the present invention can be implemented with various modifications without departing from the spirit of the present invention. In the following description of the drawings, the same or similar parts are denoted by the same or similar reference numerals. The drawings are schematic and do not necessarily match actual dimensions and ratios. In some cases, the dimensional relationships and ratios may be different between the drawings.

[Example]
In the embodiment, eyewear is taken as an example of an object on which an acceleration sensor and an angular velocity sensor are mounted. FIG. 1 is a diagram illustrating an example of an information processing system 1 in the embodiment. The information processing system 1 shown in FIG. 1 includes an external device 10 and eyewear 30, and the external device 10 and eyewear 30 are connected via a network so that data communication is possible.

  The eyewear 30 mounts the processing device 20 on a temple portion, for example. The processing device 20 includes a three-axis acceleration sensor and a three-axis angular velocity sensor (may be a six-axis sensor). The eyewear 30 may have bioelectrodes 31, 33, and 35 at the pair of nose pads and the bridge portion, respectively. When biological electrodes are provided on the eyewear 30, electrooculogram signals acquired from these biological electrodes are transmitted to the processing device 20.

  The installation position of the processing apparatus 20 is not necessarily a temple, but may be positioned in consideration of the balance when the eyewear 30 is attached.

  The external device 10 is an information processing device having a communication function. For example, the external device 10 is a mobile communication terminal such as a mobile phone and a smartphone possessed by the user, a PC (Personal Computer), or the like. The external device 10 displays an object indicating the state of the form when the user runs or walks (hereinafter also referred to as running or running) based on the sensor signal or the like received from the processing device 20. At this time, it is possible to easily grasp the current state of your own form by displaying an object indicating the ideal or target form state superimposed on the object indicating the current form. Will be able to. Hereinafter, the external device 10 will be described as the information processing device 10.

<Hardware Configuration of Information Processing Apparatus 10>
FIG. 2 is a schematic configuration diagram illustrating a hardware configuration of the information processing apparatus 10 according to the embodiment. A typical example of the information processing apparatus 10 is a mobile phone such as a smartphone. In addition, a network such as a mobile terminal that can be wirelessly or wired connected to a network, or an electronic device that includes a touch panel such as a tablet terminal. A general-purpose device capable of displaying a screen while processing data while communicating using the information processing apparatus 10 may correspond to the information processing apparatus 10 in the embodiment.

  The information processing apparatus 10 according to the embodiment includes, for example, a rectangular thin housing (not shown), and a touch panel 102 is configured on one surface of the housing. In the information processing apparatus 10, each component is connected to the main control unit 150. The main control unit 150 is a processor, for example.

  The main control unit 150 includes a mobile communication antenna 112, a mobile communication unit 114, a wireless LAN communication antenna 116, a wireless LAN communication unit 118, a storage unit 120, a speaker 104, a microphone 106, a hard button 108, and a hard key 110. And the 6-axis sensor 111 is connected. The main control unit 150 is further connected with a touch panel 102, a camera 130, and an external interface 140. The external interface 140 includes an audio output terminal 142.

  The touch panel 102 has both functions of a display device and an input device, and includes a display (display screen) 102A that bears a display function and a touch sensor 102B that bears an input function. The display 102A is configured by a general display device such as a liquid crystal display or an organic EL (Electro Luminescence) display. The touch sensor 102B includes an element for detecting a contact operation disposed on the upper surface of the display 102A and a transparent operation surface stacked on the element. As a contact detection method of the touch sensor 102B, an arbitrary method among known methods such as a capacitance method, a resistance film method (pressure-sensitive method), and an electromagnetic induction method can be adopted.

  The touch panel 102 as a display device displays an application image generated by the execution of the program 122 by the main control unit 150. The touch panel 102 as an input device detects an action of a contact object (including a player's finger, stylus, and the like. Hereinafter, a case of a “finger” will be described as a representative example). The operation input is received, and information on the contact position is given to the main control unit 150. The movement of the finger is detected as coordinate information indicating the position or area of the contact point, and the coordinate information is represented as coordinate values on two axes of the short side direction and the long side direction of the touch panel 102, for example.

  The information processing apparatus 10 is connected to the network N through the mobile communication antenna 112 and the wireless LAN communication antenna 116, and can perform data communication with the processing apparatus 20. The storage unit 120 records the program 122, and the storage unit 120 may be separate from the external device 10, and may be a recording medium such as an SD card or a CD-RAM.

<Configuration of Processing Device 20>
FIG. 3 is a block diagram illustrating an example of the configuration of the processing device 20 according to the embodiment. As illustrated in FIG. 3, the processing device 20 includes a processing unit 202, a transmission unit 204, a 6-axis sensor 206, and a power supply unit 208. In addition, each of the bioelectrodes 31, 33, and 35 is connected to the processing unit 202 using an electric wire via an amplification unit, for example. In addition, each part of the processing apparatus 20 may be distributed in a pair of temples instead of being provided in one temple.

  The 6-axis sensor 206 is a 3-axis acceleration sensor and a 3-axis angular velocity sensor. Each of these sensors may be provided separately. The 6-axis sensor 206 outputs the detected sensor signal (also referred to as detection data) to the processing unit 202.

  The processing unit 202 is, for example, a processor, processes the sensor signal obtained from the 6-axis sensor 206 as necessary, and outputs the processed signal to the transmission unit 204. For example, the processing unit 202 uses the sensor signal from the 6-axis sensor 206 to perform the first data indicating the pitch angle, the second data indicating the roll angle, and the direction and magnitude of the inclination of the body axis. Third data indicating a posture including the height is generated. The pitch angle indicates, for example, blurring around the head, the roll angle indicates, for example, lateral blurring of the head, and the direction and magnitude of the body axis tilt indicate, for example, the direction and magnitude of the head tilt. The pitch angle, roll angle, and posture may be calculated using a known technique. Further, the processing unit 202 may only amplify the sensor signal obtained from the 6-axis sensor 206.

  The transmission unit 204 transmits each data including the third data to the information processing apparatus 10 from the first data processed by the processing unit 201. For example, the transmission unit 204 transmits the sensor signal or each data to the information processing apparatus 10 by wireless communication such as Bluetooth (registered trademark) and wireless LAN, or wired communication. The power supply unit 208 supplies power to the processing unit 202, the transmission unit 204, the 6-axis sensor 206, and the like.

<Configuration of Information Processing Apparatus 10>
Next, the configuration of the information processing apparatus 10 will be described. FIG. 4 is a diagram illustrating an example of the configuration of the information processing apparatus 10 according to the embodiment. The information processing apparatus 10 includes a storage unit 302, a communication unit 304, and a control unit 306.

  The storage unit 302 can be realized by, for example, the storage unit 120 shown in FIG. The storage unit 302 stores data related to the running application in the embodiment, for example, data received from the processing device 20, screen information displayed on the screen, and the like.

  The communication unit 304 can be realized by the mobile communication unit 114, the wireless LAN communication unit 118, and the like, for example. The communication unit 304 receives data from the processing device 20, for example. The communication unit 304 may transmit data processed in the information processing apparatus 10 to a server (not shown). That is, the communication unit 304 functions as a transmission unit and a reception unit.

  The control unit 306 can be realized by the main control unit 150, for example. The control unit 306 executes a running application. The running application in the embodiment has a function that can easily grasp the state of the runner's form in addition to the function of the normal running application. In order to realize this function, the control unit 306 includes an acquisition unit 312, a setting unit 314, an execution processing unit 316, a post-processing unit 318, and a display control unit 320.

  The acquisition unit 312 includes first data indicating blurring of the front and back of the human body based on detection data from the six-axis sensor 206 attached to the human body, second data indicating blurring of the human body, and inclination of the human body axis. At least one of the third data indicating the posture including the direction and the size is acquired. Wearing on the human body includes not only wearing directly but also wearing indirectly using a wearable device including the eyewear 30 and the like.

  The display control unit 320 sets the threshold corresponding to the acquired first data, second data, and / or third data among the front and rear blur, left and right blur, and posture thresholds stored in the storage unit 302. The reference object formed based on the display is controlled on a predetermined coordinate in the screen. Each threshold value may be stored in the storage unit 302 in advance, or may be obtained and stored from the first data, the second data, and / or the third data measured for a predetermined time.

  The display control unit 320 controls the display of the target object formed based on the first data, the second data, and / or the third data acquired by the acquisition unit 312 on the same predetermined coordinates as the reference object. This makes it possible to superimpose the target object based on the data measured during your running on the ideal or target reference object for your own form, and you can easily grasp the objective indicators for your form. Can be made. In addition, since the target object indicating the state of its own form is formed and displayed superimposed on the reference object, the visibility of the state of its own form can be improved. In the example shown below, it is assumed that the acquisition unit 312 acquires the first data, the second data, and the third data.

  Further, the display control unit 320 may make it possible to identify an area outside or inside the reference object among the target objects displayed in the screen. For example, the display control unit 320 may change the part of the target object that protrudes from the reference object from the original color to another color, or change the pattern. As a result, the user can easily determine the part of the target object that protrudes from the threshold, can easily grasp the bad part of his / her form, and can also reflect it on his / her form. Become.

  The setting unit 314 sets a threshold value for each item of front / rear blur, left / right blur, and posture. For example, the setting unit 314 sets a threshold corresponding to each item set by the user as a comparison target of each data acquired each time. More specifically, the setting unit 314 prepares a plurality of sets of thresholds corresponding to the user's target and the place where the user runs, and sets each threshold according to the set target and location as each data acquired. To be compared. Thereby, the setting of a threshold value can be made variable and a more suitable threshold value can be used according to a runner's level and environment. Details of the setting unit 314 will be described later with reference to FIG.

  The execution processing unit 316 mainly has a function of processing data obtained at the time of traveling or the like. For example, the execution processing unit 316 forms a target object indicating the state of the form from the data obtained at the time of traveling, etc., determines the possibility of injury, and the time when it is considered that stable traveling or the like cannot be performed. Judgment. Details of the execution processing unit 316 will be described later with reference to FIG.

  The post-processing unit 318 mainly has a function of processing results such as traveling. The result here refers to, for example, the result of totaling the pace of traveling, the distance of traveling, the trajectory of traveling, and the state of the form during traveling in time series. The post-processing unit 318 will be described later with reference to FIG.

  The display control unit 320 controls display of a screen displayed on the touch panel 102. For example, as described above, the display control unit 320 generates screen information in a running application and controls the screen based on the screen information to be displayed.

≪Setting section≫
FIG. 5 is a diagram illustrating an example of the configuration of the setting unit 314 in the embodiment. The setting unit 314 illustrated in FIG. 5 includes a reception unit 3142 and a reference setting unit 3144.

  The accepting unit 3142 accepts selection of one set from a plurality of sets including each threshold value stored in the storage unit 302. For example, the reception unit 3142 allows the user to select a target pace, a place such as running (indoor or outdoor), and the like on the setting screen of the running application, and receives the selection result.

  The reference setting unit 3144 acquires one set corresponding to the received pace, place such as running, and sets the parameters of the reference object based on each threshold value in the acquired one set. For example, the reference setting unit 3144 sets the threshold values of head shake, left and right shake, and posture in a one-to-one correspondence so as not to overlap with the vertical width, horizontal width, and center range of the reference object. . Thereby, an appropriate threshold value can be set according to the item set by the user.

≪Execution processing part≫
FIG. 6 is a diagram illustrating an example of the configuration of the execution processing unit 316 in the embodiment. The execution processing unit 316 includes a first formation unit 3162, a second formation unit 3164, an identification unit 3166, and a determination unit 3168.

  The first forming unit 3162 forms a reference object based on each threshold set by the setting unit 314. For example, the front and back blur, left and right blur, and posture threshold values are set in a one-to-one correspondence so as not to overlap with the vertical width, horizontal width, and center range of the reference object. Thereby, the object used as a standard of a user's run etc. can be formed using a simple shape. As a specific example, the blur threshold before and after the head is set to an intuitively corresponding vertical width, the left and right blur threshold is set to an intuitively corresponding horizontal width, and the posture threshold is set to an intuitively corresponding center width. It is good to be done. The threshold value may have a range.

  The second forming unit 3164 sets the first data, the second data, and the third data acquired by the acquiring unit 312 to correspond to the reference object with respect to the vertical width, horizontal width, and center range of the target object. Based on the setting, the target object is formed. The formed reference object and target object are displayed using the same coordinate system in the screen. Accordingly, the user can easily grasp the state of his / her form according to the size and shape of the object, and can easily be compared with a threshold value for determining stable running or the like.

  In addition, the acquisition unit 312 may further acquire fourth data indicating an impact ratio when the left and right feet are touched based on acceleration data in the vertical direction of the acceleration sensor.

  At this time, the display control unit 320 may perform display control of a screen for informing which of the left and right feet is in contact with the ground based on the acceleration data in the vertical direction and the second data representing the roll angle. For example, the display control unit 320 controls to notify which of the left and right feet is grounded using a pair of objects representing the left and right feet. Note that the control unit 306 recognizes the ground contact based on the vertical acceleration data, and recognizes the lateral deflection width based on the roll angle. As the knowledge of the roll angle, it is known that the right foot swings to the right and the left foot landing to the left.

  Therefore, the control unit 306 determines that the right foot is grounded if it can be recognized that the user swings to the right at the roll angle, and determines that the left foot is grounded if the swing can be recognized to swing to the left. Accordingly, it is possible to determine which foot is in contact with the ground by recognizing the impact when the foot is in contact with the ground and determining in which direction the roll angle is inclined. Since it is conceivable that the feet are alternately grounded during running, the determination of which feet are grounded may be performed periodically at intervals. Thereby, power saving can be achieved.

  When the fourth data indicating the impact ratio when the left and right feet touch the ground satisfies the predetermined condition regarding injury, the identifying unit 3166 identifies the object that is likely to be injured with respect to the pair of objects representing the left and right feet. to enable. The object is, for example, a footprint or a sole shape. The identification unit 3166 determines that there is no possibility of injury if the ratio of the acceleration data in the vertical direction of each of the left and right feet is within a predetermined range. For example, if the value of acceleration data in the vertical direction of the right foot / value of acceleration data in the vertical direction of the left foot is 0.95 or more and 1.05 or less, the identification unit 3166 has no possibility of injury. If it is less than 0.95, it is determined that there is a possibility of injury on the right foot, and if it exceeds 1.05, it is determined that there is a possibility of injury on the left foot. This is based on the finding that the contact time of a potentially injured foot is shortened by hitting the potentially injured foot.

  The identification unit 3166 informs the user that there is a possibility of injury by changing the color or pattern of the object that has been determined to be injured and highlighting the object. That is, the user can know which foot is being crushed unconsciously.

  The acquisition unit 312 also includes fourth data indicating the impact ratio when the left and right feet are touched based on acceleration data in the vertical direction of the acceleration sensor, and / or detection data from a GPS (Global Positioning System) sensor or acceleration sensor. 5th data which shows the pace which moves the predetermined distance based on may be further acquired.

  At this time, the determination unit 3168 determines, for example, a point in time when a problem related to the stability of the form occurs (hereinafter also referred to as a breakpoint) based on at least one of the data from the first data to the fifth data. To do. The break point is a time point at which it is considered that it is no longer possible to travel in a stable form.

  For example, the determination unit 3168 determines whether or not each data from the first data to the fifth data has exceeded a threshold for each data. When there is data exceeding the threshold, the determination unit 3168 may determine that a breakpoint has occurred. In addition, the determination unit 3168 may determine the occurrence of a break point when the condition for the conditions regarding the first data to the fifth data is satisfied. Breakpoint generation conditions in the embodiment will be described later with reference to FIGS. 9 and 10.

  When a breakpoint has occurred, the display control unit 320 controls to display information indicating the breakpoint on the screen. Note that the information indicating the breakpoint may be notified not only by displaying on the screen but also by voice or the like. Thereby, the user can grasp a break point in the middle of traveling or the like, and can grasp at which point his form has collapsed. In addition, when a break point occurs, the determination unit 3168 stores the break point location, travel distance, travel time, values of each data, and the like in the storage unit 302. Thereby, the user can analyze the occurrence of a break point after running or the like.

≪Post-processing section≫
FIG. 7 is a diagram illustrating an example of the configuration of the post-processing unit 318 in the embodiment. In the example illustrated in FIG. 7, the post-processing unit 318 includes a result collection unit 3182 and a training acquisition unit 3184.

  The result collection unit 3182 collects result data such as traveling. The result collection unit 3182 evaluates traveling and the like based on result data such as traveling. The evaluation result is displayed on the screen or notified to the user by voice or the like.

  The result collection unit 3182 also informs the user of information indicating the time point (break point) at which it is considered that stable running or the like can no longer be performed on the result screen. The information indicating the break point includes information on main data resulting from the occurrence of the break point. As a result, the user can be informed mainly of what caused the breakpoint.

  The training acquisition unit 3184 acquires a training site corresponding to main data from the storage unit 302, for example. It is sufficient that one or more training sites are associated with each data of the first data to the fifth data. The acquired information on the training site is controlled to be displayed on the screen. In addition, the training site may be notified by voice or the like. Thereby, the user can know the training part with respect to his weakness discovered by actually exercising.

<Data example>
Next, examples of various data used for the running application in the embodiment will be described. FIG. 8 is a diagram illustrating a set example of threshold values. In the example shown in FIG. 8, for example, the target time of the full marathon is set on the horizontal axis, and the place where the vehicle runs is set on the vertical axis.

  As the horizontal axis, “Sub3”, “Sub4”, and “Sub5” are set, which respectively represent within 3 hours, within 4 hours, and within 5 hours for the full marathon. On the vertical axis, “indoor” or “outdoor” represents a place to run.

  At this time, it is assumed that the threshold set includes threshold values for each of the shakes before and after the head, the left and right shakes of the head, and the posture (direction and magnitude of the tilt of the head). Each threshold is set based on data acquired at the time when the runner corresponding to each item wears the eyewear 30 and runs.

  The setting unit 314 may be configured so that items on the horizontal axis and items on the vertical axis can be set on the setting screen of the running application. The horizontal axis may include an item (for example, “Free”) that does not set a full marathon goal. At this time, a threshold value may be set based on each data acquired at a predetermined time and the predetermined number of steps at the beginning of running. For example, the control unit 306 sets the average of each data (particularly, the first data, the second data, and the third data) acquired at a predetermined time and a predetermined number of steps at the beginning of running as a threshold value.

  In the example shown in FIG. 8, the reason why the place to run is divided indoors or outdoors is that the indoors are mostly run using a treadmill, and the treadmill has a limited space to run, so it is more than running outdoors. This is because the blur of the foam is known to be small. Therefore, in order to reflect this difference, the user is allowed to select indoor or outdoor, and an appropriate threshold value is set according to the selected item.

  FIG. 9 is a diagram illustrating an example of each data recorded in the mode A. A mode A shown in FIG. 9 is, for example, an item “Free” mode that does not use a preset threshold value, and FIG. 9 shows an example of data recorded at this time. In the example shown in FIG. 9, Pitch, Roll, left / right balance, pace, posture, and total point are associated with each determination section.

  The determination section shown in FIG. 9 represents one determination section with 20 steps. “Pitch” represents the fluctuation width of the blur before and after the running form. Roll represents the runout width of the running foam. The left-right balance represents the ratio of the magnitude of impact (impact) when the left and right feet touch each other. The pace represents the running time in 1 kilometer. The posture represents the direction and magnitude of the inclination of the body axis.

Using the data shown in FIG. 9, the determination unit 3168 determines a breakpoint. First, as basic processing, the processing unit 202 or the control unit 306 performs the following processing.
・ Calculate Pitch, Roll, and left / right balance values for each step ・ Calculate the average value of Pitch, Roll, and left / right balance with the value for 20 steps, and calculate the pace time with distance and time of 20 steps Calculation • Average value for 20 steps is defined as one determination section. • Posture is calculated in 10 determination sections (200 steps). If one step is not detected within 1 second, it is determined that the vehicle is not running. The execution processing unit 316 performs processing according to the following flow.

(1) From start to 40 determination section (about 1 km) Since 800 steps from start (40 determination section≈1 km) is a reference value creation section, threshold determination is not performed. The reference value is a value obtained by a user's running at an initial stage or the like, and is a value based on a target object that is formed first. In addition, the execution processing unit 316 compares the threshold set for the created reference value with the values in the subsequent determination sections. If 800 steps are less than 1 km, the first feedback is when 1 km is reached. In the “Free” mode, the threshold is set based on the reference value. For example, the reference value may be set as the threshold value, or a value changed from the reference value using a predetermined reference may be set as the threshold value.

(2) After 41 determination sections If the four items (Pitch, Roll, left / right balance, and pace) calculated for each determination section exceed the threshold value, the determination unit 3168 adds points for each item.
・ Pitch: 1 point ・ Roll: 1 point ・ Left / Right balance: 0.5 point ・ Pace: 1.5 points Note that the posture has a different calculation cycle. For example, the determination unit 3168 determines the posture once every 10 determination sections, and adds points if the threshold is exceeded.
・ Attitude: 0.5 points

  The total point represents the total point of the corresponding row. The determining unit 3168 determines and records the third section as a break point when the total score is 2.5 points or more for three consecutive sections. In the case illustrated in FIG. 9, the determination unit 3168 determines 53 sections as break points. At this time, time, travel distance, and various data may be recorded in the storage unit 302 in association with the breakpoint.

  Note that the execution processing unit 316 may feed back the pace and form to the user about every 1 km (multiple of 40 sections). The pace is fed back, for example, by voice, and the form is fed back, for example, by displaying an object indicating the state of the form.

  FIG. 10 is a diagram illustrating an example of each data recorded in the mode B. A mode B shown in FIG. 10 is a mode using a preset threshold value, for example, and FIG. 10 shows an example of data recorded at this time. In the example shown in FIG. 10, Pitch, Roll, left / right balance, pace, posture, overall point, and class are associated with each determination section. The basic process is the same as the basic process described with reference to FIG. The execution processing unit 316 performs processing according to the following flow.

(1) Subclass determination The determination unit 3168 determines which subclass of a to d corresponds to the four items (Pitch, Roll, left-right balance, and pace) calculated for each determination section. For example, the determination unit 3168 determines the subclasses a to d according to the threshold value determined for each factor.

(2) Additional points The determination unit 3168 adds points according to the determined subclasses a to d. FIG. 11 is a diagram illustrating the relationship between subclasses and points. In the example illustrated in FIG. 11, the determination unit 3168 adds 0.5 points when the Pitch subclass is b. Note that the posture has a different calculation cycle. The determination unit 3168 determines the posture once every 10 determination sections, determines a to d similarly to (1), and adds points.

(3) Calculation of total point The determination unit 3168 calculates a total point for each determination section, and performs a comprehensive determination on classes A to D. FIG. 12 is a diagram illustrating the relationship between the total score and the class. In the example illustrated in FIG. 12, when the total score is 1.75, the determination unit 3168 determines class B and adds points.

(4) Breakpoint determination The determination unit 3168 determines that the overall determination result (class) is A → B, A → C, A → D, B → C, B → D, or C → D, and from that state. If it continues down for 3 judgment sections without being up, the third section is judged as a breakpoint and recorded. At this time, time, travel distance, and various data may be recorded in the storage unit 302 in association with the breakpoint. When each item in the table shown in FIG. 9 or FIG. 10 is viewed on the time axis in the vertical direction, the occurrence of an abnormality in that item can be detected.

  Next, an example of a training part displayed on the screen after the end of running will be described. FIG. 13 is a diagram illustrating an example of information on a training region. In the example shown in FIG. 13, the presentation of the training site differs depending on whether or not a breakpoint is generated. The main item indicates a high score item among the items. For example, in the example shown in FIG. 10, Roll with the highest average score of each item is regarded as the main item. The main items are not limited to those having the highest average score.

  For example, when Roll is the main item, the training sites are the transversus abdominis, obliques, and hamstrings. At this time, all the parts may be displayed on the screen, or any one part may be selected in a predetermined order or randomly and displayed on the screen. When one training site is selected, it is possible to prevent the training site from being the same every time even if the main item is the same every time.

  In addition, about a comment, it is the content of the text displayed on the display screen after completion | finish of a run, or the audio | voice output.

<Screen example>
Next, a screen example of a running application in the embodiment will be described. FIG. 14 is a diagram illustrating an example of the setting screen. The screen shown in FIG. 14 is a screen that is displayed at an initial stage after the execution of the application, for example, and is a screen that allows the user to select a target (TARGET) and a place to run (LOCATION).

  For example, when the target “Sub4” and the place “outdoor” are selected, the setting unit 314 acquires the set 22 illustrated in FIG. 8 and sets each threshold included in the set 22 as a parameter of the reference object. In the screen shown in FIG. 14, when the Start button is pressed, measurement and / or recording of various data for running starts.

  FIG. 15 is a diagram illustrating an example of a screen displayed during running. In the example shown in FIG. 15, in addition to items displayed in a general running application such as a running distance, an average pace, and calorie consumption, a point where a break point has occurred, an object related to a running form, and the like are displayed.

  In the example shown in FIG. 15, the display control unit 320 displays the reference object S10 generated by the first forming unit 3162 and the target object T10 generated by the second forming unit 3164 on the screen using the same coordinate system. Control as follows. The center C10 of the target object T10 can be obtained using the third data.

  Each object is represented by, for example, a circular (including elliptical) object. The center of each object represents the center of the body axis, the horizontal width represents the left and right blur width of the form, and the vertical width represents the front and rear of the form. Represents the blur width.

  In addition, the display control unit 320 makes it possible to identify an area outside the reference object S10 within the area of the target object T10 with respect to other areas, for example, by performing highlighting such as changing the color. This allows the user to travel in the ideal form that can achieve the goal if the target object is not highlighted, or if the target object is highlighted, the part of the form is bad. You can easily grasp at a glance that you are not able to travel in the ideal form.

  Further, the screen shown in FIG. 15 can be informed of the state of the center of the form posture of the current user based on the center C10 of the target object T10. For example, in the case shown in FIG. 15, it is displayed on the screen that the body is tilted to the right front.

  FIG. 16 is a diagram illustrating another example of a screen displayed during running. The screen shown in FIG. 16 can be switched to the screen shown in FIG. FIG. 16A is a diagram illustrating an example in which a right foot object RF is displayed. FIG. 16B is a diagram illustrating an example in which a left foot object LF is displayed. The screen shown in FIG. 16B is displayed next to the screen shown in FIG. 16A.

  FIG. 16C is a diagram illustrating an example in which a right foot object RF is displayed. The screen shown in FIG. 16C is displayed next to the screen shown in FIG. 16B. FIG. 16D is a diagram illustrating an example in which an object LF for the left foot is displayed. The screen shown in FIG. 16D is displayed next to the screen shown in FIG. 16C.

  In the example illustrated in FIG. 16D, it is assumed that the identification unit 3166 detects an imbalance between the left and right feet and further determines that the left foot may be injured. In this case, the identification unit 3166 notifies the user of the abnormality by changing the color or pattern of the displayed object LF for the left foot. As a result, it is possible to quickly determine an action of scolding a foot that the user himself / herself is not aware of and notify the user.

  FIG. 17 is a diagram illustrating an example of a table display screen that is a result of running. In the example shown in FIG. 17, the average pace, front / rear blur, and left / right blur are displayed every 1 km. The example shown in FIG. 17 indicates that a breakpoint has occurred at 7.2 km. Moreover, as shown in FIG. 17, you may make it display the item regarding the travel distance which the breakpoint generate | occur | produced in the state which can be identified. With respect to the break point, since the storage unit 302 records each data for the break point, the display shown in FIG. 17 becomes possible.

  FIG. 18 is a diagram illustrating an example of a display screen of a route that is a result of running. By sliding the lower part of the screen shown in FIG. 18 to the left or right, the average pace at that time, the shape of the object with respect to the form, and the like can be confirmed while changing the travel distance. Further, as shown in FIG. 18, the display control unit 320 may display a mark B10 in which the break point is known.

  FIG. 19 is a diagram showing an example of an enlarged view of the lower part of the route display screen. In the example shown in FIG. 19, a map button M10 is displayed. When the map button M10 is pressed, the running route acquired using the GPS function is displayed (see FIG. 21).

  FIG. 20 is a diagram illustrating another example of the enlarged view of the lower part of the route display screen. In the example shown in FIG. 20, a mark B10 indicating a breakpoint and a button D10 for erasing the breakpoint are displayed. When the control unit 306 detects that the button D10 has been pressed, the control unit 306 deletes the data related to the break point at this point stored in the storage unit 302.

  FIG. 21 is a diagram showing an example of a map display screen as a result of running. In the example shown in FIG. 21, a route acquired using a GPS function or a GPS sensor is displayed as a running route on the map, and a pin B12 is displayed at a point where a break point has occurred. As a result, it is possible to know at a glance at which point the break point has occurred.

  FIG. 22 is a diagram illustrating an example of a display screen of a graph that is a result of running. In the example shown in FIG. 22, each of front / rear blur, left / right blur, left / right balance, and running pace is represented by a line graph with the horizontal axis as time. Also in the example shown in FIG. 22, a mark B10 indicating a break point is displayed. As a result, it is possible to know at a glance when breakpoints occur when the values of various data are generated.

  FIG. 23 is a diagram showing an example of a display screen showing training sites. In the example shown in FIG. 23, it is assumed that a breakpoint has occurred and the main items are running results of posture (front) and pace. At this time, the training acquisition unit 3184 acquires the latissimus dorsi muscle corresponding to the posture (front), and further acquires the rectus abdominis muscle corresponding to the pace. Then, the acquired rectus abdominis and latissimus dorsi muscles are displayed at the corresponding portions of the human body object displayed on the screen. It is sufficient that information indicating each muscle is associated with each part of the human body object. Thereby, the user can easily grasp which part should be trained. Furthermore, the user can recognize what form can be run by training the part, and can actively encourage training.

<Operation>
Next, the operation of the information processing apparatus 10 in the embodiment will be described. FIG. 24 is a flowchart illustrating an example of overall processing of an application in the embodiment. The flowchart shown in FIG. 24 is a process performed when the user wears the eyewear 30, operates the information processing apparatus 10, and starts the above-described application. The connection between the processing device 20 and the information processing device 10 may be performed in advance.

  In step S102 illustrated in FIG. 24, the control unit 306 determines whether there is a start instruction based on a user operation. For example, when the application icon is touched, it is determined that there is an activation instruction. If there is an activation instruction (step S102-YES), the process proceeds to step S104. If there is no activation instruction (step S102-NO), the process returns to step S102.

  In step S104, the setting unit 314 instructs the display control unit 320 to display the setting screen, and the display control unit 320 controls to display the setting screen (see FIG. 14).

  In step S106, the setting unit 314 receives a target (target) setting. For example, the setting unit 314 accepts setting of items such as Free and Sub4 based on a user operation on the setting screen described in FIG.

  In step S108, the setting unit 314 receives a setting of a location (location such as traveling). For example, the setting unit 314 accepts settings for indoor or outdoor items based on a user operation on the setting screen described in FIG.

  In step S110, the setting unit 314 sets each threshold value for forming the reference object based on the received target and location. For example, the setting unit 314 acquires each threshold set using the table described in FIG. 8 and sets each acquired threshold.

  In step S112, the control unit 306 determines whether traveling or the like (hereinafter also referred to as movement) has been started. The start of movement is determined, for example, by whether or not the “Start” button displayed on the screen shown in FIG. 14 has been pressed. When this “Start” button is pressed, the countdown starts, and when the count reaches 0, the movement starts. If movement has started (step S112—YES), the process proceeds to step S114. If movement has not started (step S112—NO), the process returns to step S112.

  In step S114, the execution processing unit 316 performs acquisition, aggregation, processing, and the like of various data during movement, and instructs the display control unit 320 to display the execution screen in a timely manner. The display control unit 320 controls to display the instructed execution screen (see FIG. 15 or FIGS. 16A to 16D). Display control processing during application execution will be described later with reference to FIGS. 25 and 26.

  In step S116, the control unit 306 determines whether the movement has ended. The end of the movement is determined, for example, by whether or not the end of the movement has been executed by a user operation after the “slide and pause” displayed in FIG. 15 is executed. When the movement is finished (step S116-YES), the process proceeds to step S118, and when the movement is not finished (step S116-NO), the process returns to step S114.

  In step S118, the post-processing unit 318 performs aggregation and processing of various data after movement, and instructs the display control unit 320 to display the result screen in a timely manner. The display control unit 320 controls to display the designated execution screen (see FIGS. 17 to 23). Thereafter, the process is terminated by an instruction to stop and start the application.

  FIG. 25 is a flowchart illustrating an example of an execution screen display control process according to the embodiment. In step S202 illustrated in FIG. 25, the first forming unit 3162 forms a reference object based on the threshold set by the setting unit 314. For example, the reference object is represented by an object S10 shown in FIG. 15, but is not limited to this shape.

  In step S204, the display control unit 320 displays the reference object formed by the first forming unit 3162 on the screen using a predetermined coordinate system.

  In step S206, the acquisition unit 312 determines whether at least the first data, the second data, and the third data based on the detection data measured by the six-axis sensor 206 have been acquired. In this case, the acquisition unit 312 may acquire various data for a predetermined number of steps or a predetermined period. If data has been acquired (step S206—YES), the process proceeds to step S208. If data has not been acquired (step S206—NO), the process returns to step S206.

  In step S208, the second forming unit 3164 forms a target object based on the acquired data. For example, the target object is represented by an object T10 shown in FIG. 15, but is not limited to this shape. After this processing, the processing after step S210 and the processing after step S216 are executed separately.

  In step S210, the identification unit 3166 determines whether at least one of the acquired data values is equal to or greater than a threshold value. For example, the identifying unit 3166 determines whether or not the target object is outside the area of the reference object. If at least one of the data is greater than or equal to the threshold (step S210—YES), the process proceeds to step S212. If all the data is less than the threshold (step S210—NO), the process proceeds to step S214.

  In step S212, the display control unit 320 controls to display the execution screen A while making it possible to identify an area outside the reference object among the target objects. For example, the execution screen A is the screen shown in FIG.

  In step S214, the display control unit 320 controls to display the execution screen B in which the target object is displayed in the reference object.

  In step S216, determination unit 3168 determines whether or not a breakpoint has occurred. For example, the determination unit 3168 determines the occurrence of a breakpoint by the processing using the data shown in FIG. 9 and FIG. If a breakpoint has occurred (step S216-YES), the process proceeds to step S218. If a breakpoint has not occurred (step S216-NO), the process proceeds to step S116. Details of the breakpoint determination process will be described with reference to FIG.

  In step S218, display control unit 320 controls to display on the screen that a breakpoint has occurred. Further, the occurrence of the break point may be notified to the user by outputting it by voice instead of the screen display. As a result, the user can easily know the current state of his / her form while moving.

  FIG. 26 is a flowchart illustrating an example of a breakpoint determination process in the embodiment. In step S302 shown in FIG. 26, the determination unit 3168 determines whether or not a determination section composed of predetermined steps has been detected. The predetermined step is 20 steps, for example. If the determination section for the predetermined step is detected (step S302—YES), the process proceeds to step S304. If the determination section for the predetermined step is not detected (step S302—NO), the process returns to step S302.

  In step S304, the determination unit 3168 determines whether a predetermined number of determination sections have elapsed. The predetermined number is 10, for example. If the predetermined number of determination intervals have elapsed (step S304—YES), the process proceeds to step S306. If the predetermined number of determination intervals have not elapsed (step S304—NO), the processing proceeds to steps S310, S312, S314, Proceed to S320.

  In step S306, the determination unit 3168 acquires postures in a predetermined number of determination sections, and calculates an average thereof. For example, the acquisition unit 312 calculates the average (posture) of the direction and magnitude of the inclination of the body axis in the 10 determination sections.

  In step S308, the determination unit 3168 calculates a posture point corresponding to the average posture in 10 determination sections. The posture point is calculated using, for example, a table shown in FIG. As a result of clearing the count of the determination section after the calculation, steps S306 and S308 are calculated every time 10 determination sections elapse.

  In step S310, the determination unit 3168 calculates a Pitch point corresponding to the average of the pitches acquired in one determination section. The Pitch point is calculated using, for example, a table shown in FIG.

  In step S312, the determination unit 3168 calculates a Roll point corresponding to the average of Rolls acquired in one determination section. The Roll point is calculated using, for example, a table shown in FIG.

  In step S314, the determination unit 3168 determines which of the left and right feet the landed foot is. As described above, the determination unit 3168 can determine that the ground is grounded based on the vertical value of the acceleration data, and can determine which foot is grounded at the Roll angle.

  In step S316, the determination unit 3168 calculates a left / right balance value that is an average in one determination section. For the left and right balance values, for example, the average of the impact value of the right foot (acceleration data value in the vertical direction) / the impact value of the left foot within one determination section is used as the left and right balance value.

  In step S318, the determination unit 3168 calculates a left / right balance point corresponding to the left / right balance value. The left / right balance point is calculated using, for example, a table shown in FIG.

  In step S320, determination unit 3168 calculates the pace. A known method may be used for calculating the pace.

  In step S322, the determination unit 3168 calculates a pace point corresponding to the average of the paces in one determination section. The pace point is calculated using, for example, a table shown in FIG.

  In step S324, the determination unit 3168 stores the calculated points of the items in the storage unit 302.

  In step S326, the determination unit 3168 adds up the points of each item to calculate a total score.

  In step S328, the determination unit 3168 determines whether the total score is equal to or greater than the threshold value continuously for a predetermined number of times. For example, the predetermined number of times is three. If the total score is equal to or greater than the threshold for a predetermined number of times (step S328-YES), the process proceeds to step S218. If the total score is not equal to or greater than the threshold for a predetermined number of times (step S328-NO), the process is performed. Proceed to step S116.

  Note that the processing steps included in the processing flow described with reference to FIGS. 24 to 26 can be executed in any order or in parallel as long as the processing contents do not contradict each other. Other steps may be added in between. Further, a step described as one step for convenience can be executed by being divided into a plurality of steps, while a step described as being divided into a plurality of steps for convenience can be grasped as one step.

  As described above, according to the embodiment, the user can easily grasp the state of the form during traveling or walking. Further, according to the embodiment, it is possible to set a more appropriate threshold value by separately providing a threshold value as a reference for form determination for indoor and outdoor. Moreover, according to the Example, based on the left and right balance values, it is possible to quickly determine a foot that may be injured and notify the user. Further, according to the embodiment, it is possible to easily grasp at which point the form has collapsed by determining the time point (break point) at which stable running or the like cannot be performed. In addition, according to the embodiment, it is possible to identify a main factor whose form has collapsed at a breakpoint and present a part for training the main factor.

  In the embodiment, the case where the eyewear 30 is glasses has been described. However, eyewear is not limited to this. The eyewear may be any device related to the eye, and may be a face wearing device or a head wearing device such as glasses, sunglasses, goggles and a head mounted display and their frames.

  In the embodiment, it has been described that the eyewear 30 may be provided with a biological electrode. However, based on an electrooculogram signal that can be acquired from the biological electrode, eye movement or blink may be detected. At this time, each data that can be acquired from the 6-axis sensor 206 may be stored in association with the line-of-sight movement and the blink. This makes it possible to analyze blinks and line-of-sight movement during exercise.

  In the embodiment, the detection data from the six-axis sensor 206 mounted on the eyewear 30 has been described. However, the detection data from the six-axis sensor 111 mounted on the information processing apparatus 10 may be used. It is possible to execute the application described in the example. That is, the 6-axis sensor may be mounted not only on the head but also on any position of the human body.

  As mentioned above, although this invention was demonstrated using the Example, the technical scope of this invention is not limited to the range as described in the said Example. It will be apparent to those skilled in the art that various modifications and improvements can be made to the above-described embodiments. It is apparent from the description of the scope of claims that embodiments with such changes or improvements can be included in the technical scope of the present invention.

Hereinafter, the following additional notes will be disclosed regarding the examples.
[Appendix 1]
An information processing method executed by a computer having a storage unit and a control unit,
The controller is
Accepting indoor or outdoor choices,
Indoors received from a plurality of sets including each threshold value of posture including front and back blur of the human body, left and right blur of the human body, and the direction and magnitude of the tilt of the human body, stored in the storage unit Or to get one set corresponding to the outdoors,
Each threshold value in the acquired one set includes first data indicating blurring before and after the human body based on detection data from an acceleration sensor and an angular velocity sensor mounted on the human body, and second data indicating left and right blurring of the human body. Setting the comparison target of the data and the third data indicating the posture of the human body,
Information processing method to execute.
[Appendix 2]
An information processing method executed by a computer having a control unit,
The controller is
First data indicating front / rear blur of the human body based on detection data from an acceleration sensor and an angular velocity sensor attached to the human body, second data indicating left / right blur of the human body, and the direction and magnitude of the tilt of the human body. Based on third data indicating posture including, fourth data indicating impact ratio when the left and right legs are in contact with ground based on vertical acceleration data of the acceleration sensor, and / or based on detection data from the GPS sensor or the acceleration sensor Obtaining fifth data indicating a pace of moving a predetermined distance;
Determining when a problem relating to stability of the pace or the form at the time of movement occurs based on at least one of each data from the first data to the fifth data;
Controlling display of information indicating the time point on a screen;
Information processing method to execute.
[Appendix 3]
An information processing method executed by a computer having a control unit,
The controller is
Obtaining fourth data indicating the impact ratio of the left and right legs when touching the ground based on the acceleration data in the vertical direction, the second data indicating the lateral blur of the human body, and the acceleration data in the vertical direction of the acceleration sensor;
Based on the acceleration data and the second data, display control of a screen for informing which of the pair of objects corresponding to the left and right legs is grounded;
When the fourth data satisfies a predetermined condition regarding injury, the object having the possibility of injury can be identified with respect to the pair of objects.
Information processing method to execute.

DESCRIPTION OF SYMBOLS 10 Information processing apparatus 20 Processing apparatus 30 Eyewear 302 Storage part 304 Communication part 306 Control part 312 Acquisition part 314 Setting part 316 Execution process part 318 Post-processing part 320 Display control part

Claims (9)

An information processing method executed by a computer having a control unit and a storage unit,
The controller is
First data indicating blurring of the front and rear of the human body based on detection data from an acceleration sensor and an angular velocity sensor attached to the human body, second data indicating left and right blurring of the human body, and inclination of the body axis of the human body Obtaining third data indicating a posture including direction and size;
A reference object formed based on a threshold corresponding to acquired data among the threshold values of the front and rear blur, the left and right blur, and the posture stored in the storage unit, A reference object having a shape set based on a threshold value and a left / right blur threshold value and a center range set based on the posture threshold value is displayed and controlled on a predetermined coordinate in the screen;
The target object having a shape based on the first data and the second data, and the position of the target object on the predetermined coordinate based on the third data is the center of the target object. Display control so that the relationship between the shape of the reference object and the shape of the reference object matches the relationship between the first data, the second data, and the shape of the target object ,
Information processing method to execute. The controller is
Highlighting an area outside the reference object among the target objects displayed in the screen;
The information processing method according to claim 1, further executing. The controller is
The front and rear blur threshold, the left and right blur threshold, and the posture threshold are set in a one-to-one correspondence so as not to overlap with the vertical width, horizontal width, and center range of the reference object, Forming the reference object;
The acquired first data, the second data, and the third data are set based on the correspondence relationship of the reference object with respect to the vertical width, horizontal width, and center range of the target object, Forming a target object,
The information processing method according to claim 1 or 2, further executing: First data indicating blurring of the front and rear of the human body based on detection data from an acceleration sensor and an angular velocity sensor attached to the human body, second data indicating left and right blurring of the human body, and a direction of inclination of the body axis of the human body And an acquisition unit for acquiring third data indicating a posture including the size,
A storage unit that stores threshold values of the front and rear blur, the left and right blur, and the posture;
Among the threshold values stored in the storage unit, the reference object is formed based on the threshold value corresponding to the data acquired by the acquisition unit, and is based on the front and rear blur threshold and the left and right blur threshold. A reference object in which a shape is set and a center range is set based on the threshold of the posture is displayed on predetermined coordinates on the screen, and a target object having a shape based on the first data and the second data is With the position on the predetermined coordinate based on the third data as the center of the target object, the relationship between the front and rear blur threshold and the left and right blur threshold and the shape of the reference object is the first data and the first object. A display control unit that performs display control so as to match the relationship between the two data and the shape of the target object ;
An information processing apparatus comprising: The display control unit
The information processing apparatus according to claim 4, wherein an area outside the reference object among the target objects displayed in the screen is highlighted. The front and rear blur threshold, the left and right blur threshold, and the posture threshold are set in a one-to-one correspondence so as not to overlap with the vertical width, horizontal width, and center range of the reference object, A first forming part for forming the reference object;
The acquired first data, the second data, and the third data are set based on the correspondence relationship of the reference object with respect to the vertical width, horizontal width, and center range of the target object, A second forming unit for forming a target object;
The information processing apparatus according to claim 4, further comprising: On the computer,
First data indicating front and back blur of the human body based on detection data from an acceleration sensor and an angular velocity sensor attached to the human body, second data indicating left and right blur of the human body, and the direction and magnitude of the tilt of the human body Obtaining third data indicating posture including
A reference object formed based on a threshold value corresponding to acquired data among the threshold values of the front / rear blur, the left / right blur, and the posture, wherein the front / rear blur threshold and the left / right blur threshold Controlling the display of a reference object on which a shape is set based on a threshold value and a center range is set based on the posture threshold value on a predetermined coordinate in the screen;
The target object having a shape based on the first data and the second data, and the position of the target object on the predetermined coordinate based on the third data is the center of the target object. Display control so that the relationship between the shape of the reference object and the shape of the reference object matches the relationship between the first data, the second data, and the shape of the target object ,
A program that executes In the computer,
Highlighting an area outside the reference object among the target objects displayed in the screen;
The program according to claim 7, further executing. In the computer,
The front and rear blur threshold, the left and right blur threshold, and the posture threshold are set in a one-to-one correspondence so as not to overlap with the vertical width, horizontal width, and center range of the reference object, Forming the reference object;
The acquired first data, the second data, and the third data are set based on the correspondence relationship of the reference object with respect to the vertical width, horizontal width, and center range of the target object, Forming a target object,
The program according to claim 7 or 8, wherein the program is further executed.

Images