JP2014059788A - Gazing action estimation device, gazing action estimation method and gazing action estimation program - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide a gazing action estimation device for estimating an action of gazing at any object (gazing action) by a moving person, a gazing action estimation method, and a gazing action estimation program.SOLUTION: The gazing action estimation device for estimating the fact that a moving person is in a gazing action which is an action of gazing at a particular object includes: a head posture measurement unit which is attached to a head of a person and measures an absolute direction of the head; a step counting unit which is attached to a body of a person and counts the number of steps; and a gazing action determination unit which, on the basis of the measured absolute direction of the head and the counted number of steps, generates a difference angle of the absolute directions of the head for every one or predetermined number of steps and, when the difference angle which is consecutively retained between a first and second threshold values and a third frequency threshold being maintained is detected, this determines the person is in a gazing action.

Description

  The present invention relates to a gaze behavior estimation device, a gaze behavior estimation method, and a gaze behavior estimation program.

  Gaze behavior is behavior in which a person pays attention to something. For example, if a person is walking around an exhibition hall and if it can be determined that the person is gazing at an exhibit, a new service will be provided, such as presenting the person with detailed information on the object of gazing. be able to.

  When a person is stationary, when the person is gazing, the absolute direction of the person's head is fixed in the direction of the object to be watched. Can be estimated.

  Patent Document 1 describes that a driver's gaze direction is detected from an image captured by an in-vehicle camera, a point where a plurality of detected gaze directions intersect is detected as a gazing point, and a facility at the gazing point is specified. . However, this document does not estimate whether the driver is gazing.

  Furthermore, if a gaze that is the direction in which each passer-by is gazing is detected from images of a plurality of passers-by captured by the surveillance camera and the gazes are concentrated in one place, any abnormality or incident Japanese Patent Application Laid-Open No. H10-228707 describes that the occurrence of the occurrence of the above is detected. However, this document does not estimate whether or not a predetermined passer-by is taking gaze action.

JP 2009-31943 A JP 2008-40758 A JP 2010-61452 A

  Accordingly, an object of the present invention is to provide a gaze behavior estimation device, a gaze behavior estimation method, and a gaze behavior estimation program for estimating a behavior (gaze behavior) in which a moving person gazes at an object.

A first aspect of the gaze behavior estimation device is a gaze behavior estimation device that estimates that a moving person is gaze behavior to gaze at a specific object,
A head posture measuring unit attached to the head of the person for measuring the absolute direction of the head;
A step counting unit attached to the human body for measuring the number of steps;
Based on the measured absolute direction of the head and the number of steps, a difference angle of the absolute direction of the head for each step or every predetermined number of steps is generated, and the difference angle is between the first and second thresholds, And a gaze action determination unit that determines that the person is performing the gaze action when it is detected that the third threshold number of times is continuously maintained.

  According to the first aspect, it is possible to estimate the gaze behavior of a moving person with high accuracy.

It is a figure explaining provision of the service using the gaze action estimation apparatus of this Embodiment. It is a schematic flowchart figure of provision of the service using the gaze action estimation apparatus in this Embodiment. It is a figure which shows the outline of gaze action estimation by the gaze action estimation apparatus in this Embodiment. It is a block diagram of the gaze action estimation apparatus in this Embodiment. It is a figure explaining the method of estimating the gaze action of the person in this Embodiment. It is a figure which shows the example of a change of difference angle (DELTA) (theta) of the head posture direction corresponding to the increase in the step count of the person who performed the gaze action. It is a flowchart figure of a process of the gaze action determination program in this Embodiment. It is a flowchart figure of the calculation process of the 1st, 2nd, 3rd threshold value by a gaze action determination program. It is a figure which shows the gaze determination triangle set when difference angle (DELTA) (theta) exceeded reference value. It is a figure which shows a state when passing the center C of the base AB of a gaze determination triangle.

[Outline of services using gaze behavior estimation]
FIG. 1 is a diagram for explaining the provision of a service using the gaze action estimation apparatus according to the present embodiment. In FIG. 1, the person 10 is walking in the direction of the dashed arrow in the vicinity of the exhibit E1 while gazing at the exhibit E1. Such a movement of the moving person 10 gazing at the exhibition E1 can be estimated by the headset 12 worn by the person 10 or the terminal 11 such as a smart phone or a pad terminal that is carried. If possible, the headset 12 or the terminal 10 transmits gaze action determination information including the information of the gaze target exhibit E1 to the exhibit content server 14 (S10), and in response, the exhibit content server 14 The content information related to the exhibition object E1 to be watched can be push-transmitted (S12) to the terminal 11. As a result, it is possible to provide a service for providing the person 10 with relevant information on the exhibit that the person 10 moving in the exhibition hall is watching.

  FIG. 2 is a schematic flowchart of service provision using the gaze behavior estimation apparatus according to the present embodiment. Moreover, FIG. 3 is a figure which shows the outline of gaze action estimation by the gaze action estimation apparatus in this Embodiment. The service provision shown in the flowchart of FIG. 2 will be described with reference to FIG.

  In FIG. 3, a person 10 is walking in front of the exhibit E1 while gazing at the exhibit E1 in the exhibition hall where a plurality of exhibits E1 to E4 are exhibited. The person 10 moves from the position A (x0, y0) to the position x1, y1) by one step of walking. Furthermore, by continuing walking, the person 10 sequentially changes the position from the position A (x0, y0) toward the point B.

  At the same time, when the person 10 moves by walking while gazing at the exhibit E1 from the plurality of exhibits, the head posture of the person 10 is maintained in the direction of the exhibit E1.

  Therefore, the person 10 wears a sensor device that detects the direction of the head posture at least on the head 10H. With this sensor device, it is possible to detect the absolute direction of the posture of the head 10H at one step or every predetermined number of steps of the person 10 who is moving by walking. If the person 10 keeps gazing at the exhibit E1 while walking, the direction of the posture of the head 10H of the person 10 who is walking changes at a substantially constant angle as will be described later. Therefore, by monitoring whether or not the change in the direction of the head 10H of the person 10 is at a certain angle, it is possible to detect whether or not the person is performing a gaze action.

  Furthermore, if the position A (x0, y0) of the person 10 can be detected by any method, the exhibit E1 ahead of that direction is detected based on the measurement data in the direction of the head 10H (arrow direction) of the person 10. can do. Or, based on the position of the person at the position A (x0, y0) and the position B (x1, y1) one step ahead and the posture direction of the head, the exhibit E1 closest to the intersection position of the head posture direction is detected. can do.

  Therefore, as shown in FIG. 2, the exhibit E1 ahead of the front direction of the head 10H is detected from the direction and position of the head of the moving person, and one step or every predetermined number of steps. It can be determined whether or not the person 10 is gazing from the change in the orientation of the head 10H (S10). Therefore, when the gaze behavior of the person is determined, the fact of gaze behavior detection and the information on the detected exhibit E1 are transmitted from the headset or terminal of the person 10 to the exhibit content server 14 (S12). ).

  In response to this, the exhibit content server 14 push-transmits the content related to the exhibit E1, which is the watched object, to the terminal of the person 10 (S14). Then, the moving person 10 can acquire the contents of the exhibition E1 that has been completed from the terminal (S16).

[Configuration of gaze behavior estimation device]
FIG. 4 is a configuration diagram of the gaze action estimation apparatus in the present embodiment. The gaze action estimation device in FIG. 4 is, for example, a headset worn on a human head. Alternatively, the gaze behavior estimation device is configured by a combination of a headset and a terminal such as a smart phone or a pad terminal carried by a person.

  The gaze action estimation device includes a head posture measurement unit 20 that measures the direction of the posture of the head, and a step count measurement unit 24 that measures the number of steps of a person. The head posture measurement unit 20 includes a sensor unit 21 having a geomagnetic sensor and a gyro sensor, and a signal processing unit 22 that processes output signals of these sensors, and is mounted on a human head.

  The geomagnetic sensor can detect the absolute direction of the head, whereas the gyro sensor can detect the angular velocity when the direction of the head changes. The geomagnetic sensor can detect the absolute direction of the head, but the response characteristics are not so good, while the gyro sensor can detect the angular direction and angular velocity when changing the direction of the head with a high-speed response. Therefore, by combining both sensors, the direction in the initial state where the head is stationary is detected by the geomagnetic sensor, the change in the direction of the head after that is detected by the gyro sensor, and the change angle with respect to the change in the direction of the head Is accumulated in the direction in the initial state, and the change in the direction of the posture of the head can be tracked.

  On the other hand, the step count measuring unit 24 includes the acceleration sensor 25 and a signal processing unit that processes the sensor output signal, and it is only necessary for a person to carry it without wearing it on the head. Since the acceleration sensor 25 can detect accelerations in the three-axis directions of X, Y, and Z, the number of steps of a person can be counted by counting the increase in the acceleration in the vertical direction. Also, since the gyro sensor is provided, the vertical direction can be followed even if the terminal is tilted, so the number of steps is counted at the timing when the acceleration in the vertical direction increases temporarily.

  The gaze action determination unit 30 includes a CPU 31 and a gaze action determination program 32, and the CPU 31 executes the gaze action determination program 32 to determine whether or not it is a gaze action. A memory 34 and a wireless communication device 35 are connected to the CPU 31 via the bus 28. The memory 34 stores parameters such as a threshold for determining gaze behavior. The processing flow of the gaze action determination program will be described later.

  The signal processing unit 26 of the step count measuring unit 24 supplies a sampling signal to the signal processing unit 22 of the head posture measuring unit at every step or every predetermined number of steps, so that the signal processing unit 22 performs the head posture at the sampling timing. Output direction. Alternatively, the CPU 31 may acquire the direction data output from the signal processing unit 22 of the head posture measurement unit at the timing of the sampling signal generated by the signal processing unit 26 of the step count measurement unit.

  When the gaze action estimation device is configured by a combination of a headset and a terminal such as a smart phone or a pad terminal carried by a person, the head posture measurement unit 20 is provided in the headset, and the remaining configuration is configured. Provided on the terminal. Alternatively, when the gaze behavior estimation device is configured only with a headset, all the configurations in FIG. 4 are provided in the headset.

  The gaze behavior estimation device is realized by only the head posture measurement unit 20, the step count measurement unit 24, and the wireless communication device 35 by a headset or a combination of a headset and a terminal, and the gaze behavior determination unit 30 and the memory 34 include exhibition contents. You may implement | achieve with CPU in the server 14, a gaze action determination program, and memory.

[Method for estimating gaze behavior]
FIG. 5 is a diagram for explaining a method for estimating the gaze behavior of a person in the present embodiment. In the present embodiment, the direction of the human head posture and the number of steps are detected, and the gaze behavior of the person is estimated approximately. As shown in FIG. 5, when the person 10 is traveling straight while looking at a certain gazing point E1, at the position of the 0th step, the head 10H is directed diagonally upward to the right and the front direction of the head 10H. There is a gazing point E1, and at the position of the first step after walking one step from the zeroth step, the head 10H is directed to the right lateral direction, and at the zeroth step and the first step, the direction of the head 10H Is rotated clockwise by Δθ1.

  Further, at the position of the second step after the next one-step walk, the head 10H is directed diagonally to the right rear, and the direction of the head 10H is rotated clockwise by Δθ2 between the first and second steps. ing. If it is assumed that the stride is constant, it can be understood that the change angle or difference angle Δθ1, Δθ2 in the absolute direction of the head is substantially constant (Δθ1 = Δθ2).

  Strictly speaking, when the person 10 moves on an arc centered on the gazing point E1, the difference angle Δθ in the direction of the head 10H at the sampling timing for each step becomes constant. However, when the person moves on a straight line, if the distance between the person 10 and the gazing point E1 is equal to or greater than a predetermined distance, the difference angle Δθ in the direction of the head 10H at the sampling timing for each step is also substantially constant. .

  Therefore, in the gaze determination program of the gaze behavior estimation apparatus according to the present embodiment, the difference angle Δθ, which is the amount of change in head direction at the sampling timing for each step of the moving person or for each predetermined number of steps, is continuously measured. A state in which the difference angle Δθ is equal to or larger than a reference angle, the difference angle Δθ is within a certain range (between the first and second threshold values), and the difference angle Δθ is substantially constant is predetermined. If it is detected that the number of steps (the third threshold) continues, it is estimated that the person is gazing.

[Example of gaze behavior]
FIG. 6 is a diagram illustrating a change example of the difference angle Δθ in the head posture direction corresponding to an increase in the number of steps of the person who performed the gaze action. The horizontal axis of FIG. 6 is the number of steps, and the vertical axis is the detected difference angle Δθ in the head posture direction. A variation example 100 of the difference angle Δθ in that case is shown.

  According to this example, the difference angle Δθ in the head posture direction does not exceed the reference value in the period t1 from the initial number of steps 0 to a certain number of steps. When the period t1 has elapsed, the difference angle Δθ exceeds the reference value, and the difference angle Δθ during the period t2 is maintained between the first and second threshold values. Strictly speaking, the difference angle Δθ during the period t2 gradually increases from the vicinity of the first threshold low on the low side, reaches the vicinity of the second threshold high on the high side, and then reaches the first threshold on the low side. It drops to the vicinity of the low threshold value.

  The reason is that, as will be described later, when a person goes straight near the gazing point, the difference angle Δθ at the position closest to the gazing point becomes maximum, and the difference angle Δθ decreases as the distance from the gazing point increases. is there.

[Process of gaze behavior determination program]
FIG. 7 is a flowchart of processing of the gaze behavior determination program in the present embodiment. In the example shown in FIG. 6, the gaze behavior determination unit 30 in which the CPU executes the gaze behavior determination program is maintained during the third threshold step number t3 while the difference angle Δθ is between the first and second threshold values. If it is, it is determined that the person is gazing.

  First, as described with reference to FIG. 5, the gaze action determination unit 30 is in a state where the difference angle Δθ in the direction of the head posture of the person 10 at a sampling timing for each step or every predetermined number of steps is within a certain range. In order to determine whether or not has reached the third threshold number of steps, a gaze determination counter is used.

  First, the gaze action determination unit 30 clears the gaze determination counter and sets the count value to zero (S20). Then, head posture direction data and step count data are read from the head posture measurement section 20 and the step count measurement section 24 (S21). The head posture direction data is the absolute direction data of the current head 10H, and the step count data is data indicating the timing of each step by walking.

  Steps S20 and S21 are repeated until an update of one step or a predetermined number of steps is detected from the step count data (NO in S22). When the gaze action determination unit 30 detects an update of one step or a predetermined number of steps from the step count data (YES in S22), the gaze action determination unit 30 calculates the head of the previous sampling timing and the current sampling timing at the sampling timing of the update. A change angle of the direction of the head posture direction data, that is, a difference angle Δθ is calculated (S23).

  Then, the gaze action determination unit 30 determines whether or not the difference angle Δθ calculated in step S23 exceeds a reference value (S24). If a moving person moves while gazing at a gaze target, the head posture direction changes by a difference angle Δθ exceeding a certain reference value, so this reference value is an extent that estimates the possibility of gaze behavior. Is set to the difference angle Δθ.

  When the difference angle Δθ exceeds the reference value for the first time (YES in S24), there is a possibility that the person has entered the gaze action. Therefore, the gaze action determination unit 30 determines that the counter value of the gaze determination counter is 0 (S25). YES), the first, second and third threshold values are calculated (S26). Further, when the difference angle Δθ repeatedly exceeds the reference value (YES in S24), if the person continues the gaze action, the counter value of the gaze determination counter becomes a positive value other than 0 (NO in S25). ). However, even if the difference angle Δθ repeatedly exceeds the reference value, the counter value of the gaze determination counter remains 0 if the person is not in the gaze behavior.

  In the example of FIG. 6, the difference angle Δθ does not exceed the reference value during the period t1. When the period t1 has elapsed, the difference angle Δθ exceeds the reference value. At this point, step S24 in the flowchart of FIG. 7 is YES. Then, only when the gaze determination counter value is 0, the following first, second and third thresholds are calculated based on the current position of the person and the head direction (S26).

[Calculation of first, second, and third threshold values]
The gaze action determination unit 30 calculates the first, second, and third threshold values (S26) as follows. As shown in FIG. 3, it is assumed that the person 10 walks linearly in front of the exhibit E1 while gazing at the exhibit E1. When the difference angle Δθ exceeds the reference value, the possibility of the human gaze action is estimated, and the gaze action determination unit 30 sets the gaze determination triangle 100 shown in FIG. The gaze determination triangle 100 is an isosceles triangle having the side AB as a base and the gaze target E1 as a vertex. However, the triangle is not necessarily an isosceles triangle, and may be a triangle having the current position A and the moving direction of the person as the base and the gaze target E1 as the apex.

  Since the point A is farthest from the gaze target E1, the difference angle Δθ at one step or a predetermined number of steps at the point A on the base AB is the minimum value and corresponds to the first threshold value. Further, since the center C of the base AB is closest to the gaze target E1, the difference angle Δθ at one step or a predetermined number of steps at the center C is the maximum value and corresponds to the second threshold value. Then, since it is desirable to determine whether or not a person has performed a gaze action while walking the distance L of the base AB, the number of steps obtained by dividing a part of the predetermined distance of the distance L by the stride is the third number. Corresponds to the threshold value. This distance L is set as a gaze determination distance L.

  FIG. 8 is a flowchart of first, second, and third threshold value calculation processing by the gaze behavior determination program. FIG. 9 is a diagram illustrating a gaze determination triangle that is set when the difference angle Δθ exceeds the reference value. FIG. 10 is a diagram showing a state when passing through the center C of the base AB of the gaze determination triangle. The calculation process of FIG. 8 will be described with reference to FIGS.

  The gaze action determination device measures the position of the person when the difference angle Δθ exceeds the reference value (S40). A terminal such as a smart phone or a pad terminal carried by a person has a function of detecting the current position. For example, it is possible to detect the distance from the base station based on the radio field intensity by wireless communication with two WiFi base stations, and to detect the position of the terminal from the base station position data and the obtained two distances. . The accuracy of this position detection is not so high, but it is sufficient if an approximate position can be detected. This is because the information is used to calculate a threshold value used for gaze behavior determination.

  Next, the moving direction when the person walks the next step is measured (S41). The moving direction can be acquired from the sensor value of the gyro sensor. Alternatively, the position after movement may be obtained from the radio wave intensity between the base stations, and the movement direction may be acquired from the relationship between the position before movement and the position after movement.

  In this case, the absolute direction of the head posture has already been acquired by the head posture measuring unit 20.

  Therefore, based on the position information at point A in FIGS. 3 and 9 and the absolute direction information of the head posture at that time, an exhibit in front of the head direction is displayed for a plurality of pre-registered exhibits. The position database is specified by scanning (S42). That is, from the position information at the point A and the head posture direction, the exhibit located at the forefront of the direction is detected as a gaze target.

  Alternatively, from the position information and the head posture direction at the point A (x0, y0) in FIG. 3 and the position information and the head posture direction at the coordinates (x1, x2) after moving one step, the intersection position Can be obtained as the position of the point of interest. However, since the position of the gazing point obtained by this calculation is low in accuracy, the exhibit that has a position closest to the position of the gazing point obtained by the calculation by scanning the position database of a plurality of exhibits registered in advance. Is identified as a gaze target (S42).

  In any method, the position data of the gaze target has high accuracy by using the position data of the exhibits extracted from the position data of a plurality of exhibits.

  Next, the gaze action determination unit 30 sets an isosceles triangle having the position of the gaze object as a vertex and the moving direction as a base from the point A as the gaze determination triangle 100 (S43). That is, the triangle 100 shown in FIG. 9 is set. As a result, the length L of the bottom of the gaze determination triangle is obtained as the gaze determination distance, and the length D of the perpendicular (triangle height) D drawn from the vertex gaze point to the bottom is obtained.

Then, based on the gaze determination triangle 100, the gaze behavior determination unit 30 calculates the difference angle of the direction of the human head gaze at the point A as the first threshold (S44). Specifically, in the gaze determination triangle 100 of FIG.
tanθh1 ＝ D / (L / 2)
L = 2D / tanθh1
Next, assuming that the step length of one step between the coordinates (x0, y0) and the coordinates (x1, y1) in FIG. 3 is S and the angles with respect to the bottom of the head posture at each coordinate are θh1 and θh2, The formula holds.
Δθ = θh2−θh1 = abs {atan (d / (L / 2-s))-atan (d / (L / 2)}
Where abs is an absolute value. This Δθ corresponds to the difference angle of the head posture due to one step movement between the coordinates (x0, y0) and the coordinates (x1, y1), and corresponds to the first threshold value.

  The above example is an example in which the difference angle sampling period is one step. If the sampling period of the difference angle is N steps, s in the above equation may be set to s = Ns.

Next, the gaze action determination unit 30 calculates the difference angle of the head posture direction at the center C of the bottom side of the gaze determination triangle 100 as the second threshold value (S45). As shown in FIG. 10, when the step s of one step on both sides b at the center C is used, the difference angle Δθ can be obtained as follows.
Δθ ＝ atan (s / D)
This is calculated as the second threshold value. In this example, the difference angle sampling cycle is one step. If the sampling period of the difference angle is N steps, s in the above equation may be set to s = Ns.

  Finally, the gaze action determination unit 30 calculates the sampling number (one step or a predetermined number of steps) of a predetermined ratio (for example, 30 to 50%) of the base length L of the gaze triangle 100 or the minimum sampling number necessary for the gaze determination. , Calculated as the third threshold value. It is desirable to set the larger sampling number as the third threshold value. That is, if the gaze determination distance L is long, the sampling number of a predetermined ratio is generated as the third threshold, and if it is short, the minimum necessary sampling number is generated as the third threshold.

  Returning to FIG. 7, the gaze behavior determination unit 30 stores the first, second, and third threshold values in the memory 34 after obtaining the first, second, and third threshold values in the process S <b> 26. Then, the gaze action determination unit 30 determines whether or not the difference angle Δθ determined to exceed the reference value in step S24 is between the first and second thresholds (S27). That is, it is determined whether or not the difference angle Δθ is between the first threshold low and the second threshold high in FIG. When the difference angle Δθ does not fall between the first and second threshold values (NO in S27), the gaze action determination unit 30 clears the gaze determination counter and returns to step S21. That is, the threshold value based on the gaze determination triangle set when the difference angle Δθ exceeds the reference value is canceled.

  On the other hand, when the difference angle Δθ is between the first and second threshold values (YES in S27), the gaze action determination unit 30 increments the gaze determination counter (S28). That is, the gaze behavior determination unit 30 estimates that the person has started the gaze behavior and starts incrementing the gaze determination counter. In this case, a threshold value based on the set gaze determination triangle is subsequently used.

  Next, the gaze action determination unit 30 determines whether or not the value of the gaze determination counter has exceeded the third threshold (S30). Initially, since the third threshold value has not yet been exceeded, the determination in step S30 is NO.

  And the following processes are repeated from process S21.

  As described above, according to the processing of the flowchart of FIG. 7, the gaze action determination unit 30 always reads the detection data of the number of steps and the head posture, and performs sampling intervals at the sampling timing at which one step or a predetermined number of steps is updated. The difference angle of the head posture is calculated, and if it is between the first and second threshold values higher than the reference value, the gaze counter is incremented. When the gaze counter reaches the third threshold (YES in S30), the person's gaze behavior is recognized (S31).

  When the difference angle falls outside the range between the first and second threshold values (NO in S27), the gaze action determination unit 30 clears the gaze determination counter (S29), cancels the calculated threshold value, and performs the determination. Start over from the beginning. Also, the gaze action determination unit 30 calculates the first, second, and third thresholds only once when the difference angle exceeds the reference value again after clearing the gaze counter (S26). By doing so, it is possible to determine the gaze behavior based on the threshold value based on the gaze determination triangle adapted to the situation of the person by dynamically changing these threshold values.

  As described above, according to the gaze determination device of the present embodiment, it is estimated whether or not a person is moving while paying attention to an exhibit from the measurement data of the direction of the head posture of the person and the number of steps data. By doing so, it is possible to approximately extract the gaze behavior of a person. By extracting such gaze behavior, it is possible to provide a service such as push transmission of content about a gaze target to a terminal carried by a person.

20: Head posture measurement unit 24: Step count measurement unit

Claims (6)

A gaze behavior estimation device for estimating that a moving person is gaze behavior to gaze at a specific object,
A head posture measuring unit attached to the head of the person for measuring the absolute direction of the head;
A step counting unit attached to the human body for measuring the number of steps;
Based on the measured absolute direction of the head and the number of steps, a difference angle of the absolute direction of the head for each step or every predetermined number of steps is generated, and the difference angle is between the first and second threshold values. , A gaze behavior estimation device having a gaze behavior determination unit that determines that the person is performing the gaze behavior when it is detected that the third threshold number of times is continuously maintained. In claim 1,
The gaze behavior determination unit
Based on the gaze start position of the person, the movement direction of the person, and the absolute direction of the head, the gaze object that the person gazes at is detected,
The difference angle at the gaze start position of the person having the apex at the position of the gaze object and the base of the moving direction from the gaze start position of the person is the first threshold value, and the difference angle at the gaze start position of the person is the first threshold. A gaze action estimation device that generates the difference angle at a position closest to a vertex as the second threshold. In claim 2,
The gaze behavior determination unit is configured to generate a gaze behavior estimation device that generates, as the third threshold value, the number of times corresponding to a predetermined ratio distance of the base of the triangle. In claim 2,
The gaze behavior determination unit is configured to detect the gaze object by searching position data of a plurality of objects, and a position closest to the gaze target position based on the gaze start position of the person and the absolute direction of the head Gaze action estimation device performed by detecting a target object. A gaze behavior estimation method for estimating that a moving person is gazing at a specific object,
Based on the measurement data from the head posture measurement unit that is attached to the human head and measures the absolute direction of the head, and the step count data from the step measurement unit that is attached to the human body and measures the number of steps, Generate a difference angle in the absolute direction of the head for each step or a predetermined number of steps, and detect that the difference angle is continuously maintained for the third threshold number of times between the first and second thresholds A gaze behavior estimation method including a gaze behavior determination step of determining that the person is performing the gaze behavior when the person performs the gaze behavior. A gaze behavior estimation program for processing a gaze behavior estimation method for estimating that a moving person is gaze behavior to gaze at a specific object,
The gaze behavior estimation method includes:
Based on the measurement data from the head posture measurement unit that is attached to the human head and measures the absolute direction of the head, and the step count data from the step measurement unit that is attached to the human body and measures the number of steps, Generate a difference angle in the absolute direction of the head for each step or a predetermined number of steps, and detect that the difference angle is continuously maintained for the third threshold number of times between the first and second thresholds A gaze behavior estimation program comprising a gaze behavior determination step for determining that the person is performing the gaze behavior when the person performs the gaze behavior.

Images