JP2015150150A - Information providing device and program - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide an information providing device and program which can provide notification that a person is in a fatigue state by appropriately determining the fatigue state of the person.SOLUTION: A terminal device 4 includes a detection part 52 for detecting a state of a person, a determination part 54 for determining the fatigue degree of the person on the basis of a series of states of the person detected by the detection part 52 within a predetermined period, and an information providing part 56 for providing the person with perceivable information in the case that the fatigue degree of the person determined by the determination part 54 satisfies the predetermined reference of a fatigue degree.

Description

  The present invention relates to an information providing apparatus and a program.

  Patent Document 1 discloses an input unit that captures an operator's face and outputs image data of the face, an image processing unit that creates a human face model from the image data, and an operator who analyzes the model and analyzes the model. There is disclosed a fatigue alleviation system comprising: a fatigue degree judging means for judging the fatigue degree of the above; and an output means for outputting response information corresponding to the fatigue degree.

  Patent Document 2 includes a main body unit to be worn on the upper limb of the measurement subject, an acceleration sensor for detecting the acceleration of the main body unit, and a control unit for processing the detected acceleration. An acceleration acquisition unit that acquires time-series acceleration from the acceleration sensor during a movement period of walking or running of the measurement subject wearing the main body, and a displacement of the position of the main body from the acquired time-series acceleration. A fatigue determination apparatus including a displacement acquisition unit to be acquired, and a determination unit that determines the degree of fatigue of the measurement subject according to the acquired displacement and the fatigue determination criterion is disclosed.

  Patent Document 3 continuously determines whether or not the driver is tired by suppressing an increase in cost, and as a driver fatigue level estimation device that can more accurately detect driver fatigue. When the driving time exceeds the allowable driving time, in the driver fatigue level estimation device that performs a driver fatigue reduction measure, a fatigue map storage unit that stores a fatigue map in which a high fatigue area is registered for each area, and the fatigue map Fatigue degree calculation means for calculating the fatigue degree according to the high fatigue operation time of driving in the high fatigue area determined with reference, and the allowable operation time is changed according to the fatigue degree calculated by the fatigue degree calculation means And a determination means for determining that it is time to perform the fatigue alleviation measure of the driver when the continuous operation time exceeds the allowable operation time. About to disclose.

JP 2002-042115 A JP 2013-017614 A JP 2009-293996 A

  An object of the present invention is to provide an information providing apparatus and a program capable of appropriately determining a person's fatigue state and notifying that the person is in a fatigue state.

  The present invention according to claim 1 determines the degree of fatigue of the person based on a detection means for detecting the state of the person and a series of states of the person within a predetermined period detected by the detection means. An information providing apparatus comprising: a determination unit configured to perform determination; and an information providing unit configured to provide information perceived by the person when the fatigue level of the person determined by the determination unit satisfies a predetermined fatigue level standard. It is.

  According to a second aspect of the present invention, the determination means determines the degree of fatigue of the person based on a time during which a state detected by the detection means within a predetermined period satisfies a predetermined condition. An information providing apparatus according to claim 1.

  The present invention according to claim 3 further comprises a timing determining means for determining a timing for providing information to the person, wherein the information providing means provides the information at a timing determined by the timing determining means. Item 3. The information providing device according to Item 1 or 2.

  The present invention according to claim 4 further comprises estimation means for estimating the degree of concentration of the person in the work, and the time determination means determines the time according to the degree of concentration estimated by the estimation means. Item 4. The information providing device according to Item 3.

  According to a fifth aspect of the present invention, the detecting means detects the state of the person from an input operation by the person on the input receiving device, and the timing determining means determines in advance the degree of concentration estimated by the estimating means. The information providing apparatus according to claim 4, wherein, when the degree of concentration is equal to or greater than a predetermined concentration level, a time when an input amount by the input operation is below a predetermined threshold is determined as an information providing time.

  According to a sixth aspect of the present invention, the detection means detects the state of the person from an input operation by the person on the input receiving device, and the determination means has an input amount by an input operation within a predetermined period or The information providing apparatus according to claim 1, wherein the person's fatigue level is determined based on an input correction amount.

  In the present invention according to claim 7, the detecting means detects the posture of the person, and the determining means determines the degree of fatigue of the person based on a deviation amount of the posture of the person from a pre-registered posture. The information providing device according to any one of claims 1 to 6.

  The present invention according to claim 8 is the information providing apparatus according to claim 7, wherein the detection unit detects the posture based on a photographed image obtained by photographing the person.

  The present invention according to claim 9 is the information providing apparatus according to claim 7 or 8, wherein the detection means detects the posture based on a pressure applied to a seating surface on which the seated person is seated.

  The present invention according to claim 10 is the information according to any one of claims 1 to 9, wherein the detection means detects the facial expression of the person, and the determination means determines the degree of fatigue of the person based on the facial expression of the person. It is a providing device.

  The present invention according to claim 11 further comprises information storage means for storing information provided by the information providing means for each person, and the information providing means provides information according to the person. The information providing apparatus according to any one of 10 to 10.

  According to a twelfth aspect of the present invention, the detection means for detecting the state of the person, the determination means for determining the degree of fatigue of the person based on the state detected by the detection means, and the determination means Time determination means for determining a provision time of information to be provided to the person when the degree of fatigue of the person satisfies a predetermined fatigue degree criterion; and the time determined by the time determination means; And an information providing device that provides information perceived by the user.

  According to a thirteenth aspect of the present invention, the degree of fatigue of the person is determined based on a detection step for detecting the state of the person and a series of states of the person within a predetermined period detected in the detection step. And a step of providing an information providing step for providing information perceived by the person when the degree of fatigue of the person determined in the determination step satisfies a predetermined fatigue degree criterion. It is a program.

  The present invention according to claim 14 is determined by the detection step of detecting the state of the person, the determination step of determining the degree of fatigue of the person based on the state detected by the detection step, and the determination step. A timing determining step for determining a provision timing of information to be provided to the person when the fatigue level of the person satisfies a predetermined fatigue criterion, and the timing determined in the timing determination step; An information providing step for providing information perceived by the computer is executed by a computer.

  According to the first aspect of the present invention, it is possible to appropriately determine the person's fatigue state as compared with the case where the present configuration is not provided, and to notify that the person is in the fatigue state.

  According to the second aspect of the present invention, it is possible to appropriately determine the person's fatigue state compared to the case where the present configuration is not provided, and to notify that the person is in the fatigue state.

  According to the present invention of claim 3, notification can be made at a desired time.

  According to the fourth aspect of the present invention, notification can be made at an appropriate time according to the concentration of the person.

  According to the fifth aspect of the present invention, it is possible to suppress the notification from interfering with the work as compared with the case where the present configuration is not provided.

  According to the sixth aspect of the present invention, the fatigue that appears in the input operation can be reflected in the determination of the person's fatigue level.

  According to the seventh aspect of the present invention, the fatigue that appears in the posture of the person can be reflected in the determination of the degree of fatigue of the person.

  According to the eighth aspect of the present invention, the fatigue that appears in the posture of the person can be reflected in the determination of the degree of fatigue of the person.

  According to the ninth aspect of the present invention, even when it is difficult to grasp the deviation of the posture of the person from the appearance, the fatigue that appears in the posture of the person can be reflected in the determination of the degree of fatigue of the person. .

  According to the tenth aspect of the present invention, fatigue appearing on a person's face can be reflected in the determination of the person's degree of fatigue.

  According to the present invention of claim 11, desired contents can be provided for each person.

  According to the present invention of claim 12, it is possible to notify at a desired time that a person is in a fatigued state.

  According to the thirteenth aspect of the present invention, it is possible to appropriately determine the person's fatigue state as compared with the case where the present configuration is not provided, and to notify that the person is in a fatigue state.

  According to the present invention of claim 14, it is possible to notify at a desired time that a person is in a fatigued state.

It is a schematic diagram which shows an example of a structure of the information provision system 2 which concerns on embodiment of this invention. It is a figure which shows an example of the hardware constitutions of the terminal device 4 which concerns on embodiment of this invention. It is a block diagram which shows the function structure of the terminal device 4 implement | achieved by running a program. It is a schematic diagram which shows an example of the information which the provision information storage part 58 memorize | stores. It is a schematic diagram explaining the duration for every magnitude | size of a fatigue degree, (a) is a figure explaining the duration of the state made into the fatigue degree: 3, (b) was made into the fatigue degree: 2. It is a figure explaining the continuation time of a state. It is a schematic diagram showing the relationship between the posture of the person 14 and the distance d1 from the head P of the person 14 to the first imaging device 6 and the distance d2 from the chest Q of the person 14 to the first imaging device 6. (A) shows a case where the person 14 is in a forward posture, and (b) shows a posture where the person 14 is seated. It is a table | surface which shows the difference of the distance d1 and the distance d2, and the relationship of the fatigue degree. It is a schematic diagram which shows an example of the pressure distribution concerning the seating surface of the person 14, and the statistic obtained from the said pressure distribution, (a) shows the pressure distribution and statistic in the case of a reference posture, (b) The pressure distribution and statistic in the case of the front turning posture are shown, and (c) shows the pressure distribution and statistic in the case of the backrest posture. It is a table | surface explaining the deviation | shift amount which the determination part 54 calculates. It is a table | surface which shows an example in the case of judging the fatigue degree based on the detection result of the 2nd attitude | position detection part 522 using the calculated backrest degree. It is a schematic diagram explaining an example of the judgment of the fatigue degree based on the detection result of the input operation state detection part 524, (a) is a graph which shows an example of input amount, (b) is input amount (number of keystrokes) Is a table showing an example of determining the degree of fatigue based on the detection result of the input operation status detection unit 524 according to (). It is a table | surface which shows an example in the case of judging the fatigue degree based on the detection result of the facial expression detection part 526 according to the frequency | count of specific operation | movement. 5 is a flowchart illustrating an operation of the information providing system 2. It is a flowchart which shows an example of the prior setting process (S10) in the information provision system 2. FIG. It is a flowchart which shows an example of the information provision process (S20) in the information provision system 2. FIG. It is a flowchart which shows an example of the determination operation | movement of the fatigue degree in step 202 of FIG. It is a flowchart which shows an example of the determination operation | movement of the information provision time in step 206 of FIG. It is a table | surface which shows an example of the fatigue degree determination table. It is a table | surface which shows an example of the fatigue degree determination table by which the menu of the information which the information provision part 56 provides is preset.

Hereinafter, embodiments of the present invention will be described in detail with reference to the drawings.
FIG. 1 is a schematic diagram illustrating an example of a configuration of an information providing system 2 according to an embodiment of the present invention. The information providing system 2 of the present invention includes a terminal device 4 that functions as an information providing device, a first imaging device 6, a second imaging device 8, and a pressure measuring device 10, and includes a first The photographing device 6, the second photographing device 8, and the pressure measuring device 10 are connected to the terminal device 4 so as to be communicable by wire or wirelessly.

  The terminal device 4 is a device having a function as a computer. For example, the terminal device 4 is a personal computer, and may be a tablet PC (personal computer), a PDA (Personal Digital Assistant), a smartphone, or the like.

  The first photographing device 6 is a camera that photographs a seated person in order to determine the posture of the person. In the present embodiment, the first photographing device 6 is a camera equipped with a distance image sensor, and is configured to photograph a distance image, and photographs the person 14 seated on the chair 12 from the front of the person 14. Thereby, three-dimensional data is obtained from the first photographing device 6 as photographing data. In the present embodiment, the first image capturing device 6 only needs to be able to capture a distance image, and the distance image capturing method does not matter. For example, the distance image capturing method may be a TOF (Time Of Flight) method or a pattern irradiation method.

  In the present embodiment, the first photographing device 6 is provided to photograph the upper body of the seated person 14 including, for example, the buttocks, but the photographing range is not limited thereto. For example, it may be provided to photograph the body above the waist, or may be provided to photograph a range including the lower part than the buttocks.

  The second photographing device 8 is a camera that photographs the face of the person 14 in order to determine the facial expression of the person 14. In the present embodiment, two cameras, the first photographing device 6 and the second photographing device 8, are provided as the posture determination camera and the facial expression determination camera. Also good.

  The pressure measuring device 10 is a measuring device that measures pressure applied to a seating surface on which a person is seated. The pressure measuring device 10 is configured, for example, in a sheet shape, and is laid on the seat surface, and detects the pressure applied to the seat surface by sitting. In the present embodiment, the pressure measurement device 10 is provided on the seat surface of the chair 12 and detects the pressure at each point (for example, 16 × 16 256 points) in the seat surface region.

FIG. 2 is a diagram illustrating an example of a hardware configuration of the terminal device 4.
As shown in FIG. 2, the terminal device 4 includes a CPU 20, a memory 22, a storage unit 24 such as a hard disk drive (HDD), the first photographing device 6, the second photographing device 8, and the pressure measuring device 10. A user interface including a communication interface (IF) 26 for transmitting and receiving data wirelessly or by wire, an input receiving device such as a keyboard for accepting an input made by an operator, a pointing device, and a display device for displaying information to be displayed ( UI) unit 28, and these components are connected to each other via a control bus 30. Note that the communication IF 26 may transmit / receive data to / from other devices via a network (not shown).

  The CPU 20 controls the operation of the terminal device 4 by executing processing based on a program stored in the memory 22 or the storage unit 24. In the present embodiment, the CPU 20 has been described as reading and executing a program stored in the memory 22 or the storage unit 24. However, the program is stored in a storage medium such as a CD-ROM and provided to the CPU 20. It is also possible to provide it to the CPU 20 via the communication IF 26.

  FIG. 3 is a block diagram illustrating a functional configuration of the terminal device 4 realized by executing the program.

  As illustrated in FIG. 3, the terminal device 4 includes a user recognition unit 50, a detection unit 52, a determination unit 54, an information provision unit 56, a provision information storage unit 58, a time determination unit 60, and a concentration estimation. Part 62.

  The user recognition unit 50 recognizes the person 14 who is a user. For example, the user recognition unit 50 may recognize the person 14 based on the identification information input by the person 14 via the UI unit 28, or may be captured by the first imaging device 6 or the second imaging device 8. The person 14 may be recognized by comparing the captured image with a previously registered image.

  The detection unit 52 detects the state of the person 14 based on the observation data about the person 14. In the present embodiment, the detection unit 52 includes a first posture detection unit 520 that detects the posture of the person 14 based on the shooting data obtained by the first shooting device 6, and the person 14 based on the measurement data obtained by the pressure measurement device 10. A second posture detection unit 522 that detects the posture of the person 14, an input operation status detection unit 524 that detects the input operation status of the person 14 based on input data input via the input reception device of the UI unit 28, And a facial expression detection unit 526 that detects the facial expression of the person 14 based on data captured by the second imaging device 8.

  In the following description, the detection unit 520 for the first posture detection unit 520, the detection unit 522 for the second posture detection unit 522, the detection unit 524 for the input operation status detection unit 524, and the detection unit 526 for the facial expression detection unit 526. May be abbreviated.

  The first posture detection unit 520 first estimates the position of a predetermined part of the body of the person 14 in the seated state from shooting data obtained by shooting with the first shooting device 6. The first posture detection unit 520 models the skeleton of a human body in advance by machine learning or the like, and applies the model to a photographed image from the first photographing device 6, for example, so that the body of the person 14 in the sitting state The position of the part is estimated. Moreover, the 1st attitude | position detection part 520 estimates the position of the head and the chest of the person 14 as positional information on a predetermined part, for example.

  Next, the first posture detection unit 520 determines the posture from the estimated position of the part of the person 14. For example, the first posture detection unit 520 determines the front and back of the person 14 based on the difference in the position of the head and chest of the person 14 in the front-rear direction (the distance from the first imaging device 6 to the head and chest of the person 14). Detect the inclination of the orientation of the direction.

  The second posture detection unit 522 acquires measurement data of pressure applied to the seating surface on which the person 14 is seated from the pressure measuring device 10 and detects the posture state of the person 14 appearing in the pressure applied to the seating surface. For example, the second posture detection unit 522 acquires a pressure distribution composed of pressure values at a total of 256 points of 16 × 16 arranged in the seating area at regular intervals.

For example, the second posture detection unit 522 calculates a predetermined statistic from the measurement data, and detects the posture state represented by the calculated statistic. Specifically, the second posture detection unit 522 calculates, for example, the average value μ, the variance σ ² , the peak value (maximum value) Vp, and the kurtosis Vk from the pressure distribution obtained as measurement data. In addition, you may use not only these statistics but another statistics.

  The input operation status detection unit 524 detects the input operation status of the person 14 based on the input amount. For example, the input amount is determined from the number of keystrokes on the keyboard. Note that the input operation status detection unit 524 may detect the input operation status of the person 14 based on the input correction amount instead of or together with the input amount. The input correction amount is determined, for example, by detecting the input of a deletion key such as the Back space key.

  The expression detection unit 526 detects a specific action appearing on the face of the person 14 from the photographed image of the face of the person 14. Specifically, the facial expression detection unit 526 detects the yawn of the person 14. The specific operation is not limited to yawning, and may be an operation of blinking or rubbing eyes.

  The determination unit 54 determines the degree of fatigue of the person 14 based on the state detected by the detection unit 52. Details of the determination unit 54 will be described later.

  The information providing unit 56 provides information perceived by the person 14 when the fatigue level determined by the determination unit 54 satisfies a predetermined fatigue level standard. The information providing unit 56 provides information to the person 14 by, for example, voice, music, alarm sound, display, or the like. Information provided by the information providing unit 56 is stored in the provided information storage unit 58. Here, the information providing unit 56 provides information at a time determined by a time determining unit 60 described later.

  The provided information storage unit 58 stores information content for alleviating the fatigue state of the person 14 determined to have reached a predetermined degree of fatigue. The provided information storage unit 58 stores the content of information to be provided for each person recognized by the user recognition unit 50.

  FIG. 4 is a schematic diagram illustrating an example of information stored in the provision information storage unit 58. As shown in FIG. 4, the provision information storage unit 58 stores, for example, a plurality of types of menus (information types), and for each menu, default (default) content and preference for the person for each person. It is memorized with the contents matched to. Thereby, for example, when the determination unit 54 determines that Mr. A is tired, the information providing unit 56 reads out the provision content corresponding to Mr. A from the provision information storage unit 58 and outputs it. Further, for example, when the determination unit 54 determines that Mr. X is tired, if the provision information for Mr. X is not stored in the provision information storage unit 58, the default content is output. The information providing unit 56 may provide one type of menu or a combination of a plurality of types of menus.

  The time determination unit 60 determines a time for providing information to a person. The time determination unit 60 determines the time according to the concentration degree estimated by the concentration estimation unit 62 that estimates the concentration degree of the person 14 to the work as the information provision time.

  Specifically, for example, when it is estimated that the person 14 is not in a concentrated state, the time determination unit 60 determines that the fatigue level satisfies a predetermined fatigue level criterion by the determination unit 54, If it is decided to provide information immediately and it is estimated that the person 14 is concentrated, it is decided to wait for information provision until a predetermined condition is satisfied. For example, when it is estimated that the person 14 is in a concentrated state, the time determination unit 60 sets the time when the input operation via the UI unit 28 is settled (the input amount per unit time falls below a predetermined amount). When the time when it is assumed that the concentration will not be hindered is determined, as in

  For example, when the same posture continues for a predetermined time or / and when a predetermined input amount per unit time continues for a predetermined time or more, the concentration estimation unit 62 14 is estimated to be in a concentrated state, and is assumed not to be in a concentrated state in other cases. Here, the same posture means a state in which the posture variation is equal to or less than a predetermined variation amount.

  The concentration estimation unit 62 of the present embodiment estimates the concentration level of the person 14 from the state of the person 14 detected by the detection unit 52, but estimates the concentration level based on information other than detection by the detection unit 52. May be.

  The determination of the degree of fatigue by the determination unit 54 will be described. The determination unit 54 of the present embodiment determines the degree of fatigue of the person 14 based on a series of states of the person 14 within a predetermined period (hereinafter referred to as a determination target period) detected by the detection unit 52. . That is, it is not determined whether the person's 14 fatigue level has reached a predetermined standard fatigue level based on the state of the person 14 at a certain moment, but a series of states in the determination target period of the person 14. Is detected by the detection unit 52, and it is determined whether or not the fatigue level of the person 14 has reached a predetermined standard fatigue level.

  Specifically, as an example, the determination unit 54 determines the degree of fatigue of a person based on a time during which a state detected by the detection unit 52 within a determination target period satisfies a predetermined condition. The details will be described below.

  The determination unit 54 first determines the fatigue level determined from the detection result of the first posture detection unit 520, the fatigue level determined from the detection result of the second posture detection unit 522, and the input operation status detection unit 524. The degree of fatigue determined from the detection result and the degree of fatigue determined from the detection result of the facial expression detection unit 526 are calculated.

  Each fatigue degree is calculated as one of a predetermined number of stages of fatigue. For example, the degree of fatigue is calculated in one of four levels, that is, fatigue level: 0 (no fatigue), fatigue level: 1 (small), fatigue level: 2 (medium), or fatigue level: 3 (large). . In this case, when the fatigue level determined from the detection result of the first posture detection unit 520 is described as an example, the state detected by the first posture detection unit 520 satisfies a predetermined first condition. If the state detected by the first posture detection unit 520 satisfies the second predetermined condition, the fatigue level is calculated as 2, and the first posture detection unit 520 is calculated. When the condition detected by the above condition satisfies the predetermined third condition, the degree of fatigue is calculated as 3, and when neither condition is satisfied, the degree of fatigue is calculated as 0. In addition, the detail about the calculation method of the fatigue degree for every detection part 520-526 is mentioned later.

  Next, regardless of whether the detection unit 520 to 526 determines the degree of fatigue, the determination unit 54 determines the degree of fatigue within the determination target period for each degree of fatigue. The duration which is a state is calculated | required (refer FIG. 5), and it is determined whether the value calculated based on the calculated | required duration exceeds a predetermined threshold value. The determination unit 54 determines that the degree of fatigue of the person 14 satisfies a predetermined criterion for the degree of fatigue when the predetermined threshold is exceeded, and determines that the person 14 is less than or equal to the predetermined threshold. It is determined that the degree of fatigue does not satisfy a predetermined fatigue degree standard.

  A specific example will be described. FIG. 5 is a schematic diagram for explaining the duration of each fatigue level, and FIG. 5 (a) is a diagram for explaining the duration of the state where the fatigue level is 3, FIG. 5 (b). These are the figures explaining the continuation time of the state made into fatigue degree: 2.

  Here, in the detection result by the first posture detection unit 520, during the determination target period, the time (time range) in which the degree of fatigue is set to 3 is tf1b, and the detection target by the first posture detection unit 520 is the determination target. During the period, the time (time range) in which the fatigue level is 2 is tf1m, and the time (time range) in which the fatigue level is 1 during the determination target period in the detection result by the first posture detection unit 520. ) Is tf1s.

  Similarly, in the detection results by the second posture detection unit 522 / input operation status detection unit 524 / expression detection unit 526, the time when the fatigue level is 3 during the determination target period is tf2b / tf3b / tf4b, In the detection result of the posture detection unit 522 / input operation state detection unit 524 / expression detection unit 526, the time when the fatigue level is set to 2 during the determination target period is tf2m / tf3m / tf4m, and the second posture detection In the detection result by the unit 522 / input operation state detection unit 524 / expression detection unit 526, the time when the fatigue level is 1 during the determination target period is defined as tf2s / tf3s / tf4s.

  Based on the detection results of the detection units 520 to 526 in the determination target period (in the example of FIG. 5, 10 seconds) that is a predetermined period until the current time, the determination unit 54 determines whether the fatigue state of the person 14 is in advance. It is determined whether or not a predetermined standard is satisfied. Here, as shown in FIG. 5A, the time tf1b within the determination target period in which the fatigue level is set to 3 in the detection result of the first posture detection unit 520 is 5 seconds. Note that the state in which the fatigue level is 3 in the detection result of the first posture detection unit 520 continues from before the determination target period, but since the time in the determination target period is 5 seconds, tf1b = 5 seconds. It becomes. Similarly, the time tf2b / tf3b / tf4b within the determination target period in the state where the fatigue level is 3 based on the detection results of the second posture detection unit 522 / input operation state detection unit 524 / expression detection unit 526 is 2 seconds. / 2 seconds / 2 seconds. Note that, as indicated by the arrows in FIG. 5A, the length and position of the time range in which each of the detection units 520 to 526 is set to the fatigue level: 3 are not necessarily the same.

  The determination part 54 calculates | requires the continuation time which is the state of the fatigue degree in the determination object period: 3 irrespective of whether the detection part 520-526 was set to fatigue degree: 3. Specifically, as shown in the following formula (1), the duration Tfatig_b of the fatigue level: 3 is obtained by calculating a logical wheel for the time range where the fatigue level is 3.

  Tfatig_b = tf1b ∨ tf2b ∨tf3b ∨ tf4b (1)

  In the example shown in FIG. 5A, the time range of tf2b is included in the time range of tg1b, and the time ranges of tf3b and tf4b are overlapped, so that Tfatig_b = 7 seconds is obtained from equation (1).

  Similarly, the determination part 54 calculates | requires the continuation time which is the state of the fatigue degree: 2 in the determination object period irrespective of whether the detection part 520-526 made the fatigue degree: 2. Specifically, as in the above formula (1), the duration Tfatig_m of the fatigue level: 2 is obtained by calculating a logical ring for the time range where the fatigue level is 2, as in the following formula (2). .

  Tfatig_m = tf1m ∨ tf2m ∨tf3m ∨ tf4m (2)

  In the example shown in FIG. 5B, Tfatig_m = 5 seconds is obtained from the equation (2).

  Furthermore, although illustration is omitted in FIG. 5, similarly, the determination unit 54 determines the fatigue level within the determination target period regardless of which detection unit 520 to 526 has set the fatigue level to 1. : 1: Determine the duration of the 1 state. Specifically, as in the above formula (1), the duration Tfatig_s of the fatigue level: 1 is obtained by calculating a logical ring for the time range where the fatigue level is 1, as in the following formula (3). .

  Tfatig_s = tf1s ∨ tf2s ∨tf3s ∨ tf4s (3)

  As described above, after obtaining Tfatig_b, Tfatig_m, and Tfatig_s, the weighted sum Jt is calculated for these. Specifically, Jt is calculated as in the following formula (4). Here, the weighting coefficients kb, km, and ks are coefficients for adjusting how much the degree of fatigue is taken into account in each stage. For example, when calculating Jt, the degree of fatigue is high. The weighting coefficient is set so that kb> km> ks, so that is more contributed.

  Jt = kb × Tfatig_b + km × Tfatig_m + ks × Tfatig_s (4)

  Finally, the determination unit 54 determines whether or not the calculated weighted sum Jt exceeds a predetermined threshold Th_Jt, and if so, the fatigue level of the person 14 is a predetermined fatigue level reference. If the threshold value Th_Jt is equal to or less than the threshold value Th_Jt, it is determined that the fatigue level of the person 14 does not satisfy a predetermined fatigue level standard.

  Here, an example of a method for determining the degree of fatigue for each of the detection units 520 to 526 determined from the detection results of the detection units 520 to 526 will be described.

  First, an example of a fatigue level determination method based on the detection result of the first posture detection unit 520 will be described. 6 and 7 are schematic diagrams illustrating an example of a fatigue degree determination method based on the detection result of the first posture detection unit 520. FIG. FIG. 6 is a schematic diagram showing the relationship between the posture of the person 14 and the distance d1 from the head P of the person 14 to the first imaging device 6 and the distance d2 from the chest Q of the person 14 to the first imaging device 6. FIG. FIG. 7 is a table showing the difference between the distance d1 and the distance d2 and the relationship between the fatigue levels. In the example illustrated in FIGS. 6 and 7, the determination unit 54 determines the detection result of the first posture detection unit 520 based on the difference between the distance d1 and the distance d2 detected by the first posture detection unit 520. Based on the fatigue level judgment.

  When the difference between the distance d1 and the distance d2 is larger than a predetermined threshold, the determination unit 54 compares the posture of the person 14 with a reference posture (in this example, a posture where d1≈d2 is set as a reference posture). It is determined that the posture is leaning forward or backrest. Then, the determination unit 54 determines the degree of fatigue according to the previous degree of leaning or backrest. That is, it is determined that the greater the degree of leaning or the backrest, the greater the degree of fatigue.

  In the example shown in FIG. 7, the degree of leaning is determined and the degree of fatigue is determined depending on whether the difference between the distance d1 and the distance d2 exceeds the thresholds Tha1, Tha2, Tha3 (where Tha1 <Tha2 <Tha3). The Further, the degree of backrest and the degree of fatigue are determined depending on whether or not the difference between the distance d1 and the distance d2 exceeds the threshold values Thb1, Thb2, Thb3 (where Thb1 <Thb2 <Thb3).

  Thus, the degree of fatigue is determined based on the degree of deviation from the reference posture. In the above example, the reference posture is d1≈d2, but the reference posture is not limited to this, and d1 (d2) is longer than d2 (d1) by a predetermined length. It is good also as a standard posture. In the above example, the posture is determined based on the positions of the head and the chest. However, the posture may be determined based on the position of another part, or the position of the person 14 may be determined in the front-rear direction. The fatigue level may be determined by determining the deviation of the person 14 from the reference posture based on the position in the horizontal direction.

  Next, an example of a method for determining the degree of fatigue based on the detection result of the second posture detection unit 522 will be described. The determination unit 54, for example, a deviation between a statistical value of the pressure distribution on the seating surface of the person 14 obtained as a detection result of the second posture detection unit 522 and a statistical value of the pressure distribution on the seating surface in the reference posture. The fatigue level is determined based on the detection result of the second posture detection unit 522 according to the amount.

  FIG. 8 is a schematic diagram showing an example of the pressure distribution on the seating surface of the person 14 and the statistics obtained from the pressure distribution, and FIG. 8A shows the pressure distribution and statistics in the reference posture. FIG. 8 (b) shows the pressure distribution and statistics in the forward leaning posture, and FIG. 8 (c) shows the pressure distribution and statistics in the backrest posture. Note that the pressure distribution or statistic in the reference posture is registered in advance, and stored in the storage unit 24, for example.

  In the statistic shown in FIG. 8, the number of effective points indicates the number of points where the pressure value is not 0 among all the points where the pressure value is measured (for example, all 256 points). Moreover, the average has shown the average value of the pressure value of each point counted by the number of effective points. Further, the variance, peak value, and kurtosis are calculated from the pressure value at each point counted as the number of effective points. The kurtosis takes a value of 0 in the case of a normalized distribution, takes a positive value if it is sharper than the normalized distribution, and takes a negative value if it is not sharper than the normalized distribution. Here, the average value, the variance, the peak value, and the kurtosis are calculated for points where the pressure value is not 0 among all points, but these may be calculated for all points.

  For these statistics, the determination unit 54 calculates the statistics of the pressure distribution on the seating surface of the person 14 obtained as the detection result of the second posture detection unit 522 and the statistics of the pressure distribution on the seating surface in the reference posture. The amount of deviation (difference) from the amount is calculated. Specifically, for example, the shift amount (difference) is calculated as shown in FIG. Here, FIG. 9 shows that, for example, the deviation amount Δavg of the average μ can be obtained by the absolute value of the difference between the average value in the reference posture and the average value of the posture in the determination. It is also shown that other deviation amounts are calculated from the absolute value of the difference.

  Next, the determination unit 54 calculates the degree of forward leaning and the degree of backrest from the reference posture based on the statistic deviation amount. For example, it has been experimentally known that the average value of the pressure value decreases when the user leans on a desk or a chair back against a standard posture. Further, it has been experimentally known that the kurtosis decreases in the forward posture, the center of gravity moves backward in the posture of the backrest, and the pressure value in the vicinity of both of them decreases. Further, it has been experimentally understood that the peak value decreases when the tired state is reached. It is expected that the posture will be judged from the deviation amount of the statistics so that the experimentally grasped result is reflected.

Here, the average μ deviation amount Δ _avg , the effective point number N deviation amount Δ _N , the variance σ ² deviation amount Δσ ₂ , the peak value Vp deviation amount Δ _peak , and the kurtosis Vk deviation amount Δ _kurt are used. For example, an evaluation value K _front that represents the degree of front turning from the reference posture is calculated by the following equation (5). Further, for example, the evaluation value K _back representing the degree of backrest from the reference posture is calculated by the following equation (6).

K _front = k _f1 × Δσ ₂ + k _f2 × Δ _peak + k _f3 × Δ _kurt (5)

K _back = k _b1 × Δ _avg + k _b2 × Δ _N + k _b3 × Δσ ₂ + k _b4 × Δ _peak + k _b5 × Δ _kurt (6)

Note that k _f1 , k _f2 , k _f3 , k _b1 , k _b2 , k _b3 , k _b4 , k _b5 are coefficients indicating the degree of contribution of each deviation amount to the evaluation value, for example, obtained from the above experiment It is a coefficient set to reflect the matter. By adjusting the coefficient, it is expected to evaluate the degree of leaning and the backrest more accurately.

Next, the determination unit 54 determines the degree of fatigue based on the detection result of the second posture detection unit 522 based on the backrest degree and / or the forward leaning degree. FIG. 10 is a table illustrating an example of determining the fatigue level based on the detection result of the second posture detection unit 522 using the calculated backrest degree. In the table shown in FIG. 10, T _bk indicates a time during which the posture of the person 14 is in a backrest state, and is obtained as, for example, a time during which the K _back exceeds a predetermined threshold. Moreover, you may obtain | require as time when the above-mentioned distance d1 is longer than the threshold value d2 more than a predetermined threshold value. Th _K1 and Th _K2 indicate threshold _values for K _back , and Th _T1 and Th _T2 indicate threshold _values for T _bk .

That is, in the example shown in FIG. 10, when the value of the backrest degree K _back is between the threshold values Th _{K1 to} Th _K2 and the time of the backrest state is between the threshold values Th _{T1 to} Th _T2 , the determination is made. The unit 54 determines that the fatigue level based on the detection result of the second posture detection unit 522 is the fatigue level: 1. When the value of the backrest degree K _back is between the threshold values Th _{K1 to} Th _K2 and the time of the backrest state is equal to or greater than the threshold value Th _T2 , the determination unit 54 determines whether the second posture detection unit 522 It is determined that the fatigue level based on the detection result is fatigue level: 2. When the value of the backrest degree K _back is equal to or greater than the threshold value Th _K2 and the time of the backrest state is greater than the threshold value Th _T1 , the determination unit 54 is based on the detection result of the second posture detection unit 522. The degree of fatigue is determined to be fatigue level: 3.

  Note that the fatigue level based on the detection result of the second posture detection unit 522 is limited to, for example, the shooting range of the first shooting device 6, and the posture state of the entire upper body of the person 14, for example, is detected by the first posture detection. When the part 520 cannot be detected, it plays a role of interpolating it.

  Next, an example of determination of the degree of fatigue based on the detection result of the input operation state detection unit 524 will be described. The determination unit 54 determines the degree of fatigue based on the detection result of the input operation status detection unit 524 according to the input operation status obtained as the detection result of the input operation status detection unit 524. FIG. 11 is a schematic diagram for explaining an example of determination of the degree of fatigue based on the detection result of the input operation state detection unit 524, FIG. 11A is a graph showing an example of the input amount, and FIG. ) Is a table showing an example of determining the fatigue level based on the detection result of the input operation status detection unit 524 according to the input amount (number of keystrokes).

In Figure 11, the fewer keystrokes per unit time, shows an example of a case where it is determined that a large degree of fatigue, when keying the number N _a per unit time is less than 0 or more Th _Na1 fatigue degree: 3 and determines, when the key entry number N _a is less than Th _Na1 than Th _Na2 fatigue index: 2 and judges, when keying the number N _a is Th _Na2 above, fatigue: 1 Judging. The time and the unit refers to the following predetermined time determination period, Th _Na1, Th _Na2 is a threshold for keying the number N _a.

  The determination of the fatigue level based on the detection result of the input operation state detection unit 524 may be performed based on the input correction amount. For example, the greater the amount of correction per unit time, the greater the degree of fatigue may be determined.

  Next, an example of determination of the degree of fatigue based on the detection result of the facial expression detection unit 526 will be described. The determination unit 54 determines the degree of fatigue based on the detection result of the facial expression detection unit 526 according to the number of specific movements of the person 14 detected by the facial expression detection unit 526. FIG. 12 is a table showing an example of determining the degree of fatigue based on the detection result of the facial expression detection unit 526 according to the number of specific actions.

In Figure 12, as the number of times a specific action to be performed per unit time, shows an example of a case where it is determined that a large degree of fatigue, the number N _b of a particular operation per unit time is less than 0 or more Th _Nb1 If it is, fatigue: 1 and determines, if N _b is less than Th _Nb1 than Th _Nb2 fatigue index: 2 and judges, when N _b is Th _Nb2 or more, fatigue Degree: 3 is judged. The unit time refers to a predetermined time that is equal to or less than the determination target period, and Th _Nb 1 and Th _Nb 2 are threshold _values for N _b .

Next, the operation of the information providing system 2 will be described with reference to FIGS.
FIG. 13 is a flowchart illustrating the operation of the information providing system 2. As shown in FIG. 13, the information providing system 2 first performs prior setting processing for recognizing the person 14, registering the reference posture of the person 14, and registering the information providing content prior to providing information to the person 14. (S10) is performed, and then the state of the person 14 is detected, and an information providing process (S20) for determining the degree of fatigue based on the detected state is performed.

  Here, the details of the operation of the pre-setting process will be described. FIG. 14 is a flowchart illustrating an example of the pre-setting process (S10) in the information providing system 2.

  In step 100 (S100), the user recognition unit 50 recognizes the person 14.

  In step 102 (S102), the first photographing device 6 photographs the person 14 seated in the reference posture.

  In step 104 (S104), the first posture detection unit 520 uses the photographing data obtained in step 102 as the position of the predetermined part of the body of the person 14 in the seated state, Estimate the position.

  In step 106 (S106), the first posture detection unit 520 detects the inclination of the posture of the person 14 from the position estimated in step 104.

  In step 108 (S108), posture inclination data at the time of the reference posture detected in step 106 is stored in the storage unit 24.

  In step 108 (S110), the pressure measuring device 10 measures the pressure of the seating surface in the seating in the reference posture.

  In step 112 (S112), the second posture detection unit 522 calculates a predetermined statistic from the measurement data obtained in step 110.

  In step 114 (S114), the statistical data of the pressure distribution in the reference posture calculated in step 112 is stored in the storage unit 24.

  In step 116 (S116), the provision information storage unit 58 stores the contents of the provision information corresponding to the person 14. Note that the content of the provision information corresponding to the person 14 is set, for example, when the person 14 inputs the provision content according to his / her preference via the UI unit 28.

  As described above, the example of performing the process of measuring the pressure and the process based on the measurement data after the imaging process and the process based on the captured data as the presetting process and then performing the process of registering the provided content has been described. May be reversed, or these operations may be performed in parallel.

  Regarding registration of the reference posture data in the presetting process, the same person as the subject of fatigue level determination in the information providing process in step 20 is seated on the seating surface in the reference posture, and data at the reference posture is obtained. However, the data at the reference posture does not necessarily have to be data on sitting by the same person. The seating surface on which the person sits in step 10 is preferably the same as the seating surface on which the person sits in step 20. Thereby, since the measurement conditions by the pressure measuring device 10 can be made uniform at the time of data acquisition of the reference posture and at the time of fatigue determination, the influence on the measurement due to the elasticity of the seating surface is suppressed.

  Next, details of the operation of the information providing process will be described. FIG. 15 is a flowchart illustrating an example of the information providing process (S20) in the information providing system 2.

  In step 200 (S200), the detection unit 52 detects the state of the person 14 based on the observation data about the person 14.

  In step 202 (S202), the determination unit 54 determines the degree of fatigue of the person 14 based on the state detected in step 200. The fatigue level determination operation in step 202 will be described in detail with reference to FIG.

  In step 204 (S204), the determination unit 54 determines whether or not the degree of fatigue satisfies a predetermined fatigue degree standard. If the predetermined degree of fatigue is satisfied, the determination unit 54 proceeds to step 204. If the predetermined fatigue level criterion is not satisfied, the routine proceeds to step 214.

  In step 206 (S206), the time determination unit 60 determines the time for providing information to the person 14. The timing determination operation will be described in detail with reference to FIG.

  In step 208 (S208), the information providing unit 56 determines whether or not the time determined in step 206 has arrived. When the time determined in step 206 has arrived, the information providing unit 56 proceeds to step 210.

  In step 210 (S210), the information providing unit 56 reads the content to be provided to the person 14 from the provided information storage unit 58. The information providing unit 56 reads out the provided content corresponding to the person 14 from the provided content stored in the provided information storage unit 58. When the information storage unit 24 stores information including a plurality of types of menus, the information providing unit 56 reads information set in advance among the plurality of menus. Further, the menu to be provided may be selected according to the degree of fatigue determined by the determination unit 54.

  In step 212 (S212), the information providing unit 56 provides the person 14 with the information on the provided content read in step 210. For example, when the read information is display information, it is displayed on the UI unit 28. Further, when the read information is sound information such as music, a sound is output from a speaker (not shown).

  In step 214 (S214), it is determined whether or not the information providing process is to be continued. If so, the process returns to step 200. If not, the process is terminated. Whether or not the information providing process is continued may be determined according to an instruction from the person 14, for example, or a continuation condition may be set in advance.

  Here, the determination operation of the degree of fatigue in step 202 will be further described using a flowchart. FIG. 16 is a flowchart illustrating an example of the fatigue level determination operation in step 202.

  In step 2000 (S2000), the determination unit 54 calculates the degree of fatigue within the determination target period for each of the detection units 520 to 526 (see FIGS. 6 to 12).

  In step 2002 (S2002), for each stage of the degree of fatigue, the determination unit 54 calculates the duration that is the state of the stage within the determination target period (see FIG. 5).

  In step 2004 (S2004), the determination unit 54 determines whether the fatigue level of the person 14 satisfies a predetermined fatigue level criterion based on the duration calculated in step 2002. Specifically, the determination is made using the above equation (4).

  Next, the information provision time determination operation in step 206 will be further described with reference to a flowchart. FIG. 17 is a flowchart illustrating an example of the information provision time determination operation in step 206.

  In step 2100 (S2100), the concentration estimation unit 62 determines whether or not the person 14 is in a concentrated state. For example, when the same posture continues for a predetermined time and the input amount per unit time continues for a predetermined time or more, the concentration estimation unit 62 determines that the person 14 is in a concentrated state. presume.

  In step 2102 (S2102), the time determination unit 60 determines whether or not the person 14 is estimated to be in a concentrated state in step 2100, and if it is not estimated that the person 14 is in a concentrated state. Shifts to step 2104, and shifts to step 2106 if it is estimated that the user is in a concentrated state.

  In step 2104 (S2104), the time determination unit 60 determines the information provision time so that information is immediately provided.

  On the other hand, in step 2106 (S2106), the time determination unit 60 determines the information provision time so as to wait for information provision until a predetermined condition is satisfied. For example, as a predetermined condition, a time when the number of keystrokes per unit time is less than a predetermined number of keystrokes continues for a predetermined time or longer is set as the information provision time. As described above, when it is estimated that the person 14 is in a concentrated state, the time determination unit 60 determines the information provision time so as to provide information at a time when it is assumed that the concentration is not hindered.

  For example, when the state in which the person 14 is estimated to be concentrated by the concentration estimating unit 62 continues for a long period (predetermined period), or the same posture state is determined for a long period (predetermined). In the case where the information provision period continues, the timing when the predetermined period is exceeded may be set as the information provision time.

  As described above, as an embodiment of the present invention, in the detection unit 52, the first posture detection unit 520, the second posture detection unit 522, the input operation state detection unit 524, and the facial expression detection unit 526 function. Although shown, you may comprise so that what was combined arbitrarily or only either among these detection parts 520-526 may function. Moreover, what is necessary is just to detect the state of the person 14 based on the observation data about the detection part 52 and the person 14, and the detection content is not limited to the above.

  Next, an information providing system 2 according to another embodiment of the present invention will be described. In the above embodiment, the fatigue level of the person 14 is determined based on a series of states of the person 14 within the determination target period detected by the detection unit 52. However, in the present embodiment, the determination unit 54 includes the detection unit 520. The degree of fatigue of the person 14 is determined by a combination of the levels of fatigue determined from the detection results for each of ˜526.

  Specifically, the determination unit 54 according to the present embodiment includes, for example, the fatigue degree determination table shown in FIG. 18, and the person 14 is selected according to the combination of the fatigue levels based on the respective detection units determined as described above. Determine the degree of fatigue. In the example illustrated in FIG. 18, the first posture detection unit 520, the second posture detection unit 522, and the input operation status detection unit 524 in the detection unit 52 are used for determination in the determination unit 54. Show. Instead of the input operation status detection unit 524, a facial expression detection unit 526 may be used. Further, among these detection units 520 to 526, any combination or only one of them may be used for determination by the determination unit 54.

  The determination unit 54 according to the present embodiment will be described along the example illustrated in FIG. 18. First, the determination unit 54 is based on the detection result of the first posture detection unit 520, and the degree of fatigue is any one of 1 to 4. The fatigue level of any one of 1 to 4 is determined based on the detection result of the second posture detection unit 522, and any one of the fatigue levels of 1 to 3 based on the detection result of the input operation state detection unit 524 Judge the degree. Subsequently, the determination unit 54 uniquely determines the fatigue level of the person 14 according to the combination of the determined fatigue levels from each detection unit, according to the fatigue level determination table.

  In the example shown in FIG. 18, the fatigue level of the person 14 is finally determined in one of three stages. That is, the degree of fatigue: small (corresponding to “-” in FIG. 18), the degree of fatigue: medium (corresponding to “◯” in FIG. 18), and the degree of fatigue: large (corresponding to “◎” in FIG. 18). It is judged by either.

  As described above, the time determination unit 60 may determine the information provision time, but the time according to the fatigue level of the person 14 determined by the determination unit 54 may be used as the information provision time. For example, when the determination unit 54 determines that the degree of fatigue is medium, the period when the degree of fatigue has continued, for example, for 2 hours is set as the information provision time. For example, the time when the degree is continued for one hour may be set as the information provision time.

  The information providing unit 56 provides information when the determination unit 54 determines that the degree of fatigue exceeds a predetermined standard. 18 will be described as an example. For example, the information providing unit 56 provides information when the degree of fatigue is determined to be medium or large.

  The menu of information provided by the information providing unit 56 may be set in advance in the fatigue degree determination table as shown in FIG.

  Although the embodiments of the present invention have been described above, the present invention is not limited to the embodiments described above, and various modifications can be made without departing from the scope of the present invention. For example, the first imaging device 6 may shoot not only from the front of the person 14 but also from the back. Further, the first imaging device 6 may shoot from the side of the person 14. Alternatively, the first imaging device 6 may be configured as a camera that captures a two-dimensional image and the posture may be detected.

2 Information providing system 4 Terminal device 6 First imaging device 8 Second imaging device 10 Pressure measuring device 28 UI unit 50 User recognition unit 52 Detection unit 54 Determination unit 56 Information provision unit 58 Provision information storage unit 60 Timing determination unit 62 Concentration estimation unit 520 First posture detection unit 522 Second posture detection unit 524 Input operation status detection unit 526 Expression detection unit

Claims (14)

Detection means for detecting the state of the person;
Determination means for determining a degree of fatigue of the person based on a series of states of the person within a predetermined period detected by the detection means;
An information providing apparatus comprising: information providing means for providing information perceived by the person when the degree of fatigue of the person determined by the determination means satisfies a predetermined fatigue degree criterion. The information providing apparatus according to claim 1, wherein the determination unit determines the degree of fatigue of the person based on a time in which a state detected by the detection unit within a predetermined period satisfies a predetermined condition. Further comprising a time determining means for determining when to provide information to the person,
The information providing apparatus according to claim 1, wherein the information providing unit provides information at a time determined by the time determining unit. An estimation means for estimating the degree of concentration of the person in the work;
The information providing apparatus according to claim 3, wherein the time determination unit determines a time according to a concentration degree estimated by the estimation unit. The detection means detects the state of the person from an input operation by the person on the input receiving device,
The time determination means indicates a time when the input amount by the input operation is less than a predetermined threshold when the concentration degree estimated by the estimation means is equal to or greater than a predetermined concentration degree. The information providing apparatus according to claim 4, which is determined as The detection means detects the state of the person from an input operation by the person on the input receiving device,
5. The information providing apparatus according to claim 1, wherein the determination unit determines the degree of fatigue of the person based on an input amount or an input correction amount by an input operation within a predetermined period. The detection means detects the posture of the person,
The information providing apparatus according to claim 1, wherein the determination unit determines the degree of fatigue of the person based on an amount of deviation of the person's posture from a pre-registered posture. The information providing apparatus according to claim 7, wherein the detection unit detects a posture based on a photographed image obtained by photographing the person. The information providing apparatus according to claim 7, wherein the detection unit detects a posture based on pressure applied to a seating surface on which the person in the sitting state is seated. The detection means detects the facial expression of the person,
The information providing apparatus according to claim 1, wherein the determination unit determines the degree of fatigue of the person based on the facial expression of the person. Information storage means for storing information provided by the information providing means for each person;
The information providing apparatus according to claim 1, wherein the information providing unit provides information according to the person. Detection means for detecting the state of the person;
Determination means for determining the degree of fatigue of the person based on the state detected by the detection means;
Time determination means for determining a provision time of information to be provided to the person when the fatigue degree of the person determined by the determination means satisfies a predetermined fatigue degree criterion;
An information providing apparatus comprising: information providing means for providing information perceived by the person at a time determined by the time determining means. A detection step for detecting the state of the person;
A determination step for determining a degree of fatigue of the person based on a series of states of the person within a predetermined period detected in the detection step;
A program for causing a computer to execute an information providing step of providing information perceived by the person when the degree of fatigue of the person determined in the determination step satisfies a predetermined fatigue level criterion. A detection step for detecting the state of the person;
A determination step of determining the degree of fatigue of the person based on the state detected by the detection step;
A time determination step for determining a provision time of information to be provided to the person when the fatigue degree of the person determined in the determination step satisfies a predetermined fatigue degree criterion;
A program for causing a computer to execute an information providing step of providing information perceived by the person at a time determined in the time determining step.

Images