JP2017056053A - Detection system, detection device, notification device, detection method, and program - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide a detection system, a detection device, a notification device, a detection method, and a program which accurately detect user's motion associated with eating and drinking.SOLUTION: A detection system 10 comprises a sensor, acquisition means 100, and notification means 200. The sensor is fitted to the neck of a user to detect the movement of the throat of the user. The acquisition means 100 acquires motion information indicating a motion associated with the eating and drinking by the user, on the basis of the movement of the throat of the user detected by the sensor. The notification means 200 outputs notification information acquired on the basis of the motion information.SELECTED DRAWING: Figure 1

Description

  The present invention relates to a detection system, a detection device, a notification device, a detection method, and a program.

  Techniques for detecting user actions associated with eating and drinking are known. For example, Patent Literature 1 discloses a technique for measuring the number of mastications, which is a user's operation associated with eating and drinking, by detecting deformation of the user's ear canal.

Japanese Patent Laid-Open No. 11-318862

  By the way, although the user is eating and drinking, the user's external auditory canal may not be deformed. In such a case, the device of Patent Document 1 cannot accurately measure the number of chewing times.

  This invention is made | formed in view of the said situation, and it aims at providing the detection system, detection apparatus, alerting | reporting apparatus, detection method, and program which detect the user's operation | movement accompanying food / beverage correctly.

In order to achieve the above object, one aspect of the detection system according to the present invention is:
A sensor that is mounted on a user's neck and detects movement of the user's throat;
Based on the movement of the throat of the user detected by the sensor, acquisition means for acquiring operation information indicating an operation accompanying the eating and drinking of the user;
Notification means for outputting notification information acquired based on the operation information;
Comprising
It is characterized by that.

In order to achieve the above object, an aspect of the detection apparatus according to the present invention is as follows:
A sensor that is mounted on a user's neck and detects movement of the user's throat;
Based on the movement of the throat of the user detected by the sensor, acquisition means for acquiring operation information indicating an operation accompanying the eating and drinking of the user;
Transmitting means for transmitting the operation information to a notification device that outputs the notification information acquired based on the operation information;
Comprising
It is characterized by that.

In order to achieve the above object, an aspect of the notification device according to the present invention is as follows:
Receiving means for receiving movement information indicating movement of the user's throat detected by a sensor mounted on the user's neck from a detection device including the sensor;
Based on the movement of the throat of the user detected by the sensor, acquisition means for acquiring operation information indicating an operation accompanying the eating and drinking of the user;
Notification means for outputting notification information acquired based on the operation information;
Comprising
It is characterized by that.

In order to achieve the above object, an aspect of the detection method according to the present invention is as follows:
Detecting movement of the user's throat by a sensor attached to the user's neck;
Based on the movement of the throat of the user detected by the sensor, obtain operation information indicating the operation accompanying the user's eating and drinking,
Outputting notification information acquired based on the operation information;
It is characterized by that.

In order to achieve the above object, an aspect of the program according to the present invention is as follows:
In the computer of the detection device,
Movement information indicating movement of the user's throat detected by a sensor mounted on the user's neck is acquired;
Based on the movement information, the operation information indicating the operation accompanying the eating and drinking of the user is acquired,
The operation information is transmitted to a notification device that outputs notification information acquired based on the operation information.
It is characterized by that.

In order to achieve the above object, an aspect of the program according to the present invention is as follows:
In the computer of the notification device,
Notification information acquired based on movement information indicating movement of the user's throat detected by a sensor mounted on the user's neck is received from a detection device including the sensor,
Outputting the received broadcast information;
It is characterized by that.

  ADVANTAGE OF THE INVENTION According to this invention, the detection system, detection apparatus, alerting | reporting apparatus, detection method, and program which detect the user's operation | movement accompanying eating and drinking correctly can be provided.

It is a figure which shows the structural example of the detection system which concerns on 1st Embodiment of this invention. It is a block diagram which shows the structural example of the detection apparatus which concerns on 1st Embodiment of this invention. It is a figure which shows the example of mounting | wearing of the detection apparatus which concerns on 1st Embodiment of this invention. It is a block diagram which shows the structural example of the alerting | reporting apparatus which concerns on 1st Embodiment of this invention. It is a figure which shows an example of the waveform which shows a time-dependent change of the magnitude | size of a user's throat movement. It is a figure which shows an example of an alerting | reporting screen. It is a flowchart for demonstrating the detection process which the detection apparatus which concerns on 1st Embodiment of this invention performs. It is a flowchart for demonstrating the alerting | reporting process which the alerting | reporting apparatus which concerns on 1st Embodiment of this invention performs. It is a block diagram which shows the structural example of the detection apparatus which concerns on 2nd Embodiment of this invention. It is a block diagram which shows the structural example of the alerting | reporting apparatus which concerns on 2nd Embodiment of this invention. It is a flowchart for demonstrating the detection process which the detection apparatus which concerns on 2nd Embodiment of this invention performs. It is a flowchart for demonstrating the alerting | reporting process which the alerting | reporting apparatus which concerns on 2nd Embodiment of this invention performs.

(First embodiment)
Hereinafter, embodiments of the present invention will be described with reference to the drawings. In the figure, the same reference numerals are assigned to the same or equivalent components.

  The detection system which concerns on this embodiment detects the operation | movement accompanying a user's eating and drinking based on a user's throat movement. In the present embodiment, the detection system detects mastication and swallowing, which are operations associated with the user's eating and drinking. When the user chews and swallows, movements characteristic of each operation occur in the user's throat. The detection system detects mastication and swallowing by detecting the movement of the user's throat caused by mastication and swallowing. The detection system acquires and outputs information useful for user health management or beauty promotion based on the detection result.

  Specifically, the detection system acquires operation information indicating an operation associated with the user's eating and drinking based on the movement of the user's throat detected by a sensor attached to the user's neck. The detection system outputs notification information acquired based on this operation information. Details of the operation information and the notification information will be described later.

  As shown in FIG. 1, the detection system 10 includes a detection device 100 and a notification device 200. The detection device 100 is a wearable device worn on the user's neck, and transmits movement information indicating the movement of the user's throat detected by a sensor attached to the user's neck to the notification device 200. The notification device 200 acquires operation information based on the motion information received from the detection device 100. The notification device 200 acquires notification information based on the operation information and outputs the acquired notification information. The notification information is information useful for user health management or beauty promotion. In the present embodiment, a smartphone is used as an example of the notification device 200. Hereinafter, configurations and functions of the detection device 100 and the notification device 200 will be described.

  First, the configuration and function of the detection apparatus 100 will be described. As illustrated in FIG. 2, the detection device 100 includes a mounting unit 110, a sensor 120, a control unit 130, an operation unit 140, and a wireless communication I / F (interface) 150.

  The mounting unit 110 mounts the sensor 120 on the user's neck. In the present embodiment, the mounting unit 110 is a band, and as illustrated in FIG. 3, the sensor 120 is mounted in close contact with the user's throat. The mounting unit 110 is not limited to a band, and can be configured by any member that can mount the sensor 120 on the user's neck. For example, the mounting portion 110 may be configured by a belt, a necklace, a choker, a string, an adhesive tape, or the like.

  Returning to FIG. 2, the sensor 120 is mounted on the user's neck by the mounting unit 110 and detects the movement of the user's throat. In this embodiment, the sensor 120 is a three-axis gyro sensor, and detects the movement of the user's throat by acquiring the angular velocity around the three axes of the pitch, yaw and roll of the device itself. Since the sensor 120 is mounted on the user's neck by the mounting unit 110, the movement of the user's throat can be detected by acquiring the angular velocity when the device is tilted in response to the movement of the user's throat. The sensor 120 supplies the acquired angular velocity to the control unit 130. Instead of the three-axis gyro sensor, any other sensor that can detect the movement of its own device in response to the movement of the user's throat may be used. An example of such a sensor is an acceleration sensor.

  The control unit 130 controls each unit of the detection device 100. The control unit 130 includes a CPU (Central Processing Unit), a ROM (Read-Only Memory), and a RAM (Random Access Memory), all not shown. The control unit 130 realizes the function of the transmission unit 131 by controlling each unit of the detection device 100 according to a program stored in the ROM.

  The transmission unit 131 transmits movement information indicating the movement of the user's throat detected by the sensor 120 to the reception unit 221 of the notification device 200 described later. The transmission unit 131 is realized by cooperation between the control unit 130 and a wireless communication I / F 150 described later.

  In this embodiment, the transmission part 131 transmits the information which shows the magnitude | size of a user's throat movement to the alerting device 200 as movement information. Specifically, the transmission unit 131 acquires the magnitude of the movement of the user's throat by summing the square values of the angular velocities about the three axes supplied from the sensor 120 and transmits them to the detection device 200 in real time. Since the magnitude of the movement of the user's throat is acquired by the sensor 120 as the magnitude of the voltage, the unit is V.

  Note that the transmission unit 131 may transmit motion information at predetermined time intervals instead of in real time. In this case, the motion information is stored in a RAM included in the control unit 130, and is supplied to the transmission unit 131 and transmitted at predetermined time intervals. The predetermined time interval is, for example, 100 msec.

  The operation unit 140 accepts various inputs in accordance with user operations. In the present embodiment, the operation unit 140 includes various operation buttons of the detection apparatus 100 including a power button (not shown).

  The wireless communication I / F 150 transmits and receives various data to and from the wireless communication I / F 210 of the notification device 200 described later.

  Next, the configuration and function of the notification device 200 will be described. As shown in FIG. 4, the notification device 200 includes a wireless communication I / F 210, a control unit 220, an operation unit 230, a display 240, and a speaker 250.

  The wireless communication I / F 210 transmits / receives various data to / from the wireless communication I / F 150 of the detection apparatus 100.

  The control unit 220 controls each unit of the notification device 200. The control unit 220 includes a CPU, a ROM, and a RAM (not shown). The control unit 220 realizes the functions of the reception unit 221, the acquisition unit 222, and the notification unit 223 by controlling each unit of the notification device 200 according to a program stored in the ROM.

  The reception unit 221 receives motion information from the transmission unit 131 of the detection device 100. The reception unit 221 supplies the received motion information to the acquisition unit 222. The receiving unit 221 is realized by cooperation between the wireless communication I / F 210 and the control unit 220.

  The acquisition unit 222 acquires operation information indicating an operation associated with the user's eating and drinking based on the motion information received by the reception unit 221. The acquisition unit 222 acquires notification information based on the acquired operation information. The acquisition unit 222 supplies the acquired notification information to the notification unit 223.

  In this embodiment, the acquisition part 222 acquires the information which shows the timing of mastication and swallowing which are operation | movement accompanying a user's eating and drinking as operation | movement information. Specifically, the acquisition unit 222 acquires a waveform representing a change over time in the magnitude of the user's throat movement illustrated in FIG. 5 based on the information indicating the magnitude of the movement of the user's throat, which is the movement information. . The acquisition part 222 acquires the information which shows the timing of mastication and swallowing by analyzing the waveform shown in FIG.

  In the waveform diagram of FIG. 5, the horizontal axis represents time, and the vertical axis represents the magnitude of the user's throat movement. The waveform shown in FIG. 5 shows the change over time of the magnitude of the movement of the user's throat when the user is eating or drinking. When the user chews and swallows along with eating and drinking, a waveform representing the movement of the user's throat that is characteristic of each action appears on the waveform diagram. Hereinafter, a waveform representing the movement of the user's throat accompanying swallowing is referred to as a swallowing waveform, and a waveform representing the movement of the user's throat accompanying chewing is referred to as a mastication waveform.

  As shown in FIG. 5, the amplitude of the swallowing waveform is larger than the amplitude of the mastication waveform. This corresponds to the occurrence of greater movement in the user's throat when swallowing than when chewing. Moreover, in the waveform shown in FIG. 5, after the mastication waveform appears a plurality of times, a cycle in which the swallowing waveform appears repeatedly appears. This corresponds to the user repeating the operation of including one mouthful of food and drink in the mouth, swallowing after chewing a plurality of times, and including the next mouthful of food and drink in the mouth.

  The acquisition unit 222 acquires information indicating the timing when the swallowing waveform appears as operation information indicating the timing of swallowing. In the present embodiment, the acquisition unit 222 determines a waveform having an amplitude larger than a predetermined second threshold as a swallowing waveform, and acquires information indicating the appearance timing of this waveform as operation information indicating the timing of swallowing. The second threshold value is set by an arbitrary method and is stored in advance in a ROM included in the control unit 220. For example, the magnitude of the movement of the user's throat during swallowing may be measured, and the average value of the measured magnitudes may be set as the second threshold value.

Moreover, the acquisition part 222 acquires the information which shows the timing when the mastication waveform appeared as operation information which shows the timing of mastication. In the present embodiment, the acquisition unit 222 determines a waveform that satisfies the following conditions (a) to (c) as a mastication waveform, and acquires information indicating the appearance timing of the waveform as operation information indicating the timing of mastication. To do.

(A) A plurality of waveforms appear within a predetermined determination time or until a swallowing waveform appears.
(B) The number of appearances of the waveform per unit time is within a predetermined determination range.
(C) Each waveform has an amplitude greater than or equal to a predetermined first threshold and less than or equal to a second threshold.

The determination time, the determination range, and the first threshold are each set by an arbitrary method, and are stored in advance in a ROM included in the control unit 220. For example, the time required for the user to chew a mouthful of food and drink may be measured, and the average value of the measured times may be set as the discrimination time. Moreover, what is necessary is just to measure the frequency | count of mastication per unit time when a user chews, and to set the maximum value and minimum value of the measured frequency | count of mastication per unit time as an upper limit value and a lower limit value of a discrimination range, respectively. Moreover, the magnitude | size of a user's throat movement in the case of mastication should be measured, and the average value of the measured magnitude | size should just be set as a 1st threshold value. The first threshold value is smaller than the second threshold value. This corresponds to the fact that the movement of the user's throat accompanying chewing is smaller than the movement of the user's throat accompanying swallowing.

  The acquiring unit 222 can acquire the operation information by any method other than the above method. For example, the acquisition unit 222 obtains the motion information based on whether or not the waveform shown in FIG. 5 includes a waveform whose similarity with the swallowing waveform and the mastication waveform learned in advance is equal to or greater than a predetermined value. You may get it. In this case, the acquisition unit 222 acquires information indicating the appearance timing of a waveform whose similarity with the swallowing waveform learned in advance is a predetermined value or more as operation information indicating the timing of swallowing. Moreover, the acquisition part 222 acquires the information which shows the appearance timing of the waveform whose similarity with the mastication waveform learned beforehand is a predetermined value or more as operation information which shows the timing of mastication.

Moreover, the acquisition part 222 acquires the following (1)-(4) information as alerting | reporting information which is information useful for a user's health management or beauty promotion.

(1) Information indicating the number of chewing times per mouth (2) Information indicating the number of chewing times per meal (3) Information indicating whether the number of chewing times per mouth is suitable for health management or beauty promotion (4) Information indicating whether the number of chewing times per unit time is suitable for health management or beauty promotion

  The user can obtain effects such as health promotion and beauty promotion by eating and drinking so that the number of chewing times and the number of chewing times per unit time included in the notification information are suitable for health management or beauty promotion. .

  Specifically, the acquisition unit 222 obtains information indicating the number of mastications detected until swallowing is detected based on the timing of swallowing and the timing of mastication indicated by the operation information. Is obtained as notification information.

  Moreover, the acquisition part 222 acquires the information which shows the cumulative value of the number of chewing times per mouth as alerting | reporting information which shows the number of chewing times per meal.

  In addition, the acquisition unit 222 indicates information indicating whether the number of chewing times per mouth belongs to the preset three ranges of “preferable”, “slightly unsuitable”, and “unsuitable”. It is acquired as notification information indicating whether it is suitable for health management or beauty promotion. More specifically, in the present embodiment, the acquisition unit 222 acquires, as notification information, information indicating that the number of mastications per mouth belongs to the “preferred” range if the number of mastications per mouth is 30 or more. . In addition, when the number of chewing times per mouth is 29 times or less and 20 times or more, the acquiring unit 222 acquires information indicating that the number of chewing times per mouth belongs to the “slightly inappropriate” range as notification information. Further, if the number of chewing times per mouth is less than 20, the acquiring unit 222 acquires information indicating that the number of chewing times per mouth belongs to the “unsuitable” range as notification information. Each range of “preferable”, “slightly unsuitable”, and “unsuitable” is set by an arbitrary method based on medical knowledge and the like, and is stored in advance in a ROM included in the control unit 220. Note that the range to be set does not have to be three, and an arbitrary number of ranges can be set.

  The acquisition unit 222 acquires the number of mastications per unit time based on the timing of mastication indicated by the operation information. The acquisition unit 222 obtains information indicating whether the acquired number of chewing times per unit time belongs to one of the three ranges of “preferred”, “slightly inappropriate”, and “unsuitable” set in advance. It is acquired as notification information indicating whether the number of times is suitable for health management or beauty promotion. More specifically, in the present embodiment, the acquisition unit 222 uses, as notification information, information indicating that the number of mastications per unit time belongs to the “preferred” range if the number of mastications per unit time is less than two. get. Moreover, if the number of chewing times per unit time is 2 times or more and 3 times or less, the acquiring unit 222 acquires information indicating that the number of chewing times per unit time belongs to the “slightly inappropriate” range as notification information. Further, if the number of mastications per unit time is 5 or more, the acquisition unit 222 acquires information indicating that the number of mastications per unit time belongs to the “unsuitable” range as notification information. Each range of “preferable”, “slightly unsuitable”, and “unsuitable” is set by an arbitrary method based on medical knowledge and the like, and is stored in advance in a ROM included in the control unit 220. Note that the range to be set does not have to be three, and an arbitrary number of ranges can be set.

  The notification unit 223 outputs the notification information acquired by the acquisition unit 222 based on the operation information. The notification unit 223 is realized by the cooperation of the control unit 220 and a display 240 and a speaker 250 described later.

  In this embodiment, the alerting | reporting part 223 outputs alerting | reporting information by outputting the alerting | reporting screen Wn shown in FIG. The notification screen Wn includes a first display area Cn, a second display area Tn, a first notification icon In1, and a second notification icon In2.

  In the first display area Cn, an image corresponding to the notification information indicating the number of chewing times per mouth is displayed. In the example of FIG. 6, based on the notification information indicating that the number of chewing times per mouth is 26, an image representing a message “the number of chewing times per mouth is 26” is displayed in the first display area Cn. Has been.

  In the second display area Tn, an image corresponding to the notification information indicating the number of chewing times per meal is displayed. In the example of FIG. 6, based on the notification information indicating that the number of chewing times per meal is 293, an image representing a message “the total number of chewing times is 293” is displayed in the second display area Tn. Yes.

  The first notification icon In1 is an icon for notifying notification information indicating whether the number of chewing times per mouth is suitable for health management or beauty promotion. Specifically, the notification unit 223 displays the first notification icon In1 according to whether the range to which the number of mastications per mouth indicated by the notification information belongs is “preferred”, “slightly inappropriate”, or “unsuitable”. The color is displayed in any one of a plurality of colors. More specifically, the notification unit 223 displays the first notification icon In1 in blue corresponding to the notification information indicating that the number of chewing times per mouth belongs to the “preferred” range. Further, the notification unit 223 displays the first notification icon In1 in yellow corresponding to the notification information indicating that the number of chewing times per mouth belongs to the “slightly inappropriate” range. Further, the notification unit 223 displays the first notification icon In1 in red corresponding to the notification information indicating that the number of chewing times per mouth belongs to the “unsuitable” range.

  The second notification icon In2 is an icon for notifying notification information indicating whether the number of mastications per unit time is suitable for health management or beauty promotion. Specifically, the notification unit 223 determines whether the range to which the number of mastications per unit time indicated by the notification information belongs is “preferred”, “slightly inappropriate”, or “unsuitable”. Is displayed in one of a plurality of colors. More specifically, the notification unit 223 displays the second notification icon In2 in blue corresponding to the notification information indicating that the number of mastications per unit time belongs to the “preferred” range. Further, the notification unit 223 displays the second notification icon In2 in yellow corresponding to the notification information indicating that the number of mastications per unit time belongs to the “slightly inappropriate” range. In addition, the notification unit 223 displays the second notification icon In2 in red corresponding to the notification information indicating that the number of mastications per unit time belongs to the “unsuitable” range.

  Moreover, the alerting | reporting part 223 outputs 1st alert information as alerting | reporting information, when the frequency | count of the operation | movement accompanying the eating and drinking per mouth which alerting | reporting information shows satisfy | fills 1st alert | warning conditions. In this embodiment, the alerting | reporting part 223 outputs 1st alert information as alerting | reporting information, when the frequency | count of chewing per mouth which alerting | reporting information shows satisfy | fills 1st alert | warning conditions. In the present embodiment, the first warning condition is that the number of chewing times per mouth is 10 times or less. The notification unit 223 outputs the first warning information by outputting the first warning sound through the speaker 250.

  Moreover, the alerting | reporting part 223 outputs 2nd warning information as alerting | reporting information, when the frequency | count of the operation | movement accompanying the food-drink per unit time which alerting | reporting information shows satisfies 2nd alerting | warning conditions. In this embodiment, the alerting | reporting part 223 outputs 2nd warning information as alerting | reporting information, when the frequency | count of mastication per unit time which alerting | reporting information shows satisfy | fills 2nd alerting | warning conditions. In the present embodiment, the second warning condition is that the number of chewing times per unit time is 5 or more. The notification unit 223 outputs the second warning information by outputting a second warning sound different from the first warning sound through the speaker 250.

  In addition, you may set a 1st warning condition and a 2nd warning condition according to the thing which a user eats and drinks, respectively. The number of chewing times per unit and the number of chewing times per unit time that are inappropriate from the viewpoint of health management or beauty promotion vary depending on the product. Therefore, the number of chewing times per mouth and the number of chewing times per unit time, which are considered inappropriate from the viewpoint of health management or beauty promotion when eating and drinking each item, are set as the first warning condition and the second warning condition, respectively. By doing so, information useful for health care or beauty promotion can be provided to the user.

  Returning to FIG. 4, the operation unit 230 accepts various inputs in accordance with user operations. In the present embodiment, the operation unit 230 includes various operation buttons of the notification device 200 including a power button (not shown), and a touch panel arranged so as to be superimposed on a display 240 described later.

  The display 240 displays various images according to the control of the control unit 220.

  The speaker 250 outputs various sounds according to the control of the control unit 220.

  Next, operations of the detection device 100 and the notification device 200 having the above configuration and functions will be described.

  First, detection processing executed by the detection device 100 will be described with reference to the flowchart of FIG. A user who desires to start the detection process turns on the power of the detection device 100 by operating a power button provided in the operation unit 140 of the detection device 100. In response to the power being turned on, the detection device 100 starts the detection process shown in the flowchart of FIG.

  First, the transmission part 131 of the detection apparatus 100 transmits the information which shows the magnitude | size of the user's throat movement acquired based on the output from the sensor 120 as movement information (step S101).

  Next, the control unit 130 determines whether or not the user has received an instruction to end the detection process (step S102). If it is determined that the end instruction has not been received (step S102; NO), the process returns to step S101, and the processes of steps S101 to S102 are repeated until it is determined that the end instruction has been received.

  A user who desires to end the detection process turns off the power of the detection device 100 by operating a power button provided in the operation unit 140 of the detection device 100. In response to this, the control unit 130 determines that an instruction to end the detection process has been received (step S102; YES), and ends the detection process.

  Next, the notification process executed by the notification device 200 will be described with reference to the flowchart of FIG. In the following description, it is assumed that the detection device 100 continues to transmit the acquired motion information to the notification device 200 in real time by executing the detection processing of the flowchart of FIG. In this state, when the user who desires to start the notification process turns on the notification device 200 by operating the power button provided in the operation unit 230 of the notification device 200, the notification device 200 responds to this by The notification process shown in the flowchart of FIG.

  First, the receiving unit 221 of the notification device 200 receives information indicating the magnitude of the movement of the user's throat as movement information from the transmission unit 131 of the detection device 100 (step S201). The reception unit 221 supplies the received motion information to the acquisition unit 222.

  The acquisition unit 222 acquires a waveform indicating the temporal change in the magnitude of the user's throat movement based on the movement information (step S202). The acquisition unit 222 determines whether or not the waveform acquired in step S222 includes a waveform whose amplitude exceeds the first threshold (step S203). If it is determined that it is not included (step S203; NO), the process returns to step S201, and the processes of steps S201 to S203 are repeated until it is determined that a waveform whose amplitude exceeds the first threshold is included.

  If it is determined that a waveform whose amplitude exceeds the first threshold is included (step S203; YES), the acquisition unit 222 acquires operation information by executing the processing of steps S204 to S209.

  In the present embodiment, the processes in steps S204 to S209 are executed in response to the determination that a waveform whose amplitude exceeds the first threshold is included, but this is only an example. The acquisition unit 222 can execute the processes of steps S204 to S209 in response to the satisfaction of an arbitrary condition. For example, the acquisition unit 222 includes means for acquiring at least one of a user's body temperature, pulse, and blood pressure, and steps S204 to S209 are performed in response to an increase in at least one of the body temperature, pulse wave, and blood pressure. The operation information may be acquired by executing the process. According to this aspect, the start of eating and drinking by the user can be detected based on an increase in body temperature, pulse and blood pressure accompanying eating and drinking, and operation information can be acquired based on the detection result. For this reason, the possibility of failing to capture the start of eating and drinking is reduced, and mastication and swallowing can be detected more accurately. In addition, since the technique which measures a user's body temperature, a pulse, and a blood pressure is well-known, detailed description is abbreviate | omitted.

  In step S204, the acquisition unit 222 determines whether the amplitude of the waveform determined to have exceeded the first threshold in step S203 exceeds the second threshold (step S204).

  If it is determined that the amplitude of the waveform exceeds the second threshold (step S204; YES), since this waveform is considered to be a swallowing waveform, the acquisition unit 222 obtains information indicating the appearance timing of this waveform. Obtained as operation information indicating the timing (step S205). Thereafter, the process proceeds to step S207.

  If it is determined that the amplitude of the waveform does not exceed the second threshold (step S204; NO), the acquisition unit 222 determines whether or not the waveform from the appearance timing of this waveform to the time after the determination time has been acquired (step S206). ).

  If it is determined that the waveform after the determination time has not yet been acquired (step S206; NO), the process returns to step S201, and a waveform whose amplitude exceeds the second threshold is detected (YES is determined in step S204). Or the process of step S201-S206 is repeated until the motion information which acquires the waveform until after the discrimination | determination time is received (it is discriminate | determined as YES by step S206). If it is determined that the waveform up to after the determination time has been acquired (step S206; YES), the process proceeds to step S207.

  In step S207, the acquisition unit 222 generates a plurality of waveforms having an amplitude that is greater than or equal to the first threshold value and less than or equal to the second threshold value, and whose number of appearances per unit time is within the determination range in the acquired waveform. It is determined whether or not there is (step S207).

  When it is determined that a plurality of waveforms having amplitudes not less than the first threshold and not more than the second threshold and whose number of appearances per unit time is within the determination range does not appear (step S207; NO), the process proceeds to step S209. Move on.

  If it is determined that a plurality of waveforms having amplitudes not less than the first threshold value and not more than the second threshold value and whose number of appearances per unit time is within the determination range (step S207; YES), the acquiring unit 222 Information indicating the appearance timing of these waveforms is acquired as operation information indicating the timing of mastication (step S208), and the process proceeds to step S209.

  In step S209, the acquisition unit 222 determines whether or not the operation information indicating the timing of swallowing or mastication has been acquired (step S209). If it is determined that no operation information has been acquired (step S209; NO), the process returns to step S201.

  When it is determined that the operation information indicating the timing of swallowing or mastication has been acquired (step S209; YES), the acquisition unit 222 acquires the notification information by executing the processes of steps S210 to S213.

  In step S210, the acquisition unit 222 acquires notification information indicating the number of chewing times per mouth based on the operation information acquired in steps S201 to S209 (step S210).

  The acquisition unit 222 performs the cumulative addition of the number of chewing times per mouth obtained in step S210 to the number of chewing times per meal obtained in the previous steps S201 to S211 so that the notification information indicating the number of chewing times per meal is obtained. Is acquired (step S211).

  The acquisition unit 222 acquires notification information indicating whether the number of chewing times per mouth acquired in step S210 belongs to a preset range of “preferred”, “slightly inappropriate”, and “unsuitable” (step S212). ).

  Based on the motion information acquired in steps S201 to S209, the acquisition unit 222 belongs to a preset range of “preferred”, “slightly inappropriate”, and “inappropriate”. Is obtained (step S213).

  The acquisition unit 222 supplies the notification information acquired in steps S210 to S213 to the notification unit 223. The alerting | reporting part 223 outputs the alerting | reporting information supplied by performing the process of step S214-S218.

  In step S214, the notification unit 223 outputs the notification screen Wn corresponding to the notification information as a notification image via the display 240 (step S214).

  The notification unit 223 determines whether or not the number of chewing times per mouth indicated by the notification information satisfies the first warning condition (step S215). If it is determined that the first warning condition is not satisfied (step S215; NO), the process proceeds to step S217.

  When it is determined that the number of chewing times per mouth satisfies the first warning condition (step S215; YES), the notification unit 223 outputs the first warning sound as notification information via the speaker 250 (step S216). The process moves to step S217.

  The notification unit 223 determines whether or not the number of mastications per unit time indicated by the notification information satisfies the second warning condition (step S217). If it is determined that the second warning condition is not satisfied (step S217; NO), the process proceeds to step S219.

  When it is determined that the number of chewing times per unit time satisfies the second warning condition (step S217; YES), the notification unit 223 outputs the second warning sound as notification information via the speaker 250 (step S218). ), The process proceeds to step S219.

  In step S219, the control unit 220 determines whether or not an instruction to end the notification process has been received (step S219). If it is determined that an end instruction has not been received (step S219; NO), the process returns to step S201.

  When a user who desires to end the notification process turns off the notification device 200 by operating a power button provided in the operation unit 230 of the notification device 200, the control unit 220 accepts an end instruction in response thereto. (Step S219; YES), and the notification process is terminated.

  As described above, the detection system 10 according to the present embodiment detects mastication and swallowing, which are user actions associated with eating and drinking, based on the movement of the user's throat, and is useful for health management or beauty promotion based on the detection result. The broadcast information is output.

  When the user chews and swallows, movement occurs in the user's throat even when no movement occurs in other parts of the user's body. For this reason, the detection system 10 that performs detection based on the movement of the user's throat can accurately detect the user's actions associated with eating and drinking.

  In particular, the detection system 10 can accurately detect a swallowing operation that is difficult to detect based on the movement of a portion other than the user's throat. Since the detection system 10 can accurately detect swallowing, it can output notification information based on the number of chewing times per mouthful.

(Second Embodiment)
In the first embodiment, the detection device 100 acquires motion information, and the notification device 200 acquires operation information, acquisition of notification information, and output of notification information. However, this is only an example, and each operation of the detection system 10 may be executed by either the detection device 100 or the notification device 200.

  Hereinafter, an embodiment will be described in which the detection device 100 ′ acquires motion information, motion information, and notification information, and the notification device 200 ′ outputs notification information.

  First, the configuration and function of the detection device 100 ′ will be described focusing on differences from the configuration and function of the detection device 100 according to the first embodiment. The detection device 100 ′ has substantially the same configuration and function as the detection device 100, but a part of the configuration and function is different.

  As shown in FIG. 9, the detection device 100 ′ is different from the detection device 100 in that it includes an acquisition unit 132.

  The acquisition unit 132 acquires operation information based on the movement of the user's throat detected by the sensor 120 attached to the user's neck. The function of acquiring the operation information by the acquisition unit 132 is the same as the function of acquiring the operation information by the acquisition unit 222 of the notification device 200 already described in the first embodiment, and thus detailed description thereof is omitted.

  The acquisition unit 132 acquires notification information based on the acquired operation information. The function of acquiring the notification information based on the operation information by the acquisition unit 132 is the same as the function of acquiring the notification information by the acquisition unit 222 of the notification device 200 already described in the first embodiment, and thus detailed description thereof is omitted. To do. The acquisition unit 132 supplies the acquired notification information to the transmission unit 131.

  The transmission unit 131 transmits the supplied notification information to the reception unit 221 of the notification device 200 ′.

  Next, the configuration and function of the notification device 200 ′ will be described focusing on differences from the configuration and function of the notification device 200 according to the first embodiment. The notification device 200 ′ has substantially the same configuration and function as the notification device 200, but a part of the configuration and function is different.

  As shown in FIG. 10, the notification device 200 ′ is different from the notification device 200 in that the acquisition unit 222 is not provided.

  The receiving unit 221 of the notification device 200 ′ receives notification information from the transmission unit 131 of the detection device 100 ′. The receiving unit 221 supplies the received notification information to the notification unit 223.

  The notification unit 223 outputs the notification information supplied from the reception unit 221. Since the function that the notification unit 223 outputs the notification information has already been described in the first embodiment, the description thereof is omitted.

  Next, operations of the detection device 100 ′ and the notification device 200 ′ having the above configuration and functions will be described.

  First, detection processing executed by the detection device 100 ′ will be described with reference to the flowchart of FIG. 11. A user who desires to start the detection process turns on the power of the detection device 100 ′ by operating a power button provided in the operation unit 140 of the detection device 100 ′. In response to the power being turned on, the detection device 100 'starts the detection process shown in the flowchart of FIG.

  First, the acquisition unit 132 of the detection device 100 ′ acquires, as movement information, a waveform that represents a temporal change in the magnitude of the movement of the user's throat based on the output from the sensor 120 (step S <b> 202).

  The acquisition unit 132 acquires operation information based on the motion information acquired in step S202 by executing the processes of steps S203 to S209.

  The acquisition part 132 acquires alerting | reporting information based on the operation | movement information acquired by step S203-S209 by performing the process of step S210-S213. The acquisition unit 132 supplies the acquired notification information to the transmission unit 131.

  The details of the processing in steps S202 to S213 have already been described in the first embodiment, and thus description thereof will be omitted.

  The transmission unit 131 transmits the supplied notification information to the reception unit 221 of the notification device 200 '(step S301).

  Thereafter, in step S102, control unit 130 determines whether an instruction to end detection processing has been received (step S102). If it is determined that the end instruction has not been received (step S102; NO), the process returns to step S202, and the processes of steps S202 to S102 are repeated until it is determined that the end instruction has been received.

  When a user desiring to end the detection process turns off the power by operating a power button provided in the operation unit 140, the control unit 130 determines that an end instruction has been received in response to this (step S102; YES) ) And the detection process is terminated.

  Next, the notification process performed by the notification device 200 'will be described with reference to the flowchart of FIG. In the following description, it is assumed that the detection device 100 ′ continues to transmit notification information to the notification device 200 ′ by executing the detection process of the flowchart of FIG. 11. In this state, when a user who desires to start the notification process turns on the notification device 200 ′ by operating the power button provided in the operation unit 230 of the notification device 200 ′, the notification device 200 ′ responds to this. Then, the notification process shown in the flowchart of FIG. 12 is started.

  First, the receiving unit 221 of the notification device 200 'receives notification information from the transmission unit 131 of the detection device 100' (step S401). The receiving unit 221 supplies the received notification information to the notification unit 223.

  The alerting | reporting part 223 outputs the alerting | reporting information supplied from the receiving part 221 by performing the process of step S214-S218. The details of the processing in steps S214 to S218 have already been described in the first embodiment, and thus description thereof will be omitted.

  After outputting the notification information, the control unit 220 of the notification device 200 'determines whether or not an instruction to end the notification process has been received (step S219). If it is determined that the end instruction has not been received (step S219; NO), the process returns to step S401, and the processes of steps S401 to S219 are repeated until it is determined that the end instruction has been received.

  When the user who desires to end the notification process turns off the power by operating the power button provided in the operation unit 230 of the notification device 200 ′, the control unit 220 determines that an end instruction has been received in response to this. (Step S219; YES), the notification process is terminated.

  As described above, according to the present embodiment, the detection device 100 ′ acquires motion information, motion information, and notification information, and the notification device 200 ′ outputs notification information. For this reason, the processing load of the notification device 200 ′ can be reduced compared to the first embodiment in which the notification device 200 acquires operation information, acquisition of notification information, and output of notification information. In addition, since communication is performed between the detection device 100 ′ and the notification device 200 ′ only when the detection device 100 ′ has acquired the operation information (determined as YES in step S209 in the flowchart of FIG. 11), the movement Compared to the first embodiment in which information is transmitted in real time without sorting, the communication load can be reduced.

  As mentioned above, although embodiment of this invention was described, these embodiment is an example and the application range of this invention is not restricted to this. That is, the embodiments of the present invention can be applied in various ways, and all the embodiments are included in the scope of the present invention.

  In the above embodiment, the detection system 10 has been described as detecting the mastication and swallowing that are the user's actions associated with eating and drinking. However, this is only an example. As long as the detection system 10 according to the present invention is an operation involving the movement of the user's throat, it can detect an arbitrary operation associated with eating and drinking. For example, the detection system 10 can also detect throat movements and vomiting. Moreover, as long as it is operation | movement with a user's throat movement, the detection system 10 can also detect a user's operation | movement accompanying activities other than eating and drinking. For example, the detection system 10 can detect operations such as yawning, coughing, and hiccups.

  In the first embodiment, the detection device 100 acquires motion information, and the notification device 200 acquires operation information, acquisition of notification information, and output of notification information. In the second embodiment, the detection device 100 ′ acquires motion information, motion information, and notification information, and the notification device 200 ′ outputs notification information. However, these are merely examples, and each operation of the detection system according to the present invention may be executed by either the detection device 100 or the notification device 200. For example, a single device may perform all the operations of acquiring motion information, acquiring motion information, acquiring notification information, and outputting notification information. According to this aspect, the detection system according to the present invention can be configured simply.

  Alternatively, the detection device 100 may acquire motion information and motion information, and the notification device 200 may acquire notification information and output notification information. In this case, the detection device 100 includes a sensor attached to the user's neck, and acquires operation information based on the movement of the user's throat detected by the sensor. The transmission unit 131 of the detection device 100 transmits the acquired operation information to the notification device 200, and the notification device 200 acquires and outputs the notification information acquired based on the received operation information. According to this aspect, the processing load of the notification device 200 can be reduced as compared with the first embodiment. In addition, since the communication between the detection device 100 and the notification device 200 is performed only when the detection device 100 acquires operation information, the detection device 100 transmits the movement information in real time without selecting the movement information. Compared with, communication load can be reduced.

  In the above-described embodiment, the notification unit 223 of the notification device 200 outputs an image of the notification screen Wn via the display 240 and outputs the first warning sound and the second warning sound via the speaker 250 as a sound. Broadcast information was output. However, this is only an example. The notification unit 223 can output notification information by an arbitrary method. For example, the notification unit 223 performs notification by performing at least one of audio output, image output, generation of vibration, and generation of light emission based on the timing of an operation associated with eating and drinking indicated by the operation information. Information may be output. In this case, the notification unit 223 includes a light emitting unit that generates light emission and a vibrator that vibrates the notification device 200 in addition to the display 240 and the speaker 250. Specifically, the notification unit 223 performs, for example, at least one of audio output, image output, vibration generation, and light emission generation in accordance with the timing of mastication indicated by the operation information. According to this aspect, the user can intuitively recognize his / her chewing frequency and chewing frequency, and can use it for health management or beauty promotion.

  The above embodiment has been described using a smartphone as an example of the notification device 200. However, this is only an example. The detection system, the detection device, and the notification device according to the present invention can be realized by an arbitrary electronic device such as a computer, a smart watch, or a PDA (Personal Digital Assistance). Specifically, a program for operating an electronic device such as a smartphone, a computer, or a smart watch as the detection system, the detection device, and the notification device according to the present invention is recorded on a recording medium (for example, a memory) that can be read by these electronic devices. The detection system, the detection device, and the notification according to the present invention are stored in a card, a CD-ROM (Compact Disc Read-Only Memory), a DVD-ROM (Digital Versatile Disc Read-Only Memory), and distributed and installed. An apparatus can be realized.

  Alternatively, the above-described program is stored in a storage device (for example, a disk device) included in a server device on a communication network such as the Internet, and a smartphone, a computer, a smart watch, or the like downloads the program to the present invention. You may implement | achieve the detection system, detection apparatus, and alerting | reporting apparatus which concern on.

  In addition, when the functions of the detection system, the detection device, and the notification device according to the present invention are realized by cooperation or sharing of an operating system (OS) and an application program, only the application program portion is stored in a recording medium, You may store in a memory | storage device.

  Further, the application program may be superimposed on a carrier wave and distributed via a communication network. For example, an application program may be posted on a bulletin board (BBS: Bulletin Board System) on a communication network, and the application program may be distributed via the network. Then, the detection system, the detection device, and the notification device according to the present invention may be realized by installing and starting this application program on a computer and executing it in the same manner as other application programs under the control of the OS. .

  The preferred embodiments of the present invention have been described above. However, the present invention is not limited to the specific embodiments, and the present invention includes the invention described in the claims and the equivalent scope thereof. included. Hereinafter, the invention described in the scope of claims of the present application will be appended.

(Appendix 1)
A sensor that is mounted on a user's neck and detects movement of the user's throat;
Based on the movement of the throat of the user detected by the sensor, acquisition means for acquiring operation information indicating an operation accompanying the eating and drinking of the user;
Notification means for outputting notification information acquired based on the operation information;
Comprising
A detection system characterized by that.

(Appendix 2)
The action accompanying the eating and drinking is at least one of chewing and swallowing,
The detection system according to supplementary note 1, wherein:

(Appendix 3)
The movement information is timing of at least one of the chewing and the swallowing.
The detection system according to supplementary note 2, characterized by:

(Appendix 4)
The sensor detects biological information of the user,
The acquisition means acquires the operation information based on the biological information.
The detection system according to any one of appendices 1 to 3, characterized in that:

(Appendix 5)
The notification information indicates the number of operations associated with the eating and drinking per mouth,
The notification means outputs first warning information as the notification information when the number of operations with the eating and drinking per mouth indicated by the notification information satisfies a first warning condition.
The detection system according to any one of appendices 1 to 4, wherein

(Appendix 6)
The notification information further indicates the number of operations associated with the eating and drinking per unit time,
The notification means outputs second warning information as the notification information when the number of operations accompanying the eating and drinking per unit time indicated by the notification information satisfies a second warning condition.
The detection system according to appendix 5, characterized by:

(Appendix 7)
The first warning condition and the second warning condition are respectively set according to the food that the user eats and drinks.
The detection system according to appendix 6, characterized in that:

(Appendix 8)
The notification means outputs the notification information by performing at least one of audio output, image output, vibration generation, and light emission generation based on the timing of the operation accompanying the eating and drinking. ,
The detection system according to any one of appendices 1 to 7, characterized in that:

(Appendix 9)
The detection system includes a detection device and a notification device,
The detection device is:
The sensor;
Transmission means for transmitting movement information indicating movement of the throat of the user detected by the sensor to the notification device;
Have
The notification device
Receiving means for receiving the motion information transmitted from the detection device;
The obtaining means for obtaining the motion information based on the motion information received by the receiving means;
The notification means;
Having
The detection system according to any one of appendices 1 to 8, characterized in that:

(Appendix 10)
The detection system includes a detection device and a notification device,
The detection device is:
The sensor;
The acquisition means;
Transmitting means for transmitting the notification information acquired based on the operation information acquired by the acquisition means to the notification device;
Have
The notification device
Receiving means for receiving the broadcast information transmitted from the detection device;
The notification means for outputting the notification information received by the reception means;
Having
The detection system according to any one of appendices 1 to 8, characterized in that:

(Appendix 11)
A sensor that is mounted on a user's neck and detects movement of the user's throat;
Based on the movement of the throat of the user detected by the sensor, acquisition means for acquiring operation information indicating an operation accompanying the eating and drinking of the user;
Transmitting means for transmitting the operation information to a notification device that outputs the notification information acquired based on the operation information;
Comprising
A detection device characterized by that.

(Appendix 12)
Receiving means for receiving movement information indicating movement of the user's throat detected by a sensor mounted on the user's neck from a detection device including the sensor;
Based on the movement of the throat of the user detected by the sensor, acquisition means for acquiring operation information indicating an operation accompanying the eating and drinking of the user;
Notification means for outputting notification information acquired based on the operation information;
Comprising
A notification device characterized by the above.

(Appendix 13)
Detecting movement of the user's throat by a sensor attached to the user's neck;
Based on the movement of the throat of the user detected by the sensor, obtain operation information indicating the operation accompanying the user's eating and drinking,
Outputting notification information acquired based on the operation information;
A detection method characterized by that.

(Appendix 14)
In the computer of the detection device,
Movement information indicating movement of the user's throat detected by a sensor mounted on the user's neck is acquired;
Based on the movement information, the operation information indicating the operation accompanying the eating and drinking of the user is acquired,
The operation information is transmitted to a notification device that outputs notification information acquired based on the operation information.
A program characterized by that.

(Appendix 15)
In the computer of the notification device,
Notification information acquired based on movement information indicating movement of the user's throat detected by a sensor mounted on the user's neck is received from a detection device including the sensor,
Outputting the received broadcast information;
A program characterized by that.

DESCRIPTION OF SYMBOLS 10 ... Detection system, 100, 100 '... Detection apparatus, 110 ... Mounting part, 120 ... Sensor, 130, 220 ... Control part, 131 ... Transmission part, 132, 222 ... Acquisition part, 140, 230 ... Operation part, 150, 210 ... Wireless communication I / F, 200, 200 '... Notification device, 221 ... Reception unit, 223 ... Notification unit, 240 ... Display, 250 ... Speaker, Wn ... Notification screen, Cn ... First display area, Tn ... Second Display area, In1 ... first notification icon, In2 ... second notification icon

Claims (15)

A sensor that is mounted on a user's neck and detects movement of the user's throat;
Based on the movement of the throat of the user detected by the sensor, acquisition means for acquiring operation information indicating an operation accompanying the eating and drinking of the user;
Notification means for outputting notification information acquired based on the operation information;
Comprising
A detection system characterized by that. The action accompanying the eating and drinking is at least one of chewing and swallowing,
The detection system according to claim 1. The movement information is timing of at least one of the chewing and the swallowing.
The detection system according to claim 2. The sensor detects biological information of the user,
The acquisition means acquires the operation information based on the biological information.
The detection system according to any one of claims 1 to 3, wherein: The notification information indicates the number of operations associated with the eating and drinking per mouth,
The notification means outputs first warning information as the notification information when the number of operations with the eating and drinking per mouth indicated by the notification information satisfies a first warning condition.
The detection system according to any one of claims 1 to 4, wherein: The notification information further indicates the number of operations associated with the eating and drinking per unit time,
The notification means outputs second warning information as the notification information when the number of operations accompanying the eating and drinking per unit time indicated by the notification information satisfies a second warning condition.
The detection system according to claim 5. The first warning condition and the second warning condition are respectively set according to the food that the user eats and drinks.
The detection system according to claim 6. The notification means outputs the notification information by performing at least one of audio output, image output, vibration generation, and light emission generation based on the timing of the operation accompanying the eating and drinking. ,
The detection system according to claim 1, wherein: The detection system includes a detection device and a notification device,
The detection device is:
The sensor;
Transmission means for transmitting movement information indicating movement of the throat of the user detected by the sensor to the notification device;
Have
The notification device
Receiving means for receiving the motion information transmitted from the detection device;
The obtaining means for obtaining the motion information based on the motion information received by the receiving means;
The notification means;
Having
The detection system according to any one of claims 1 to 8, wherein The detection system includes a detection device and a notification device,
The detection device is:
The sensor;
The acquisition means;
Transmitting means for transmitting the notification information acquired based on the operation information acquired by the acquisition means to the notification device;
Have
The notification device
Receiving means for receiving the broadcast information transmitted from the detection device;
The notification means for outputting the notification information received by the reception means;
Having
The detection system according to any one of claims 1 to 8, wherein A sensor that is mounted on a user's neck and detects movement of the user's throat;
Based on the movement of the throat of the user detected by the sensor, acquisition means for acquiring operation information indicating an operation accompanying the eating and drinking of the user;
Transmitting means for transmitting the operation information to a notification device that outputs the notification information acquired based on the operation information;
Comprising
A detection device characterized by that. Receiving means for receiving movement information indicating movement of the user's throat detected by a sensor mounted on the user's neck from a detection device including the sensor;
Based on the movement of the throat of the user detected by the sensor, acquisition means for acquiring operation information indicating an operation accompanying the eating and drinking of the user;
Notification means for outputting notification information acquired based on the operation information;
Comprising
A notification device characterized by the above. Detecting movement of the user's throat by a sensor attached to the user's neck;
Based on the movement of the throat of the user detected by the sensor, obtain operation information indicating the operation accompanying the user's eating and drinking,
Outputting notification information acquired based on the operation information;
A detection method characterized by that. In the computer of the detection device,
Movement information indicating movement of the user's throat detected by a sensor mounted on the user's neck is acquired;
Based on the movement information, the operation information indicating the operation accompanying the eating and drinking of the user is acquired,
The operation information is transmitted to a notification device that outputs notification information acquired based on the operation information.
A program characterized by that. In the computer of the notification device,
Notification information acquired based on movement information indicating movement of the user's throat detected by a sensor mounted on the user's neck is received from a detection device including the sensor,
Outputting the received broadcast information;
A program characterized by that.