JP2017086322A - Gustatory sense evaluation diagnosis device, gustatory sense evaluation diagnosis method of gustatory sense evaluation diagnosis device - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide a gustatory sense evaluation diagnosis device and a gustatory sense evaluation diagnosis method capable of noninvasively performing gustatory sense evaluation diagnosis of functionality which is sensibility reaction to food and drink with a simple configuration.SOLUTION: A gustatory sense evaluation diagnosis device includes: a body surface motion detection unit; a deglutition movement analysis unit for performing analysis processing concerning a deglutition movement based on a signal obtained by the body surface motion detection unit; an input unit to which gustatory sense evaluation data is input; a data base generation unit storing a database in a storage unit, the data base associating gustatory sense evaluation data input by the input unit and analysis results from the deglutition movement analysis unit; and a gustatory sense evaluation diagnosis unit for performing processing concerning gustatory sense evaluation diagnosis based on the signal obtained by the body surface motion detection unit and the analysis result by the deglutition movement analysis unit stored in the database in the storage unit.SELECTED DRAWING: Figure 1

Description

  The present invention relates to a taste evaluation diagnosis apparatus and a taste evaluation diagnosis method for a taste evaluation diagnosis apparatus.

  The taste sensory test is performed according to a certain standard of an examiner (panelist) specializing in the test. As presented in Non-Patent Document 1, at present, there is no uniform standard, and it is the actual situation that each inspection execution organization has decided independently.

  Taste is inherently sensory and varies greatly between individuals. It is based on a sensory evaluation when the inspected person actually tastes the food. Moreover, since the difference in the preservation | save state of food to be examined, a preparation method, etc. may be influenced, it is thought that the uniform evaluation is still difficult at present. The technical improvement of the measuring method is desired.

  Patent Document 1 describes a continuous swallowing movement measuring device using a plurality of reflective optical sensors arranged along the vertical movement direction of thyroid cartilage when food is swallowed.

  Patent Document 2 describes a method for evaluating the sense of feeling over the throat of a beverage by frequency analysis of waveform data of the surface myoelectric potential of the muscles of the pharynx.

  In Patent Document 3, three or more light emitting means for irradiating the head and neck surface with light having different wavelengths and the light reflected by the head and neck surface are dispersed to obtain spectral image data in time series. And an apparatus for measuring mastication or swallowing movement based on each spectral image data acquired by the imaging means.

JP 2009-160459 A JP 2011-200662 A JP 2013-31650 A

Evaluation of food texture by a questionnaire utilizing oropharyngeal sensation using oral and pharyngeal sensations: Kohei Yamada, Izumi Kondo, Kenichi Ozaki, Tokuno Tsuno, Takanobu Tanaka: Japanese Journal of Comprehensive Rehabilitation Science 4 (2013), Page1-6, (2014.01)

  However, the devices (methods) described in Patent Documents 1 to 3 analyze swallowing movements using a reflective optical sensor, a sensor that measures surface myoelectric potential, an imaging unit, and the like. And requires complicated analysis processing.

The taste evaluation and diagnosis apparatus of the present invention has at least the following configuration.
The taste evaluation diagnostic apparatus includes a body surface motion detection unit,
A swallowing motion analysis unit that performs analysis processing related to swallowing motion based on the signal obtained by the body surface motion detection unit;
An input unit for inputting taste evaluation data;
A database generation unit that stores a database that associates the taste evaluation data input by the input unit with the analysis result of the swallowing movement analysis unit in a storage unit;
A taste evaluation diagnosis unit that performs processing related to taste evaluation diagnosis based on the signal obtained by the body surface motion detection unit and the analysis result by the swallowing motion analysis unit stored in the database of the storage unit. It is characterized by that.

Moreover, the taste evaluation diagnostic method of the taste evaluation diagnostic apparatus of the present invention comprises at least the following configuration.
A body surface motion detection unit, a swallowing motion analysis unit that performs analysis processing on swallowing motion based on a signal obtained by the body surface motion detection unit, an input unit that inputs taste evaluation data, and the input unit A database generation unit that stores a database that associates the input taste evaluation data with the analysis result of the swallowing movement analysis unit in a storage unit, a signal obtained by the body surface motion detection unit, and the storage unit A taste evaluation diagnostic unit for performing a taste evaluation diagnosis based on the analysis result by the swallowing movement analysis unit stored in the database, and a taste evaluation diagnostic method of a taste evaluation diagnostic device,
The body surface motion detection unit generating a signal;
Performing a process related to taste evaluation diagnosis based on a signal generated by the body surface motion detection unit and an analysis result by the swallowing movement analysis unit stored in the database of the storage unit, the taste evaluation diagnosis unit; It is characterized by having.

ADVANTAGE OF THE INVENTION According to this invention, the taste evaluation diagnostic apparatus which can perform the taste evaluation diagnosis noninvasively about the functionality which is a sensory reaction with respect to food and drink with simple structure can be provided.
ADVANTAGE OF THE INVENTION According to this invention, the taste evaluation diagnostic method of the taste evaluation diagnostic apparatus which can perform the taste evaluation diagnosis of the sensory reaction with respect to food and drink noninvasively with simple structure can be provided.

The figure which shows an example of the taste evaluation diagnostic apparatus which concerns on 1st Embodiment of this invention. The conceptual diagram which shows an example of the acceleration detection part for body surfaces affixed on the human body. The figure which shows an example of operation | movement of the acceleration detector for body surfaces affixed on the human body, (a) is a figure which shows the state of the acceleration detector for body surfaces before swallowing, (b) is the acceleration detection for body surfaces at the time of swallowing The figure which shows the state of a part. The figure which shows an example of the signal from the acceleration detection part for body surfaces, (a) is a figure which shows an example of the signal which shows the acceleration of a x-axis direction, (b) is a figure which shows an example of the signal which shows the acceleration of a y-axis direction (C) is a figure which shows an example of the signal which shows the acceleration of az axis direction. The figure which shows an example of the signal from the acceleration detection part for body surfaces, (a) is a figure which shows an example of the signal which shows the acceleration of an x-axis direction, (b) is a figure which shows the power spectrum of the signal shown to (a). . The figure for demonstrating the relationship between a power spectrum and taste evaluation, (a) is a figure which shows an example of the power spectrum at the time of taste evaluation being delicious, (b) is an example of the power spectrum at the time of taste evaluation when it is not delicious FIG. The flowchart which shows an example of operation | movement of the taste evaluation diagnostic apparatus which concerns on 1st Embodiment of this invention. The figure which shows an example of the taste evaluation diagnostic apparatus which concerns on 2nd Embodiment of this invention. The figure which shows an example of the functional block of a control part. The figure which shows an example of the image imaged by the imaging part. The figure which shows an example of an optical flow. The figure which shows an example of a movement of a larynx. The figure for demonstrating the movement of the convex part of a larynx, (a) is the state which a convex part moves to the lower part from the upper part, (b) is the state where a convex part moves to the upper part from the lower part, (c) is convex. The figure which shows an example of the state in which a part is located in the upper part. The figure which shows an example of the detection signal by swallowing operation | movement when test subject A1 feels delicious, (a) is displacement, (b) is speed, (c) is a figure which shows an example of an acceleration. The figure which shows an example of the detection signal by swallowing operation | movement when it feels unpleasant by test subject A1, (a) is a displacement, (b) is a speed, (c) is a figure which shows an example of an acceleration. The figure which shows an example of the detection signal by swallowing operation | movement when it feels delicious by test subject A2, (a) is a displacement, (b) is a speed, (c) is a figure which shows an example of an acceleration. The figure which shows an example of the detection signal by swallowing operation | movement when it feels unpleasant by test subject A2, (a) is displacement, (b) is speed, (c) is a figure which shows an example of an acceleration. The figure which shows an example of a power spectrum, (a) is a figure which shows an example of the power spectrum of speed, (b) is a figure which shows an example of the power spectrum of acceleration. The figure which shows an example of the intake speed in a pleasant state or an unpleasant state.

<First Embodiment>
The taste evaluation and diagnosis apparatus according to the first embodiment of the present invention is a body surface motion detection unit such as a body surface acceleration detection unit, and an analysis related to swallowing motion based on signals obtained by the body surface motion detection unit. A storage unit stores a database in which a swallowing motion analysis unit that performs processing, an input unit that inputs taste evaluation data, and the taste evaluation data input by the input unit and an analysis result by the swallowing motion analysis unit are associated with each other Taste evaluation diagnosis for performing processing related to taste evaluation diagnosis based on the database generation unit, the signal obtained by the body surface motion detection unit, and the analysis result by the swallowing motion analysis unit stored in the database of the storage unit And a portion.
In the present embodiment, the swallowing motion analysis unit performs processing for calculating intensity information (power spectrum) of the frequency component of the acceleration signal based on the acceleration signal obtained by the body surface acceleration detection unit. In addition, the database generation unit performs processing for storing a database in which the taste evaluation data, the acceleration signal, and the intensity information of the frequency component of the acceleration signal are associated with each other in the storage unit. The taste evaluation diagnosis unit performs processing related to taste evaluation diagnosis based on the acceleration signal obtained by the body surface acceleration detection unit and the analysis result of the swallowing movement analysis unit stored in the database.

  Hereinafter, embodiments of the present invention will be described with reference to the drawings. The embodiment of the present invention includes the contents shown in the drawings, but is not limited to this. In the following description of each drawing, parts that are common to the parts that have already been described are assigned the same reference numerals, and duplicate descriptions are partially omitted.

  As shown in FIG. 1, the taste evaluation diagnostic apparatus 100 according to the first embodiment of the present invention includes a body surface acceleration detecting unit 1 as a body surface motion detecting unit, and an information processing device 2 (computer). .

  As shown in FIGS. 1 and 2, the body surface acceleration detection unit 1 is disposed at a predetermined body surface position such as the larynx, pharynx, neck, and face of the human body A. Specifically, in the example shown in FIG. 2, the body surface acceleration detecting unit 1 is attached to the front surface of the larynx with an adhesive material such as cellophane tape. When eating food or drink, the body surface acceleration detection unit 1 detects the movement of the human body surface due to swallowing, chewing, or peristalsis, and outputs the detected acceleration signal to the information processing device 2.

Specifically, the body surface acceleration detection unit 1 includes an acceleration sensor 11 (acceleration detection unit), a CPU 12, a communication unit 13, and the like.
As the acceleration sensor 11, a three-axis acceleration sensor such as a capacitance type, a piezoresistive type, or a piezoelectric type can be adopted. The acceleration sensor 11 can detect the acceleration of the sensor itself and the acceleration of gravity. In the example shown in FIG. 2, the vertical direction of the human body A is defined as the x-axis direction, the front-rear direction is defined as the y-axis direction, and the left-right direction is defined as the z-axis direction.

  The CPU 12 performs a process of outputting a signal indicating the acceleration detected by the acceleration sensor 11 via the communication unit 13.

  The communication unit 13 transmits a signal indicating acceleration to the information processing apparatus 2 (computer) through control of the CPU 12 via a wireless or wired communication path.

The information processing apparatus 2 performs a taste evaluation process, a database creation process for taste evaluation, and the like based on a signal indicating acceleration from the body surface acceleration detection unit 1.
As illustrated in FIG. 1, the information processing apparatus 2 includes a communication unit 21, an input unit 22, a display unit 23, a sound generation unit 24, a storage unit 25, a control unit 26 (CPU), and the like. Each component (communication part 21, input part 22, display part 23, sound generation part 24, storage part 25) is electrically connected to control part 26 (CPU) via communication line 27.

  The communication unit 21 communicates with the body surface acceleration detecting unit 1 through a wireless or wired communication path under the control of the control unit 26 and receives a signal indicating acceleration from the body surface acceleration detecting unit 1. To do.

  The input unit 22 is an operation input unit such as a button, a switch, a keyboard, a mouse, or a touch panel, and outputs a signal corresponding to the input to the control unit 26.

The display unit 23 is a display device such as an LED or a liquid crystal display device, and performs display under the control of the control unit 26.
The sound generation unit 24 is a sound generation device such as a speaker, and performs sound generation under the control of the control unit 26.
The storage unit 25 is a storage device such as a RAM, a ROM, a magnetic recording / reproducing device, or an SSD. The storage unit 25 stores programs and various data. The storage unit 25 functions as a work area for executing the program. In addition, the storage unit 25 stores in advance a database that associates the taste evaluation data to be searched with the intensity information of the frequency components to be searched.

The control unit 26 comprehensively controls each component of the information processing apparatus 2. Moreover, the control part 26 implement | achieves the function based on this invention in the information processing apparatus 2 (computer) by running the program memorize | stored in the memory | storage part 25. FIG.
Specifically, the control unit 26 includes a swallowing movement analysis unit 261, a database generation unit 262, a taste evaluation diagnosis unit 263, and the like.

  The swallowing motion analysis unit 261 performs analysis processing related to swallowing motion based on the signal obtained by the body surface acceleration detection unit 1. Specifically, the swallowing movement analysis unit 261 calculates intensity information of the frequency component of the acceleration signal based on the acceleration signal obtained from the body surface acceleration detection unit 1.

  When generating the database, the database generation unit 262 associates, for example, the intensity information of the frequency component of the acceleration signal and the taste evaluation data input by the input unit (operation input unit) as search targets, and stores them in the database DB. The database DB related to the taste evaluation data is generated.

  When an acceleration signal is obtained by the body surface acceleration detection unit 1, the taste evaluation diagnosis unit 263 is stored in the intensity information of the frequency component of the acceleration signal analyzed by the swallowing motion analysis unit 261 and the database DB of the storage unit 25. The processing related to the taste evaluation diagnosis is performed based on the taste evaluation data specified based on the intensity information of the frequency component to be searched.

  In addition, the taste evaluation diagnostic unit 263 specifies taste evaluation data based on feature information (such as a feature pattern) calculated from the intensity information of the frequency component of the acceleration signal.

Next, an example of the movement of the body surface acceleration detecting unit 1 will be described.
For example, as shown in FIGS. 2 and 3, the body surface acceleration detecting unit 1 is attached to the larynx PL of the human body A with an adhesive or the like. Before the subject eats food or drink or before swallowing, the body surface acceleration detecting unit 1 is disposed at the position shown in FIG. The laryngeal protuberance of the larynx PL is due to the thyroid cartilage located in the middle of the throat. During swallowing, the thyroid cartilage and the esophagus move according to the swallowing action, and the protuberance position of the body surface changes.

Specifically, when the subject eats food or drink and swallows, as shown in FIG. 3B, the body surface is displaced according to the swallowing operation, and the body surface acceleration detecting unit 1 corresponds to the swallowing operation. And move. The body surface acceleration detecting unit 1 transmits a signal indicating acceleration during swallowing to the information processing device 2. That is, the position movement of the body surface acceleration detection unit 1 is observed together with the swallowing motion, and sensing related to peristalsis is realized.
The body surface acceleration detector 1 is arranged at a position where it is easy to detect the acceleration of the displacement of the body surface according to the swallowing motion of the subject during eating and drinking.

Next, an example of an acceleration signal obtained by the body surface acceleration detection unit 1 when the subject eats bread as food will be described. 4A to 4C, time is shown on the horizontal axis, and acceleration in the x-axis direction, acceleration in the y-axis direction, and acceleration in the z-axis direction are shown on the vertical axis.
When the subject eats bread, the body surface acceleration detecting unit 1 detects the acceleration of the body surface according to the swallowing motion of the subject. For example, as shown in FIGS. 4 (a) to 4 (c), A signal indicating acceleration in the x-axis direction, acceleration in the y-axis direction, and acceleration in the z-axis direction is output. That is, the body surface acceleration detecting unit 1 detects body surface movement due to continuous swallowing motion or peristaltic motion with high accuracy.

  Next, when the subject swallows food, the motion detection of the body surface of the larynx by the body surface acceleration detection unit and the power spectrum of the acceleration signal detected by the body surface acceleration detection unit will be described.

  In FIG. 5A, the vertical axis represents the acceleration in the x-axis direction during swallowing, and the horizontal axis represents time. The swallowing motion analysis unit 261 of the control unit 26 (CPU) calculates intensity information of the frequency component of the acceleration signal based on the acceleration signal by the body surface acceleration detection unit 1. Specifically, as shown in FIG. 5A, when an acceleration signal is obtained, the swallowing motion analysis unit 261 of the control unit 26 performs signal analysis processing such as Fourier transform processing in FIG. As shown, intensity information of the frequency component of the acceleration signal is calculated. In FIG. 5B, the horizontal axis indicates the frequency, and the vertical axis indicates the power spectrum (the intensity of the frequency component of the acceleration signal). In the example shown in FIG. 5B, the power spectrum is large in the low frequency component and shows a lower value as the frequency becomes higher.

  As shown in FIG. 5B, body surface movement due to continuous swallowing motion and peristaltic motion can be detected by the body surface acceleration detecting unit 1. By quantitatively analyzing the power spectrum, taste evaluation can be performed with respect to sweetness, salty taste, bitterness, umami, deliciousness, and the like.

  In detail, when the subject eats or drinks food or drink, for example, when the subject feels delicious and when the subject feels not delicious, there is a difference in continuous swallowing exercise or peristaltic exercise, and the body surface acceleration detecting unit 1 A difference appears in the power spectrum due to the acceleration signal detected in.

  The inventor of the present application has a difference in the power spectrum according to the acceleration signal detected by the body surface acceleration detecting unit 1 between when the subject feels delicious during eating and drinking and when the subject feels not delicious. It was confirmed by experiment.

Specifically, when the subject felt that it was delicious, a power spectrum as shown in FIG. 6A was obtained from the acceleration signal from the body surface acceleration detector 1. Further, when the subject felt that it was not delicious, a power spectrum as shown in FIG. 6B was obtained from the acceleration signal from the body surface acceleration detecting unit 1.
When the power spectrum is compared, when the subject feels delicious, as shown in FIG. 6A, there is a large peak in the vicinity of a frequency of 0.3 Hz in the low frequency range.

  That is, when the subject feels delicious, the power spectrum has a large peak near the low frequency range of 0.3 Hz, and when the subject feels not delicious, the low frequency range is characteristic around 0.3 Hz. The power spectrum has no peak.

  That is, the taste evaluation diagnosis unit 263 performs signal analysis on the acceleration signal from the body surface acceleration detection unit 1, for example, as feature information calculated from the intensity information of the frequency component of the acceleration signal, as a low frequency in the power spectrum. The taste evaluation related to the subject can be objectively and quantitatively determined based on the information indicating the size of the region peak and the presence or absence of the peak.

  Note that the feature information is not limited to the above-described embodiment. For example, the acceleration information from the body surface acceleration detecting unit 1 is used as a signal analysis, and is obtained by chaos analysis, fractal dimension analysis, attractor analysis, etc. by nonlinear mathematical theory. Information may be used.

  Next, an example of operation | movement at the time of preparation of the database regarding the taste evaluation of the taste evaluation diagnostic apparatus 100 which concerns on this embodiment is demonstrated.

  When creating the database, as shown in FIGS. 1 and 2, the body surface acceleration detecting unit 1 is mounted near the subject's larynx PL. When the subject eats food or drink, taste evaluation data indicating whether or not the subject feels delicious is input by the input unit 22 of the information processing apparatus 2 (computer). The control unit 26 of the information processing device 2 acquires taste evaluation data input from the input unit 22.

In addition, the control unit 26 of the information processing device 2 analyzes the acceleration signal from the body surface acceleration detection unit 1 during eating and drinking by the swallowing motion analysis unit 261, and specifies a different feature pattern (feature information) depending on whether or not it feels delicious. And stored in the database in association with the taste evaluation data.
Specifically, the control unit 26 analyzes the acceleration signal from the body surface acceleration detecting unit 1 during eating and drinking by the swallowing motion analyzing unit 261, calculates intensity information (power spectrum) of the frequency component, and the taste evaluation data And stored in the database DB of the storage unit 25 as a search target.

In the example shown in FIG. 6, the taste evaluation data indicating that the subject feels delicious and the feature information indicating that a peak equal to or higher than the threshold is detected in the vicinity of 0.3 Hz in the low frequency range are associated with the database DB. Is remembered.
Further, taste evaluation data indicating that the subject feels not delicious and feature information indicating that a peak equal to or higher than the threshold is not detected in the vicinity of 0.3 Hz in the low frequency range are associated with each other and stored in the database DB.

  When creating a database related to taste evaluation, the accuracy of taste evaluation improves as the number of subjects increases.

  Next, an example of operation | movement of the taste evaluation diagnostic apparatus 100 at the time of taste evaluation diagnosis is demonstrated. In the database DB of the storage unit 25, the taste evaluation data to be searched and the intensity information of the frequency component to be searched are stored in advance as information obtained at the time of creating the database.

At the time of taste evaluation diagnosis, the body surface acceleration detection unit 1 is attached to the subject's larynx with an adhesive, a double-sided tape, a band, an attachment member, or the like.
As shown in FIG. 7, in step ST <b> 1, when eating or drinking, the body surface acceleration detection unit 1 attached to the subject detects acceleration according to the movement of the body surface such as the subject's pharynx, and the information processing device 2. Sends an acceleration signal.
The control unit 26 acquires the acceleration signal by receiving the acceleration signal from the body surface acceleration detecting unit 1 through the communication unit 21.

  In step ST2, the control unit 26 performs signal analysis on the acceleration signal. Specifically, the swallowing motion analysis unit 261 of the control unit 26 calculates the intensity information of the frequency component from the acceleration signal obtained by the body surface acceleration detection unit 1.

In step ST3, the taste evaluation diagnosis unit 263 of the control unit 26 searches for the intensity information of the frequency component of the acceleration signal obtained by the body surface acceleration detection unit 1 and the database DB of the storage unit 25. The taste evaluation data is specified based on the intensity information of the frequency component of the sound, and the taste evaluation diagnosis process is performed based on the specified taste evaluation data.
In the example shown in FIG. 6, the taste evaluation diagnosis unit 263 specifies taste evaluation data based on feature information calculated from the intensity information of the frequency component of the acceleration signal.

  Specifically, in step ST4, the taste evaluation diagnosis unit 263 determines whether or not there is a peak equal to or higher than a predetermined threshold near 0.3 Hz in the low frequency range in the power spectrum obtained from the acceleration signal. When a peak is detected, taste evaluation data indicating that the subject feels delicious is specified, and evaluated as delicious for the subject (step ST5). For example, the control unit 26 performs processing for displaying taste evaluation data indicating that the subject is evaluated to be delicious on the display unit 23 (step ST6). Further, the control unit 26 may perform a process of generating a sound indicating that the sound generation unit 24 evaluates that the sound is delicious for the subject.

  In step ST4, when the taste evaluation diagnosis unit 263 determines that the power spectrum obtained from the acceleration signal does not have a peak equal to or higher than the predetermined threshold value in the vicinity of 0.3 Hz in the low frequency range, the taste is not delicious by the subject. Taste evaluation data indicating this is specified, and it is evaluated that it is not delicious for the subject (step ST7). For example, the control unit 26 performs processing for displaying taste evaluation data indicating that the subject is evaluated as not delicious on the display unit 23 (step ST8). Moreover, the control part 26 may perform the process which produces | generates the sound which shows that the sound generation part 24 evaluates that it is not delicious for a test subject.

  As described above, the taste evaluation and diagnosis apparatus 100 according to the first embodiment of the present invention is obtained by the body surface acceleration detection unit 1 as the body surface motion detection unit and the body surface acceleration detection unit 1. Swallowing motion analyzer 261 that calculates frequency component intensity information from the acceleration signal, a storage unit 25 that stores in advance a database DB that associates taste evaluation data and intensity information of frequency components to be searched, and body surface When an acceleration signal is obtained by the acceleration detection unit 1, it is specified based on the intensity information of the frequency component of the acceleration signal and the intensity information of the frequency component to be searched stored in the database DB of the storage unit 25. A taste evaluation diagnosis unit 263 that performs a taste evaluation diagnosis based on the taste evaluation data. That is, with a simple configuration, it is possible to provide a taste evaluation and diagnosis apparatus 100 that can perform a taste evaluation diagnosis of a sensory reaction of a human body with respect to food and drink in a noninvasive manner.

  More specifically, the taste evaluation diagnostic apparatus 100 performs signal analysis on the acceleration signal obtained by the body surface acceleration detection unit 1 regarding the taste evaluation of “feeling delicious” and “feeling not delicious” by the subject during eating and drinking. Thus, the taste evaluation diagnosis can be performed with a simple configuration.

  In addition, the taste evaluation diagnostic apparatus 100 does not rely on the subject's sense alone but non-invasively measures the physical surface movement, acceleration, and the like in the neck and throat, which are specific physical quantities, by the body surface acceleration detection unit. Physical sensing and various signal analysis processes, such as time series curve patterns, frequency characteristics by spectral analysis, chaos analysis by nonlinear mathematical theory, fractal dimension analysis, information analysis, etc. It is possible to quantitatively diagnose the taste of sweetness, saltiness, spiciness, astringency, taste, etc., the taste of swallowing, and the functionality.

Moreover, as described above, the taste evaluation diagnostic method of the taste evaluation diagnostic apparatus 100 can be provided. Specifically, a body surface motion detection unit such as the body surface acceleration detection unit 1, a swallowing motion analysis unit that performs analysis processing on swallowing motion based on a signal obtained by the body surface motion detection unit, and taste evaluation Obtained by the input unit for inputting data, the taste evaluation data input by the input unit, and the database generation unit for storing the database in which the analysis result by the swallowing movement analysis unit is associated with the storage unit, and the body surface motion detection unit And a taste evaluation diagnosis unit for performing taste evaluation diagnosis based on an analysis result obtained by the swallowing movement analysis unit stored in the database of the storage unit, The body surface motion detection unit generates a signal (step ST1), the taste evaluation diagnosis unit generates the signal generated by the body surface motion detection unit, and the database of the storage unit A step of performing processing related to taste evaluation diagnosis based on the analysis result of swallowing motion analysis unit stored (step ST4), the.
It is possible to provide a taste evaluation diagnosis method for a taste evaluation diagnostic apparatus that performs a taste evaluation diagnosis of a sensory reaction to food and drink in a non-invasive manner.

  Moreover, if the taste evaluation diagnostic apparatus according to the embodiment of the present invention is applied, the functions of swallowing movement, mastication movement, and peristaltic movement can be easily diagnosed.

  Moreover, if the taste evaluation diagnostic apparatus according to the embodiment of the present invention is applied, it is possible to noninvasively diagnose the peristaltic function of a patient having peristaltic impairment such as aspiration pneumonia.

  In addition, if the taste evaluation diagnostic apparatus according to the embodiment of the present invention is applied, diagnosis of swallowing and peristalsis function before or after surgery related to pharyngeal cancer, laryngeal cancer, esophageal cancer, tracheal cancer, etc. In addition, a wide range of taste evaluation and diagnosis apparatuses can be applied to postoperative evaluation, evaluation of swallowing and peristaltic function of patients with aspiration pneumonia.

Second Embodiment
The taste evaluation and diagnosis apparatus 100A according to the second embodiment of the present invention has a body surface imaging unit as a body surface motion detection unit, images the human throat and its vicinity, The moving image is analyzed, and processing related to taste evaluation diagnosis is performed.

  As shown in FIG. 8, the taste evaluation diagnostic apparatus 100A according to the present embodiment includes a body surface imaging unit 29 and an information processing apparatus 2A (computer).

  The body surface imaging unit 29 (also referred to as the imaging unit 29) as the body surface motion detection unit is provided so as to image a predetermined part of the body surface, such as the larynx PL of the human body A or the vicinity thereof. .

  As the imaging unit 29, for example, a CCD type imaging device, a CMOS type imaging device, a MOS type imaging device, or the like can be adopted. In the present embodiment, a distance image capturing device (distance image capturing camera) that acquires a distance image is employed as the image capturing unit 29. Details of the configuration of the range image capturing apparatus will be described later. Note that a stereoscopic imaging device using a plurality of cameras may be employed as the imaging unit 29.

  The information processing apparatus 2 </ b> A performs a taste evaluation process, a database creation process related to taste evaluation, and the like based on a signal from the body surface imaging unit 29.

  The information processing apparatus 2A (computer) includes a communication unit 21A, an input unit 22, a display unit 23, a sound generation unit 24, a storage unit 25A, a control unit 26A (CPU), an interface 28, and the like. Each component (communication unit 21A, input unit 22, display unit 23, sound generation unit 24, storage unit 25A, interface 28) is electrically connected to a control unit 26A (CPU) via a communication line 27.

  The communication unit 21A performs data communication with another computer (not shown) via a wireless or wired communication path under the control of the control unit 26A. Since the input unit 22, the display unit 23, and the sound generation unit 24 have substantially the same configuration as that of the first embodiment, description thereof is omitted.

  The storage unit 25 stores programs and various data. The storage unit 25 functions as a work area for executing the program. In addition, the storage unit 25 stores a database in which taste evaluation data indicating delicious evaluation, taste evaluation, and the like are associated with a database in which an analysis result obtained by analyzing a time-series image from the imaging unit is associated.

  The control unit 26A comprehensively controls each component of the information processing apparatus 2A and the imaging unit 29. In addition, the control unit 26A executes the program stored in the storage unit 25, thereby realizing the function according to the present invention in the information processing apparatus 2A (computer).

  Specifically, as shown in FIGS. 8 and 9, the control unit 26A includes a swallowing motion analysis unit 261A, a database generation unit 262A, a taste evaluation diagnosis unit 263A, and the like.

  The swallowing motion analysis unit 261A analyzes information such as an image obtained by the imaging unit 29 serving as the body surface imaging unit.

  The database generation unit 262A stores the results analyzed by the swallowing movement analysis unit 261A and the taste evaluation data input by the input unit 22 (operation input unit) in the database DB in association with each other as a search target when the database is generated. Thus, processing for generating a database DB related to taste evaluation data is performed. The database 25 is stored in the storage unit 25.

  The taste evaluation diagnosis unit 263A performs processing related to taste evaluation diagnosis based on the result of analysis of the image (time-series image) from the imaging unit 29 by the analysis unit 161A and the taste evaluation data stored in the database DB of the storage unit 25A. Do.

Next, the swallowing motion analysis unit 261A will be described in detail.
In the present embodiment, as shown in FIG. 9, the swallowing motion analysis unit 261A includes a feature point extraction processing unit 31, an image filter processing unit 32, a separation processing unit 33, a region specifying unit 34, a swallowing fluctuation analysis unit 35, a breathing A fluctuation analysis unit 36 and the like are included.

  To the swallowing motion analysis unit 261A, an image obtained by imaging the larynx of the subject (subject) and the vicinity thereof by the imaging unit 29 is input.

Next, an image captured by the imaging unit 29 (body surface imaging unit) of the present embodiment will be described.
In the present embodiment, a distance image camera is employed as the imaging unit 29. The distance image camera associates and outputs distance information between the imaging unit and the subject (subject) for each pixel of the image.
As a method for acquiring the distance information, for example, a time of flight (TOF) method, a pattern irradiation method, or the like can be employed. In this embodiment, a high-resolution TOF method is adopted.

  The TOF imaging unit receives a normal monochrome image or RGB image, a light projecting unit provided near the imaging sensor for projecting infrared light, and infrared light reflected by the subject. And a light receiving portion. In the TOF method, the distance between the imaging unit and the subject (subject) is determined based on the time from when the light projecting unit projects the subject (subject) to when it is reflected by the subject (subject) and received by the light receiving unit. Get distance information. Specifically, in the phase difference method of the TOF method, the imaging unit and the subject (subject) are projected by projecting pulsed light that flashes at high speed from the light projecting unit and measuring the phase delay of the reflected light received by the light receiving unit. Get distance information between.

  In the pattern irradiation method, a random dot pattern or a predetermined pattern is irradiated to a subject (subject) with a laser beam, and the subject (subject) is detected based on the distortion of the reflected light pattern received by the light receiving unit or a change in the pattern. Get distance information.

  An example of an image obtained by an imaging unit that employs a distance image capturing device is shown in FIG. In the example shown in FIG. 10, the imaging unit displays an image of the subject's human body A, such as the larynx PL and the region in the vicinity of the larynx PL (throat and upper chest), and distance information for each pixel of the image. Output in association. In the distance image shown in FIG. 10, since the distance differs between the laryngeal protuberance of the larynx PL and other portions, the position and movement of the larynx PL can be specified with high accuracy.

<Feature Point Extraction Processing Unit 31>
The feature point extraction processing unit 31 extracts a feature point Pa from the image obtained by the imaging unit 29. For example, the feature point extraction processing unit 31 uses, as a feature point, a pixel having a maximum luminance change based on each pixel of the image and pixels in the vicinity thereof. Various extraction methods such as SIFT (Scale-Invariant Feature Transform) and SURF (Speeded Up Robust Features) can be adopted as a feature point extraction method by the feature point extraction processing unit 31, and an optimum method is adopted. As a result, the extraction accuracy of the fluctuating region can be increased. Further, by extracting feature points based on a distance image in which the image and distance information are associated with each other, it is possible to further improve the extraction accuracy of the fluctuating region.
Note that the feature point extraction processing by the feature point extraction processing unit 31 may be performed by an image processing circuit included in the imaging unit 29.

  In the example shown in FIG. 11, a displacement Pb (flow vector) for each pixel of an image between frames is calculated by an optical flow method based on a plurality of time-series images. In the feature point-based optical flow method, the displacement Pb for each pixel of the image between frames is calculated by specifying the movement destination for each pixel based on the feature point of the time-series image. Based on the displacement Pb for each pixel generated by this optical flow method, the movement of the skin surface of the laryngeal protuberance of the larynx associated with the swallowing operation can be easily identified with high accuracy.

In the above-described embodiment, the optical flow method is employed. However, the present invention is not limited to this embodiment, and various methods can be employed.
In the example illustrated in FIG. 12, the movement of the region corresponding to the laryngeal protuberance of the larynx can be specified based on the time-series image captured by the imaging unit. Specifically, in FIG. 12, the horizontal axis indicates the x-axis (see FIG. 8), the vertical axis indicates the z-axis (see FIG. 8), and these are arranged in time series in the back direction (time axis (T)). A 3D map is created. The time on the time axis T corresponds to the frame number of the time series image. The convex part shown in FIG. 12 corresponds to the laryngeal protuberance of the larynx, and it can be seen that the protuberance shape changes with the passage of time (increase in the frame number). That is, the movement of the skin surface of the laryngeal protuberance of the larynx accompanying swallowing movement can be specified with high accuracy.

<Image Filter Processing Unit 32>
The image filter processing unit 32 (noise removal processing unit) performs noise removal processing on the displacement of each pixel of the time-series image and the feature point of each pixel. Examples of the noise removal process include a smoothing process (moving average filter process, median filter process, etc.).

<Separation processing unit 33>
Based on the image (including feature points) output from the image filter processing unit 32, the separation processing unit 33 includes a portion corresponding to a motion of a frequency (for example, about 0.5 Hz) or more corresponding to the swallowing cycle by the swallowing operation. Then, a process for separating the frequency into parts (including body motion, heart rate variability component, respiratory frequency component, etc.) corresponding to less than the frequency (about 0.5 Hz) is performed.
If there is no need to extract respiratory fluctuations, the separation processing by the separation processing unit 33 may not be performed.

<Area specifying unit 34>
Based on the image (including feature points) output from the image filter processing unit 32, the region specifying unit 34 specifies a region corresponding to the movement of the skin surface accompanying the swallowing operation. Specifically, the region specifying unit 34 specifies a region corresponding to the laryngeal protuberance of the larynx.
Note that the region specifying unit 34 may specify a region corresponding to the laryngeal protuberance of the larynx based on an image (including feature points) subjected to separation processing as necessary by the separation processing unit 33. Specifically, the region specifying unit 34 corresponds to the larynx PL based on, for example, the optical flow method image (including feature points) shown in FIG. 11 or the time-series data shown in FIG. A process for specifying the region and its movement is performed.

A case where a swallowing operation is performed only once by the subject will be described with reference to FIG.
At time T1, as shown in FIG. 13A, at time T1, the larynx PL is located near the upper part of the neck and moves downward (downward in FIG. 13).
Next, at time T2, as shown in FIG. 13B, the larynx PL moves upward (upward in FIG. 13) from the central lower position of the neck.
At time T3, as shown in FIG. 13C, the larynx PL is located near the upper part of the neck.
As described above, the region specifying unit 34 can easily specify the position and movement of the larynx PL due to the swallowing operation with high accuracy based on the integral movement of the predetermined pixel and the vicinity thereof.

<Swallowing fluctuation analysis unit 35>
The swallowing fluctuation analyzing unit 35 is the displacement of the region specified by the region specifying unit 34 (the region corresponding to the larynx PL or the vicinity thereof), the velocity that is the time derivative of the displacement, the power spectrum of the velocity, and the time derivative of the velocity. A certain acceleration and a power spectrum of the acceleration are calculated. The result calculated by the swallowing fluctuation analysis unit 35 is output to the database generation unit 262A at the time of database generation, and output to the taste evaluation diagnosis unit 263A at the time of taste diagnosis evaluation.

  Next, a plurality of subjects (subjects A1 and A2) actually eat and drink food, and when it feels delicious and when it feels unpleasant, the imaging unit picks up the subject's larynx and its nearby region. The result of having analyzed the time series image obtained by doing is shown.

FIG. 14 is a graph showing the movement of the larynx PL when the subject A1 feels that the food is delicious, and FIG. 15 is a graph showing the movement of the larynx PL when the subject A1 feels that the food is tasteless.
FIG. 16 is a graph showing the movement of the larynx PL when the subject A2 feels that the food is delicious, and FIG. 16 shows the movement of the larynx PL when the subject A2 feels that the food is tasteless.

Specifically, in FIGS. 14 (a), 15 (a), 16 (a), and 17 (a), the vertical axis indicates the displacement M of the subject's larynx PL (the reference position is 0). The horizontal axis indicates time (sec). In FIG. 14B, FIG. 15B, FIG. 16B, and FIG. 17B, the vertical axis indicates time differentiation dM / dt, and the horizontal axis indicates time (sec).
Specifically, in FIGS. 14 (c), 15 (c), 16 (c), and 17 (c), the vertical axis represents the second-order derivative d ² M / dt ² with respect to time, and the horizontal axis represents time. (Sec).
The displacement M described above is the magnitude of the displacement vector in consideration of the x component and the y component (and z component if necessary) of the displacement vector.

  14 (a), 15 (a), 16 (a), and 16 (a), the down arrow indicates the timing at which the larynx and esophagus move downward due to the swallowing motion of the subject. When the down arrow is described multiple times, it indicates that the laryngeal protuberance and esophagus of the larynx have moved downward several times due to swallowing movement. The swallowing behavior time Ta (swallowing operation time) indicates the time taken for one swallowing operation.

Actually, the subjects A1 and A2 eat and drink juice as food, and the taste evaluation data indicating that the food is evaluated as delicious or tasteless by the subjects A1 and A2 is input from the input unit.
The database generation unit 262A associates the taste evaluation diagnosis unit data with the result of calculation by the swallowing fluctuation analysis unit 35, and stores it in the storage unit 25A as a database DB.

For example, in the example illustrated in FIG. 14, when the subject A1 swallows the juice, the swallowing operation is performed three times, and the juice is evaluated as delicious.
In the example shown in FIG. 15, when the subject A1 swallows the juice, the swallowing operation is performed three times, and the juice is evaluated as being tasteless.

Moreover, the swallowing fluctuation | variation analysis part 35 calculates the power spectrum of the speed accompanying the swallowing exercise | movement of the area | region corresponding to the laryngeal protuberance of a larynx, as shown to Fig.18 (a). For example, based on the speed graphs shown in FIGS. 14 (b), 15 (b), 16 (b), and 17 (b), the power spectrum of each speed is calculated by Fourier transform processing or the like. The
As a result of the experiment, when the subject feels delicious, a sharp and large peak is obtained with the frequency component of the speed corresponding to the cycle of swallowing movement, and when it feels unpleasant, the peak becomes broad and the peak frequency tends to increase. I found out that

Further, the swallowing fluctuation analyzing unit 35 calculates the power spectrum of the acceleration as shown in FIG. For example, based on the acceleration graphs shown in FIGS. 14 (c), 15 (c), 16 (c), and 17 (c), the power spectrum of each acceleration is calculated by Fourier transform processing or the like. The
As a result of the experiment, when the subject feels delicious, a sharp and large peak is obtained with the frequency component of the acceleration corresponding to the cycle of swallowing movement, and when it feels unpleasant, the peak becomes broad and the peak frequency tends to increase. I found out that

  As described above, there is a tendency that a delicious evaluation and an unfavorable evaluation differ for the power spectrum of displacement, velocity, velocity, acceleration, and acceleration. From this tendency, important parameters for evaluating delicious or unpleasant include swallowing behavior time Ta, speed periodicity, acceleration variation coefficient, speed power spectrum, acceleration power spectrum, and the like. Specifically, as shown in Table 1, analysis can be made regarding swallowing movements.

  The swallowing behavior time Ta (see FIG. 14 (a), FIG. 15 (a), FIG. 16 (a), and FIG. 17 (a)) tends to be short when evaluated as delicious by the subject, and is evaluated as tasteless. Tend to be long.

  Regarding the periodicity of speed (speed amplitude and speed period), if the subject evaluates that it is delicious, the component of the swallowing cycle (frequency component corresponding to the swallowing cycle) resulting from repeated swallowing movements is large, and the rest (swallowing cycle) (Components other than frequency components corresponding to) tend to be small. When the subject evaluates the taste as unpleasant, there is a tendency that a frequency component larger or smaller than the frequency component corresponding to the swallowing cycle resulting from the repeated swallowing operation increases.

  With regard to the acceleration variation coefficient (an index indicating variation), when the subject evaluates that it is delicious, the variation coefficient indicating the variation in acceleration tends to be small in synchronization with the swallowing motion. If the subject evaluates the taste as unfavorable, the acceleration tends to increase asynchronously with the swallowing behavior.

The database generation unit 262A analyzes the taste evaluation data and the image captured by the imaging unit, analyzes that the swallowing exercise and the taste evaluation by the subject have the above-described tendency, and records them in the database. Specifically, the database generation unit 262A performs processing for storing a database in which the taste evaluation data and the analysis result by the swallowing movement analysis unit 261A are associated with each other in the storage unit.
When constructing the database DB, the larger the number of subjects, the better. As the number of subjects increases, the above-mentioned tendency can be clarified from the analysis on the swallowing movement based on the image by the imaging unit in each of the delicious evaluation and the taste evaluation, and the diagnostic accuracy at the taste evaluation diagnosis can be improved. .

  The taste evaluation diagnosis unit 263 performs processing related to taste evaluation diagnosis based on the image captured by the body surface imaging unit 29 and the analysis result by the swallowing motion analysis unit stored in the database DB at the time of taste diagnosis.

<Respiration variation analysis unit 36>
The swallowing motion analysis unit 261 may include a respiratory fluctuation analysis unit 36 that performs analysis processing related to respiratory fluctuations. By providing the respiratory fluctuation analysis unit 36, it is possible to improve the diagnostic accuracy regarding taste evaluation.
Specifically, the respiratory fluctuation analysis unit 36 is a part of the image analysis that is subjected to the separation processing by the separation processing unit 33 and less than a predetermined frequency component (about 0.5 Hz) (body motion, heart rate fluctuation component, respiratory frequency component, etc. For example, by extracting a respiratory frequency component (a frequency component corresponding to the respiratory motion) to detect a change in the body surface according to the breathing of the subject.
The body surface imaging unit 29 captures an image including the chest of the subject as an imaging range, so that a change in the body surface according to the subject's breathing can be easily detected with high accuracy.

<Delicious or tasty evaluation considering breathing action>
From the time-series images obtained by the body surface imaging unit 29, when the subject eats or drinks, the breathing inspiration rate tends to be different between a pleasant state (comfortable state) and an uncomfortable state (uncomfortable state). (See FIG. 19). Specifically, it can be seen that the intake speed is higher in the uncomfortable state (uncomfortable state) than in the pleasant state (comfortable state).

The relationship between delicious evaluation or tasteless evaluation, and the pleasant state and uncomfortable state due to breathing motion will be explained.
It was found that when the subject evaluated that it was delicious, the breathing action was pleasant (a comfortable state), and the inspiration rate tended to be relatively slow.
In addition, it was found that when the subject evaluated that the taste was unpleasant, the breathing motion was uncomfortable (uncomfortable), and the intake speed tended to be relatively fast.
The database generation unit 262 performs processing for storing the database DB in which the taste evaluation data, the analysis result by the respiratory fluctuation analysis unit 36, and the analysis result by the swallowing fluctuation analysis unit 35 are associated with each other in the storage unit 25A.

  The taste evaluation diagnosis unit 263A performs taste evaluation based on the image captured by the body surface imaging unit 29, the analysis result by the swallowing fluctuation analysis unit 35 stored in the database, and the analysis result by the respiratory fluctuation analysis unit 36. Performs diagnostic processing.

  Next, an example of operation | movement at the time of creation of the database regarding the taste evaluation of 100 A of taste evaluation diagnostic apparatuses which concern on this embodiment is demonstrated.

  When creating the database, as shown in FIG. 8, the body surface imaging unit 29 images the subject's larynx PL and its vicinity. When the subject eats food or drink, taste evaluation data indicating whether or not the subject feels delicious is input by the input unit 22 of the information processing apparatus 2A (computer). The control unit 26A of the information processing apparatus 2A acquires the taste evaluation data input from the input unit 22.

  The control unit 26A of the information processing device 2A analyzes an image (signal) from the body surface imaging unit 29 during eating and drinking by the swallowing motion analysis unit 261A, and specifies a different feature pattern (feature information) depending on whether or not it feels delicious. And stored in the database DB of the storage unit 25A in association with the taste evaluation data.

Specifically, the feature point extraction processing unit 31 performs processing for extracting feature points based on the image captured by the imaging unit 29. Next, noise removal processing such as smoothing processing is performed by the image filter processing unit 32. Then, in the image processing, the separation processing unit 33 performs a process of separating a high-frequency component due to the movement of the skin surface accompanying the swallowing operation and a low-frequency component such as heartbeat fluctuation or respiratory fluctuation.
Then, the region specifying unit 34 performs a process of specifying the region of the variable part based on the displacement of the plurality of feature points extracted by the feature point extraction processing unit 31. Next, the swallowing fluctuation analyzing unit 35 performs a process of calculating at least one of the displacement, velocity, velocity power spectrum, acceleration, and acceleration power spectrum of the region identified by the region identifying unit 34.
The respiratory fluctuation analysis unit 36 performs an analysis process on respiratory fluctuations based on the low-frequency component image output from the separation processing unit 33.
Next, the database generation unit 262 performs processing for storing the database DB in which the taste evaluation data, the analysis result by the swallowing fluctuation analysis unit, and the analysis result by the respiratory fluctuation analysis unit 36 are associated with each other in the storage unit 25A.

  Next, an example of operation | movement of the taste evaluation diagnostic apparatus 100A at the time of taste evaluation diagnosis is demonstrated. Information obtained at the time of creating the database is stored in the database DB of the storage unit 25A.

  When eating or drinking, the body surface imaging unit 29 images the subject's larynx PL and its vicinity. The control unit 26A of the information processing device 2A analyzes the image (signal) from the body surface imaging unit 29 by the swallowing motion analysis unit 261A during eating and drinking, and the analysis result and the swallowing stored in advance in the database DB. Based on the analysis result by the fluctuation analysis unit 35, the analysis result by the respiratory fluctuation analysis unit 36, and the taste evaluation data associated therewith, the process related to the taste evaluation diagnosis, specifically, the subject feels delicious, or A process of diagnosing whether it feels unpleasant is performed.

Specifically, the feature point extraction processing unit 31 performs processing for extracting feature points based on the image captured by the imaging unit 29. Next, noise removal processing such as smoothing processing is performed by the image filter processing unit 32. Then, in the image processing, the separation processing unit 33 performs a process of separating a high-frequency component due to the movement of the skin surface accompanying the swallowing operation and a low-frequency component such as heartbeat fluctuation or respiratory fluctuation.
Then, the region specifying unit 34 performs a process of specifying the region of the variable part based on the displacement of the plurality of feature points extracted by the feature point extraction processing unit 31. Next, the swallowing fluctuation analyzing unit 35 performs a process of calculating at least one of the displacement, velocity, velocity power spectrum, acceleration, and acceleration power spectrum of the region identified by the region identifying unit 34.
The respiratory fluctuation analysis unit 36 performs an analysis process on respiratory fluctuations based on the low-frequency component image output from the separation processing unit 33.

  The taste evaluation and diagnosis unit 263A analyzes the image output from the body surface imaging unit 29, the analysis result by the swallowing fluctuation analysis unit 35, and the analysis by the respiratory fluctuation analysis unit 36, which are stored in the database DB in advance. Based on the results and the taste evaluation data associated therewith, processing related to taste evaluation diagnosis, specifically, processing for diagnosing whether the subject feels delicious or tasteless is performed.

As described above, in the taste evaluation and diagnosis apparatus 100A according to the present embodiment, the swallowing movement analysis unit 261A extracts the feature points based on the images captured by the body surface imaging unit 29. 31, a region specifying unit 34 that specifies the region of the variable part based on the displacement of the plurality of feature points extracted by the feature point extraction processing unit 31, and the displacement, speed, and speed of the region specified by the region specifying unit 34 And a swallowing fluctuation analyzing unit 35 that calculates at least one of the power spectrum, acceleration, and acceleration power spectrum. The database generation unit 262 performs processing for storing a database in which the taste evaluation data and the analysis result by the swallowing fluctuation analysis unit 35 are associated with each other in the storage unit 25A. The taste evaluation diagnosis unit 263A performs processing related to taste evaluation diagnosis based on the image captured by the body surface imaging unit 29 and the analysis result by the swallowing fluctuation analysis unit 35 stored in the database DB.
That is, the body surface imaging unit 29 images the larynx PL and the vicinity thereof, and by performing image analysis of the swallowing motion, it is possible to easily perform processing relating to taste evaluation diagnosis non-invasively.

Further, the body surface imaging unit 29 associates and outputs distance information between the body surface imaging unit 29 and the subject for each pixel of the captured image. The feature point extraction processing unit 31 extracts feature points based on the image captured by the body surface imaging unit 29 and distance information.
That is, a distance image capturing device capable of generating a distance image is employed as the body surface imaging unit 29, and feature points can be easily extracted with high accuracy based on the obtained distance image. Further, the region specifying unit 34 can easily specify a region corresponding to the laryngeal protuberance of the larynx based on the time-series distance image. Therefore, the taste evaluation diagnosis unit 263A can perform a process of making a diagnosis with high accuracy regarding taste evaluation.

As described above, the embodiments of the present invention have been described in detail with reference to the drawings. However, the specific configuration is not limited to these embodiments, and there are design changes and the like without departing from the gist of the present invention. Is included in the present invention.
Further, the embodiments shown in the above drawings can be combined with each other as long as there is no contradiction or problem in the configuration or the like.
Moreover, the description content of each figure can become independent embodiment, respectively, and embodiment of this invention is not limited to one embodiment which combined each figure.

  In the above embodiment, the taste evaluation diagnostic apparatus includes a body surface motion detection unit, a swallowing motion analysis unit, an input unit for inputting taste evaluation data, a database generation unit, a taste evaluation diagnosis unit, and the like. However, it is not limited to this form. For example, the taste evaluation diagnostic apparatus may include at least a body surface motion detection unit, a swallowing motion analysis unit, an input unit for inputting taste evaluation data, and a taste evaluation diagnosis unit.

1 ... Body surface acceleration detector (body surface motion detector)
2, 2A Information processing device (computer)
11 ... Accelerometer (acceleration detector)
12 ... CPU
DESCRIPTION OF SYMBOLS 13 ... Communication part 21 ... Communication part 22 ... Input part 25, 25A ... Storage part 26, 26A ... Control part (CPU)
29 ... imaging unit for body surface (motion detection unit for body surface)
DESCRIPTION OF SYMBOLS 31 ... Feature point extraction process part 32 ... Image filter process part 33 ... Separation process part 34 ... Area | region specific part 35 ... Swallowing fluctuation | variation analysis part 36 ... Respiration fluctuation | variation analysis part 100, 100A ... Taste evaluation diagnostic apparatus 261, 261A ... Analysis part 262 , 261A ... database generation unit 263, 263A ... taste evaluation diagnosis unit PL ... larynx

Claims (6)

A body surface motion detector;
A swallowing motion analysis unit that performs analysis processing related to swallowing motion based on the signal obtained by the body surface motion detection unit;
An input unit for inputting taste evaluation data;
A database generation unit that stores a database that associates the taste evaluation data input by the input unit with the analysis result of the swallowing movement analysis unit in a storage unit;
A taste evaluation diagnosis unit that performs processing related to taste evaluation diagnosis based on the signal obtained by the body surface motion detection unit and the analysis result by the swallowing motion analysis unit stored in the database of the storage unit;
A taste evaluation and diagnosis apparatus characterized by comprising: The body surface motion detection unit includes a body surface acceleration detection unit,
The swallowing motion analysis unit performs a process of calculating intensity information of a frequency component of the acceleration signal based on the acceleration signal obtained by the body surface acceleration detection unit,
The database generation unit performs a process of storing in the storage unit a database in which intensity information of frequency components of the taste evaluation data, the acceleration signal, and the acceleration signal is associated,
The taste evaluation diagnosis unit performs processing related to taste evaluation diagnosis based on the acceleration signal obtained by the body surface acceleration detection unit and the analysis result of the swallowing movement analysis unit stored in the database. The taste evaluation diagnostic apparatus according to claim 1, wherein The body surface motion detection unit includes a body surface imaging unit,
The swallowing motion analysis unit extracts a feature point based on an image captured by the body surface imaging unit;
An area specifying unit for specifying an area of a variable part based on displacement of a plurality of feature points extracted by the feature point extraction processing unit;
A swallowing fluctuation analyzing unit that calculates at least one of the displacement, velocity, velocity power spectrum, acceleration, and acceleration power spectrum of the region identified by the region identifying unit;
The database generation unit performs processing for storing in the storage unit a database in which the taste evaluation data and an analysis result by the swallowing fluctuation analysis unit are associated,
The taste evaluation diagnosis unit performs processing related to taste evaluation diagnosis based on an image captured by the body surface imaging unit and an analysis result by the swallowing motion analysis unit stored in the database. The taste evaluation diagnostic apparatus according to claim 1. The body surface imaging unit associates and outputs distance information between the body surface imaging unit and the subject for each pixel of the captured image,
The taste evaluation diagnosis apparatus according to claim 3, wherein the feature point extraction processing unit extracts a feature point based on the image captured by the body surface imaging unit and the distance information. The swallowing motion analysis unit includes a respiratory fluctuation analysis unit that performs an analysis process on respiratory fluctuations based on an image captured by the body surface imaging unit,
The database generation unit performs a process of storing in the storage unit a database in which the taste evaluation data and the analysis result of the respiratory variation analysis unit are associated with each other,
The taste evaluation diagnostic unit is based on the image captured by the body surface imaging unit, the analysis result by the swallowing motion analysis unit stored in the database, and the analysis result by the respiratory fluctuation analysis unit. 4. The taste evaluation diagnosis apparatus according to claim 3, wherein a process related to diagnosis is performed. A body surface motion detection unit, a swallowing motion analysis unit that performs analysis processing on swallowing motion based on a signal obtained by the body surface motion detection unit, an input unit that inputs taste evaluation data, and the input unit A database generation unit that stores a database that associates the input taste evaluation data with the analysis result of the swallowing movement analysis unit in a storage unit, a signal obtained by the body surface motion detection unit, and the storage unit A taste evaluation diagnostic unit for performing a taste evaluation diagnosis based on the analysis result by the swallowing movement analysis unit stored in the database, and a taste evaluation diagnostic method of a taste evaluation diagnostic device,
The body surface motion detection unit generating a signal;
Performing a process related to taste evaluation diagnosis based on a signal generated by the body surface motion detection unit and an analysis result by the swallowing movement analysis unit stored in the database of the storage unit, the taste evaluation diagnosis unit; A taste evaluation diagnostic method for a taste evaluation diagnostic apparatus.

Images