JP2014144077A - Contact pickup system - Google Patents

Contact pickup system Download PDF

Info

Publication number
JP2014144077A
JP2014144077A JP2013013649A JP2013013649A JP2014144077A JP 2014144077 A JP2014144077 A JP 2014144077A JP 2013013649 A JP2013013649 A JP 2013013649A JP 2013013649 A JP2013013649 A JP 2013013649A JP 2014144077 A JP2014144077 A JP 2014144077A
Authority
JP
Japan
Prior art keywords
contact pickup
contact
pickup system
chewing
vibration
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
JP2013013649A
Other languages
Japanese (ja)
Other versions
JP6146855B2 (en
Inventor
Minoru Kimura
穣 木村
Takeshi Mishima
健 三島
Hidenori Nakatani
任▲徳▼ 中谷
Hideo Nakamura
英夫 中村
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Kansai Medical University
Goldendance Co Ltd
Original Assignee
Kansai Medical University
Goldendance Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Kansai Medical University, Goldendance Co Ltd filed Critical Kansai Medical University
Priority to JP2013013649A priority Critical patent/JP6146855B2/en
Publication of JP2014144077A publication Critical patent/JP2014144077A/en
Application granted granted Critical
Publication of JP6146855B2 publication Critical patent/JP6146855B2/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Landscapes

  • Measurement Of The Respiration, Hearing Ability, Form, And Blood Characteristics Of Living Organisms (AREA)

Abstract

PROBLEM TO BE SOLVED: To provide a contact pickup system which can pick up vibration during mastication and vibration during deglutition with high sensitivity and utilize them.SOLUTION: A contact pickup system 1, which contacts the human body and picks up the vibration transmitting through the body tissue, is equipped with a contact pickup body 10 which picks up the vibration and converts it to electric signals and a casing 20 which holds the contact pickup body 10 and has a space 22 at least between a component 21 forming a part of an exterior surface and the contact pickup body 10.

Description

本発明は、人体に接触させて体組織を伝わる振動を拾うコンタクトピックアップシステムに関し、特に、咀嚼の際の振動や嚥下の際の振動を感度よく拾い、咀嚼であるか嚥下であるかを識別可能である様にデータを収集する技術に関するものである。   The present invention relates to a contact pickup system that picks up vibrations transmitted through body tissues by contacting the human body, and in particular, can detect vibrations during mastication and vibrations during swallowing with high sensitivity, and can identify whether it is mastication or swallowing It is related to the technology to collect data.

従来より、治療、介護、及び生活習慣の改善などのために、食事の頻度や速度(以下「食事態様」という)をモニタしたいという要望がある。   Conventionally, there is a desire to monitor the frequency and speed of meals (hereinafter referred to as “meal mode”) for treatment, care, improvement of lifestyle habits, and the like.

例えば、肥満傾向の人は自分ではあまり食べていないと言いながら、実体的には高い頻度で食物を摂取している事がある。またひとくちあたりの咀嚼回数が少ないと肥満になり易いと言われている。ここで咀嚼とは、食物を摂取して粉砕し、唾液と混和して食塊にするまでの一連の過程を言う。   For example, people who are obese tend to eat food at a high frequency, while saying that they do not eat much by themselves. Also, it is said that if the number of chewing times per mouth is small, obesity tends to occur. Here, mastication refers to a series of processes from ingestion of food to pulverization and mixing with saliva to form a bolus.

現代人の咀嚼回数は、弥生時代の人の約6分の1と言われている。咀嚼回数は、食品の量や性状に加え、現在の歯数、唾液分泌能等が影響を与える。現代人の好む食事は、あまり噛まなくても食べることができる軟らかいものが多く、咀嚼回数は次第に減ってきている。咀嚼回数が減ると、あごの骨の発達が遅れたり、虫歯や肥満になり易いなどの健康被害が起こることが報告されており、ひとくちあたり30回以上噛むことが好ましいと言われている。   It is said that the number of chewing times for modern people is about one-sixth that of people in the Yayoi period. The number of chewing cycles is influenced by the current number of teeth and salivary secretion in addition to the amount and properties of food. Many modern people prefer soft meals that can be eaten without much biting, and the number of chewing cycles is gradually decreasing. It has been reported that when the number of chewing cycles decreases, the development of chin bone is delayed, and health damage such as cavities and obesity easily occurs, and it is said that it is preferable to chew at least 30 times per bit.

ひとくちあたりの咀嚼回数と肥満との関連性については様々な研究がなされている。煎餅の初回嚥下までの咀嚼回数と体格との関連を成人期と高齢期に分けて比較検討したある調査(http://www.niph.go.jp/soshiki/koku/kk/sosyaku/report/report2010_6.pdf参照)においては、成人期(20〜64歳)では、咀嚼回数が24回以下の群の男性は、咀嚼回数が25〜30回の群の男性に較べて内臓脂肪蓄積の比率が有意に高く、また咀嚼回数が31回以上の群の男性は、咀嚼回数が25〜30回の群の男性に較べて内臓脂肪蓄積及び肥満の比率が有意に高い。高齢期(65歳以上)では、咀嚼回数が31回以上の群の男性は、咀嚼回数が30回以下の群の男性に較べて痩せ(低栄養)の比率が有意に高い。女性では咀嚼回数と内臓脂肪蓄積との間に統計学的に有意な関連は見られない。以上のように、成人期の男性において、咀嚼回数が少なくても(24回以下)、多くても(31回以上)臓脂肪蓄積の傾向があり、高齢期の男性においては、咀嚼回数が多い(31回以上)人は栄養が不足している傾向がある。咀嚼回数が少ない男性は、成人期の場合は「早食い」、「よく噛まない」といった食行動が肥満に繋がるものと推測されるが、高齢期の場合は肥満との関連は認められない。咀嚼回数が31回以上の男性は、歯数が少ない人の割合が高く、咀嚼能力が低下して「よく噛めない」ため咀嚼回数が増加しているものと推測される。成人期の「よく噛めない」男性の場合は、咀嚼能力の低下が食品選択に影響を与え、炭水化物の摂取量が多くなるなどの栄養摂取バランスの悪化を招き肥満に繋がるものと推測され、高齢期の「よく噛めない」男性の場合は、総摂取エネルギー量や各栄養素の摂取量低下を引き起こしているものと推測される。一方女性の場合は、一般に食品や料理に関する知識が豊富であり、食事や栄養に気を使っている人の割合が高いため、咀嚼回数と体格の間に関連が認められなかったものと推測される。よって、一概に咀嚼回数が多ければ好ましいというわけではなく、適度な咀嚼回数(成人期の男性で25〜30回)があり、歯数等の個人的な要因による影響も考慮して、個々に適度な咀嚼回数を決めることができる。   Various studies have been conducted on the relationship between the number of chewing times per mouth and obesity. A study comparing the relationship between the number of chewing cycles until the first swallowing of rice crackers and the physique for adults and older adults (http://www.niph.go.jp/soshiki/koku/kk/sosyaku/report/ In the report 2010_6.pdf), in adulthood (20-64 years old), men in the group with 24 or less chewing cycles have a higher rate of visceral fat accumulation than men in the group with 25 to 30 chewing cycles. The ratio of visceral fat accumulation and obesity is significantly higher in men in the group with significantly higher chewing frequency than 31 in comparison with men in the group with mastication frequency in 25-30 times. In the elderly (65 years old and over), men in the group with 31 or more chewing cycles have a significantly higher proportion of leanness (undernutrition) than men in the group with 30 or less chewing cycles. There is no statistically significant association between chewing frequency and visceral fat accumulation in women. As described above, in adult men, there is a tendency to accumulate visceral fat even if the number of chewing times is small (less than 24 times) or at most (more than 31 times), and in older men, the number of chewing times is large. (31 times or more) People tend to lack nutrition. For men with a small number of chewing cycles, it is speculated that eating behavior such as “early eating” and “not chewing well” may lead to obesity in adulthood, but there is no association with obesity in older age. It is presumed that men with 31 or more chewing cycles have a high percentage of people with few teeth, and their chewing ability is reduced and they cannot chew well. In the case of males who do not chew well in adulthood, it is speculated that a decline in chewing ability will affect food selection, leading to poor nutritional balance such as increased carbohydrate intake, leading to obesity. It is speculated that men who do not chew well in the period are causing a decrease in the total energy intake and the intake of each nutrient. On the other hand, women are generally knowledgeable about food and cooking, and a high percentage of people are concerned about diet and nutrition, so it is presumed that there was no association between the number of chewing cycles and physique. The Therefore, it is not always preferable if the number of chewing times is large, there is an appropriate number of chewing times (25 to 30 times for male adults), and the individual factors such as the number of teeth are taken into account individually. An appropriate number of chewing cycles can be determined.

また介護の現場では本人の判断力や記憶力が欠如していることも多いので、自己申告により食事態様を管理するのは難しい場合がある。そこで夫々の人が自分の食習慣を客観的に認識できるようなデータを入手して、食習慣を改善する為の材料とすることが望まれている。   In addition, it is often difficult to manage the meal mode by self-reporting because the person's judgment and memory are often lacking in the field of care. Therefore, it is desired that each person obtains data that can objectively recognize their eating habits and uses them as a material for improving eating habits.

食事態様を監視するには、他者が目視で確認する方法が考えられるが、この方法では24時間監視を続けることが難しい。そこで、何らかの装置を用いて、自動的に咀嚼や嚥下の回数やパターンを記録し、食事態様を監視することが望ましい。   In order to monitor the meal mode, there is a method in which another person visually confirms, but it is difficult to continue monitoring for 24 hours with this method. Therefore, it is desirable to record the number and pattern of mastication and swallowing automatically using some device and monitor the meal mode.

従来の食事態様を監視する装置は、例えば特許文献1、2に開示されているものがある。特許文献1に記載された咀嚼センサは、咀嚼の際に外耳道が変形することを利用して、イヤーマイクロホンに小さい孔で外部と通じている気室を設け、気室13内の音圧をマイクロホンで検出することにより、咀嚼回数を測定する(段落0010、0011)。特許文献2に記載された発音・飲食状態検出システムは、骨伝導マイクやコンタクトマイク(音源に直接取り付けて、空気振動を電気信号に変換するマイク)を用いて咀嚼・嚥下・発声に伴う音を検出して電気信号に変換し、FFTを行なって得られた周波数パターンの分布から「飲食状態」であるか「発話状態」であるかを判定する(段落0026、0027)。   For example, there are devices disclosed in Patent Documents 1 and 2, for example, for monitoring a conventional meal mode. The mastication sensor described in Patent Document 1 uses the deformation of the ear canal during mastication to provide an air chamber that communicates with the outside through a small hole in the ear microphone, and the sound pressure in the air chamber 13 is measured by the microphone. The number of mastications is measured by detecting with (paragraphs 0010 and 0011). The pronunciation / eating / drinking state detection system described in Patent Document 2 uses a bone conduction microphone or a contact microphone (a microphone that is directly attached to a sound source and converts air vibration into an electric signal) to generate sounds accompanying mastication, swallowing, and vocalization. It is detected and converted into an electric signal, and it is determined from the distribution of frequency patterns obtained by performing FFT whether it is a “food state” or “speech state” (paragraphs 0026 and 0027).

特開平11−318862号公報Japanese Patent Laid-Open No. 11-318862 特開2008−61790号公報JP 2008-61790 A

しかしながら、特許文献1の咀嚼センサでは、顎が動いたか否かを判定するため、会話等で顎を動かしても反応してしまうので、正確に咀嚼回数だけを測定することができない。   However, in the mastication sensor of Patent Document 1, since it is determined whether or not the jaw has moved, even if the jaw is moved in conversation or the like, it reacts, so that only the number of mastications cannot be measured accurately.

特許文献2の発音・飲食状態検出システムでは、「飲食状態」と「発話状態」とを判定する際に周波数スペクトルの差異を利用する旨や、判定基準となる具体的な周波数が開示されているが、「咀嚼状態」と「嚥下状態」とを判定する際には、周波数スペクトルは利用されず、「発生頻度が高いものを咀嚼状態、低いものを嚥下状態に分けることが可能」と開示されているのみである(段落0038)。従って、特許文献2の開示内容では、発生頻度がどの程度高いものを「咀嚼状態」とし、発生頻度がどの程度低いものを「嚥下状態」とするのかが明確でないため、「咀嚼状態」と「嚥下状態」とを具体的にどのように判別するかを明確に理解することができない。   In the pronunciation / eating / drinking state detection system of Patent Document 2, the fact that a difference in frequency spectrum is used when determining the “eating / drinking state” and the “speech state” and a specific frequency serving as a determination criterion are disclosed. However, when determining the “mastication state” and the “swallowing state”, the frequency spectrum is not used, and it is disclosed that “high occurrence frequency can be divided into mastication state and low one can be divided into swallowing state”. (Paragraph 0038). Therefore, in the disclosure content of Patent Document 2, it is not clear how high the occurrence frequency is the “chew state” and how low the occurrence frequency is the “swallow state”. It is not possible to clearly understand how to specifically identify the “swallowing state”.

また特許文献2には、「コンタクトマイクを用いた場合は咽喉部に付着させるため、骨伝導マイクを用いるものに比べて嚥下音を検出しやすくなる」(段落0040)との記載があるが、実測データが開示されておらず、例えばコンタクトマイクを咽喉部に付着させる程度で本当に嚥下音を検出しやすくなり、正しく嚥下音などの検証をすることができるのか不明である。   In addition, Patent Document 2 has a description that “when a contact microphone is used, it is attached to the throat, so that it is easier to detect swallowing sound than that using a bone conduction microphone” (paragraph 0040). The actual measurement data is not disclosed, and it is unclear whether the swallowing sound can be correctly verified by actually making it easy to detect the swallowing sound, for example, by attaching a contact microphone to the throat.

またコンタクトマイクは会話などの周囲の音を拾うため、特許文献2のように「飲食状態」と「発話状態」とを判定する手段としては適しているであろうが、本発明の場合は周囲の音は雑音であり周囲の音を拾うコンタクトマイクは適していない。   In addition, since the contact microphone picks up surrounding sounds such as conversations, it is suitable as a means for determining the “food state” and “speaking state” as in Patent Document 2, but in the case of the present invention The sound is noisy and a contact microphone that picks up the surrounding sound is not suitable.

一方、コンタクトマイクの代わりに、コンタクトピックアップを用いると、周囲の音の影響を積極的に排除することができる。実際に本発明者らが、市販の骨伝導マイクをコンタクトピックアップ用として鎖骨上及び咽喉部に密着させ、咀嚼の際の振動及び嚥下の際の振動の検出を試みたところ、咀嚼の際にも嚥下の際にも、十分な出力信号を得ることができなかった。   On the other hand, if a contact pickup is used instead of the contact microphone, the influence of ambient sounds can be positively eliminated. Actually, the present inventors tried to detect vibration during mastication and vibration during swallowing by bringing a commercially available bone conduction microphone into close contact with the clavicle and throat for contact pickup. Even during swallowing, a sufficient output signal could not be obtained.

本発明は以上のような従来の課題を考慮してなされたものであり、咀嚼の際の振動や嚥下の際の振動を感度よく拾い、咀嚼であるか嚥下であるかを識別可能である様にデータを収集することができるコンタクトピックアップシステムを提供するものである。   The present invention has been made in consideration of the conventional problems as described above, and can detect vibrations during mastication and vibrations during swallowing with high sensitivity and can identify whether it is mastication or swallowing. A contact pickup system capable of collecting data is provided.

本発明に係るコンタクトピックアップシステムは、人体に接触させて体組織を伝わる振動を拾うコンタクトピックアップシステムであって、振動を拾って電気信号に変換するコンタクトピックアップ本体と、前記コンタクトピックアップ本体を保持し、少なくとも、外面の一部を形成する部材と該コンタクトピックアップ本体との間に、空間が設けられている筺体とを備える。   The contact pickup system according to the present invention is a contact pickup system that picks up vibrations that are transmitted to body tissues by contacting with a human body, the contact pickup body that picks up vibrations and converts them into electrical signals, and holds the contact pickup body, At least a housing having a space provided between a member forming a part of the outer surface and the contact pickup main body is provided.

また、前記空間は、外気から遮断された密閉空間であることが好ましい。   Moreover, it is preferable that the said space is a sealed space cut off from outside air.

また、前記外面の一部を形成する部材の外気側に、人体に対して粘着性を持つ粘着シートを備えることが好ましい。   Moreover, it is preferable to provide the adhesive sheet which has adhesiveness with respect to a human body in the external air side of the member which forms a part of said outer surface.

また、前記コンタクトピックアップ本体より電気信号を受け付け、該電気信号の強さと振動パターンとに基づいて、噛む動作及び飲み込む動作を検出する動作検出部を備える様な態様とすることもできる。   Further, it is possible to adopt an aspect in which an operation detection unit that receives an electrical signal from the contact pickup main body and detects a chewing operation and a swallowing operation based on the strength and vibration pattern of the electrical signal can be employed.

また、食品毎の噛む動作の振動パターンを記憶する記憶部と、前記コンタクトピックアップ本体より電気信号を受け付け、該電気信号の振動パターンを、前記記憶部に記憶された食品毎の噛む動作の振動パターンと比較して、食べた食品を特定する食品特定部を備える様な態様とすることもできる。   In addition, a storage unit that stores a vibration pattern of a biting operation for each food, and an electrical signal received from the contact pickup body, and the vibration pattern of the electric signal stored in the storage unit is stored in the storage unit. Compared to the above, it is also possible to employ a mode in which a food identification unit that identifies a food that has been eaten is provided.

本発明のコンタクトピックアップシステムは、外面の一部を形成する部材とコンタクトピックアップ本体との間に空間が設けられていることにより、該部材を人体に接触させると、該空間が設けられていないときよりも体組織を伝わる振動を感度よく拾うことができる。よって、鎖骨上や咽喉部に該部材を付着させることで咀嚼の際の振動及び嚥下の際の振動を感度よく拾い、咀嚼であるか嚥下であるかを識別可能である様にデータを収集することができる。   In the contact pickup system of the present invention, when a space is provided between the member forming a part of the outer surface and the contact pickup main body, when the member is brought into contact with the human body, the space is not provided. It is possible to pick up vibrations transmitted through the body tissue more sensitively. Therefore, by attaching the member to the clavicle or the throat, vibrations during mastication and vibration during swallowing can be picked up with high sensitivity, and data can be collected so that it is possible to identify whether it is mastication or swallowing. be able to.

本発明の実施形態1に係るコンタクトピックアップシステムの概要を示す図である。It is a figure which shows the outline | summary of the contact pick-up system which concerns on Embodiment 1 of this invention. 図1を図中の一点鎖線Aが通る平面において切断した断面図である。It is sectional drawing cut | disconnected in the plane through which the dashed-dotted line A passes in FIG. 本発明のコンタクトピックアップシステムを用いて、被験者がせんべいを食べるときの振動を測定した結果を示すグラフである。It is a graph which shows the result of having measured the vibration when a subject eats rice crackers using the contact pickup system of the present invention. 比較例としてコンタクトピックアップ本体を鎖骨上に直接貼り付けて、被験者がせんべいを食べるときの振動を測定した結果を示すグラフである。It is a graph which shows the result of having measured the vibration when a test subject eats a rice cracker by sticking a contact pick-up main body directly on a clavicle as a comparative example. 本発明のコンタクトピックアップシステムを用いて、被験者がアーモンドを食べるときの振動を測定した結果を示すグラフである。It is a graph which shows the result of having measured the vibration when a subject eats an almond using the contact pickup system of the present invention. 本発明のコンタクトピックアップシステムを用いて、被験者がお茶を飲んだときの振動を測定した結果を示すグラフである。It is a graph which shows the result of having measured the vibration when a subject drinks tea using the contact pickup system of the present invention. 比較例としてコンタクトピックアップ本体を鎖骨上に直接貼り付けて、被験者がお茶を飲んだときの振動を測定した結果を示すグラフである。It is a graph which shows the result of having measured the vibration when a subject picked up tea directly by sticking a contact pick-up body on a clavicle as a comparative example. 本発明の実施形態2に係るコンタクトピックアップシステムの概要を示す図である。It is a figure which shows the outline | summary of the contact pick-up system which concerns on Embodiment 2 of this invention. 本発明の実施形態3に係るコンタクトピックアップシステムの概要を示す図である。It is a figure which shows the outline | summary of the contact pick-up system which concerns on Embodiment 3 of this invention. 本発明の実施形態4に係るコンタクトピックアップシステムの概要を示す図である。It is a figure which shows the outline | summary of the contact pick-up system which concerns on Embodiment 4 of this invention. 本発明の実施形態5に係るコンタクトピックアップシステムの概要を示す図である。It is a figure which shows the outline | summary of the contact pick-up system which concerns on Embodiment 5 of this invention.

<実施形態1>
以下、図面に示した実施形態に基づいて本発明を詳細に説明する。
<Embodiment 1>
Hereinafter, the present invention will be described in detail based on the embodiments shown in the drawings.

図1に示す本発明の実施形態1に係るコンタクトピックアップシステム1は、コンタクトピックアップ本体10と筺体20とを備える。ここで図2は、図1を図中の一点鎖線Aが通る平面において切断した断面図である。   A contact pickup system 1 according to Embodiment 1 of the present invention shown in FIG. 1 includes a contact pickup main body 10 and a housing 20. Here, FIG. 2 is a cross-sectional view of FIG. 1 cut along a plane through which the alternate long and short dash line A passes.

コンタクトピックアップ本体10は、骨伝導マイクのように人体に接触させて体組織を伝わる振動を拾って電気信号に変換する振動センサであり、ここではダイナミックマイクと同様の構造を持つ。コンタクトピックアップ本体10の外形は、これをモニタリング目的で人体に24時間接触させて使用するケースを想定すれば、一例としておよそ縦0.6mm×横0.48mm×長さ1.6mm程度の大きさからなる略直方体が好ましく、2本の出力ケーブル10a、10bが出ている。   The contact pick-up main body 10 is a vibration sensor that picks up vibrations transmitted through body tissues by contacting with a human body like a bone conduction microphone, and has the same structure as a dynamic microphone here. Assuming a case where the contact pickup body 10 is used in contact with the human body for 24 hours for monitoring purposes, as an example, the outer shape of the contact pickup body 10 is approximately 0.6 mm long × 0.48 mm wide × 1.6 mm long. The substantially rectangular parallelepiped which consists of is preferable, and the two output cables 10a and 10b have come out.

筺体20は、金属やプラスチックなどで形作られた箱であり、外面を形作る中空構造の外部材21、及び、外部材21とコンタクトピックアップ本体10との間の空間22を含む。筺体20の外形は、コンタクトピックアップ本体10よりも一回り大きく、上記使用目的などを勘案すれば、およそ縦1.0mm×横0.8mm×長さ2.0mm程度の大きさからなる略直方体が好ましい。なお、筺体20の外形は角が立っていると扱い難いので、角を丸くした方が望ましい。   The housing 20 is a box formed of metal, plastic, or the like, and includes a hollow outer member 21 that forms an outer surface, and a space 22 between the outer member 21 and the contact pickup body 10. The outer shape of the housing 20 is slightly larger than that of the contact pickup main body 10, and taking into consideration the above-mentioned purpose of use, a substantially rectangular parallelepiped having a size of approximately 1.0 mm in length × 0.8 mm in width × 2.0 mm in length is approximately. preferable. In addition, since the outer shape of the housing 20 is difficult to handle when the corners are standing, it is preferable that the corners are rounded.

空間22が設けられることにより、外部材21を人体に接触させると、空間22が設けられていないときよりも体組織を伝わる振動を感度よく拾うことができる。よって、鎖骨上や咽喉部に該部材を付着させることで咀嚼の際の振動及び嚥下の際の振動を感度よく拾い、咀嚼であるか嚥下であるかを識別可能である様にデータを収集することができる。   By providing the space 22, when the outer member 21 is brought into contact with a human body, vibration transmitted through the body tissue can be picked up with higher sensitivity than when the space 22 is not provided. Therefore, by attaching the member to the clavicle or the throat, vibrations during mastication and vibration during swallowing can be picked up with high sensitivity, and data can be collected so that it is possible to identify whether it is mastication or swallowing. be able to.

また空間22は、外気と連通していてもよいが、外気から遮断された密閉空間にすることが好ましく、該密閉空間とすれば咀嚼の際の振動及び嚥下の際の振動を感度よく拾うことができる。   The space 22 may be communicated with the outside air, but is preferably a sealed space that is cut off from the outside air, so that the vibration during mastication and the vibration during swallowing can be picked up with high sensitivity. Can do.

ここでコンタクトピックアップ本体10は、出力ケーブル10a、10bの一部分が外部材21に保持され、外部材21の略中心に設置されている。なお、コンタクトピックアップ本体10は、空間22が確保されるのであれば、必ずしも外部材21の略中心に設置されなくてもよい。また、コンタクトピックアップ本体10の一部が外部材21の内壁に接触しても問題はないので、例えばコンタクトピックアップ本体10の外形が略直方体である場合には、該略直方体の角の部分が外部材21の内壁に接触していても構わない。また、空間22の全部又は一部に、空洞を多く有するスポンジなどの部材を詰めることにより、実質的に空間22をほとんど狭めることなく、該部材によりコンタクトピックアップ本体10を確実に保持することができる。   Here, in the contact pickup main body 10, a part of the output cables 10 a and 10 b is held by the outer member 21, and is installed at the approximate center of the outer member 21. The contact pickup main body 10 does not necessarily have to be installed at the approximate center of the outer member 21 as long as the space 22 is secured. Further, there is no problem even if a part of the contact pickup main body 10 contacts the inner wall of the outer member 21. For example, when the outer shape of the contact pickup main body 10 is a substantially rectangular parallelepiped, the corner portions of the substantially rectangular parallelepiped are external. It may be in contact with the inner wall of the material 21. Further, by filling a part of the space 22 with a member such as a sponge having many cavities, the contact pickup body 10 can be reliably held by the member without substantially narrowing the space 22. .

なお、コンタクトピックアップ本体10の周り全てに空間を設ける必要はなく、少なくとも外面の一部を形成する部材(外部材21の一部)とコンタクトピックアップ本体10との間に空間を設ければよい。例えば外部材21の図2中の下側の面の部分を、使用する際に人体に接触させる接触部21aとすると、少なくとも接触部21aとコンタクトピックアップ本体10との間に空間22a(図2中の鎖線の部分)を設ければよい。   Note that it is not necessary to provide a space around the contact pickup body 10, and a space may be provided between the contact pickup body 10 and a member that forms at least a part of the outer surface (a part of the outer member 21). For example, when the lower surface portion in FIG. 2 of the outer member 21 is a contact portion 21a that is brought into contact with the human body when used, a space 22a (in FIG. 2) is provided at least between the contact portion 21a and the contact pickup body 10. The chain line portion) may be provided.

<検証>
実施形態1のコンタクトピックアップシステム1を鎖骨上に貼り付けて、体組織を伝わる振動を感度よく拾うことができるかを検証した。また比較のために、筺体20から外した裸のコンタクトピックアップ本体10を直接、鎖骨上に貼り付けて、その他の条件はコンタクトピックアップシステム1とできるだけ同じにして測定を行った。ここでは、コンタクトピックアップ本体10の出力ケーブル10a、10bを、市販のノートパソコンの音声入力端子に接続し、計測用のフリーソフトを使用して、「せんべいを食べる」、「アーモンドを食べる」、「お茶を飲む」の3つの動作を被験者に実際に行ってもらい計測を行った。
<Verification>
The contact pick-up system 1 of Embodiment 1 was affixed on the clavicle, and it was verified whether the vibration transmitted through the body tissue could be picked up with high sensitivity. For comparison, the naked contact pickup main body 10 removed from the housing 20 was directly pasted on the clavicle, and the other conditions were the same as the contact pickup system 1 as much as possible. Here, the output cables 10a and 10b of the contact pickup main body 10 are connected to the audio input terminal of a commercially available laptop computer, and using free software for measurement, "eating rice crackers", "eating almonds", " Measurement was performed by having the subject actually perform the three actions of “Drinking tea”.

図3は、本発明のコンタクトピックアップシステム1を鎖骨上に貼り付けて、被験者がせんべいを食べるときの振動を測定した結果を示すグラフである。図3によれば、せんべいを咀嚼しているとき(以下、「咀嚼時」という)には(図3中のA)、ほぼ一定の周期で電気信号が発生し、せんべいを嚥下しているとき(以下、「嚥下時」という)には(図3中のB)、咀嚼の後に少し遅れて、咀嚼時の3〜4倍ほどの強さの電気信号が発生していることがわかる。   FIG. 3 is a graph showing a result of measuring vibration when the contact pickup system 1 of the present invention is pasted on the clavicle and the subject eats rice crackers. According to FIG. 3, when a rice cracker is chewed (hereinafter referred to as “when chewing”) (A in FIG. 3), an electrical signal is generated at a substantially constant period and the rice cracker is swallowed. (Hereinafter referred to as “at the time of swallowing”) (B in FIG. 3), it can be seen that an electric signal having a strength about 3 to 4 times that at the time of mastication is generated with a slight delay after mastication.

図4は、比較例としてコンタクトピックアップ本体10を鎖骨上に直接貼り付けて、被験者がせんべいを食べるときの振動を測定した結果を示すグラフである。図4によれば、咀嚼時も嚥下時もほとんど電気信号が発生していないことがわかる。   FIG. 4 is a graph showing a result of measuring vibration when the subject picks up rice crackers by attaching the contact pickup body 10 directly on the clavicle as a comparative example. According to FIG. 4, it can be seen that almost no electrical signal is generated during mastication and swallowing.

図5は、図3と同様に本発明のコンタクトピックアップシステム1を用いて、被験者がアーモンドを食べるときの振動を測定した結果を示すグラフである。図5によれば、アーモンド咀嚼時には(図5中のA)、せんべい咀嚼時と同様に、ほぼ一定の周期で電気信号が発生しているが、信号強度が最初は強く、その後急に弱くなり、アーモンド嚥下時には(図5中のB)、咀嚼の後に少し遅れて、せんべい嚥下時よりも明らかに弱い電気信号が発生していることがわかる。   FIG. 5 is a graph showing the results of measuring vibrations when the subject eats almonds using the contact pickup system 1 of the present invention as in FIG. According to FIG. 5, when almond chewing (A in FIG. 5), an electric signal is generated at a substantially constant cycle, as in the case of rice cracker chewing, but the signal strength is initially strong and then suddenly weakens. When swallowing almonds (B in FIG. 5), it can be seen that an electrical signal that is clearly weaker than when swallowing rice crackers is generated with a slight delay after chewing.

図6は、図3と同様に本発明のコンタクトピックアップシステム1を用いて、被験者がお茶を飲んだときの振動を測定した結果を示すグラフである。図6によれば、お茶嚥下時には、比較的大きな電気信号が発生していることがわかる。   FIG. 6 is a graph showing the results of measuring vibrations when the subject drinks tea using the contact pickup system 1 of the present invention, as in FIG. According to FIG. 6, it can be seen that a relatively large electrical signal is generated during the swallowing of tea.

図7は、図4と同様にコンタクトピックアップ本体10を鎖骨上に直接貼り付けて、被験者がお茶を飲んだときの振動を測定した結果を示すグラフである。図7によれば、お茶嚥下時はほとんど電気信号が発生していないことがわかる。   FIG. 7 is a graph showing the results of measuring vibration when the subject picked up tea with the contact pickup body 10 directly pasted on the clavicle as in FIG. According to FIG. 7, it can be seen that almost no electrical signal is generated during the swallowing of tea.

以上の結果から、図3、図5、図6のようにコンタクトピックアップシステム1を鎖骨上に貼り付けた場合には、噛む動作及び飲み込む動作を検出できることがわかる。   From the above results, it can be seen that when the contact pickup system 1 is affixed on the clavicle as shown in FIGS. 3, 5, and 6, it is possible to detect chewing and swallowing motions.

また、図3と図4との比較、及び図6と図7との比較より、コンタクトピックアップシステム1を鎖骨上に貼り付けた場合には、コンタクトピックアップ本体10を鎖骨上に直接貼り付けた場合よりも、咀嚼の際の振動や嚥下の際の振動を感度よく拾えることがわかる。   3 and 4 and FIG. 6 and FIG. 7, when the contact pickup system 1 is attached to the clavicle, the contact pickup body 10 is attached directly to the clavicle. It can be seen that vibration during mastication and vibration during swallowing can be picked up with high sensitivity.

さらに、図3、図5、図6の比較より、食べた食品により異なる振動パターンが得られるので、食べた食品を推定するためのデータとしても活用の可能性がある。   Furthermore, from the comparison of FIG. 3, FIG. 5, and FIG. 6, since different vibration patterns are obtained depending on the eaten food, it may be used as data for estimating the eaten food.

<実施形態2>
図8に示すように、実施形態2のコンタクトピックアップシステム2は、実施形態1におけるコンタクトピックアップシステム1の構成において、さらに、コンタクトピックアップ本体10を外部材21の内面(図8では内部空間の天井面)に固定する固定部材30を備える。
<Embodiment 2>
As shown in FIG. 8, in the contact pickup system 2 of the second embodiment, in the configuration of the contact pickup system 1 in the first embodiment, the contact pickup body 10 is further connected to the inner surface of the outer member 21 (in FIG. 8, the ceiling surface of the inner space). ) Is provided.

固定部材30は、外部材21と同様の金属やプラスチックなどの材質からなる本体部分と、外部材21の内面、及びコンタクトピックアップ本体10に接着材等を用いて接着、あるいは溶着する接続部分とを含む。なお、固定部材30は、外部材21又はコンタクトピックアップ本体10と一体成形により形作られてもよいし、外部材21やコンタクトピックアップ本体10とは独立した部品片であってもよい。   The fixing member 30 includes a main body portion made of a material such as metal or plastic similar to the outer member 21, and an inner surface of the outer member 21 and a connection portion that is bonded or welded to the contact pickup main body 10 using an adhesive or the like. Including. The fixing member 30 may be formed integrally with the outer member 21 or the contact pickup main body 10 or may be a component piece independent of the outer member 21 or the contact pickup main body 10.

<実施形態3>
図9に示すように、実施形態3のコンタクトピックアップシステム3は、実施形態1におけるコンタクトピックアップシステム1の構成に、さらに、人体に対する粘着性を持つ粘着シート40を備える。
<Embodiment 3>
As shown in FIG. 9, the contact pickup system 3 of the third embodiment further includes an adhesive sheet 40 having adhesiveness to the human body in addition to the configuration of the contact pickup system 1 in the first embodiment.

粘着シート40は、接触部21aの外気側に設けられ、筺体20を人体に装着する際に、別途装着のための器具や粘着物を準備する必要がないため大変便利である。   The pressure-sensitive adhesive sheet 40 is provided on the outside air side of the contact portion 21a, and is very convenient because it is not necessary to prepare a separate tool or pressure-sensitive adhesive for mounting the housing 20 on the human body.

<実施形態4>
図10に示すように、実施形態4のコンタクトピックアップシステム4は、実施形態1におけるコンタクトピックアップシステム1の構成に、さらに、動作検出部50を備える。
<Embodiment 4>
As shown in FIG. 10, the contact pickup system 4 of the fourth embodiment further includes an operation detection unit 50 in addition to the configuration of the contact pickup system 1 of the first embodiment.

動作検出部50は、コンタクトピックアップ本体10より電気信号を受け付け、該電気信号の強さと振動パターンとに基づいて、噛む動作及び飲み込む動作を検出する。   The motion detection unit 50 receives an electrical signal from the contact pickup body 10 and detects a chewing motion and a swallowing motion based on the strength of the electrical signal and the vibration pattern.

なお、動作検出部50に、予め噛む動作であるか飲み込む動作であるかを見分けるための条件を設定しておき、該条件に基づいて判断することもできる。ここで該条件とは、例えば、電気信号の強弱、連続する電気信号の長さ及び電気信号の周期性の有無などである。   In addition, it is possible to set a condition for discriminating whether it is a chewing action or a swallowing action in the motion detection unit 50 in advance, and it is also possible to make a determination based on the condition. Here, the conditions include, for example, the strength of the electric signal, the length of the continuous electric signal, and the presence / absence of periodicity of the electric signal.

<実施形態5>
図11に示すように、実施形態5のコンタクトピックアップシステム5は、実施形態1におけるコンタクトピックアップシステム1の構成に、さらに、パターン記憶部60と、食品特定部61とを備える。
<Embodiment 5>
As shown in FIG. 11, the contact pickup system 5 of the fifth embodiment further includes a pattern storage unit 60 and a food identification unit 61 in addition to the configuration of the contact pickup system 1 of the first embodiment.

パターン記憶部60は、食品毎の噛む動作の振動パターンを記憶する。ここで振動パターンとは、例えば、振動の強弱、周波数、連続する振動の長さ、及び振動の周期などの組み合わせである。   The pattern storage unit 60 stores a vibration pattern of a chewing operation for each food. Here, the vibration pattern is, for example, a combination of vibration intensity, frequency, continuous vibration length, vibration period, and the like.

食品特定部61は、コンタクトピックアップ本体10より電気信号を受け付け、該電気信号の変動パターンを、パターン記憶部60に記憶された食品毎の噛む動作の振動パターンと比較して、合致するものがないかを検索し、食べた食品を推定する。   The food identification unit 61 receives an electrical signal from the contact pickup body 10, compares the variation pattern of the electrical signal with the vibration pattern of the chewing operation for each food stored in the pattern storage unit 60, and there is no match. Search for and estimate the food you ate.

なお、矛盾が生じない限り、実施形態1〜5は適宜組み合わせることができる。   In addition, as long as no contradiction arises, Embodiments 1-5 can be combined suitably.

本発明に係るコンタクトピックアップシステム1〜5は、外部材21とコンタクトピックアップ本体10との間に空間22が設けられていることにより、外部材21を人体に接触させると、空間22が設けられていないときよりも体組織を伝わる振動を感度よく拾うことができる。よって、鎖骨上や咽喉部などに外部材21を付着させることで咀嚼の際の振動及び嚥下の際の振動を感度よく拾い、咀嚼であるか嚥下であるかを識別可能である様にデータを収集することができる。   In the contact pickup systems 1 to 5 according to the present invention, since the space 22 is provided between the outer member 21 and the contact pickup main body 10, the space 22 is provided when the outer member 21 is brought into contact with the human body. The vibration transmitted through the body tissue can be picked up more sensitively than when there is not. Therefore, by attaching the outer member 21 on the clavicle, the throat, etc., the vibration during mastication and the vibration during swallowing can be picked up with high sensitivity, and data can be identified so that it is possible to identify whether it is mastication or swallowing. Can be collected.

1〜5 コンタクトピックアップシステム
10 コンタクトピックアップ本体
10a、10b 出力ケーブル
20 筺体
21 外部材
21a 接触部
22 空間
22a 空間
30 固定部材
40 粘着シート
50 動作検出部
60 パターン記憶部
61 食品特定部
DESCRIPTION OF SYMBOLS 1-5 Contact pick-up system 10 Contact pick-up main body 10a, 10b Output cable 20 Housing 21 External material 21a Contact part 22 Space 22a Space 30 Fixing member 40 Adhesive sheet 50 Motion detection part 60 Pattern memory | storage part 61 Food identification part

Claims (5)

人体に接触させて体組織を伝わる振動を拾うコンタクトピックアップシステムであって、
振動を拾って電気信号に変換するコンタクトピックアップ本体と、
前記コンタクトピックアップ本体を保持し、少なくとも、外面の一部を形成する部材と該コンタクトピックアップ本体との間に、空間が設けられている筺体とを備えることを特徴とするコンタクトピックアップシステム。
A contact pick-up system that picks up vibrations transmitted through the body tissue by contacting the human body
A contact pickup body that picks up vibrations and converts them into electrical signals;
A contact pickup system comprising: a member that holds the contact pickup main body and that forms at least a part of an outer surface; and a housing in which a space is provided between the contact pickup main body.
前記空間は、外気から遮断された密閉空間である請求項1に記載のコンタクトピックアップシステム。   The contact pickup system according to claim 1, wherein the space is a sealed space cut off from outside air. 該コンタクトピックアップシステムは、さらに、
前記外面の一部を形成する部材の外気側に、人体に対して粘着性を持つ粘着シートを備える請求項1又は2に記載のコンタクトピックアップシステム。
The contact pickup system further includes:
The contact pickup system according to claim 1, further comprising an adhesive sheet having adhesiveness to a human body on an outside air side of a member forming a part of the outer surface.
該コンタクトピックアップシステムは、さらに、
前記コンタクトピックアップ本体より電気信号を受け付け、該電気信号の強さと振動パターンとに基づいて、噛む動作及び飲み込む動作を検出する動作検出部を備える請求項1〜3のいずれか1項に記載のコンタクトピックアップシステム。
The contact pickup system further includes:
The contact according to claim 1, further comprising an operation detection unit that receives an electrical signal from the contact pickup body and detects a chewing operation and a swallowing operation based on the strength and vibration pattern of the electrical signal. Pickup system.
該コンタクトピックアップシステムは、さらに、
食品毎の噛む動作の振動パターンを記憶する記憶部と、
前記コンタクトピックアップ本体より電気信号を受け付け、該電気信号の振動パターンを、前記記憶部に記憶された食品毎の噛む動作の振動パターンと比較して、食べた食品を特定する食品特定部を備える請求項1〜4のいずれか1項に記載のコンタクトピックアップシステム。
The contact pickup system further includes:
A storage unit for storing a vibration pattern of a chewing action for each food;
A food identifying unit that receives an electrical signal from the contact pickup body, compares a vibration pattern of the electrical signal with a vibration pattern of a chewing operation for each food stored in the storage unit, and identifies a eaten food. Item 5. The contact pickup system according to any one of Items 1 to 4.
JP2013013649A 2013-01-28 2013-01-28 Contact pickup system Active JP6146855B2 (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
JP2013013649A JP6146855B2 (en) 2013-01-28 2013-01-28 Contact pickup system

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
JP2013013649A JP6146855B2 (en) 2013-01-28 2013-01-28 Contact pickup system

Publications (2)

Publication Number Publication Date
JP2014144077A true JP2014144077A (en) 2014-08-14
JP6146855B2 JP6146855B2 (en) 2017-06-14

Family

ID=51424850

Family Applications (1)

Application Number Title Priority Date Filing Date
JP2013013649A Active JP6146855B2 (en) 2013-01-28 2013-01-28 Contact pickup system

Country Status (1)

Country Link
JP (1) JP6146855B2 (en)

Cited By (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR20160120131A (en) * 2015-04-07 2016-10-17 엘지전자 주식회사 Wearalbe terminal and display device wireless communicating with the same
JP2017056053A (en) * 2015-09-17 2017-03-23 カシオ計算機株式会社 Detection system, detection device, notification device, detection method, and program
JP2017060548A (en) * 2015-09-24 2017-03-30 富士通株式会社 Eating and drinking behavior detection device, eating and drinking behavior detection method, and computer program for eating and drinking behavior detection

Families Citing this family (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2016029981A (en) * 2014-07-25 2016-03-07 学校法人関西医科大学 Contact pickup system

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JPH01270865A (en) * 1988-04-22 1989-10-30 Daikin Ind Ltd Mastication measuring device
JPH07171136A (en) * 1993-12-20 1995-07-11 G C:Kk Mastication frequency recording device
JP2009206885A (en) * 2008-02-28 2009-09-10 Audio Technica Corp Microphone
JP2009279122A (en) * 2008-05-21 2009-12-03 Konica Minolta Medical & Graphic Inc Status detector
JP2011169697A (en) * 2010-02-17 2011-09-01 Asahi Kasei Corp Vibration sensor, personal digital assistant

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JPH01270865A (en) * 1988-04-22 1989-10-30 Daikin Ind Ltd Mastication measuring device
JPH07171136A (en) * 1993-12-20 1995-07-11 G C:Kk Mastication frequency recording device
JP2009206885A (en) * 2008-02-28 2009-09-10 Audio Technica Corp Microphone
JP2009279122A (en) * 2008-05-21 2009-12-03 Konica Minolta Medical & Graphic Inc Status detector
JP2011169697A (en) * 2010-02-17 2011-09-01 Asahi Kasei Corp Vibration sensor, personal digital assistant

Non-Patent Citations (2)

* Cited by examiner, † Cited by third party
Title
EDWARD SAZONOV ET AL.: "Non-invasive monitoring of chewing and swallowing for objective quantification of ingestive behavior", PHYSIOL. MEAS., vol. 29(5), JPN6016038166, May 2008 (2008-05-01), pages 525 - 541, ISSN: 0003543828 *
OLEKSANDR MAKEYEV ET AL.: "Automatic food intake detection based on swallowing sounds", BIOMED SIGNAL PROCESS CONTROL., vol. 7(6), JPN6016038168, 1 November 2012 (2012-11-01), pages 649 - 656, ISSN: 0003543829 *

Cited By (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR20160120131A (en) * 2015-04-07 2016-10-17 엘지전자 주식회사 Wearalbe terminal and display device wireless communicating with the same
KR102304744B1 (en) * 2015-04-07 2021-09-24 엘지전자 주식회사 Wearalbe terminal and display device wireless communicating with the same
JP2017056053A (en) * 2015-09-17 2017-03-23 カシオ計算機株式会社 Detection system, detection device, notification device, detection method, and program
JP2017060548A (en) * 2015-09-24 2017-03-30 富士通株式会社 Eating and drinking behavior detection device, eating and drinking behavior detection method, and computer program for eating and drinking behavior detection

Also Published As

Publication number Publication date
JP6146855B2 (en) 2017-06-14

Similar Documents

Publication Publication Date Title
Sazonov et al. Non-invasive monitoring of chewing and swallowing for objective quantification of ingestive behavior
Sazonov et al. A sensor system for automatic detection of food intake through non-invasive monitoring of chewing
Amft et al. Analysis of chewing sounds for dietary monitoring
JP6146855B2 (en) Contact pickup system
US20150208163A1 (en) Wearable Physiological Acoustic Sensor
JP6210417B2 (en) Body sound sensor and body sound diagnostic apparatus
WO2009001449A1 (en) Listening device
US20140251023A1 (en) Chewing monitoring device
Päßler et al. Acoustical method for objective food intake monitoring using a wearable sensor system
TW201511736A (en) Vital signs sensing apparatus and associated method
US20190343452A1 (en) Bruxism monitoring and prevention system
US20170128000A1 (en) Method and apparatus for monitoring a physiological indication associated with functioning of a living animal
US20170035350A1 (en) System and method for detecting bruxism
CN112203588B (en) Wheezing detection device and storage medium
US20170367639A1 (en) Ingestion monitoring systems
Lee Food intake detection using ultrasonic doppler sonar
Olubanjo et al. Detecting food intake acoustic events in noisy recordings using template matching
WO2008053412B1 (en) Method and device for detecting deglutition in babies
TW200938168A (en) An electronic stethoscope and the stepthoscope auscultation method using the same
JP6576045B2 (en) Biologically wearable measuring device and measuring method
Kalantarian et al. A comparison of piezoelectric-based inertial sensing and audio-based detection of swallows
US20200205780A1 (en) Array sonography for detection of esophageal events
JP2007090054A (en) Mouth-related pressure measurement probe and mouth-related pressure measurement device using the same
Min et al. Audio-kinetic model for automatic dietary monitoring with earable devices
JP2016029981A (en) Contact pickup system

Legal Events

Date Code Title Description
A621 Written request for application examination

Free format text: JAPANESE INTERMEDIATE CODE: A621

Effective date: 20151113

A521 Request for written amendment filed

Free format text: JAPANESE INTERMEDIATE CODE: A821

Effective date: 20151113

A521 Request for written amendment filed

Free format text: JAPANESE INTERMEDIATE CODE: A523

Effective date: 20160107

A521 Request for written amendment filed

Free format text: JAPANESE INTERMEDIATE CODE: A821

Effective date: 20160107

A977 Report on retrieval

Free format text: JAPANESE INTERMEDIATE CODE: A971007

Effective date: 20160916

A131 Notification of reasons for refusal

Free format text: JAPANESE INTERMEDIATE CODE: A131

Effective date: 20161011

A521 Request for written amendment filed

Free format text: JAPANESE INTERMEDIATE CODE: A523

Effective date: 20161201

TRDD Decision of grant or rejection written
A01 Written decision to grant a patent or to grant a registration (utility model)

Free format text: JAPANESE INTERMEDIATE CODE: A01

Effective date: 20170425

A61 First payment of annual fees (during grant procedure)

Free format text: JAPANESE INTERMEDIATE CODE: A61

Effective date: 20170512

R150 Certificate of patent or registration of utility model

Ref document number: 6146855

Country of ref document: JP

Free format text: JAPANESE INTERMEDIATE CODE: R150

R250 Receipt of annual fees

Free format text: JAPANESE INTERMEDIATE CODE: R250

S111 Request for change of ownership or part of ownership

Free format text: JAPANESE INTERMEDIATE CODE: R313117

R350 Written notification of registration of transfer

Free format text: JAPANESE INTERMEDIATE CODE: R350

R250 Receipt of annual fees

Free format text: JAPANESE INTERMEDIATE CODE: R250

R250 Receipt of annual fees

Free format text: JAPANESE INTERMEDIATE CODE: R250

S111 Request for change of ownership or part of ownership

Free format text: JAPANESE INTERMEDIATE CODE: R313113

R350 Written notification of registration of transfer

Free format text: JAPANESE INTERMEDIATE CODE: R350

S111 Request for change of ownership or part of ownership

Free format text: JAPANESE INTERMEDIATE CODE: R313113

R350 Written notification of registration of transfer

Free format text: JAPANESE INTERMEDIATE CODE: R350

S531 Written request for registration of change of domicile

Free format text: JAPANESE INTERMEDIATE CODE: R313531

R350 Written notification of registration of transfer

Free format text: JAPANESE INTERMEDIATE CODE: R350

R250 Receipt of annual fees

Free format text: JAPANESE INTERMEDIATE CODE: R250