KR102638583B1 - Multimodal cutaneous sensor and method thereof - Google Patents

Abstract

The multi-modal sensor of the present invention is arrayed on a patch and implemented in a module form, comprising a first sensor consisting of a first sensing gel for measuring electrocardiogram (ECG), a first sensing gel for measuring blood pressure (BP), and a mechanical muscle diagram. It includes a second sensor made of a laminated second sensing gel for measuring (MMG), and a third sensor made of a first sensing gel for measuring electromyography (EMG). Accordingly, the present invention can monitor biological signals by simultaneously measuring them at the same location.

Description

Multi-modal sensor and method of manufacturing the same {MULTIMODAL CUTANEOUS SENSOR AND METHOD THEREOF}

The present invention relates to a multi-modal sensor and a method of manufacturing the same, and in particular, to a wearable multi-modal sensor that can simultaneously measure and monitor biological signals at the same location and a method of manufacturing the same.

Recently, interest in wearable sensing technology has been increasing. Sensors used in wearable sensing technology measure muscle movements such as wrists, fingers, ankles, and knees, kinematic signals such as pulse rate, heart rate, respiration, and blood pressure (BP), and physiological signals such as electrocardiogram (ECG), electromyogram (EMG), and brain waves. Physical signals can be detected. Because these wearable sensing technologies can collect biophysical information of patients, much research is being conducted in the healthcare industry.

As wearable sensors, various sensors based on mechanisms such as piezoelectric effect or capacitive effect have been developed.

In particular, technology is being developed to monitor single physical parameters such as electrocardiogram (ECG) and blood pressure (BP) using non-invasive wearable sensors. Furthermore, the integration of sensors is now being researched into combinations of various sensor types.

Recently, technical studies have been conducted to monitor cardiovascular function, metabolism, or body temperature in athletes by combining ECG electrodes with lactate or glucose sensors.

However, since each sensor monitors a single physical parameter, a plurality of measurement sensors are required to measure biological signals. In addition, since measurements are performed at different locations for each sensor, it is difficult to continuously measure data without interruption in daily activities, and there are structural problems that make it difficult to carry.

Accordingly, the need for a wearable multi-modal sensor that can simultaneously measure and monitor biological signals at the same location and is easy to carry is emerging.

“Development of a wearable smart patch system based on a non-invasive hybrid biosensor for self-management of chronic diseases”, Project report, ‘Bio-medical technology development project’, Kwangwoon University Industry-Academic Cooperation Foundation, 2020.01.31

The present invention is intended to solve the above problems and provides a wearable multi-modal sensor that can simultaneously measure and monitor biological signals at the same location and a method of manufacturing the same.

In addition, it is a gel-type sensor that has excellent adhesion and flexibility, and provides a wearable multi-modal sensor that is easy to carry due to miniaturization and high structural freedom, and a manufacturing method thereof.

In order to achieve the above object, the multi-modal sensor according to an embodiment of the present invention is arrayed in a patch and implemented in a module form, comprising: a first sensor made of a first sensing gel for measuring electrocardiogram (ECG); a second sensor consisting of a first sensing gel for measuring blood pressure (BP) and a second sensing gel for measuring mechanical muscle strength (MMG); and

It may include a third sensor made of a first sensing gel for measuring electromyography (EMG).

In addition, the first sensor includes one or more first sensing gels, including a first sensing gel into which a ground (G) electrode body arranged on one side of the patch is inserted, a first sensing gel into which a (+) electrode body is inserted, and , may include a first sensing gel into which a (-) electrode arranged on the other side of the patch is inserted.

In addition, the first sensing gel for measuring the blood pressure (BP) of the second sensor and the second sensing gel for measuring the mechanical muscle strength (MMG) are composed of a plurality of protrusions on one side facing each other and are constant. Can be arranged at intervals.

The protrusion includes a cylinder, polygonal prism, cone, elliptical cone, polygonal cone, truncated cone, elliptical truncated cone, polygonal cone, hemisphere, hierarchical cone, hierarchical elliptical cone, hierarchical polygonal cone, hierarchical truncated cone, and hierarchical elliptic cone. , a hierarchical polygonal cone, a hierarchical hemisphere, a truncated cone, a truncated elliptical cone, a truncated polygonal cone, a truncated truncated cone, a truncated elliptical cone, a truncated polygonal cone, and a truncated hemisphere. It can be.

Additionally, the second sensing gel for measuring the mechanical muscle strength (MMG) may be coated with a conductive material on one surface where the protrusions are formed.

In addition, the second sensing gel for measuring the mechanical muscle strength (MMG) may be composed of a plurality of contact protrusions on the other surface and arranged at regular intervals.

Additionally, the second sensing gel for measuring mechanical muscle strength (MMG) may include a carbon electrode as an electrode body.

Additionally, the electrode body may have an interdigital shape.

Additionally, the first sensing gel may include polyvinyl chloride (PVC), an insulating material, and a plasticizer and an ionic liquid.

Additionally, the first sensing gel may further include a conductive polymer.

Additionally, the second sensing gel may include a plasticizer in the piezoelectric material.

In addition, the piezoelectric material is polyvinylidene fluoride-trifluoroethylene (PVDF-TrFE, PT), polyvinylidene fluoride (PVDF), polyvinylidene fluoride triofluoroethylene-chloro It may be selected from the group consisting of polyvinylidene fluoride-trifluoroethylene-chlorofluoroethylene (PVDF-TrFE-CFE) and polyvinylidene fluoride-co-hexafluoropropylene (PVDF-HFP).

In addition, the third sensor includes one or more first sensing gels, a first sensing gel into which a (+) electrode body arranged side by side on one side of the patch is inserted, and a first sensing gel into which a ground (G) electrode body is inserted. It may include a first sensing gel into which a gel and a (-) electrode body are inserted.

In addition, among the bio-signals measured by the first sensor, the second sensor, and the third sensor, blood pressure (BP) and Two phase time differences (Dtbe: BP and ECG, Dtem: ECG and MMG) originating from electrocardiogram (ECG) signals can be acquired.

Meanwhile, a method for manufacturing a multi-modal center according to another embodiment of the present invention includes manufacturing a first sensing gel; Preparing a second sensing gel; Forming protrusions by modifying the surfaces of the first and second sensing gels; Inserting an electrode body into the first sensing gel and the second sensing gel; And, manufacturing a sensor module by arranging the first sensing gel and the second sensing gel into which the electrode body is inserted.

The protrusion may be formed into a cone-shaped structure.

In addition, the first sensing gel is implemented with a first sensor that measures electrocardiogram (ECG), a second sensor that measures blood pressure (BP), and a third sensor that measures electromyogram (EMG), and the second sensing gel It can be implemented as a second sensor that measures mechanical muscle strength (MMG).

Additionally, the second sensor may be implemented as a stack of the first and second sensing gels.

In addition, the first sensing gel of the first sensor and the third sensor may be a mixture of an insulating material and a conductive polymer, and the conductive polymer and the insulating material may be mixed at a volume ratio of 0.15:1.

Additionally, the insulating material may be polyvinyl chloride (PVC) mixed with a plasticizer and ionic liquid.

Additionally, the second sensing gel may be a mixture of a piezoelectric material and a plasticizer, and the weight ratio of the piezoelectric material and the plasticizer may be 1:2.

The piezoelectric material is polyvinylidene fluoride-trifluoroethylene (PVDF-TrFE, PT), polyvinylidene fluoride (PVDF), polyvinylidene fluoride triofluoroethylene-chlorofluoro. It may be selected from the group consisting of ethylene (polyvinylidene fluoride-trifluoroethylene-chlorofluoroethylene, PVDF-TrFE-CFE) and polyvinylidene fluoride-co-hexafluoropropylene (PVDF-HFP).

Additionally, the first sensor, second sensor, and third sensor may have conical protrusions formed on one surface attached to the object to maintain a conformal state.

The multi-modal sensor according to the present invention as described above can monitor biological signals by simultaneously measuring them at the same location.

In addition, as a gel-type sensor, it has excellent adhesion and flexibility, and is easy to carry due to miniaturization and high structural freedom.

In addition, it is possible to sensitively sense signals from an object at low power, and in particular, the second sensor unit, in which the first sensing gel (PVDF-TrFe) and the second sensing gel are stacked, is capable of self-driving.

In addition, it has excellent sensing sensitivity and can be applied as a cognitive sensor by attaching it to a robot.

Figure 1 is a diagram schematically showing a wearing state of a multi-modal sensor according to an embodiment of the present invention.
Figure 2 is a diagram schematically showing a multi-modal sensor according to an embodiment of the present invention.
Figure 3 is a diagram showing an actually manufactured multi-modal sensor according to an embodiment of the present invention.
Figure 4 is a diagram showing the surface structure of a actually manufactured second sensor according to an embodiment of the present invention.
Figure 5 is a circuit diagram for explaining the configuration of a multi-modal sensor according to an embodiment of the present invention.
Figure 6 is a usage state diagram showing an example of actual wearing of the multi-modal sensor according to the present invention.
Figure 7 is a graph measuring BP-related responses using a multi-modal sensor according to the present invention.
Figure 8 is a graph measuring MMG-related responses using a multi-modal sensor according to the present invention.
Figure 9 is a graph measuring ECG-related responses using a multi-modal sensor according to the present invention.
Figure 10 is a graph measuring EMG-related responses using a multi-modal sensor according to the present invention.
Figures 11 and 12 are graphs showing muscle mechanics and hemodynamic correlation according to exercise and muscle contraction using the multi-modal sensor according to the present invention.
Figure 13 is a flowchart for explaining a method of manufacturing a multi-modal sensor according to an embodiment of the present invention.

The present invention has an operating principle that is completely different from mechanisms such as piezoelectric effect and capacitance effect, which are known as the operating principles of conventional wearable sensors. In this specification, this is defined as a charge conduction mechanism, which is similar to the operating principle of mechanoreceptors required to effectively detect external stimuli in human skin.

Depending on the type, mechanoreceptors can be classified into slow adaptation (SA) response and rapid adaptation (RA) response. Here, slow adaptation (SA) responds to static touch and pressure, and rapid adaptation (RA) responds to dynamic touch and vibration stimuli.

Several sensing mechanisms, including piezoresistive and capacitive sensors, can maintain signals generated by stimulation and thus achieve slow adaptation (SA). Additionally, they utilize conductive porous structures to achieve excellent electrical conductivity and excellent mechanical properties. A combination was derived, which uses piezoelectric and triboelectric effects to enable a very fast response between turn-on and turn-off events, enabling rapid adaptation (RA) response.

If the slow adaptation (SA) and fast adaptation (RA) signals, which play a very important role in detecting the shape, texture, and movement of objects, are actually implemented, selective and effective signals can be produced compared to the monotonous signals obtained through conventional sensors. By acquiring it, you can respond more smartly to changing situations. Accordingly, the present invention provides heart-related technology through correlation between two or more biological signals.

Specifically, heart health can be predicted through the correlation between electromyography (EMG) and mechanical myography (MMG), which are biosignals related to muscle contraction, and the correlation between blood pressure (BP) and electrocardiogram (ECG), which are kinematic signals related to heart rate. You can. In different environments, when muscle contraction occurs, changes in pulse, blood pressure, and electrocardiogram occur due to fluctuations in blood flow, making measurement data meaningless and leading to inaccurate diagnoses. Diagnosing heart disease through strong correlation between biosignals can be a very effective and reliable method.

Vital signals exhibit slow adaptive (SA) response characteristics, such as electromyography (EMG) and mechanical myography (MMG), and fast adaptive (RA) response characteristics, such as blood pressure (BP) and electrocardiogram (ECG). Using these slow adaptation (SA) response characteristics and fast adaptation (RA) response characteristics, correlations between biological signals can be derived.

Ultimately, the multi-modal sensor of the present invention enables a new form of bio-friendly health monitoring, implements various biosensors into one module and can be easily attached to the skin of the wrist, chest, etc., and has a simple process for slow adaptation ( By simultaneously acquiring two adaptation signals, SA) and rapid adaptation (RA) response, a more analytical approach to various stimuli can be possible. Accordingly, the present invention provides four biological signals, namely, electromyogram (EMG) and electrocardiogram (ECG) corresponding to electrophysiological signals, and blood pressure (BP) and mechanical myogram (MMG) signals corresponding to kinematic signals. All can be measured and monitored simultaneously.

Hereinafter, preferred embodiments of the present invention will be described in detail with reference to the attached drawings to clarify the technical idea of the present invention. In describing the present invention, if it is determined that a detailed description of related known functions or components may unnecessarily obscure the gist of the present invention, the detailed description will be omitted. Components having substantially the same functional configuration among the drawings are given the same reference numbers and symbols as much as possible, even if they are shown in different drawings. For convenience of explanation, if necessary, the device and method should be described together.

Figure 1 is a diagram schematically showing a wearing state of a multi-modal sensor according to an embodiment of the present invention, Figure 2 is a diagram schematically showing a multi-modal sensor according to an embodiment of the present invention, and Figure 3 is an actual This is a diagram showing a manufactured multi-modal sensor according to an embodiment of the present invention, and Figure 4 is a diagram showing the surface structure of a second sensor according to an embodiment of the present invention that was actually manufactured.

1 to 4, the multi-modal sensor can simultaneously measure blood pressure (BP), mechanical myography (MMG), electrocardiogram (ECG), and electromyogram (EMG) at a single location. Accordingly, the multi-modal sensor includes a first sensor 110 for measuring electrocardiogram (ECG), a second sensor 120 for measuring blood pressure (BP) and mechanical muscle strength (MMG), and electromyography (EMG). It may include a third sensor 130 for this purpose. The multi-modal sensor may be implemented in a module form by arranging the first sensor 110, the second sensor 120, and the third sensor 130 in the patch 140. At this time, each sensor may be arranged so that it is located based on the second sensor 120 at the radial artery area where the pulse of the object 10 is measured.

The first sensor 110 may be implemented as a first sensing gel 111, 113, and 115 for measuring an electrocardiogram (ECG). The first sensor 110 may include one or more first sensing gels 111, 113, and 115. In one embodiment, the first sensor 110 is a first sensing gel ( 113) and a first sensing gel 111 with a (+) electrode body inserted, and a first sensing gel 115 with a (-) electrode body inserted arranged on the other side (Outside) of the patch 140. . Meanwhile, the arrangement of the electrodes inserted into the first sensing gels 111, 113, and 115 of the first sensor 110 may be changed according to the designer's design details, and is therefore not limited thereto.

The first sensing gels 111, 113, and 115 are gel-type sensors made of a polymer insulating material, and can be attached to an object and accurately measure signals generated from the object at low power. Here, the insulating material may include polyvinylcholoride (PVC). The first sensing gel (111, 113, 115) may further include a conductive polymer. That is, the first sensing gels 111, 113, and 115 may be implemented by mixing polyvinyl chloride (PVC) and polyaniline (PANi). Accordingly, the first sensing gels 111, 113, and 115 enable a stable and rapid response (RA) function of the electrode and can also improve detection of blood pressure (BP) signals by improving conductivity. In other embodiments, the insulating material may be a variety of known polymer-based materials, or may include combinations of the foregoing known polymers.

In addition, the first sensing gels 111, 113, and 115 may further include a plasticizer. Here, the plasticizer is an additive that reduces the viscosity or plasticity of the material and may include dibutyl adipate (DBA). Furthermore, plasticizers include phthalate-based plasticizers such as di-2-ethylhexyl phthalate (DOP), dibutyl phthalate (DBP), diheptyl phthalate (DHP), and diisodecyl phthalate (DIDP), and ester-based plasticizers such as ethylhexyl adipate. Various polymers such as (DOA), diisobutyl adipate (DIBA), adipic acid ester, adipic acid polyester, tri-2 tylhexyl trimellitate (TOTM), and triisononyl trimellitate (TINTM). It may also contain any one of plasticizers. This plasticizer can improve the elasticity, tensile properties, and flexibility of the first sensing gel.

Additionally, the first sensing gels 111, 113, and 115 may further include an ionic liquid. The ionic liquid can secure the conductivity of the first sensing gels 111, 113, and 115 or supply charge. Accordingly, when the ionic liquid is mixed with the insulating material, it can serve as an insulating film and at the same time serve as a disperser of the ionic liquid component when forming the insulating film. These ionic liquids may include IL as cationic liquids with positive and negative charges. In another embodiment, the ionic liquid is a variety of cationic liquids such as [EMIM][TFSI], [BMI][PF6], [EMI][BF4], [BMI-TFSI], and EMI, BMI, MPP, and Bpi. , DEME, P13, P14, TEA, TEMA, and SBP, and may contain at least one known cation and at least one known anion such as FSA, TFSA, BETA, PF6, and PF4.

The second sensor 120 may be implemented as a stack of a first sensing gel 121 for measuring blood pressure (BP) and a second sensing gel 123 for measuring mechanical muscle strength (MMG). The second sensor 120 has a first sensing gel 121 for measuring blood pressure (BP) and a second sensing gel 123 for measuring mechanical muscle strength (MMG) on one side facing each other. The protrusions (d) are composed of a plurality of protrusions (d) and are arranged at regular intervals. Here, protrusion (d) is a cylinder, polygonal prism, cone, elliptical cone, polygonal cone, truncated cone, elliptical truncated cone, polygonal cone, hemisphere, hierarchical cone, hierarchical elliptical cone, hierarchical polygonal cone, hierarchical truncated cone, hierarchical Various shapes such as red truncated cone, hierarchical polygonal cone, hierarchical hemisphere, truncated cone, truncated elliptical cone, truncated polygon, truncated truncated cone, truncated elliptic truncated cone, truncated polygonal cone, truncated hemisphere, etc. You can have it. In one embodiment, the protrusion d has a conical shape. The shape of these protrusions (d) is intended to improve the sensitivity of the sensor.

Figure 4 shows a photograph of the actually manufactured second sensor 120. (a) is a cross-sectional view of the second sensor 120, showing the stacked structure of the first sensing gel 121 for measuring blood pressure (BP) and the second sensing gel 123 for measuring mechanical muscle strength (MMG). You can check the shape. (b) is a photograph of the surface of the second sensing gel 123 on which protrusions (d) are formed, and (c) is a photograph of the surface of the first sensing gel 121 on which protrusions (d) are formed.

Meanwhile, the second sensing gel 123 is composed of a plurality of contact protrusions on its other surface, that is, on the surface attached to the object 10, and is arranged at regular intervals. Here, the contact protrusions are cylinders, polygonal prisms, cones, elliptical cones, polygonal cones, truncated cones, elliptical truncated cones, polygonal cones, hemispheres, hierarchical cones, hierarchical elliptical cones, hierarchical polygons, hierarchical truncated cones, and hierarchical cones. It can have a variety of shapes, including truncated cones, hierarchical polygonal cones, hierarchical hemispheres, truncated cones, truncated elliptical cones, truncated polygons, truncated cones, truncated elliptical truncated cones, truncated polygonal cones, and truncated hemispheres. there is. In one embodiment, the contact protrusion has a conical shape. The shape of these contact protrusions is intended to increase the contact area with the object 10 to improve adhesion and effectively detect biological signals. That is, if the contact protrusion is configured in a cone shape, it can contact the surface of the object 10 in a conformal contact state compared to the case where the contact protrusion is configured in a flat shape.

Meanwhile, the first sensing gel 121 for measuring blood pressure (BP) is the same as the description of the first sensing gels 111, 113, and 115 for measuring electrocardiogram (ECG) described above and is therefore omitted.

The second sensing gel 123 for measuring mechanical muscle strength (MMG) is a gel-type sensor made of a piezoelectric polymer, capable of self-actuation and serving as a medium that generates a potential difference in response to an external stimulus. Here, piezoelectric materials are materials that generate a potential difference due to mechanical external force, and their piezoelectric properties depend on the degree of arrangement of dipoles. In one embodiment, the piezoelectric material may include polyvinylidene fluoride-trifluoroethylene (PVDF-TrFE, PT). In another embodiment, the piezoelectric material is a polymer piezoelectric material, such as polyvinylidene fluoride (PVDF), polyvinylidene fluoride-trifluoroethylene-chlorofluoroethylene, PVDF-TrFE-CFE. ), polyvinylidenefluoride-co-hexafluoropropylene (PVDF-HFP), etc. are used, or composite materials containing BaTiO3, piezoelectric element (PZT; Piezoelectric Device), etc. are used. It can be included.

In addition, the second sensing gel 123 may further include a plasticizer. Here, the plasticizer is omitted since it is the same as the description of the plasticizer included in the first sensing gel 121. This plasticizer can improve the elasticity, tensile strength, and flexibility of the second sensing gel 123.

Meanwhile, a carbon coating layer may be formed on one side of the second sensing gel 123. This is so that one side of the second sensing gel can function as an electrode. In another embodiment, one side of the second sensing gel 123 is made of conductive materials such as single-walled carbon nanotubes (SWNTs), double-walled carbon nanotubes, multi-walled carbon nanotubes, graphene, and poly(3,4-ethylene). dioxythiophene) polystyrenesulfonate (poly(3,4-ethylenedioxythiophene) polystyrenesulfonate(PEDOT:PSS)), silver nanowire, silver microwire, silver nanoparticle, silver microparticle, gold nanowire, gold microwire, gold nano particles, gold microparticles, copper nanowires, copper microwires, copper nanoparticles, copper microparticles, nickel nanowires, nickel microwires, nickel nanoparticles, nickel microparticles, iron nanowires, iron microwires, iron nanoparticles, It may be coated with any one or more of iron microparticles, aluminum nanowires, aluminum microwires, aluminum nanoparticles, aluminum microparticles, and carbon black powder.

Additionally, the second sensing gel 123 may include an electrode body 125. The electrode body 125 may be implemented with a conductive metal. In one embodiment, the electrode body 125 may be implemented as a carbon electrode. Here, the electrode body 125 may have an interdigital electrode shape. Electrical signals of muscle movement can be obtained through the electrode body 125. At this time, polarization of the second sensing gel 123 due to pulse or muscle movement in the radial artery changes the charge distribution of the first sensing gel 121 for measuring blood pressure (BP), resulting in changes in mechanical stimulation of the skin. can be converted into an electrical signal. That is, the second sensor 120 operates a charge transfer mechanism in response to an external stimulus and can detect signals generated according to the voltage change and ion distribution.

The third sensor 130 may be implemented as a first sensing gel 131, 133, and 135 for measuring electromyography (EMG). The third sensor 130 may include one or more first sensing gels 131, 133, and 135. In one embodiment, the third sensor 130 is a first sensing gel 131 in which (+) electrode elements arranged side by side are inserted on one side of the patch 140 corresponding to the portion in contact with the object 10, ground. (G) It may include a first sensing gel 133 into which an electrode body is inserted and a first sensing gel 135 into which a (-) electrode body is inserted. Meanwhile, the arrangement of the electrodes 136 inserted into the first sensing gels 131, 133, and 135 of the third sensor 130 may be changed according to the designer's design details, and is therefore not limited thereto.

Meanwhile, the first sensing gels 131, 133, and 135 for measuring electromyogram (EMG) are omitted because they are the same as the description of the first sensing gels 111, 113, and 115 for measuring electrocardiogram (ECG) described above. do.

Figure 5 is a circuit diagram for explaining the configuration of a multi-modal sensor according to an embodiment of the present invention.

Referring to FIG. 5, the first sensor 110 implemented as a first sensing gel that measures an electrocardiogram (ECG) performing a sensory function, and the first sensing gel of the second sensor 120 that measures blood pressure (BP) ( 121) and a third sensor 130 implemented with a first sensing gel that measures electromyogram (EMG) and consists of capacitance, resistance, and Warburg impedance, and a second sensor 120 that measures mechanical myogram (MMG) The second sensing gel 123 is composed of resistance and voltage generation. Signal conversion can be performed through the Ardunoi interface (AD8232: ECG, AD8226: EMG).

The diffusion of charge in the first sensing gel occurs by the movement of IL molecules, an ionic liquid, and the alignment of dibutyl apitite (DBA) molecules, a plasticizer, in the dielectric polarization inside the polyvinyl chloride (PVC) gel. That is, the resistor R refers to the resistance to electron transfer caused by PVC and DBA of the first sensing gel. Conductivity C and Warburg impedance W mean conductivity due to the electrical double layer formed by the movement of IL and impedance due to charge diffusion resulting from the movement of IL, respectively. Since the width of the first sensing gel has a sufficiently large area in cm, the Warburg impedance follows a semi-infinite linear diffusion model as shown in (Equation 1).

(Equation 1)

Z_w=σ/ω^(1/2) -jσ/ω^(1/2)

Here, Zw is the Warburg impedance, σ is the Warburg coefficient, ω is the angular frequency (2Ωf, f: frequency), and j is the imaginary constant.

Hereinafter, the effects of the multi-modal sensor according to an embodiment of the present invention will be described. Here, an experiment was performed on a healthy man in his mid-50s without heart disease using the actually manufactured multi-modal sensor shown in FIG. 6.

Figure 6 is a usage state diagram showing an example of actual wearing of the multi-modal sensor according to the present invention.

Referring to FIG. 6, (a) shows an example in which the multi-modal sensor is worn on the wrist, and (b) shows an example in which the second sensor 120 is manufactured by using it between the fingers. In the case of the second sensor 120, which is a stack of the first sensing gel 121 for measuring blood pressure (BP) and the second sensing gel 123 for measuring mechanical muscle strength (MMG), it is more sensitive to stimulation. It is designed to respond well.

Accordingly, four biological signals were measured simultaneously using a multi-modal sensor, and the biological signals acquired through four channels were monitored using an oscilloscope. That is, biosignals related to electrocardiogram (ECG) and electromyogram (EMG) were acquired through the Arduino (AD8232, AD8226) module as an interface, and biosignals related to blood pressure (BP) and mechanical myogram (MMG) were acquired through the second sensor. Obtained directly from (120). All acquired biological signals were monitored through an oscilloscope.

First, biosignals related to blood pressure (BP) and mechanical muscle strength (MMG), which correspond to kinematic signals, were obtained by separating them into two channels from the second sensor 120.

Figure 7 is a graph measuring BP-related responses using a multi-modal sensor according to the present invention.

Referring to Figures 4 and 7 (a), the blood pressure (BP)-related response is obtained by acquiring biological signals from an Ag electrode connected to the PANi-PVC gel, which is the first sensing gel 121 of the second sensor 120, using an oscilloscope. It was monitored through.

Referring to (b), pulse rate and blood pressure curves could be identified from voltage changes measured under resting and post-exercise conditions.

For more intuitive monitoring, simultaneous measurements were made with a commercial cuff blood pressure monitor (Omron, HEM 6311), and the relationship was calculated by matching the voltage and blood pressure measurements. For systolic blood pressure (SBP), y = 2.6x + 93.5 (R = 0.91), and for diastolic blood pressure (DBP), y = 3.1x + 63.1 (R = 0.9). In this equation (graph inserted in c), the voltage change value is converted to BP level. Referring to (c), characteristic peaks P1 and P2 between systole and diastole were identified.

Additionally, referring to (d), when using a gripper, the change in blood pressure (BP) response tends to increase as the strength of the gripping force increases. This attempt is the result of indirectly showing the correlation between muscle contraction and heart rate, and can serve as the basis for a future correlation between mechanical myogram (MMG) and electrocardiogram (EMG).

Figure 8 is a graph measuring MMG-related responses using a multi-modal sensor according to the present invention.

Referring to Figures 4 and 8 (a), mechanical myogram (MMG), one of the signals generated during muscle contraction, is included in the PVDF-TrFe gel, which is the second sensing gel 123 of the second sensor 120. Biosignals were acquired from the carbon electrode 125 and monitored through an oscilloscope.

Referring to (b), large voltage changes were observed depending on the movement of the wrist, and fluctuations in biosignals were also confirmed depending on the degree of muscle contraction during movement. From these signals, it was possible to see a signal trend that was distinct from muscle contraction and relaxation, and it was confirmed that there was a signal deviation in the difference in the strength of the hand grip.

Referring to (c), biosignals regarding mechanical myogram (MMG) were obtained and shown from isometric muscle contraction using grasping force. The trends in vital signs regarding mechanical muscle strength (MMG) obtained by attaching sensors to the wrist and arm were similar, but the values in the arm were slightly larger.

Referring to (d), as the input frequency increased, the mechanical myogenic (MMG) response period increased, but the voltage amplitude decreased. Additionally, it can be seen that the second sensing gel 123 of the second sensor 120 has frequency responsiveness.

Unlike the above-mentioned kinematic signals, three or more conductive electrodes are generally required to measure electrical and physical biosignals. In the case of an electrocardiogram (ECG), a variety of complementary information about the heart can be obtained by attaching about 12 electrodes to the chest, arms, and legs at the hospital. However, the present invention uses three first sensing gel-based first sensors 110 and third sensors 130, which are components of a multi-modal sensor, to measure biosignals related to electrocardiogram (ECG) and electromyogram (EMG). Measured.

Figure 9 is a graph measuring ECG-related responses using a multi-modal sensor according to the present invention.

Referring to Figures 4 and 9 (a), a measurement method using the first sensor 110 of the multi-modal sensor attached to the chest and wrist is shown. Measurements were made by placing the (+) electrode and the ground electrode in contact with the skin surface and placing the opposite finger on the (-) electrode exposed on the outside of the patch.

Referring to (b), the biosignals related to the electrocardiogram (ECG) obtained from the chest and wrist in a stable state are compared with the results measured using commercial ECG electrodes of Ag/AgCl.

Referring to the graph inserted in (c), the typical P, Q, R, S, and T peaks that appear in electrocardiogram (ECG) signals were confirmed, and the T peak was also found to increase when measured at the wrist.

Referring to (c), electrocardiogram (ECG) signals measured at the wrist at rest and after light exercise were compared. Changes in pulse occurred at the electrocardiogram peak (rest: ~60, post-exercise: ~83), and the T value rose relatively after exercise.

Common electrocardiogram (ECG) electrodes use metal or hydrogel-based electrodes. However, in the case of metal electrodes, they are uncomfortable when in contact with the skin surface and it is difficult to create a conformal state on the skin surface. In addition, hydrogel dries easily under normal conditions and can be used continuously, so it is difficult to trust measured values after a certain period of time. Referring to (d), since the gel electrode used in the first sensor 110 of the present invention is based on non-hydrogel, stability was maintained even when measured after about 1 month.

Figure 10 is a graph measuring EMG-related responses using a multi-modal sensor according to the present invention.

Referring to Figures 4 and 10 (a), electromyography (EMG) is measured through a third sensor 130 including three first sensing gels 131, 133, and 135 in contact with the wrist and calf skin. Vital signs were obtained. Referring to (b), the size of the signal was found to increase depending on the force pressing the gripper. Although electromyography (EMG) signals have the disadvantage of interfering with electric fields or current flow inside and outside the body, electromyography (EMG) signals can play a complementary role compared to mechanical myography (MMG) signals.

In addition to muscle contraction caused by mechanical force, electromyography (EMG) signals were also measured during wrist flexion and extension. Referring to (c), unlike the mechanical muscle strength (MMG) signal, it shows a shape more similar to rapid response (RA) characteristics. Referring to (d), the third sensor 130 of the multi-modal sensor attached to the calf shows signals for isotonic muscle movement when standing or sitting and biosignals when kicking. Different electromyography (EMG) signals were obtained for two different actions, indicating that various movements of the body can be classified.

Figures 11 and 12 are graphs showing muscle mechanics and hemodynamic correlation according to exercise and muscle contraction using the multi-modal sensor according to the present invention.

The relationship between muscles and the heart is important in screening for or predicting heart disease.

The health of the heart is determined by two phase time differences (Δtbe: BP and ECG) resulting from the electromyographic (EMG) and mechano-myelographic (MMG) signals generated during muscle contraction and the simultaneously changing blood pressure (BP) and electrocardiogram (ECG) signals. , Δtem: ECG and MMG) were acquired and monitored.

Simultaneous measurement of vital signals and their correlations and correlations and phase differences between heart and muscles

PTT (Pulse Transit Time) is the time between the R peak of the electrocardiogram (ECG) wave and the reference point of the pulse wave measured at the periphery of the body, and refers to the time for the pulsating pressure wave to be transmitted from the aortic valve to the periphery. The R peak of electrocardiogram (ECG) and the P1 peak of blood pressure (BP) are indicators of ventricular depolarization, and the time difference between R and P1 was calculated to obtain PTT. Here, PTT was designated as Δtbe.

Electromyography (EMG) and mechanical myography (MMG) signals generated during muscle contraction are correlated with electrocardiogram (ECG) signals. This is because muscle movement changes the diameter and flow of blood vessels, affecting cardiac activity. At this time, the time difference between the R peak of the electrocardiogram (ECG) and the first exposure of the mechanical myogram (MMG) signal was defined as Δtem. The mechanical myogram (MMG) signal was selected because it is free from electrical interference from the human body and surroundings compared to the electrocardiogram (EMG) signal. Additionally, the electromyogram (EMG) signal was used for cross-verification with the mechanical myogram (MMG) signal.

First, referring to (a) of FIG. 11, four biological signals measured during the rest period are shown. During the resting period, electrocardiogram (EMG) and mechanical myogram (MMG) signals were barely found, and blood pressure (BP) and electrocardiogram (ECG) signals were obtained clearly as usual. In this case, the PTD between the R peak of the electrocardiogram (ECG), known as PTT, and the P1 peak of blood pressure (BP) is called Δtbe.

Also, referring to (b) of FIG. 11, four biological signals that appear in isometric muscle contraction at rest are shown. When a gripping action was performed by applying a grip force of 29 kg, the output voltage of electromyogram (EMG) and mechanical myogram (MMG) appeared in the form of signals of RA, respectively. Additionally, blood pressure (BP) and electrocardiogram (ECG) signals also show signal deformation due to muscle movement, but it has been difficult to obtain intact signals from electrocardiogram (ECG). In the case of blood pressure (BP), the blood pressure (BP) curve could be obtained immediately even though the voltage baseline had moved.

It can be said that each biosignal change trend in response to muscle contraction is very unique.

Referring to Figure 11 (c), the signals of electromyogram (EMG) and mechanical myogram (MMG) after light running are slightly different from the rest period. However, because there was no direct muscle movement, no changes in cognitive signals were confirmed.

Referring to Figure 11 (d), four biological signals were displayed when the grasping action was performed again after exercise. As shown in (b), the grasping action was applied for a long time (~15 seconds), and clear blood pressure (BP) and electrocardiogram (ECG) signals were obtained during the grasping time. Since electrocardiogram (ECG), an electrical signal, can be interfered with by electrical biosignals such as electromyogram (EMG), it appears that there was signal disturbance in a short period of time. Additionally, to obtain the MMG signal more clearly, the differential value was used to obtain the phase difference (Δtme) between the R peak of the electrocardiogram (ECG) and the initial firing peak of the MMG. At this time, electromyography (EMG) is an important signal that mutually confirms the firing peak of the mechanical myogram (MMG). In general, electromyography (EMG) is a biosignal used for muscle movement, but mechanical myography (MMG) is also preferred because there is electromagnetic interference inside and outside the body when acquiring electrical signals such as electrocardiogram (ECG).

In the present invention, it was confirmed that there was almost no phase difference between electromyography (EMG) and mechanical myography (MMG).

Therefore, various analyzes are possible with the four biological signals acquired simultaneously.

Referring to (a) of FIG. 12, changes in the electromyography (EMG) signal according to the distribution of blood pressure (BP) while being held were tracked. As grip strength increases, the level of electromyography (EMG) signal increases almost continuously, but there are relatively no significant changes in both SBP and DBP. This is due to isometric muscle contraction, but using larger muscles and over longer periods of muscle use will result in different magnitudes. Also, referring to (b) of FIG. 12, the signal size of mechanical muscle strength (MMG) increases with increasing grip strength in the resting state, but the change in Δtem is very small between 205 and 210, so it does not affect the phase difference (Δtem). It appeared to have no significant effect.

Conversely, these results mean that when using weak muscles at rest, irregularities in heart-related biology (Δtem irregularities or large phase differences) may signal a red alert for heart health. Referring to (c) of FIG. 12, the blood pressure distribution according to the increase in Δtbe and Δtme before and after exercise can be confirmed through the act of grasping during muscle exercise. Δtbe tends to decrease as SBP and DBP increase. In heart disease, SBP, which is directly related to the left ventricle, showed y = -0.51 x 268 (R = -0.98), and DBP showed y = -0.45x + 229 (R = -0.95).

Referring to (d) of FIG. 12, under the same conditions, Δtme tends to saturate for ~280ms. As SBP changes, the relationship between Δtbe and Δtme tends to be inversely proportional. These results can predict heart disease due to irregular PTD, or maintain PTD within a safe range with electrical stimulation therapy.

Referring to Figure 12(e), the correlation between changes in SBP and Δtbe and Δtem is shown.

Figure 13 is a flowchart for explaining a method of manufacturing a multi-modal sensor according to an embodiment of the present invention.

Referring to Figures 4 and 13, first, a first sensing gel is prepared (S210). For this purpose, a gel-type sensor can be manufactured by mixing polymer materials such as insulating materials, plasticizers, ionic liquids, and conductive polymers. At this time, the first sensing gel was prepared by fixing the weight ratio of polyvinyl chloride (PVC) as an insulating material, dibutyl apitite (DBA) as a plasticizer, and IL as an ionic liquid at 1:2:0.2.

Afterwards, polyaniline (PANi), a conductive polymer, was mixed with the first sensing gel. Here, polyaniline (PANi) was mixed based on the reference. That is, 0.286 g (1.25 mmol) of ammonium persulfate was dissolved in 1 mL of deionized water. An aniline solution was prepared by mixing 0.921 mL (1 mmol) of phytic acid, 0.458 mL (5 mmol) of aniline, and 2 mL of deionized water. Afterwards, polyaniline (PANi) was sufficiently dried in a drying oven and then mixed with the first sensing gel in a volume ratio.

Meanwhile, polyvinyl chloride (PVC), an insulating material, was purchased from Scientific Polymer Products Inc., and dibutyl apitite (DBA), a plasticizer, was obtained from TCI Chemicals (1-ethyl-3-methylimidazolium bis(trifluoromethylsulfonyl) imide) IL and Tetrahydrofuran was purchased from Sigma-Aldrich. Aniline, ammonium persulfate, and phytic acid were also purchased from Sigma-Aldrich. All chemicals were used without purification or pretreatment.

Next, prepare a second sensing gel (S220). For this purpose, a gel-type sensor can be manufactured by mixing polymer materials such as piezoelectric materials and plasticizers. At this time, the second sensing gel was prepared so that the weight ratio of polyvinyl fluoride trifluoroethylene (PVDF-TrFe), a piezoelectric material, and dibutyl apitite (DBA), a plasticizer, was 1:2.

Commercial PVDF-TrFe powder was purchased from Piezotech (FC30).

Then, the surfaces of the first and second sensing gels are modified by drop casting into a mold to form protrusions (S230). At this time, the protrusion is formed into a cone-shaped structure.

Afterwards, the electrode body is inserted into the first and second sensing gels (S240). An Ag wire, which is an electrode for acquiring signals from a sensor, is inserted into the first sensing gel, and a carbon electrode, which is an electrode that fits between fingers, is inserted into the second sensing gel. Here, the carbon electrode can be implemented as an internal electrode in a type that fits between the fingers (8×8 mm ² , line width: 0.6 mm). Additionally, the second sensing gel may form a carbon coating layer on one surface facing the first sensing gel.

Next, a multi-modal sensor is manufactured (S250). That is, the sensor module is manufactured by arranging the first sensing gel and the second sensing gel into which the electrode body is inserted.

The first sensing gel may be implemented as a first sensor that measures electrocardiogram (ECG), a second sensor that measures blood pressure (BP), and a third sensor that measures electromyogram (EMG). At this time, in the case of the first and third sensors that measure electrocardiogram (ECG) and electromyogram (EMG), which must be composed of conductive electrodes, the conductive polymer of the first sensing gel and the insulating material (PANi:PVC) have a volume ratio of 0.15:1. was fixed uniformly.

The second sensing gel may be implemented as a second sensor that measures mechanical muscle strength (MMG). At this time, the second sensor 120 is implemented in a form in which the first sensing gel 121 and the second sensing gel 123 are stacked.

The multi-modal sensor has a structure in which one side attached to the object 10 has conical protrusions formed to maintain a conformal state, and the other side attached to the patch 140 has a flat structure. In addition, among the multi-modal sensors, all sensors except the first sensor 115 arranged outside the patch 140 are implemented to contact the object 10.

The multi-modal sensor is implemented in a module form by arranging the first sensor 110, the second sensor 120, and the third sensor 130 in a patch 140. At this time, each sensor may be arranged so that it is located based on the second sensor 120 at the radial artery area where the pulse of the object 10 is measured.

That is, the first sensor 110 may be implemented as a first sensing gel 111, 113, and 115 for measuring an electrocardiogram (ECG). The first sensor 110 may include one or more first sensing gels 111, 113, and 115. In one embodiment, the first sensor 110 is a first sensing gel ( 113) and a first sensing gel 111 into which a (+) electrode is inserted, and a first sensing gel 115 into which a (-) electrode arranged on the other side (Outside) of the patch 140 is inserted. .

The second sensor 120 is implemented as a stack of the first sensing gel 121 and the second sensing gel 123.

The third sensor 130 may be implemented as a first sensing gel 131, 133, and 135 for measuring electromyography (EMG). The third sensor 130 may include one or more first sensing gels 131, 133, and 135. In one embodiment, the third sensor 130 is a first sensing gel 131 in which (+) electrode elements arranged side by side are inserted on one side of the patch 140 corresponding to the portion in contact with the object 10, ground. (G) It may include a first sensing gel 133 into which an electrode body is inserted and a first sensing gel 135 into which a (-) electrode body is inserted.

Accordingly, the present invention can establish new and reliable health indicators by measuring various biosignals. Moreover, it can be applied as a cognitive sensor by attaching it to a robot, and has the convenient advantage of being able to monitor health status by using it in real life.

So far, the present invention has been examined in detail, focusing on the preferred embodiments shown in the drawings. These embodiments are not intended to limit the invention but are merely illustrative and should be considered from an illustrative rather than a limiting perspective. The true scope of technical protection of the present invention should be determined by the technical spirit of the appended claims rather than the foregoing description. Although specific terms are used in this specification, they are used only for the purpose of explaining the concept of the present invention and are not used to limit the meaning or scope of the present invention described in the claims. Each step of the present invention does not necessarily have to be performed in the order described, but may be performed in parallel, selectively, or individually. Those skilled in the art to which the present invention pertains will understand that various modifications and other equivalent embodiments are possible without departing from the essential technical spirit of the present invention as claimed in the patent claims. Equivalents should be understood to include not only currently known equivalents but also equivalents developed in the future, that is, all components invented to perform the same function regardless of structure.

110: first sensor 120: second sensor
130: Third sensor
111, 113, 115, 121, 131, 133, 135: first sensing gel
123: Second sensing gel
116, 125, 136: electrode body
140: patch

Claims (23)

Arrayed in patches and implemented in module form,
A first sensor made of a first sensing gel for measuring electrocardiogram (ECG); a second sensor consisting of a first sensing gel for measuring blood pressure (BP) and a second sensing gel for measuring mechanical muscle strength (MMG); and
It includes a third sensor made of a first sensing gel for measuring electromyography (EMG),
Among the bio-signals measured by the first sensor, the second sensor, and the third sensor, blood pressure (BP) and electrocardiogram (ECG) that change simultaneously with the electromyogram (EMG) and mechanical myotogram (MMG) signals generated during muscle contraction ( A multi-modal sensor characterized by acquiring two phase time differences (Dtbe: BP and ECG, Dtem: ECG and MMG) originating from the ECG signal. According to paragraph 1,
The first sensor is,
Comprising one or more first sensing gels,
A first sensing gel into which a ground (G) electrode body is inserted and a first sensing gel into which a (+) electrode body is inserted arranged on one side of the patch,
A multi-modal sensor comprising a first sensing gel into which a (-) electrode arranged on the other side of the patch is inserted. According to paragraph 1,
A first sensing gel for measuring the blood pressure (BP) of the second sensor and a second sensing gel for measuring the mechanical muscle strength (MMG),
A multi-modal sensor characterized by a plurality of protrusions on one surface facing each other and arranged at regular intervals. According to paragraph 3,
The protrusions are,
Cylinder, polygonal prism, cone, elliptic cone, polygonal cone, truncated cone, elliptical truncated cone, polygonal cone, hemisphere, hierarchical cone, hierarchical elliptical cone, hierarchical polygonal cone, hierarchical truncated cone, hierarchical elliptic cone, hierarchical multi-cone It is characterized by being one of a variety of shapes, such as a truncated pyramid, a hierarchical hemisphere, a truncated cone, a truncated elliptical cone, a truncated polygon, a truncated truncated cone, a truncated elliptical cone, a truncated polygonal cone, and a truncated hemisphere. A multi-modal sensor. According to paragraph 4,
The second sensing gel for measuring the mechanical muscle strength (MMG) is,
A multi-modal sensor, characterized in that a conductive material is coated on one surface where the protrusions are formed. According to clause 5,
The second sensing gel for measuring the mechanical muscle strength (MMG) is,
A multi-modal sensor characterized by a plurality of contact protrusions on the other surface arranged at regular intervals. According to clause 6,
The second sensing gel for measuring the mechanical muscle strength (MMG) is,
A multi-modal sensor characterized by comprising a carbon electrode as an electrode body. In clause 7,
The electrode body is a multi-modal sensor, characterized in that the shape of the electrode is interdigital. According to paragraph 1,
The first sensing gel is,
A multi-modal sensor characterized by the insulating material polyvinyl chloride (PVC) containing a plasticizer and ionic liquid. According to clause 9,
The first sensing gel is,
A multi-modal sensor characterized by further comprising a conductive polymer. According to paragraph 1,
The second sensing gel is,
A multi-modal sensor characterized in that the piezoelectric material contains a plasticizer. According to clause 11,
The piezoelectric material is,
Polyvinylidene fluoride-trifluoroethylene (PVDF-TrFE, PT), Polyvinylidene fluoride (PVDF), Polyvinylidene fluoride-trifluoroethylene (Polyvinylidene fluoride- A multi-modal sensor characterized in that it is selected from the group consisting of trifluoroethylene-chlorofluoroethylene (PVDF-TrFE-CFE) and polyvinylidene fluoride-co-hexafluoropropylene (PVDF-HFP). According to paragraph 1,
The third sensor is,
Comprising one or more first sensing gels,
Characterized by comprising a first sensing gel into which a (+) electrode body is inserted arranged side by side on one side of the patch, a first sensing gel into which a ground (G) electrode body is inserted, and a first sensing gel into which a (-) electrode body is inserted. A multi-modal sensor. delete Preparing a first sensing gel;
Preparing a second sensing gel;
Forming protrusions by modifying the surfaces of the first and second sensing gels;
Inserting an electrode body into the first sensing gel and the second sensing gel; and,
It includes manufacturing a sensor module by arranging the first sensing gel and the second sensing gel into which the electrode body is inserted,
The first sensing gel is implemented with a first sensor that measures electrocardiogram (ECG), a second sensor that measures blood pressure (BP), and a third sensor that measures electromyogram (EMG),
The second sensing gel is implemented as a second sensor that measures mechanical muscle strength (MMG),
Among the bio-signals measured by the first sensor, the second sensor, and the third sensor, blood pressure (BP) and electrocardiogram (ECG) that change simultaneously with the electromyogram (EMG) and mechanical myotogram (MMG) signals generated during muscle contraction ( A method of manufacturing a multi-modal sensor characterized by acquiring two phase time differences (Dtbe: BP and ECG, Dtem: ECG and MMG) originating from an ECG signal. According to clause 15,
The protrusions are,
A method of manufacturing a multi-modal sensor, characterized in that it is formed into a cone-shaped structure. delete According to clause 15,
A method of manufacturing a multi-modal sensor, characterized in that the second sensor is implemented in a stacked form of the first sensing gel and the second sensing gel. According to clause 15,
The first sensing gel of the first sensor and the third sensor is,
Mix a conductive polymer with an insulating material,
A method of manufacturing a multi-modal sensor, characterized in that the conductive polymer and the insulating material are mixed at a volume ratio of 0.15:1. According to clause 19,
A method of manufacturing a multi-modal sensor, characterized in that the insulating material is polyvinyl chloride (PVC) mixed with a plasticizer and an ionic liquid. According to clause 15,
The second sensing gel is,
Mix the piezoelectric material and plasticizer,
A method of manufacturing a multi-modal sensor, characterized in that the weight ratio of the piezoelectric material and the plasticizer is 1:2. According to clause 21,
The piezoelectric material is,
Polyvinylidene fluoride-trifluoroethylene (PVDF-TrFE, PT), Polyvinylidene fluoride (PVDF), Polyvinylidene fluoride-trifluoroethylene (Polyvinylidene fluoride- Method for manufacturing a multi-modal sensor, characterized in that selected from the group consisting of trifluoroethylene-chlorofluoroethylene (PVDF-TrFE-CFE) and polyvinylidene fluoride-co-hexafluoropropylene (PVDF-HFP) . In paragraph 15
A method of manufacturing a multi-modal sensor, wherein the first sensor, the second sensor, and the third sensor have conical protrusions formed on one surface attached to the object to maintain a conformal state.