JP2021035402A - Measurement device and measurement method - Google Patents

Abstract

To provide a measurement device which has a more simplified structure, hardly interferes other component, and further reduces fine adjustment of a sensor position and deviation of a sensor, for reducing a load in attachment of the sensor and a measurement load.SOLUTION: A measurement device for measuring a pulse wave and a respiratory waveform of a person who experiences a virtual reality or an augmented reality, comprises: a first pulse wave sensor for detecting a pulse wave of a person; a temperature sensor for detecting a temperature of expired gas of a person; and holding means in which, an inner shape and an outer shape of a prescribed part are formed into a shape corresponding to a dorsum of a nose of an external nose of a person, other part is formed so as to surround a nostril of the external nose and a space with a prescribed capacity on the surrounding of the nostril, the holding means holding the first pulse wave sensor on an inside of a part formed into the shape corresponding to the dorsum of nose so as to contact the dorsum of nose when being attached to a person, and holding the temperature sensor on the part surrounding the nostril and the surrounding space of the nostril so as to detect a temperature of expired gas of the person which is discharged into the space when being attached to a person.SELECTED DRAWING: Figure 3

Description

The present invention relates to a measuring device and a measuring method, and more particularly to a measuring device and a measuring method for measuring a human pulse wave and a respiratory waveform.

With the development of sensing technology, it has become possible to calculate various biological indicators such as heart rate, respiratory rate, and sweating amount by measuring biological information. In the field of Virtual Reality (VR), there are many systems that incorporate biometric information measurement.

Systems that include multiple devices for sensing, detecting, or measuring physiological and phenotypic data streams related to human experience over time, processors configured to synchronize the data streams to obtain synchronized data. A system that includes, a step of selecting feature data that describes at least (one) human state from synchronized data, and a step of modeling feature data using a locally weighted polynomial regression model. A system has been proposed that includes steps to process feature data modeled using multivariate self-regression state space modeling to identify at least (one) potential trends, including (eg,). , Patent Document 1).

Further, it is mounted on at least one of the frontal contact portion that contacts the frontal region of the wearer, the temporal contact portion that contacts the temporal region of the wearer, and the frontal contact portion and the temporal contact portion. A head-mounted display including a biometric information acquisition sensor for detecting the biometric information of the wearer and a display for displaying an image to the wearer has been proposed (see, for example, Patent Document 2).

International Publication No. 2019/086856 Pamphlet Japanese Unexamined Patent Publication No. 2013-258555

When measuring the biological information of a user who is experiencing VR, it is common to attach the sensor directly to the user's body. During the VR experience, a sensor is attached in addition to the head mounted display (HMD) to acquire the electrocardiogram, pulse wave, and respiratory waveform that are effective in calculating emotions, tension, and excitement. There is a need. In addition, there are many VR content experiences that are performed while moving the body, but at that time, it is conceivable that the biometric information sensor shifts due to the body movement. For stable measurement, it is necessary to fix the sensor to the body even during the VR content experience. As described above, in the biometric information measurement method using the existing wearable sensor, it is difficult to easily sense the biometric information during the VR experience. If the sensor is provided on the head-mounted display itself, the configuration becomes complicated and the cost increases.

The present invention has been made in view of such a situation, and has a simpler configuration, is less likely to get in the way, fine-tunes the position of the sensor and reduces the deviation of the sensor, and the load of mounting the sensor and the load of the sensor. This is intended to make it possible to further reduce the measurement load.

The measuring device of one aspect of the present invention is a measuring device for measuring the pulse wave and the respiratory waveform of a person who is experiencing virtual reality or augmented reality, and is a first pulse wave sensor for detecting the pulse wave of the person. A temperature sensor that detects the temperature of a person's exhaled breath, and the inner and outer shapes of a predetermined part are formed in a shape corresponding to the back of the nostril of the person's outer nose, and the other parts are the outer nostrils and the outer part of the person's outer nostril. A first pulse wave sensor that is formed to surround a predetermined volume of space around the nostrils and is in contact with the back of the nose when worn on a person, inside a portion formed in a shape corresponding to the back of the nostril. A holding means for holding a temperature sensor in a portion surrounding the outer nostrils and the space around the outer nostrils so that the temperature of the exhaled breath of the person discharged into the space when worn by the person can be detected.

Of the portions of the holding means, the portion corresponding to the back of the nose can be formed in the shape of a triangular pyramid in which one surface portion is open.

The first pulse wave sensor is brought into contact with one of the two surfaces of the back of the nose divided by the ridgeline from the base of the nose to the tip of the nose to detect the pulse wave of a person, and from the base of the nose to the tip of the nose of the person. A second pulse wave sensor that detects a person's pulse wave in contact with the other of the two surfaces of the back of the nose divided by the ridgeline of the nose can be further provided.

The distance from the tip of the person's nose to the first pulse wave sensor can be different from the distance from the tip of the person's nose to the second pulse wave sensor.

The signal from the first pulse wave sensor and the signal from the second pulse wave sensor are acquired, and the feature amount of the signal from the first pulse wave sensor and the feature amount of the signal from the second pulse wave sensor are used. , A signal processing means for selecting either a signal from the first pulse wave sensor or a signal from the second pulse wave sensor and supplying it to the outside can be further provided.

The first pulse wave sensor irradiates the person with light of a predetermined wavelength that passes through the human skin and is absorbed by the oxidized hemoglobin in the blood, and detects the light reflected from the person to generate a pulse wave. It can be detected.

The time constant of the temperature sensor can be less than 50 milliseconds.

The temperature sensor can be a thermopile.

The holding means can be formed with a locking portion for locking to the head-mounted display.

The measuring method of one aspect of the present invention is a measuring method for measuring the pulse wave and the respiratory waveform of a person who is experiencing virtual reality or augmented reality, and covers the nostril and the outside of the nostril of the person. A pulse wave sensor that surrounds a predetermined volume of space around the nostrils and is in contact with the back of the nose detects a person's pulse wave, and a temperature sensor detects the temperature of the person's exhaled breath discharged into the space around the nostrils. Is detected.

As described above, according to the present invention, the simpler configuration is less likely to get in the way, the fine adjustment of the sensor position and the deviation of the sensor are reduced, and the load of mounting the sensor and the measurement load are further reduced. be able to.

It is a figure which shows the example of use of the measuring apparatus. It is a figure which shows the wearing state of the measuring apparatus 11. It is a figure which shows the example of the structure of the measuring apparatus 11. It is a block diagram which shows the structure of the function of the signal processing unit 71. It is a rear view seen from the rear upper side which shows the details of the structure of the holding part 41. It is a top view seen from the upper side which shows the details of the structure of the holding part 41. It is a side view seen from the left rear side which shows the details of the structure of the holding part 41. It is a side view seen from the right rear side which shows the details of the structure of the holding part 41. It is a figure which shows the example of the result of the measurement of the pulse wave of the person 12 by the measuring device 11. It is a figure which shows the example of the result of the measurement of the respiratory waveform of a person 12 by a measuring device 11.

Embodiments of the present invention will be described below, and the correspondence between the constituent requirements of the present invention and the embodiments described in the detailed description of the invention will be illustrated as follows. This description is for confirming that the embodiments supporting the present invention are described in the detailed description of the invention. Therefore, even if there is an embodiment that is described in the detailed description of the invention but is not described here as an embodiment corresponding to the constituent elements of the present invention, that is the case. It does not mean that the embodiment does not correspond to the constituent requirements. On the contrary, even if the embodiment is described here as corresponding to the constituent requirements, it means that the embodiment does not correspond to the constituent requirements other than the constituent requirements. It's not something to do.

The measuring device of one aspect of the present invention is a measuring device (for example, the measuring device 11 of FIG. 3) for measuring the pulse wave and the respiratory waveform of a person who is experiencing virtual reality or augmented reality, and is a human pulse wave. A first pulse wave sensor (for example, pulse wave sensor 42-1 in FIG. 3) for detecting the temperature of a person's exhaled breath (for example, a temperature sensor 44 in FIG. 3), and a predetermined portion of the temperature sensor. The inner and outer shapes are formed to correspond to the nostrils of the human outer nostril, and the other parts are formed to surround the outer nostrils of the human outer nostrils and a predetermined volume of space around the outer nostrils, and the nostrils. Inside the part formed in a shape corresponding to the back, the first pulse wave sensor is held so as to be in contact with the back of the nostril when worn on a person, and the part surrounding the outer nostrils and the space around the outer nostrils. Includes a holding means (eg, holding portion 41 in FIG. 3) that holds a temperature sensor so that the temperature of the exhaled breath of a person discharged into the space when worn by a person can be detected.

The first pulse wave sensor is brought into contact with one of the two surfaces of the dorsum of the nose divided by the ridgeline from the base of the nose to the tip of the nose to detect the pulse wave of a person, and from the base of the nose to the tip of the nose of the person. A second pulse wave sensor (for example, pulse wave sensor 42-2 in FIG. 3) that is in contact with the other of the two surfaces of the back of the nose divided by the ridgeline of the nose and detects a person's pulse wave can be further provided.

The signal from the first pulse wave sensor and the signal from the second pulse wave sensor are acquired, and from the feature amount of the signal from the first pulse wave sensor and the feature amount of the signal from the second pulse wave sensor. , A signal processing means (for example, the signal processing unit 71 of FIG. 4) for selecting either the signal from the first pulse wave sensor or the signal from the second pulse wave sensor and supplying it to the outside is further provided. Can be done.

The holding means can be formed with locking portions (for example, the right locking portion 54 and the left locking portion 55 in FIG. 3) for locking to the head-mounted display.

Hereinafter, the measuring device according to the embodiment of the present invention will be described with reference to FIGS. 1 to 10.

FIG. 1 is a diagram showing an example of using the measuring device according to the embodiment of the present invention. The measuring device 11 is attached to the outer nose of the person 12. The measuring device 11 measures the pulse wave and the respiratory waveform of the person 12. For example, person 12 is experiencing virtual reality. That is, the measuring device 11 measures the pulse wave and the respiratory waveform of the person 12 who is experiencing the virtual reality or the augmented reality. The person 12 wears the head-mounted display 13 in order to experience the virtual reality. The head-mounted display 13 is attached to the person 12 so as to cover a part of the measuring device 11 attached to the eyes and ears of the person 12 and the outer nose of the person 12. The measuring device 11 supplies the measured pulse wave and respiratory waveform signals to the outside via the cable 21.

The measuring device 11 is locked to the head-mounted display 13 by a hook-and-loop fastener, double-sided tape, or the like. Further, the measuring device 11 is sandwiched between the face of the person 12 and the head-mounted display 13, so that the deviation from the face of the person 12 is further reduced.

FIG. 2 is a diagram showing a state in which the measuring device 11 is attached. When the measuring device 11 is attached to the person 12, it comes into contact with the back of the nose of the person 12. Further, when the measuring device 11 is attached to the person 12, it surrounds the outer nostrils of the outer nose of the person 12 and a space having a predetermined capacity around the outer nostrils.

Of the parts of the measuring device 11, the inner shape and outer shape of the part of the person 12 in contact with the back of the nose of the outer nose are formed in a shape corresponding to the back of the nose of the person 12. By doing so, the measuring device 11 can be attached to the outer nose of the person 12 by being sandwiched between the face of the person 12 and the head-mounted display 13.

FIG. 3 is a diagram showing an example of the configuration of the measuring device 11.

In FIG. 3, among the directions indicated by the X-axis, Y-axis, and Z-axis representing the three-dimensional space (Cartesian coordinate space), the direction connecting the left and right in FIG. 3 indicates the X-axis direction. The direction connecting the lower front and the upper back in FIG. 3 indicates the Y-axis direction, and the direction connecting the lower front and the upper front in FIG. 3 indicates the Z-axis direction. The right direction is the positive direction of the X-axis, the back-up direction is the positive direction of the Y-axis, and the front-up direction is the positive direction of the Z-axis. Hereinafter, the positive direction of the Z axis is the upper side, the negative direction of the Z axis is the lower side, the negative direction of the Y axis is the rear side, the positive direction of the Y axis is the front side, and the positive direction of the X axis is the right side. , The negative direction of the X-axis is also referred to as the left side. Further, in the drawings after FIG. 3, the X-axis, the Y-axis, and the Z-axis are similarly shown. The X-axis direction is also referred to as a left-right direction, the Y-axis direction is also referred to as a front-rear direction, and the Z-axis direction is also referred to as a vertical direction.

The measuring device 11 includes a holding unit 41, pulse wave sensors 42-1 and 42-2, sponges 43-1 and 43-2, and a temperature sensor 44. The holding unit 41 holds the pulse wave sensors 42-1 and 42-2 and the temperature sensor 44. Further, when the holding portion 41 is attached to the external nose of the person 12, the upper side in FIG. 3 is in contact with the external nose of the person 12, and the external nostril of the external nose of the person 12 and a predetermined capacity around the external nostril are formed. Enclose the space of. Details of the configuration of the holding unit 41 will be described later with reference to FIGS. 5 to 8.

The pulse wave sensor 42-1 detects the pulse wave of the person 12. The pulse wave sensor 42-1 is an optical pulse wave sensor. The pulse wave sensor 42-1 is arranged inside one of the two surfaces (the surface on the right side) of the portion of the holding portion 41 that is in contact with the external nose of the person 12. The pulse wave sensor 42-1 is stopped by the holding portion 41 with the sponge 43-1 sandwiched between them. The sponge 43-1 is formed in the shape of a square plate having a predetermined thickness, and is deformed when a force is applied. Elastic deformation of the sponge 43-1 even if there is a difference between the inclination angle of the surface of the portion of the holding portion 41 that is in contact with the outer nose of the person 12 and the inclination angle of the nose back of the outer nose of the person 12. Absorbs the difference, and the pulse wave sensor 42-1 comes into close contact with the back of the outer nose of the person 12.

When the measuring device 11 is attached to the outer nose of the person 12, the pulse wave sensor 42-1 comes into contact with the back of the nose of the person 12 and detects the pulse wave of the person 12. For example, the pulse wave sensor 42-1 is a so-called reflective type, and is composed of a light emitting part and a light receiving part, and emits light having a predetermined wavelength that passes through the skin of the person 12 and is absorbed by the oxidized hemoglobin in the blood. The pulse wave is detected by irradiating the light toward the person 12 and detecting the light reflected from the person 12. By making the pulse wave sensor 42-1 a reflective type, the pulse wave sensor 42-1 in contact with the back of the nose can measure a pulse wave with higher accuracy.

The pulse wave sensor 42-2 detects the pulse wave of the person 12. The pulse wave sensor 42-2 is an optical pulse wave sensor. The pulse wave sensor 42-2 is arranged inside the other surface (left surface) of the two surfaces of the portion of the holding portion 41 that is in contact with the external nose of the person 12. The pulse wave sensor 42-2 is stopped by the holding portion 41 with the sponge 43-2 sandwiched between them. The sponge 43-2 is formed in the shape of a square plate having a predetermined thickness, similar to the shape of the sponge 43-1, and is deformed when a force is applied. Even if there is a difference between the inclination angle of the surface of the part of the holding portion 41 that is in contact with the outer nose of the person 12 and the inclination angle of the nose back of the outer nose of the person 12, elastic deformation of the sponge 43-2 The difference is absorbed by the pulse wave sensor 42-2, and the pulse wave sensor 42-2 is brought into close contact with the back of the nose of the external nose of the person 12.

When the measuring device 11 is attached to the outer nose of the person 12, the pulse wave sensor 42-2 comes into contact with the back of the nose of the person 12 and detects the pulse wave of the person 12. For example, the pulse wave sensor 42-2 is a so-called reflective type, and is composed of a light emitting part and a light receiving part, and emits light having a predetermined wavelength that passes through the skin of the person 12 and is absorbed by the oxidized hemoglobin in the blood. The pulse wave is detected by irradiating the light toward the person 12 and detecting the light reflected from the person 12. By making the pulse wave sensor 42-2 a reflective type, the pulse wave sensor 42-2 in contact with the back of the nose can measure a pulse wave with higher accuracy.

The pulse wave sensor 42-2 is arranged so as to face the pulse wave sensor 42-1. When the measuring device 11 is attached to the outer nose of the person 12, the pulse wave sensor 42-2 and the pulse wave sensor 42-1 use the pulse wave sensor 42-1 and the pulse wave sensor 42-2 on the back of the nose of the person 12. It is arranged so as to be sandwiched between. In this case, the pulse wave sensor 42-1 and the pulse wave sensor 42-2 are arranged so as to be displaced in the vertical direction with respect to the external nose and sandwich the back of the nose of the person 12. By doing so, even if the size of the external nose varies from person to person, at least one of the pulse wave sensor 42-1 and the pulse wave sensor 42-2 can be more reliably brought into close contact with the back of the nose. it can.

That is, the pulse wave sensor 42-1 detects a human pulse wave in contact with one of the two surfaces of the dorsum of the nose divided by the ridgeline from the base of the nose to the tip of the nose, and the pulse wave sensor 42-2 is The pulse wave of a person is detected in contact with the other of the two surfaces of the dorsum of the nose divided by the ridgeline from the base of the nose to the tip of the nose of the person 12. Since the pulse wave sensor 42-1 and the pulse wave sensor 42-2 sandwich the back of the nose of the person 12, for example, the shape of the outer nose of the person 12 is different, such as a crocodile nose, a eagle nose, or a squirrel nose. Also, at least one of the pulse wave sensor 42-1 and the pulse wave sensor 42-2 can be more reliably brought into close contact with the base of the nose.

Further, the pulse wave sensor 42-1 and the pulse wave sensor 42-2 are positioned so as to be vertically displaced with respect to the external nose, that is, the distance from the tip of the nose of the person 12 to the pulse wave sensor 42-1 is set by a person. The distance from the tip of the nose 12 to the pulse wave sensor 42-2 can be different. For example, even if the shape of the outer nose of the person 12 is different, such as the shape of the outer nose of the person 12 being asymmetrical, at least one of the pulse wave sensor 42-1 and the pulse wave sensor 42-2 can be used. It can be reliably attached to the back of the nose.

The temperature sensor 44 detects the exhaled temperature of the person 12. More specifically, the temperature sensor 44 detects a change in the temperature of the exhaled breath of the person 12. The temperature sensor 44 is arranged in the lower portion of the portion of the holding portion 41. It can also be said that the temperature sensor 44 is arranged in the portion of the holding portion 41 that faces the pulse wave sensor 42-1 and the pulse wave sensor 42-2. That is, the temperature sensor 44 is arranged in the portion of the holding portion 41 that is exposed to exhaled air when the measuring device 11 is attached to the outer nose of the person 12. In other words, the temperature sensor 44 is arranged so as to be able to detect (change) the temperature of the exhaled breath of the person 12 discharged into a space having a predetermined capacity around the external nostril surrounded by the holding portion 41.

For example, the time constant of the temperature sensor 44 is less than 50 milliseconds (ms). This is because it is necessary to observe changes in the frequency characteristics in the band of at least about 10 Hz in order to observe changes in the respiratory waveform when estimating emotions such as stress, and it is less than 50 milliseconds (ms) in consideration of the sampling theorem. This is because it is necessary to secure the time constant of. By doing so, the temperature sensor 44 can detect the temperature change of the exhaled breath, and can measure the respiratory waveform capable of estimating emotions such as stress. For example, the temperature sensor 44 can be a thermopile. The thermopile temperature sensor 44 can measure respiratory waveforms with fast response speeds (small time constants) and higher accuracy (closer to true values).

Further, the measuring device 11 includes a signal processing unit 71.

FIG. 4 is a block diagram showing a functional configuration of the signal processing unit 71 included in the measuring device 11.

The signal processing unit 71 processes the signals from the pulse wave sensors 42-1 and 42-2 and the temperature sensor 44, and outputs them to the outside as a pulse wave signal and a respiratory waveform signal of the person 12. The signal processing unit 71 is composed of a dedicated integrated circuit, a logable logic device such as an FPGA (field-programmable gate array), a general-purpose microprocessor that executes a predetermined program and realizes a predetermined function, and the like. The signal processing unit 71 may be provided in the holding unit 41 and output to the outside as a pulse wave signal and a respiratory waveform signal of the person 12 via the cable 21, or may be provided outside the holding unit 41. , Signals from pulse wave sensors 42-1 and 42-2 and temperature sensor 44 supplied via the cable 21 can also be processed. The measuring device 11 may output a pulse wave signal or a respiratory waveform signal to the outside by wireless communication.

The signal processing unit 71 includes A / D converters (analog-to-digital converters) 81-1 and 81-2, peak detection units 82-1 and 82-2, peak interval detection units 83-1 and 8-3, and dispersion. It includes calculation units 84-1 and 84-2, comparison unit 85, selection unit 86, and A / D converter 87.

The A / D converter 81-1 acquires an analog signal supplied from the pulse wave sensor 42-1 and converts it into a digital signal sampled at a predetermined frequency. The A / D converter 81-1 supplies the digital signal obtained by conversion to the peak detection unit 82-1 and the selection unit 86.

The peak detection unit 82-1 uses the digital signal supplied from the A / D converter 81-1 to localize the R wave among the waveforms corresponding to the P wave, QRS wave, T wave, and U wave, which are the waveforms of the electrocardiogram. The peak that is the maximum target value is detected. Before detecting the peak, the peak detection unit 82-1 applies a preprocessing such as applying a bandpass filter of 0.1 Hz to 16 Hz or detecting a maximum value to the digital signal. The peak detection unit 82-1 supplies a digital signal to which a value indicating the position of the detected peak is added to the peak interval detection unit 83-1.

The peak interval detection unit 83-1 detects the interval between adjacent peaks from the digital signal to which the value indicating the peak position is added, which is supplied from the peak detection unit 82-1. The peak interval detection unit 83-1 supplies a value indicating the interval between adjacent peaks to the variance calculation unit 84-1.

The variance calculation unit 84-1 obtains the variance of the peak intervals from the values indicating the intervals of adjacent peaks supplied from the peak interval detection unit 83-1 and compares the values indicating the variance of the peak intervals with the comparison unit 85. Supply to.

The A / D converter 81-2 acquires an analog signal supplied from the pulse wave sensor 42-2 and converts it into a digital signal sampled at a predetermined frequency. The A / D converter 81-2 supplies the converted digital signal to the peak detection unit 82-2 and the selection unit 86.

The peak detection unit 82-2 uses the digital signal supplied from the A / D converter 81-2 to localize the R wave among the waveforms corresponding to the P wave, QRS wave, T wave, and U wave, which are the waveforms of the electrocardiogram. The peak that is the maximum target value is detected. Before detecting the peak, the peak detection unit 82-2 applies a preprocessing such as applying a bandpass filter of 0.1 Hz to 16 Hz or detecting a maximum value to the digital signal. The peak detection unit 82-2 supplies a digital signal to which a value indicating the position of the detected peak is added to the peak interval detection unit 83-2.

The peak interval detection unit 83-2 detects the interval between adjacent peaks from the digital signal to which the value indicating the peak position is added, which is supplied from the peak detection unit 82-2. The peak interval detection unit 83-2 supplies a value indicating the interval between adjacent peaks to the variance calculation unit 84-2.

The variance calculation unit 84-2 obtains the variance of the peak intervals from the values indicating the intervals of adjacent peaks supplied from the peak interval detection unit 83-2, and compares the values indicating the variance of the peak intervals with the value of the comparison unit 85. Supply to.

The comparison unit 85 compares the value indicating the variance of the peak intervals supplied from the variance calculation unit 84-1 with the value indicating the variance of the peak intervals supplied from the variance calculation unit 84-2, and further. Identify the variance of small values. The comparison unit 85 supplies the selection unit 86 with a signal indicating which of the variance calculation unit 84-1 and the variance calculation unit 84-2 has supplied the variance of a smaller value. That is, when the variance of the peak intervals supplied from the variance calculation unit 84-1 is smaller than the value indicating the variance of the peak intervals supplied from the variance calculation unit 84-2, the comparison unit 85 is an A / D converter. A signal indicating 81-1 is supplied to the selection unit 86. When the variance of the peak intervals supplied from the variance calculation unit 84-2 is equal to or less than the value indicating the variance of the peak intervals supplied from the variance calculation unit 84-1, the comparison unit 85 determines the A / D converter 81. A signal indicating -2 is supplied to the selection unit 86.

The selection unit 86 has supplied a dispersion of a smaller value supplied from the comparison unit 85 among the digital signal supplied from the A / D converter 81-1 or the digital signal supplied from the A / D converter 81-2. Depending on the signal indicating the side, a digital signal having a smaller peak interval dispersion is selected and output as a pulse wave signal to the outside.

The variance of the peak interval is an example of the feature amount of the pulse wave.

Insufficient contact of the pulse wave sensor 42-1 or 42-2 with the back of the nose of the person 12 (that is, when it is in a floating state) interrupts the detection of the pulse wave. , Of the pulse wave sensors 42-1 and 42-2, the signal on the side that more appropriately detects the pulse wave of the person 12 can be output as the pulse wave signal.

The A / D converter 87 acquires an analog signal supplied from the temperature sensor 44 and converts it into a digital signal sampled at a predetermined frequency. The digital signal output from the A / D converter 87 is output to the outside as a respiratory signal.

In this way, the signal processing unit 71 acquires the signal from the pulse wave sensor 42-1 and the signal from the pulse wave sensor 42-2, and features the signal from the pulse wave sensor 42-1 and the pulse wave sensor. From the feature amount of the signal from 42-2, either the signal from the pulse wave sensor 42-1 or the signal from the pulse wave sensor 42-2 is selected and supplied to the outside. Of the signal from the pulse wave sensor 42-1 and the signal from the pulse wave sensor 42-2, either the pulse wave sensor 42-1 or the pulse wave sensor 42-2 that detects the pulse wave more closely. Signal can be output to the outside. Therefore, it is possible to output a pulse wave signal with higher accuracy.

Next, the details of the configuration of the holding unit 41 will be described.

5, FIG. 6, FIG. 7 and FIG. 8 are a rear view showing the details of the configuration of the holding portion 41 from the rear upper side, a top view seen from the upper side, a side view seen from the left rear side, and a right rear view, respectively. It is a side view seen from the side. The holding portion 41 is made of a lightweight and sturdy material that is attached to the nose of the person 12 and therefore does not have an unpleasant odor. For example, the holding portion 41 is formed of a resin such as nylon 66, a metal such as an aluminum alloy or a magnesium alloy, a paper such as corrugated cardboard, or wood such as a balsa material, or a combination thereof.

The holding portion 41 includes a right side plate 51, a left side plate 52, a bottom plate 53, a right locking portion 54, a left locking portion 55, and a temperature sensor storage portion 56. The right side plate 51 is formed in the shape of a triangular flat plate lacking the upper side, and is arranged on the right side of the holding portion 41. The left side plate 52 is formed in the shape of a triangular flat plate lacking the upper side, and is arranged on the left side of the holding portion 41. The right side plate 51 and the left side plate 52 are linearly joined in the vertical direction at the central portion of the holding portion 41. The right side plate 51 and the left side plate 52 are formed line-symmetrically with respect to a virtual straight line in the vertical direction of the central portion of the holding portion 41.

The bottom plate 53 is formed in the shape of a triangular flat plate having a hole in the central portion, and is arranged below the holding portion 41. The right side of the bottom plate 53 is joined to the lower side of the right side plate 51. The left side of the bottom plate 53 is joined to the lower side of the left side plate 52.

As described above, the right side plate 51, the left side plate 52, and the bottom plate 53 are formed in a triangular pyramid shape in which one surface (in this case, the rear surface) is open. That is, of the portion of the holding portion 41, the portion corresponding to the back of the nose of the person 12 is formed in a triangular pyramid shape in which one surface portion is open.

By doing so, when the measuring device 11 is placed on the outer nose of the person 12, the left surface of the right side plate 51 (inner surface of the triangular pyramid shape) and the right surface of the left side plate 52 (inner surface of the triangular pyramid shape) are formed. It is in contact with the dorsal surface of the outer nose of the person 12, and the right side plate 51, the left side plate 52, and the bottom plate 53 surround the outer nostrils of the outer nose of the person 12 and a space having a predetermined capacity around the outer nostrils.

A right locking portion 54 is provided on the right side of the right side plate 51, that is, on the outside of the right side of the triangular pyramid-shaped portion formed by the right side plate 51, the left side plate 52, and the bottom plate 53. The right locking portion 54 is formed in a rectangular flat plate shape. The right locking portion 54 is fixedly arranged on the right side of the right face plate 51 in a direction in which a plane having a large area of the right locking portion 54 and a plane having a large area of the right face plate 51 intersect. There is. The thickness direction surface of the right locking portion 54 and the longitudinal surface is right from the corner portion of the front end portion of the triangular pyramid shape formed by the right side plate 51, the left side plate 52, and the bottom plate 53. The right locking portion 54 is arranged along the central portion on the rear side of the locking portion 54.

A hook-and-loop fastener (one of the hook-and-loop fasteners, for example, a hook-and-loop fastener) or double-sided tape is attached to the upper surface of the right locking portion 54. By sticking the corresponding portion of the head-mounted display 13 (for example, the portion to which the surface fastener on the loop side is attached) and the upper surface of the right locking portion 54, the measuring device 11 engages with the head-mounted display 13. It will be stopped.

A left locking portion 55 is provided on the left side of the left side plate 52, that is, on the outside of the left side of the triangular pyramid-shaped portion formed by the right side plate 51, the left side plate 52, and the bottom plate 53. The left locking portion 55 is formed in the same rectangular flat plate shape as the right locking portion 54. The left locking portion 55 is fixedly arranged on the left side of the left face plate 52 in a direction in which a plane having a large area of the left side plate 52 and a plane having a large area of the left locking portion 55 intersect. There is. The thick surface of the left locking portion 55 and the longitudinal surface is on the left side from the corner portion of the front end portion of the triangular pyramid shape formed by the right side plate 51, the left side plate 52 and the bottom plate 53. The left locking portion 55 is arranged along the central portion on the rear side of the face plate 52.

A hook-and-loop fastener (one of the hook-and-loop fasteners, for example, a hook-and-loop fastener) or double-sided tape is attached to the upper surface of the right locking portion 55. By sticking the corresponding portion of the head-mounted display 13 (for example, the portion to which the surface fastener on the loop side is attached) and the upper surface of the right locking portion 55, the measuring device 11 engages with the head-mounted display 13. It will be stopped.

The right locking portion 54 and the left locking portion 55 are provided line-symmetrically with respect to a virtual straight line in the vertical direction of the central portion of the holding portion 41.

In order to firmly fix the right locking portion 54 by the right side plate 51, a gutter-shaped reinforcing member having an arcuate cross section connecting the flat surface of the right locking portion 54 and the flat surface of the right side plate 51 is provided. Can be done. Similarly, in order to firmly fix the left locking portion 55 by the left side plate 52, a gutter-shaped reinforcing member having an arcuate cross section connecting the flat surface of the left locking portion 55 and the flat surface of the left side plate 52 is provided. be able to.

Further, if there is a hole, recess or protrusion at an appropriate position of the head-mounted display 13, the right locking portion 54 or the right locking portion 55 is formed in a hook shape to be hooked on the hole, recess or protrusion, and is hook-shaped. The right locking portion 54 or the right locking portion 55 of the head-mounted display 13 may be hooked on a hole, a recess, a protrusion, or the like of the head-mounted display 13 to lock the measuring device 11 to the head-mounted display 13.

In this way, the right locking portion 54 and the left locking portion 55 for locking to the head-mounted display 13 are formed. The deviation of the measuring device 11 from the external nose of the person 12 can be suppressed, and the pulse wave and the respiratory waveform can be measured more reliably.

The length in the left-right direction of the temperature sensor storage unit 56 is substantially equal to the width in the left-right direction of the surface on the rear end side of the bottom plate 53, and the length in the front-rear direction is shorter than the length in the front-rear direction of the bottom plate 53. It is formed in a rectangular parallelepiped shape with a height, and is provided on the lower side of the bottom plate 53 integrally with the bottom plate 53. The temperature sensor storage unit 56 stores the temperature sensor 44.

A pulse wave sensor fixing portion 61, which is a rectangular parallelepiped recess, is formed on the left side of the right side plate 51, that is, inside the right side of the triangular pyramid-shaped portion formed by the right side plate 51, the left side plate 52, and the bottom plate 53. Has been done. The pulse wave sensor fixing portion 61 is formed as a rectangular parallelepiped recess (recess) so that a straight portion in the longitudinal direction of the rectangular parallelepiped recess follows the rear surface of the right side plate 51. In the pulse wave sensor fixing portion 61, the sponge 43-1 and the pulse wave sensor 42-1 are arranged so as to sandwich the sponge 43-1 between the right side plate 51 and the pulse wave sensor 42-1.

Of the portion of the right side plate 51, the portion below the pulse wave sensor fixing portion 61 is provided with a hole for passing the wiring of the pulse wave sensor 42-1.

A pulse wave sensor fixing portion 62, which is a rectangular parallelepiped recess, is formed on the right side of the left side plate 52, that is, inside the left side of the triangular pyramid-shaped portion formed by the right side plate 51, the left side plate 52, and the bottom plate 53. Has been done. The pulse wave sensor fixing portion 62 is formed as a rectangular parallelepiped recess (recess) so that a straight portion in the longitudinal direction of the rectangular parallelepiped recess follows the rear surface of the left side plate 52. The sponge 43-2 and the pulse wave sensor 42-2 are arranged on the pulse wave sensor fixing portion 62 so that the sponge 43-2 is sandwiched between the left side plate 52 and the pulse wave sensor 42-2.

Of the portion of the left side plate 52, the portion below the pulse wave sensor fixing portion 62 is provided with a hole for passing the wiring of the pulse wave sensor 42-2.

The bottom plate 53 is provided with a hole 63 in the central portion in the left-right direction from the vicinity of the front end corner to the rear end side surface. Further, the temperature sensor storage unit 56 is provided with a cavity 64 that opens on the rear side and the right side. The upper side of the cavity 64 is connected to the hole 63. The temperature sensor 44 is stored in the cavity 64 of the temperature sensor storage unit 56. The heat-sensitive portion of the temperature sensor 44 housed in the cavity 64 leads to the inside of the triangular pyramid shape formed by the right side plate 51, the left side plate 52, and the bottom plate 53 through the hole 63 of the bottom plate 53. The wiring of the temperature sensor 44 is passed through the opening on the right side of the temperature sensor storage portion 56 among the openings of the cavity 64 to the outside of the holding portion 41.

As described above, the holding portion 41 is formed so that the internal shape and the outer shape of the predetermined portion correspond to the nostril dorsum of the external nose of the person 12, and the other portions are around the external nostrils and the external nostrils of the human external nose. It is formed so as to surround a space having a predetermined capacity. Further, the holding portion 41 holds the pulse wave sensor 42-1 inside the portion formed in a shape corresponding to the back of the nose so as to be in contact with the back of the nose when attached to the person 12, and the nostrils and the outside. A temperature sensor 44 is held in a portion surrounding the space around the nostril so that the temperature of the exhaled breath of the person discharged into the space when attached to the person 12 can be detected.

Since the holding portion 41 has an inner shape and an outer shape of a predetermined portion formed in a shape corresponding to the back of the outer nose of the person 12, when the measuring device 11 is attached so as to cover the outer nose of the person 12, the person The outer nose of the 12 has a shape that is raised by a predetermined thickness, and the head-mounted display 13 can be mounted from above. Therefore, it is less likely to get in the way of the person 12 as compared with the case where the sensor is attached to the chest or arm.

Further, since the measuring device 11 may be mounted so as to cover the outer nose of the person 12, the positioning can be performed more easily and accurately, and the position of the sensor can be finely adjusted as in the case of mounting the sensor on the chest or arm. unnecessary. Further, since the measuring device 11 is pressed by the head-mounted display 13, the deviation of the sensor can be further reduced even if the person 12 moves. In this way, the load of mounting the sensor and the measurement load can be further reduced.

Furthermore, the head-mounted display 13 itself does not need to be processed or modified, and the measurement can be performed more easily. The overall cost can also be kept low. Further, when experiencing the virtual reality, the measuring device 11 may be attached to the person 12 only when it is necessary to measure the pulse wave and the respiratory waveform depending on the type of the content of the virtual reality or the like.

Further, among the portions of the holding portion 41, the portion corresponding to the back of the nose can be formed in the shape of a triangular pyramid in which one surface portion is open. The shape of the holding portion 41 can be made simpler, and it can be manufactured more easily by a three-dimensional printer, a cutting machine, or the like. Further, among the portions of the holding portion 41, the strength and rigidity of the portion corresponding to the back of the nose can be further increased.

Next, the measurement of the pulse wave and the respiratory waveform of the person 12 by the measuring device 11 will be described.

FIG. 9 is a diagram showing an example of the result of measurement of the pulse wave of the person 12 by the measuring device 11. A person 12 wearing the measuring device 11 was equipped with an electrocardiograph and a transmission type pulse wave measuring device on the fingertips, and the measurement results of the pulse waves were compared. In FIG. 9, the waveform 101 shows an electrocardiographic waveform, and the waveform 102 shows a finger pulse wave waveform which is a pulse wave measured by a transmission type pulse wave measuring device attached to a fingertip. In FIG. 9, the waveform 103 shows the pulse wave measured by the measuring device 11. In FIG. 9, black circles indicate peaks. In the waveform 103, a peak is detected as in the waveform 101 or the waveform 102. In the waveform 101, the waveform 102, and the waveform 103, the time when the peak is detected is different because the propagation time of the pulse wave is different. From the waveform 101, the waveform 102, and the waveform 103, it can be seen that the measuring device 11 can measure the electrocardiographic waveform by the electrocardiograph and the pulse wave corresponding to the pulse wave by the transmission type pulse wave measuring device of the fingertip.

In the waveform 101, the waveform 102, and the waveform 103, the respective RR Intervals became substantially equal values.

FIG. 10 is a diagram showing an example of the result of measurement of the respiratory waveform of the person 12 by the measuring device 11. A breathing band (chest band) for detecting the expansion and contraction of the rib cage due to breathing was worn on the person 12 wearing the measuring device 11, and the measurement results of the respiratory waveforms were compared. In FIG. 10, waveform 121 shows the breathing waveform measured by the breathing band, and waveform 122 shows the breathing waveform measured by the measuring device 11. From FIG. 10, it can be seen that the waveform 122 is similar to the waveform 121. If the person 12 was at rest and did not speak, the respiratory peak frequency and the center of gravity frequency of the waveform 121 and the waveform 122 were almost equal values.

As described above, the measuring device 11 measures the pulse wave and the respiratory waveform of the person 12 who is experiencing the virtual reality or the augmented reality. The pulse wave sensor 42-1 detects the pulse wave of the person 12. The temperature sensor 44 detects the exhaled temperature of the person 12. The holding portion 41 is formed so that the inner shape and outer shape of a predetermined portion correspond to the nostril dorsum of the outer nose of the person 12, and the other portion has a predetermined capacity around the outer nostril and the outer nostril of the person's outer nose. It is formed so as to surround the space of. Further, the holding portion 41 holds the pulse wave sensor 42-1 inside the portion formed in a shape corresponding to the back of the nose so as to be in contact with the back of the nose when attached to the person 12, and the nostrils and the outside. A temperature sensor 44 is held in a portion surrounding the space around the nostril so that the temperature of the exhaled breath of the person discharged into the space when attached to the person 12 can be detected.

In this way, since the holding portion 41 is formed so that the inner shape and outer shape of the predetermined portion correspond to the nasal dorsum of the outer nose of the person 12, the measuring device 11 covers the outer nose of the person 12. When the head-mounted display 13 is attached, the head-mounted display 13 can be attached from above, so that it does not get in the way of the person 12. Further, since the measuring device 11 may be mounted so as to cover the outer nose of the person 12, the position of the sensor does not need to be finely adjusted, the positioning can be performed more easily and more accurately, and the deviation of the sensor can be reduced. it can. Therefore, the load of mounting the sensor and the measurement load can be further reduced. The head-mounted display 13 itself does not need to be processed or modified, and measurement can be performed with a simpler configuration. As described above, the simpler configuration is less likely to get in the way, and the fine adjustment of the sensor position and the deviation of the sensor can be reduced, so that the load of mounting the sensor and the measurement load can be further reduced.

Of the portions of the holding portion 41, the portion corresponding to the back of the nose can be formed in the shape of a triangular pyramid in which one surface portion is open. The shape of the holding portion 41 can be made simpler, and it can be manufactured more easily.

The pulse wave sensor 42-1 is brought into contact with one of the two surfaces of the back of the nose divided by the ridgeline from the base of the nose to the tip of the nose to detect the pulse wave of a person, and the root of the nose to the tip of the nose of the person 12 is detected. A pulse wave sensor 42-2 that detects a person's pulse wave in contact with the other of the two surfaces of the back of the nose divided by the ridgeline up to is further provided. Even if the shape of the external nose of the person 12 is different, at least one of the pulse wave sensor 42-1 and the pulse wave sensor 42-2 can be more reliably brought into close contact with the nose root.

The distance from the tip of the nose of the person 12 to the pulse wave sensor 42-1 can be made different from the distance from the tip of the nose of the person 12 to the pulse wave sensor 42-2. Even if the shape of the external nose of the person 12 is different, at least one of the pulse wave sensor 42-1 and the pulse wave sensor 42-2 can be more reliably brought into close contact with the back of the nose.

The signal from the pulse wave sensor 42-1 and the signal from the pulse wave sensor 42-2 are acquired, and from the feature amount of the signal from the pulse wave sensor 42-1 and the feature amount of the signal from the pulse wave sensor 42-2. , A signal processing unit 71 that selects either the signal from the pulse wave sensor 42-1 or the signal from the pulse wave sensor 42-2 and supplies it to the outside can be further provided. Of the signal from the pulse wave sensor 42-1 and the signal from the pulse wave sensor 42-2, the signal of either the pulse wave sensor 42-1 or the pulse wave sensor 42-2, which is in closer contact with each other, is output to the outside. It is possible to output a pulse wave signal with higher accuracy.

The pulse wave sensor 42-1 irradiates the person 12 with light having a predetermined wavelength that passes through the skin of the person 12 and is absorbed by the oxidized hemoglobin in the blood, and detects the light reflected from the person to detect the pulse. Waves can be detected. The pulse wave sensor 42-1 in contact with the back of the nose can measure the pulse wave with higher accuracy.

The time constant of the temperature sensor 44 can be less than 50 milliseconds. It is possible to obtain a respiratory waveform that can estimate emotions such as stress.

The temperature sensor 44 can be a thermopile. The response speed is fast (the time constant is small), and it is possible to measure the respiratory waveform with higher accuracy.

The holding portion 41 can be formed with a right locking portion 54 and a left locking portion 55 for locking to the head-mounted display 13. The deviation of the measuring device 11 from the external nose of the person 12 can be suppressed, and the pulse wave and the respiratory waveform can be measured more reliably.

A person's pulse wave is detected by a pulse wave sensor 42-1 that covers the nostril of the person 12 and surrounds the nostril and the space of a predetermined capacity around the nostril, and is in contact with the covered nostril. The temperature sensor 44 can detect the temperature of the exhaled breath of the person 12 discharged into the space around the nostril to measure the pulse wave and respiratory waveform of the person 12 experiencing virtual reality or augmented reality. By doing so, it is less likely to get in the way, fine adjustment of the position of the sensor and deviation of the sensor can be reduced, and the load of mounting the sensor and the measurement load can be further reduced.

It has been explained that the measuring device 11 is attached to the person 12 who is experiencing the virtual reality, but the present invention is not limited to this, and the measuring device 11 is attached to the person who is experiencing the augmented reality to measure the pulse wave and the respiratory waveform. You may try to do it.

Further, the embodiment of the present invention is not limited to the above-described embodiment, and various modifications can be made without departing from the gist of the present invention.

11 Measuring device, 21 Cable, 41 Holding part, 42-1 and 42-2 Pulse wave sensor, 43-1 and 43-2 Sponge, 44 Temperature sensor, 51 Right side plate, 52 Left side plate, 53 Bottom plate, 54 Right Stop, 55 Left locking, 56 Temperature sensor storage, 61 Pulse sensor fixing, 62 Pulse sensor fixing, 63 holes, 64 cavities, 71 Signal processing, 81-1 and 81-2 A / D Converter, 82-1 and 82-2 peak detection unit, 83-1 and 8-3 peak interval detection unit, 84-1 and 84-2 dispersion calculation unit, 85 comparison unit, 86 selection unit, 87 A / D converter

Claims (10)

In a measuring device that measures pulse and respiratory waveforms of a person experiencing virtual reality or augmented reality
The first pulse wave sensor that detects the pulse wave of the person and
A temperature sensor that detects the temperature of the exhaled breath of the person and
The inner shape and outer shape of the predetermined part are formed in a shape corresponding to the nostril of the person's outer nose, and the other part provides a space of a predetermined capacity around the nostril of the person's outer nose and the nostril of the person. The first pulse wave sensor is held inside the portion formed so as to surround and corresponding to the back of the nose so as to be in contact with the back of the nose when worn by the person, and the outside Measurements including a holding means for holding the temperature sensor in a portion surrounding the nostrils and the space around the nostrils so that the temperature of the exhaled breath of the person discharged into the space when worn by the person can be detected. apparatus. In the measuring device according to claim 1,
Among the portions of the holding means, the portion corresponding to the back of the nose is a measuring device formed in a triangular pyramid shape in which one surface portion is open. In the measuring device according to claim 1,
The first pulse wave sensor detects the pulse wave of the person in contact with one of the two surfaces of the back of the nose, which is divided by the ridgeline from the base of the nose to the tip of the nose.
A measuring device further comprising a second pulse wave sensor that detects the pulse wave of the person in contact with the other of the two surfaces of the back of the nose, which is divided by the ridgeline from the base of the nose to the tip of the nose of the person. In the measuring device according to claim 3,
A measuring device in which the distance from the person's nose tip to the first pulse wave sensor is different from the distance from the person's nose tip to the second pulse wave sensor. In the measuring device according to claim 3,
The signal from the first pulse wave sensor and the signal from the second pulse wave sensor are acquired, and the feature amount of the signal from the first pulse wave sensor and the signal from the second pulse wave sensor are obtained. A measuring device further comprising a signal processing means for selecting either a signal from the first pulse wave sensor or a signal from the second pulse wave sensor and supplying the signal to the outside based on the feature amount of the above. In the measuring device according to claim 1,
The first pulse wave sensor irradiates the person with light having a predetermined wavelength that passes through the person's skin and is absorbed by oxidized hemoglobin in the blood, and detects the light reflected from the person. A measuring device that detects pulse waves. In the measuring device according to claim 1,
A measuring device in which the time constant of the temperature sensor is less than 50 milliseconds. In the measuring device according to claim 7.
The temperature sensor is a thermopile measuring device. In the measuring device according to claim 1,
A measuring device in which a locking portion for locking to a head-mounted display is formed on the holding means. In a measurement method that measures the pulse and respiratory waveforms of a person experiencing virtual reality or augmented reality.
It covers the back of the nose of the person and surrounds the nostrils and a predetermined volume of space around the nostrils.
The pulse wave sensor in contact with the back of the nose, which is covered, detects the pulse wave of the person and
A measuring method for detecting the temperature of the exhaled breath of the person discharged into the space around the nostril with a temperature sensor.

Images