WO2017122477A1 - Procédé de mesure d'activité biologique du sujet, système de mesure, et programme informatique - Google Patents

Procédé de mesure d'activité biologique du sujet, système de mesure, et programme informatique Download PDF

Info

Publication number
WO2017122477A1
WO2017122477A1 PCT/JP2016/086876 JP2016086876W WO2017122477A1 WO 2017122477 A1 WO2017122477 A1 WO 2017122477A1 JP 2016086876 W JP2016086876 W JP 2016086876W WO 2017122477 A1 WO2017122477 A1 WO 2017122477A1
Authority
WO
WIPO (PCT)
Prior art keywords
subject
light
biological activity
processing circuit
image processing
Prior art date
Application number
PCT/JP2016/086876
Other languages
English (en)
Japanese (ja)
Inventor
智之 市座
貴行 山内
淳史 堀
Original Assignee
シャープ株式会社
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by シャープ株式会社 filed Critical シャープ株式会社
Publication of WO2017122477A1 publication Critical patent/WO2017122477A1/fr

Links

Images

Classifications

    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00—Measuring for diagnostic purposes; Identification of persons
    • A61B5/08—Detecting, measuring or recording devices for evaluating the respiratory organs
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00—Measuring for diagnostic purposes; Identification of persons
    • A61B5/103—Detecting, measuring or recording devices for testing the shape, pattern, colour, size or movement of the body or parts thereof, for diagnostic purposes
    • A61B5/11—Measuring movement of the entire body or parts thereof, e.g. head or hand tremor, mobility of a limb
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00—Measuring for diagnostic purposes; Identification of persons
    • A61B5/103—Detecting, measuring or recording devices for testing the shape, pattern, colour, size or movement of the body or parts thereof, for diagnostic purposes
    • A61B5/11—Measuring movement of the entire body or parts thereof, e.g. head or hand tremor, mobility of a limb
    • A61B5/113—Measuring movement of the entire body or parts thereof, e.g. head or hand tremor, mobility of a limb occurring during breathing

Definitions

  • the present invention relates to a technique for measuring a biological activity such as a subject's respiration rate from a subject's video.
  • a technique in which a subject is photographed with a camera, a change in luminance value due to a biological reaction such as body movement or blood flow is detected from the moving image, and a biological activity such as a subject's respiratory rate or heart rate is measured (for example, Patent Documents 1 and 2).
  • the image area in which the subject is photographed is specified by an observer in advance or by using a contour extraction technique.
  • the respiration monitoring device of Patent Literature 1 divides an image obtained by photographing a subject into local regions and analyzes lightness information of each local region. Then, using the three types of threshold values, it is determined whether the subject is observing movement around the chest or observing non-respiratory body movement such as turning over.
  • the heart rate measuring device of Patent Document 2 captures a subject's face with a camera equipped with an infrared light source, extracts a specific region between eyebrows from a face image for each frame, and corrects the average luminance.
  • the heart rate measuring device obtains a waveform of a temporal change in corrected luminance from the corrected average luminance time series, and calculates the heart rate of the subject by filtering the waveform in a frequency band corresponding to the heart rate. .
  • an appropriate threshold necessary for determining non-respiratory body movement varies greatly depending on the imaging environment.
  • the threshold value to be set can vary greatly depending on changes in the brightness of the observation location, the position of the indoor light source, the presence or absence of incident light from the outside, and the movement of people or objects other than the subject. Since there is no method for always obtaining an appropriate threshold value, an area for obtaining biological information such as respiration cannot be calculated if the threshold value is inappropriate.
  • the heart rate measuring device of Patent Document 2 needs to capture the subject's face within the imaging range. Similar to Patent Document 1, when the shooting environment changes such as a change in illuminance, movement of a person, incidence of external light, etc., the luminance value of the image area in which the subject is photographed changes greatly due to a cause other than biological activity. When such disturbance noise occurs, the body movement location caused by the biological reaction cannot be specified, and the biological information may not be extracted accurately.
  • the subject's face moves away from the camera, the accuracy of acquiring the subject's biological information is reduced, so the subject's face must be imaged from a relatively short distance. As a result, a feeling of pressure is given to the subject, and there is a concern about the influence on the biological activity to be measured.
  • the present invention has been made in order to solve the above-described problems, and is a measurement system for biological activity caused by respiration, a measurement method for biological information, etc. I will provide a.
  • a method uses a biological activity measurement system including an imaging device that generates a moving image based on observation light, and an image processing circuit that measures the biological activity of a subject using the moving image.
  • a method for measuring the biological activity of the subject comprising: (a) disposing at least one absorbent material having a predetermined absorption rate or more at a position where a body motion associated with the biological activity of the subject occurs. And (b) the imaging device receives the light that is partially absorbed by the at least one absorber and the remaining part is reflected by the subject or the at least one absorber at a plurality of times. Generating a moving image composed of a plurality of time-series frame images; and (c) the image processing circuit measures the biological activity of the subject based on luminance information of the plurality of frame images. Including the step.
  • a method is a life activity measurement system including an imaging device that generates a moving image based on observation light, and an image processing circuit that measures the life activity of a subject using the moving image.
  • a method of measuring the biological activity of the subject (a) the body movement accompanying the biological activity of the subject has an absorptance greater than a predetermined value, and the light absorptance is Disposing at least one absorbent material including a plurality of different parts; (b) a part of the imaging device is absorbed by the at least one absorbent material and the remaining part is the subject or the at least one Receiving the light reflected by one absorber at a plurality of times and generating a moving image composed of a plurality of time-series frame images; and (c) the image processing circuit includes the plurality of frame images.
  • Brightness information Comprising the steps of measuring the biological activity of the subject by Zui.
  • the image processing circuit divides each frame image into a plurality of partial areas, and measures the biological activity based on luminance information of the plurality of partial areas.
  • the image processing circuit is a partial region of each frame image using the at least one absorber, and includes the at least one absorber. And the partial area
  • the image processing circuit holds information for specifying the predetermined absorption pattern in advance, and the image processing circuit uses the information to perform pattern matching processing.
  • the predetermined absorption pattern is detected in each frame image, and the partial region including the absorbing material is specified.
  • the at least one absorbent material has a predetermined absorption pattern
  • the image processing circuit includes the at least one absorbent material of each frame image.
  • the partial area including the boundary is specified.
  • the image processing circuit specifies a first direction that is a direction of the body movement, and along a second direction different from the first direction, Each frame image is divided into a plurality of partial areas.
  • the at least one absorber has a predetermined absorption pattern, and the predetermined absorption pattern includes a first portion that reflects the light toward the imaging device, and the light. And a second part that absorbs water.
  • the first portion is provided around the at least one absorbent material.
  • the measurement method further includes (d) blocking visible light incident on the imaging device using an optical filter.
  • the measurement method when the wavelength of the light is ⁇ , the measurement method is reflected by (e) an optical filter that mainly transmits the light of the wavelength ⁇ without being absorbed by the at least one absorber.
  • the method further includes passing the light.
  • the measurement method includes: (f) passing the light emitted from the light source through a polarizing element having a predetermined polarization direction; and (g) being absorbed by the at least one absorber.
  • the method further includes passing the light reflected by the material around the position marker through a polarizing element having the same polarization direction as the predetermined polarization direction.
  • the measurement method includes (h) a step of further providing an absorbent material having a predetermined shape as a position marker at a fixed position; and (i) the imaging device is the position marker. Receiving the light that is not absorbed and reflected by the material around the position marker, and generating a moving image composed of a plurality of frame images; and (j) the image processing circuit includes the plurality of frames. Determining whether or not the imaging device is photographing a predetermined direction based on at least one of the images.
  • the step (b) is executed under a shooting environment of 1000 lux or more.
  • the light source emits infrared light
  • the arranged at least one absorber absorbs the infrared light
  • the absorptance greater than or equal to the predetermined value in the step (a) is an absorptivity that produces a difference in luminance that allows the at least one absorber or a material other than the at least one absorber to be significantly distinguished. It is.
  • the image processing circuit measures a respiration rate or a heart rate of the subject as the sexual activity.
  • a system is a measurement system including an imaging device that generates a moving image based on observation light, and an image processing circuit that measures the biological activity of the subject using the moving image.
  • an imaging device that generates a moving image based on observation light
  • an image processing circuit that measures the biological activity of the subject using the moving image.
  • a system is a measurement system including an imaging device that generates a moving image based on observation light, and an image processing circuit that measures the biological activity of a subject using the moving image. And, when at least one absorbing material including a plurality of portions having a light absorption rate different from the light absorption rate at a position where the body movement associated with the biological activity of the subject is greater than or equal to, The imaging device receives a part of the light that is absorbed by the at least one absorber and the other part is reflected by the subject or the at least one absorber at a plurality of times.
  • the moving image composed of a plurality of frame images is generated, and the image processing circuit measures the biological activity of the subject based on luminance information of the plurality of frame images.
  • a computer program includes a measurement system including an imaging device that generates a moving image based on observation light, and an image processing circuit that measures the biological activity of the subject using the moving image.
  • the computer program executed by the image processing circuit in the above-mentioned computer when at least one absorbent material having a predetermined absorption rate or more is disposed at a position where a body motion associated with the biological activity of the subject is generated
  • the program is a process of receiving, in the image processing circuit, a moving image generated by the imaging device, part of which is absorbed by the at least one absorbent material, and the remaining part is the subject or the at least one one
  • the moving image composed of a plurality of time-series frame images receiving the light reflected by the absorber at a plurality of times
  • the infrared absorbing material is used, even when the surroundings are bright and the distance between the subject and the imaging device is sufficiently separated, the body movement caused by the biological activity such as respiration is divided into a plurality of frames. It can be grasped from the luminance information of the image. Since the imaging apparatus can be set apart from the subject and the imaging environment can be set bright, it is possible to acquire biological information with sufficiently high accuracy while sufficiently reducing the feeling of pressure applied to the subject.
  • FIG. It is a figure which shows the structure of the biological activity measurement system 100 by Embodiment 1.
  • FIG. It is a figure which shows the frame image 102 which image
  • FIG. 2 is a diagram illustrating an example of a hardware configuration of an information processing apparatus 30 of the life activity measurement system 100 mainly.
  • FIG. 4 is a flowchart illustrating a procedure of processing performed in the biological activity measurement system 100.
  • (A) And (b) is a figure which shows the example of the partial area Q in two frame images image
  • (c) is a figure which shows the change of the luminance value of the partial area Q. is there.
  • (A)-(f) is a figure which shows the example of the shape of the infrared rays absorber 40, respectively.
  • (A) is a figure which shows the example which mounted
  • (b) is a figure which shows the example of an imaging.
  • (A1) to (c1) are diagrams showing the infrared absorbing material 40 provided with a reflective material functioning as a marker around the triangular absorbing portion, and (a2) to (c2) are provided in the marker, respectively. It is a figure which shows two obtained partial area
  • FIG. (A) And (b) is a figure which shows the example in which the area
  • FIG. (A) And (b) is a figure which shows the example which ensured the partial area
  • c) is a diagram showing a change in luminance value of the partial region Q.
  • FIG. (A) And (b) is a figure which shows the example which ensured the partial area Q as a process unit area smaller than the partial area Q of FIG. 8,
  • (c) is a figure which shows the change of the luminance value of the partial area Q.
  • FIG. 10 is a flowchart illustrating an operation procedure of the biological information monitoring apparatus 300 according to the second embodiment. It is a figure which shows the life activity measurement system 111 by the modification of the life activity measurement system. 3 is a flowchart showing a procedure of a first heart rate measurement process performed by the biological activity measurement system 100. 5 is a flowchart showing a procedure of a second measurement process of the heart rate performed in the biological activity measurement system 100.
  • a system such as Patent Documents 1 and 2 that analyzes a moving image captured by a camera and detects biological information such as respiration rate can be used in various imaging environments.
  • the inventor of the present application has paid attention to the situation where biometric information cannot be extracted when an object moves around during shooting, the state of indoor lighting changes, or external light is incident.
  • the reason why the biometric information cannot be extracted is that the luminance value of the image region in which the subject is photographed has changed greatly due to a cause other than the biological reaction, or the image region in which the subject is photographed It was found that the brightness value of the light was uniformly brightened, and it was difficult to specify the brightness change caused by the biological reaction. Under such circumstances, the luminance change caused by the biological reaction is buried in disturbance noise. As a result, the body movement location caused by the biological reaction could not be specified.
  • the inventor of the present application has examined a countermeasure for extracting biometric information when the shooting environment becomes bright or bright among the changes in the shooting environment described above. As a result, it has been conceived that the change in the luminance value of the image area in which the subject is photographed should be increased when the shooting environment is bright.
  • the inventors of the present application installed an optical absorber that absorbs light that illuminates the shooting environment. By providing a relatively dark area in which light is absorbed by the optical absorber and a relatively bright area in which light is reflected in the frame image, the luminance value of the image area in which the subject is reflected changes. It becomes easy.
  • an optical absorber having a predetermined absorption pattern is used. As an example of the predetermined absorption pattern, a plurality of portions having different light absorption rates are provided. As a result, it is possible to more reliably identify the position where the change in the luminance value of the image area in which the subject appears.
  • FIG. 1 shows a configuration of a life activity measurement system 100 according to the present embodiment.
  • the life activity measurement system 100 includes a camera 10, an information processing device 30, and an absorbent material 40. Although the subject 1 is shown in FIG. 1, the subject 1 is not included in the life activity measurement system 100.
  • One of the purposes of the life activity measurement system 100 according to the present invention is to reliably acquire information on the life activity of the subject 1 even when a lot of light such as sunlight is incident on the measurement environment. Therefore, although described in FIG. 1, the light source 20 is not an essential component of the life activity measurement system 100. This description is merely an example. When the amount of incident light from the outside decreases, the light 20a from the light source 20 may be used to intentionally enter the measurement environment.
  • the light source 20 emits light 20a.
  • the light may be visible light or invisible light.
  • infrared light will be described as an example.
  • the light 20a is described as “infrared light 20a”.
  • the life activity measurement system 100 is used for observing the life activity of the subject 1.
  • the life activity is the respiration of the subject 1, and the life activity measurement system 100 measures the respiration rate within a predetermined time.
  • the subject 1 is described as being a person, it may be an animal other than a person, for example, a pet such as a dog or a cat. Animals (including people) as observation targets may be collectively referred to as “subjects”.
  • the camera 10 is a so-called imaging device, and shoots the subject 1 to generate a moving image.
  • the camera 10 sends moving image data to the information processing apparatus 30 by wire or wirelessly.
  • the wavelength range of the infrared light 20a is, for example, 0.7 ⁇ m to 2.5 ⁇ m, and preferably, for example, 0.84 to 0.86 ⁇ m.
  • the information processing apparatus 30 receives moving image data captured by the camera 10 and measures the respiration rate of the subject 1 using changes in images between a plurality of frame images constituting the moving image. Details of the operation of the information processing apparatus 30 will be described later.
  • the absorbing material 40 is an optical absorbing material having an optical characteristic of absorbing incident light. In the present embodiment, it is assumed that the light is infrared light. Therefore, the absorber 40 is described as “infrared absorber 40”.
  • the infrared absorbing material 40 for example, a tape (product number: CP743) available from Shurtape, USA can be used.
  • the use of the infrared absorbing material 40 as an optical absorbing material is merely an example.
  • the light incident on the measurement environment is measured, and the visible light or invisible light contained in the room is absorbed.
  • position the optical absorber to perform is just to arrange
  • a moving image captured by the camera 10 may be referred to as a “moving image based on observation light”.
  • Observation light refers to all light that travels toward the imaging device in the measurement environment.
  • light includes light that is emitted from a light source such as a fluorescent lamp and directly enters the camera 10, and also includes reflected light when the light emitted from the light source strikes an object and is reflected toward the camera 10. Including. At this time, the “object” is photographed by the camera 10 as a part of the subject.
  • the expression “moving image of the subject 1” in the following description means that the light emitted from the light source is reflected by the subject 1 as an object and is reflected by the camera 10 as a moving image.
  • the “moving image of the subject 1” is an aspect of the “moving image based on observation light”.
  • the infrared absorbing material 40 By providing the infrared absorbing material 40, a part of the disturbance light 21a incident on the infrared absorbing material 40 is absorbed, and the remaining part is the infrared absorbing material 40 or the subject 1 (for example, the skin of the subject 1, clothing). Reflected. A part of the reflected light enters the camera 10 and is photographed. Whether the infrared ray absorbing material 40 is the infrared ray absorbing material 40 or a material other than the infrared ray absorbing material 40 (including the skin of the subject 1) at the time of photographing causes a difference in luminance that is significantly distinguishable. What is necessary is just to have an infrared absorptivity.
  • the reflected light 20b of the infrared light 20a may be described as “infrared light 20b”.
  • the overall operation of the life activity measurement system 100 is outlined as follows.
  • the observer or the subject 1 arranges at least one infrared absorbing material 40 having an absorptivity greater than or equal to a predetermined level at a position where a body motion accompanying breathing of the subject 1 occurs.
  • Light incident on the measurement environment from the outside is reflected by the infrared absorber 40 or the subject 1.
  • the camera 10 receives the reflected infrared light and captures a moving image of the subject 1. If the amount of light incident on the measurement environment from the outside is less than or equal to a predetermined value, light may be actively emitted from the light source 20.
  • FIG. 2 shows a frame image 102 obtained by photographing the subject 1 wearing the infrared absorbing material 40 in a relatively bright photographing environment.
  • “Relatively bright” means, for example, that the shooting environment is 1000 lux or more. However, this illuminance value is an example and is not exact.
  • a low luminance area (black area) 104 in the center of the image is an area where the reflected light 20b is detected.
  • FIG. 3 shows a frame image 106 obtained by photographing a subject who does not wear the infrared absorbing material 40.
  • the brightness of the shooting environment is equivalent to that at the time of shooting in FIG. When the infrared absorbing material 40 is not present, it can be said that the luminance change in the captured frame image is very small.
  • FIG. 2 and FIG. 3 show a plurality of vertical lines and horizontal lines, which are boundaries virtually provided for image processing.
  • an area of an image divided by a boundary line is referred to as a “partial area” of the image.
  • FIG. 2 illustrates the partial region P. Note that the boundary lines of the partial areas P are highlighted for convenience of understanding.
  • a predetermined absorption pattern is provided in the infrared absorbing material 40, and the low luminance region 104 is detected more reliably and more easily by using the absorption pattern.
  • the shape of the absorption pattern does not appear.
  • the information processing apparatus 30 analyzes a plurality of time-series frame images constituting a moving image as shown in FIG. 2 and determines the subject based on luminance information (for example, changes in luminance values) of the plurality of frame images. 1 body motion is detected. More specifically, the information processing apparatus 30 detects the low luminance region 104 illustrated in FIG. 2 over a plurality of frame images. Since the body movement of the subject 1 during calm occurs due to breathing, the position of the low-intensity region 104 changes (vibrates) in accordance with the breathing cycle. The information processing apparatus 30 can measure the respiration rate of the subject 1 during that period by counting the number of respiration cycles over a predetermined period, with one period of vibration of the low luminance region 104 as one respiration period.
  • luminance information for example, changes in luminance values
  • the respiratory rate is an example of a biological activity resulting from the subject's breathing
  • other biological activities resulting from the subject's breathing may be measured.
  • a subject's breathing motion is measured, and a waveform resulting from breathing (a waveform corresponding to the breathing waveform) is derived from body motion due to breathing.
  • other biological activities that can be evaluated using the waveform, for example, biological activities such as breathing depth, turbulence, apnea periods, frequency of occurrence of apnea periods, This is the category of the biological activity to be measured.
  • FIG. 4 shows the vibration of the low luminance region 104 measured based on the luminance information (change in luminance value) of a plurality of frame images.
  • Waveforms observed using the infrared absorber 40 can accurately measure body movements due to breathing even in a bright photographing environment or when the bright state changes due to lighting of room lighting or incidence of external light. . That is, it is possible to measure body movement, that is, respiration, using the luminance value.
  • FIG. 5 shows changes in luminance values of a plurality of frame images taken in a bright shooting environment without providing the infrared absorbing material 40.
  • the scale of the vertical axis differs by several times.
  • the scale in FIG. 5 is larger than that in FIG.
  • the direction using the infrared absorbing material 40 means that the signal-to-noise ratio (SNR) is superior to the direction not using it (FIG. 5).
  • the infrared absorbing material 40 by using the infrared absorbing material 40, it is possible to perform imaging while sufficiently distinguishing the boundary between the region where infrared light is absorbed and the reflected region. .
  • the subject 1 and the camera 10 can be set apart by, for example, about 6 m.
  • the respiration rate can be measured in a bright photographing environment. Thereby, even if the observation place changes brightly while reducing the feeling of pressure on the subject 1, it is possible to perform shooting in an environment that is not easily affected, that is, in an environment that is less affected by noise. Therefore, it becomes possible to measure the biological activity more accurately.
  • FIG. 6 shows an example of the hardware configuration of the information processing apparatus 30 mainly in the life activity measurement system 100.
  • the information processing apparatus 30 is connected to the camera 10 and the display 32.
  • the information processing apparatus 30 receives captured moving image data from the camera 10.
  • the display 32 displays a measurement result of the number of breaths that is the biological activity of the subject 1 as a result of the processing. If it is determined that the shooting direction of the camera 10 is not appropriate because the low luminance area is not detected, the information processing apparatus 30 may display a warning on the display 32.
  • the information processing apparatus 30 includes a CPU 301, a ROM 302, a RAM 303, a hard disk drive (HDD) 304, an interface (I / F) 305, and an image processing circuit 306.
  • the CPU 301 controls the operation of the information processing apparatus 30.
  • the ROM 302 stores a computer program.
  • the computer program is a group of instructions for causing the CPU 301 or the image processing circuit 306 to perform processing shown by a flowchart described later, for example.
  • a RAM 303 is a work memory for developing a computer program when executed by the CPU 301.
  • the HDD 304 is a storage device that stores moving image data received from the camera 10 or measured respiratory rate data of the subject 1.
  • the I / F 305 is an interface for the information processing apparatus 30 to receive moving image data from the camera 10.
  • the I / F 305 is, for example, an Ethernet (registered trademark) terminal.
  • the I / F 305 is a transmission / reception circuit that performs communication based on, for example, the Wi-Fi (registered trademark) standard.
  • the I / F 305 may be a wired video input terminal.
  • the image processing circuit 306 is a so-called graphics processor that analyzes moving image data.
  • the image processing circuit 306 detects a low luminance area of each frame image of the moving image, detects a body movement based on the vibration of the low luminance area, and counts the respiration rate based on the vibration waveform of the body movement.
  • the image processing circuit 306 is provided separately from the CPU 301, but this is an example.
  • the CPU 301 may perform processing of an image processing circuit 306 described later.
  • FIG. 7 shows a procedure of processing performed in the life activity measurement system 100.
  • step S1 the camera 10 photographs the subject 1 wearing the infrared absorbing material 40.
  • the captured moving image is sent to the information processing apparatus 30.
  • step S2 the image processing circuit 306 of the information processing apparatus 30 divides each of a plurality of frame images constituting the captured moving image into a plurality of partial areas.
  • the partial region (for example, the partial region P in FIG. 2) has, for example, a size of 64 pixels in the horizontal direction and 64 pixels in the vertical direction. Note that “divide” does not require division as an actual operation. For example, the operation of setting the size of the partial area as a unit for cutting out an image or a unit for performing processing may be included in the “dividing” operation described here.
  • step S3 the image processing circuit 306 specifies a partial region including the infrared absorbing material 40 and a partial region including a body movement location due to a biological reaction based on the luminance value of each partial region.
  • the partial area where the infrared absorbing material 40 exists can be specified in each frame image.
  • the partial region including the body movement location can be specified over a plurality of frame images, that is, between the plurality of frame images.
  • the partial area where the infrared absorbing material 40 exists is specified by the following processing.
  • the image processing circuit 306 holds in advance in the ROM 302 information on the luminance value of the partial area observed when the infrared absorbing material 40 is present. This information is used as a threshold value of the luminance value, and a partial region having a luminance value equal to or lower than the threshold value is specified as a partial region where the infrared absorbing material 40 exists.
  • the luminance value at this time may be the sum of the luminance values of the pixels included in the partial area, or may be an average value. Depending on whether the sum of luminance values or the average value is adopted, the threshold may also change. Since the arithmetic processing for calculating the sum is smaller than the arithmetic processing for calculating the average value and the calculation load is small and the processing speed can be increased, the present embodiment is the sum of the luminance values of the pixels included in the partial area. And
  • the partial area including the body movement location is specified by the following process.
  • the region where the reflected light from the infrared absorbing material 40 is observed fluctuates due to body movement due to a biological reaction (respiration).
  • a partial region Q existing at a certain common coordinate position FIGS. 8A and 8B show examples of partial areas Q in two frame images taken at different times.
  • a region R shown in FIGS. 8A and 8B is assumed to be a low luminance region in which reflected light from the infrared absorbing material 40 is detected.
  • the partial area Q may or may not become a low luminance area due to body movement accompanying breathing.
  • FIG. 8C shows a change in the luminance value of the partial region Q at this time.
  • step S3 of FIG. 7 the partial area including the body movement location is specified as the partial area Q of the coordinate position indicating the luminance change shown in FIG. Then, a luminance value calculation (image processing) is performed with a group of pixels included in the partial region Q as a group.
  • step S4 the image processing circuit 306 calculates an average luminance value of the partial region Q including the body movement location.
  • step S5 the image processing circuit 306 counts the breathing rate of the subject using each calculated average luminance value.
  • Each calculated average luminance value is expressed as a waveform shown in FIG.
  • the image processing circuit 306 counts the number of breaths within a predetermined period, with one period of body movement specified by the average luminance value of the partial region Q oscillating as one breath.
  • the life activity measurement system 100 can acquire respiratory rate information with high accuracy.
  • a moving image taken by the camera 10 a difference in luminance between a region in the frame image where infrared light is absorbed by the infrared absorbing material 40 and a region of infrared light reflected by the subject 1 or the like is sufficiently large. . Therefore, it is easy to specify a partial region including body movement due to respiration from the infrared absorbing material 40 in the image.
  • FIGS. 9 (a) to 9 (f) show examples of the shape of the infrared absorbing material 40, respectively.
  • the reference numeral 40 is omitted.
  • the infrared absorbing material 40 in FIGS. 9A to 9D has a triangular shape, and the infrared absorbing material 40 in FIGS. 9E and 9F is configured by combining rectangular absorbing materials.
  • FIG. 9A shows an example of an infrared absorbing material 40 in which strip-shaped absorbing materials having different lengths are combined.
  • FIG. 9B shows an example of an infrared absorbing material 40 including a portion b1 that absorbs infrared light relatively well and a portion b2 that reflects infrared light relatively well.
  • the part b ⁇ b> 1 is provided at the outer edge of the infrared absorbing material 40
  • the part b ⁇ b> 2 is provided in a region inside the infrared absorbing material 40.
  • the frame image is divided into a plurality of partial areas using the infrared absorbing material 40 and processing is performed using the partial areas with low luminance, it may be difficult to capture body movements due to respiration. .
  • the brightness of the clothes or the background wall being worn is low, it is difficult to determine a partial region including body movement due to respiration based on the brightness. Therefore, a portion that reflects infrared light is formed in a part of the infrared absorbing material 40, and a luminance change is surely generated by body movement due to respiration.
  • FIG. 9C shows an example of the infrared absorbing material 40 in which the absorption rate changes in a gradation.
  • the intensity of reflected light from the infrared absorbing material 40 when the infrared absorbing material 40 is photographed changes in a gradation.
  • luminance becomes large because the position which the difference of the brightness produced moves by respiration. That is, the amplitude of the luminance signal is increased.
  • FIG. 9D shows an infrared absorbing material 40 including a predetermined pattern d1.
  • the pattern d1 can be formed using a material that absorbs infrared light relatively well. Since this pattern also appears in the frame image, the position including the direction of the infrared absorbing material 40 can be specified.
  • FIG. 9 (e) shows another example of the infrared absorbing material 40 including a portion e1 that absorbs infrared light relatively well and a portion e2 that reflects infrared light relatively well. Unlike FIG. 9B, in this example, a portion e ⁇ b> 1 is provided inside the infrared absorbing material 40. Since the number of boundaries increases, the conditions for setting the partial areas are easily adjusted.
  • FIG. 9 (f) shows an infrared absorbing material 40 in which portions f 1 and f 2 that absorb infrared light relatively well are dispersed and provided.
  • the portions f2 that reflect infrared light are provided at the four corners of the portion f1 that reflects infrared light.
  • the number of boundaries increases, so the conditions for setting the partial areas are easy to be prepared.
  • the marker at the back of the video may be interrupted depending on the physique of subject 1 and the angle of view at the time of shooting.
  • the triangular or quadrangular infrared absorbers and / or reflectors even if a part of the image is interrupted, the triangular or quadrangular shape is identified from the remaining unbroken shape. It becomes possible. That is, since not only the luminance information of the video but also the shape of the photographed object can be used as the information, it is easier to set the partial area as compared with the aspect using only the luminance information.
  • the infrared absorbing material and / or the reflecting material is a triangle, and one corner of the triangle is installed facing the camera side. Then, even if a part of the back side or corner of the triangle is missing on the photographed image, the visible portion (the remaining shape portion that is not interrupted) on the image and the triangle shape using the features related to the shape of the triangle Can be specified.
  • a rectangular infrared absorbing material and / or a reflecting material may be used. Either side of the rectangle is installed facing the camera. Then, even if one of the sides or corners of the rectangle is missing on the captured image, the rectangle is identified using the visible part (the unbroken side and / or corner) on the image and the features related to the rectangle. It becomes possible to do.
  • FIG. 10A shows an example in which the infrared absorbing material 40 of FIG. 9A is attached to the subject 1
  • FIG. 10B shows an imaging example.
  • the infrared absorbing material 40 is installed so that the edge portion of the infrared absorbing material 40 is located at a location (for example, the abdomen or chest) where body movement due to breathing of the subject 1 occurs.
  • the image processing circuit 306 of the information processing apparatus 30 holds in advance, for example, in the ROM 302 information indicating that the infrared absorbing material 40 having such an absorption pattern is used and the characteristics of the absorption pattern.
  • the image processing circuit 306 in each frame image of the obtained moving image, as shown in FIG. A region a1 (FIG. 9A) having a relatively low luminance value is specified from the region A including a2.
  • the image processing circuit 306 performs pattern matching processing on each frame image using the characteristics of the absorption pattern held in advance, and specifies the position of the infrared absorbing material 40.
  • the image processing circuit 306 divides each frame image into two or more.
  • the image processing circuit 306 sets a dividing line (boundary line) at a position across the infrared absorber 40. Further, the dividing line is set in a direction different from the body movement direction. For example, it is assumed that body movement is recognized in the vertical direction in the frame image.
  • the image processing circuit 306 sets a boundary line in the horizontal direction, divides each frame image into two or more, and sets a partial region.
  • the image processing circuit 306 can count the respiration rate of the subject 1 using the average luminance value of the partial area.
  • 11 (a1) to 11 (c1) each show an infrared absorbing material 40 in which an absorbing material that functions as a marker is provided around a triangular absorbing material.
  • an absorbing material that functions as a marker is provided around a triangular absorbing material.
  • the absorption portion 40a and the marker 40b are shown in FIG. 11 (a1).
  • the shape of the illustrated marker is an example. The shape is arbitrary as long as it can be identified in relation to the absorbing portion 40a.
  • the processing when using such an infrared absorbing material is generally as described above.
  • the infrared absorber 40 and its periphery are partially arranged so that the position is specified by using the infrared absorber 40 having a known shape including the absorber 40a and the marker 40b, and the dividing line comes to the position across the infrared absorber 40. What is necessary is just to divide into areas.
  • one of the absorbing portion 40a and the marker 40b may be formed of an absorbing material, and the other may be formed of a reflecting material.
  • the image processing circuit 306 may divide the marker 40b into two or more partial areas based on the searched surrounding marker 40b.
  • FIG. 11 (a2) shows two partial regions Q1 and Q2 provided in the marker 40b. Note that the shapes or sizes of the partial regions Q1 and Q2 may be different from each other. Depending on what kind of infrared absorbing material 40 is used, the shapes or sizes of the partial regions Q1 and Q2 may be determined in advance.
  • FIGS. 11B2 and 11C2 are the same as those in FIG. 11 (a1). Further, the partial region may be set in a shape exemplified in FIGS. 11B2 and 11C2.
  • FIG. 12 shows the camera 10 equipped with an optical filter 11 that blocks the wavelength in the visible light region.
  • This optical filter 11 is also called an infrared filter, for example.
  • the filter 11 is provided to photograph the subject 1.
  • the optical filter 11 radiates from the light source 20 and transmits infrared light reflected by the infrared absorber 40, the subject 1, and the like, but blocks visible light.
  • light other than infrared light more specifically visible light, is prevented from entering the camera 10, thereby affecting the change in the luminance value of the captured moving image. Can be reduced. Since fluctuations in the luminance value of each frame image due to visible light can be suppressed, it is possible to reduce the occurrence of disturbance noise due to only visible light and not due to biological reactions.
  • the inventors of the present application consider that it is very useful to provide the optical filter 11 that blocks the wavelength in the visible light region.
  • the reason is that at the time of actual photographing, some extraneous light enters the photographing environment and it is difficult to completely block the extraneous light.
  • a night light, an evacuation guide light, etc. are lit in the hospital even at night, which is the darkest shooting environment. In such a photographing environment, it is preferable to block visible light by the optical filter 11.
  • an optical filter that blocks not only visible light but also unnecessary infrared light may be provided.
  • a band pass filter that allows infrared light emitted from the light source 20 to pass therethrough may be provided as the optical filter 11.
  • an LED light source having a steep wavelength characteristic is adopted as the light source 20.
  • the wavelength is, for example, 850 nm or 940 nm and their vicinity.
  • the “steep wavelength characteristic” means that the fluctuation of the wavelength of the emitted infrared light is small here.
  • the camera 10 is provided with an optical filter having a bandpass characteristic that allows infrared light emitted from the light source 20 to pass therethrough as the optical filter 11.
  • the optical filter 11 that transmits infrared light having a wavelength of 850 nm is provided.
  • the camera 10 has sensitivity only to light having the same wavelength as that of infrared light emitted from the light source 20. Since not only visible light but also unnecessary infrared light can be blocked, the captured moving image is not affected by disturbance light.
  • infrared absorbing material 40 since the infrared absorbing material 40 is used, infrared light emitted from the light source 20 and reflected by the infrared absorbing material 40 or the like can be sufficiently identified. Therefore, the ease of capturing the reflected light is the same as that described above.
  • FIG. 13 shows the light source 20 provided with the polarizing filter 12a and the camera 10 provided with the polarizing filter 12b.
  • the camera 10 is provided with the optical filter 11 described above, but the optical filter 11 is not essential.
  • the polarizing filters 12a and 12b are installed in the camera 10 and the light source 20 so that their polarization directions coincide.
  • the camera 10 is sensitive only to light having the same polarization direction as the infrared light emitted from the light source 20 by the polarizing filters 12a and 12b.
  • the infrared light having a predetermined polarization direction that has passed through the polarizing filter 12 a out of the infrared light emitted from the light source 20 is reflected by the infrared absorbing material 40 and is incident on the camera 10. Therefore, the influence of disturbance light (visible light and infrared light) having a polarization direction different from the polarization direction can be eliminated.
  • FIG. 14 shows the configuration of the life activity measurement system 101 that uses the position marker 41 to determine the imaging direction. Except for the use of the position marker 41 and the processing of the information processing apparatus 30 regarding the position marker 41, the description is the same as the above description.
  • the position marker 41 is an infrared absorbing material provided in a fixed place such as a wall surface of a room where the life activity measurement system 101 is constructed. In this example, it is assumed that the position marker 41 has a pentagonal shape. However, this is an example.
  • the position marker 41 may be circular, elliptical, rectangular, or the like.
  • the shape and size of the position marker 41 are arbitrary as long as the camera 10 can identify the shape of the position marker 41. That is, the shape and size of the position marker 41 can be arbitrarily selected according to the resolution of the camera 10 in consideration of the distance between the position marker 41 and the camera 10.
  • the infrared light emitted from the light source 20 spreads in a conical shape and reaches the position marker 41, for example.
  • a region through which infrared light passes is shown as a space S.
  • a part of the reflected infrared light reaches the camera 10 without being absorbed by the absorbing material that is the position marker 41.
  • the intensity of the infrared light reflected by the position marker 41 is different from the intensity of the infrared light reflected by another object (a wall surface on which the position marker 41 is provided).
  • the camera 10 can image
  • the image processing circuit 306 of the information processing apparatus 30 holds, in advance, information on the shape of the position marker 41 and information on the position where the position marker 41 is installed, for example, in the ROM 302.
  • the position where the position marker 41 is installed is, for example, where the installation position of the camera 10 and the shooting direction are appropriately determined and when the position marker 41 is shot, in which position of the image where the position marker 41 is shot. This information identifies whether it exists.
  • the image processing circuit 306 analyzes the captured moving image and performs, for example, pattern matching processing using the stored information to determine whether or not the position marker 41 is included in the frame image of the moving image, and If it is included, the position is specified.
  • the image processing circuit 306 determines whether or not the specified position matches the position where the position marker 41 is to be installed with reference to information held in advance. If they do not match, it means that the camera 10 is not installed in the proper position and / or shooting direction.
  • the image processing circuit 306 notifies a warning indicating that they do not match. For example, the image processing circuit 306 sends a video signal to the display 32 to present a message “Camera position or shooting direction is shifted. Please check”. Alternatively, the CPU 301 may present a warning sound or a warning message via a voice processing circuit (not shown).
  • the life activity measurement system 101 detects the situation and notifies a warning. Can do.
  • the present embodiment relates to processing for setting a partial region in a frame image including a place where body movement due to respiration has occurred.
  • the life activity measurement system 100 shown in FIGS. 1 and 6 is referred to.
  • the difference between the present embodiment and the first embodiment is mainly the processing of the information processing apparatus 30 (FIGS. 1 and 6).
  • the same configurations and operations as those of the first embodiment, including the modified example of the infrared absorbing material 40, can be applied to the present embodiment.
  • an expected respiratory waveform may not be obtained due to the relationship between the position and size of the infrared absorber 40 and the size of a partial area that is one unit of image processing.
  • the partial region Q as shown in FIGS. 8A and 8B may not be specified.
  • a non-ideal region may be set as a unit region for performing luminance value calculation (image processing).
  • FIGS. 15A and 15B show an example in which a region at a coordinate position where a change in luminance value due to body movement does not appear is set as the partial region Q.
  • FIG. Due to body movement caused by respiration the position of the reflected light region R changes with the states of FIGS. 15A and 15B as the lower limit and the upper limit, respectively.
  • the partial area Q is always in the reflected light area R, the luminance value does not change due to body movement.
  • FIG. 15C shows a change in the luminance value of the set partial area Q. It is understood that the state of high brightness continues regardless of whether there is breathing. Since the fluctuation of the luminance value is small, it is very difficult to extract respiration information using the luminance value.
  • FIGS. 16A and 16B show another example in which a region at a coordinate position where a change in luminance value due to body movement does not appear is set as the partial region Q.
  • FIG. Assume that body movement is recognized in the vertical direction of the drawing.
  • the partial region Q is set so as to always include the upper and lower edges of the reflected light region R, the luminance value of the partial region Q does not change even if the reflected light region R changes. Even when the partial area Q is set in this way, it is very difficult to extract respiration information using the luminance value.
  • the image processing circuit 306 (FIG. 6) dynamically changes the size of the partial region Q for detecting a change in luminance value.
  • the image processing circuit 306 (FIG. 6) dynamically changes the size of the partial region Q for detecting a change in luminance value.
  • an example of setting the partial area Q will be described.
  • an area including a group of pixels for calculating a luminance value is referred to as a “processing unit area”.
  • the edge of the reflected light region R is specified, and when the coordinate position of the edge varies according to time, the processing unit region is set so as to include the region that the edge crosses.
  • the edge of the reflected light region R here is assumed to be one edge when there are a plurality of edges facing each other with respect to the fluctuation direction. For example, an area that simultaneously crosses two edges facing each other with respect to the changing direction is not set as a processing unit area.
  • FIGS. 17A and 17B show an example in which the partial region Q as the processing unit region is substantially the same as or larger than the region R of the reflected light from the infrared absorbing material 40.
  • FIGS. 17A and 17B show two frame images taken at different times.
  • Each frame image includes a region R of reflected light.
  • the coordinate position of the edge (boundary) of the region R changes with time. Therefore, the partial region Q including the region crossed by the edge of the region R is set as the processing unit region.
  • the ratio at which the reflected light region R and the partial region Q overlap changes with time. This change over time appears as a change in the luminance value of the partial region Q. Therefore, an area including such a change over time may be set as a processing unit area.
  • the luminance value of the processing unit region will not change, and counting the respiration rate using the change in luminance value is not possible. Can not.
  • FIG. 17C shows a change in luminance value of the partial region Q. Since the partial area Q is larger than the reflected light area R, it is possible to increase the dynamic range of the luminance change of the reflected light from the infrared absorbing material 40.
  • the size of the partial region Q as the processing unit region in FIGS. 8A and 8B is 64 pixels ⁇ 64 pixels
  • the size of the partial region Q is 256 pixels. x256 pixels.
  • FIGS. 18A and 18B show an example in which the partial area Q as the processing unit area is secured smaller than the partial area Q of FIG.
  • the partial region Q includes the edge (boundary) of the region R of the reflected light. That is, also in this example, since the ratio of the overlapping region R and the partial region Q changes with time, the luminance value of the partial region Q changes greatly.
  • FIG. 18C shows a change in luminance value of the partial region Q. According to FIG.18 (c), it is possible to count a respiration rate using the change of a luminance value.
  • the size of the partial area Q as the processing unit area in FIGS. 8A and 8B is 64 pixels ⁇ 64 pixels
  • the size of the partial area Q is 32 pixels. x32 pixels.
  • FIG. 19 shows the fluctuation range of the reflected light region R that varies with time, and the minimum settable processing unit regions Qa and Qb.
  • Both the processing unit areas Qa and Qb are areas that cross the edge of the area R when the area R of the reflected light fluctuates. In other words, both of the processing unit areas Qa and Qb exist at positions where part or all of them enter or leave the area R.
  • the ratio at which the reflected light region R and the partial region Qa or Qb overlap varies with time.
  • the processing unit area Qa includes a boundary (edge) of the reflected light area R when the change of the reflected light area R reaches the upper limit. That is, the processing unit area Qa is an area that exists at a position where a part of the processing unit area Qa enters or does not enter the area R.
  • the processing unit region Qb is a region that exists at a position where the entire region R enters or does not enter the region R as the reflected light region R changes.
  • One region Qc is a region that is always located in the region R of the reflected light regardless of changes in the region R of the reflected light.
  • the partial area Qc and the reflected light area R always have the same ratio of overlapping areas. Therefore, the partial area Qc is not suitable as a processing unit area.
  • the region Qa and / or Qb in the position satisfying the above-described conditions may be specified, and the processing unit region may be set in consideration of the performance of the information processing apparatus 30 and the like.
  • FIG. 20 shows examples of suitable processing unit areas Qd, Qe, and Qf.
  • Each region is a region that crosses the edge of the region R when the region R of the reflected light fluctuates.
  • FIG. 21 shows an operation procedure of the biological information monitoring apparatus 300 according to the present embodiment. This process is mainly executed by the CPU 301 and / or the image processing circuit 306. Hereinafter, an example in which the execution subject is the image processing circuit 306 will be described.
  • the image processing circuit 306 specifies a region R where the infrared absorbing material 40 exists from the acquired image.
  • the image processing circuit 306 holds information on luminance values in a region where reflected light from the infrared absorbing material 40 is observed in the ROM 302 in advance. This information is used as a threshold value of the luminance value, and a partial region having a luminance value equal to or higher than the threshold value is specified as a region where the infrared absorbing material 40 exists.
  • the image processing circuit 306 identifies a region including the edge of the infrared absorbing material 40. For example, the image processing circuit 306 specifies a portion where the difference in luminance value between adjacent pixels is equal to or greater than a predetermined value as an edge. Since the technique for detecting the edge is well known, detailed description thereof is omitted.
  • step S13 the image processing circuit 306 selects a region including an edge as a processing unit region.
  • the edge here refers to one edge when there are a plurality of edges facing each other with respect to the fluctuation direction.
  • step S14 the image processing circuit 306 adds and averages the luminance values of the pixels existing in the selected processing unit area.
  • step S15 the image processing circuit 306 determines a temporal change in the calculated average result as a respiratory waveform, and in step S16, counts the respiratory rate from the respiratory waveform.
  • step S17 the image processing circuit 306 sends a video signal to the display 32 to display information on the respiration rate.
  • the above steps S11 to S13 can be performed at any time even after the edge is detected once and the measurement of the respiration rate is started. For example, when the subject 1 rolls over, the magnitude of the luminance of light from the position where the infrared absorbing material 40 exists may change. In that case, the image processing circuit 306 may perform the processing of steps S11 to S13 again to reset the processing unit area resulting from the body movement. Compared with body movements due to respiration, body movements such as turning over are very large, and the coordinate position where light is detected changes greatly. The image processing circuit 306 performs the processes of steps S11 to S13 again when the coordinate position where the light is detected has moved by a predetermined amount or more. Note that the image processing circuit 306 continues to monitor the user's body movement in step S15. Therefore, when body movements other than breathing occur in the subject 1, the image processing circuit 306 can observe changes in body movements quickly and easily.
  • the life activity measurement system 100 shown in FIG. 1 has been described as an example.
  • the configuration of the life activity measurement system 100 is an example.
  • FIG. 22 shows a life activity measurement system 111 according to a modification of the life activity measurement system 100.
  • a plurality of cameras 10 are connected to the information processing apparatus 30 via the network 110.
  • the information processing apparatus 30 acquires moving image data output from the plurality of cameras 10 and individually performs the above-described processing. Similar to the configuration of FIG. 1, the light source 20 is not essential in the example of FIG.
  • the life activity measurement system 111 is laid, for example, in a hospital.
  • the camera 10 may be installed in each patient's home, and the information processing apparatus 30 may be installed in a hospital or the like.
  • the camera can reliably capture low-intensity areas that absorb infrared light and disturbance infrared light irradiated on the subject's detection target area, and can easily detect changes in luminance values caused by biological reactions. . Due to the effect of the infrared absorbing material, the brightness of the region where the absorbing material is present is lower than that of other regions, and the detection target region of the biological information can be easily specified.
  • the reflective material may be a retroreflective material.
  • the retroreflective material is a reflective material having an optical characteristic of reflecting incident light toward the incident direction. That is, the incident angle of light incident on the retroreflecting material is equal to the emission angle of light reflected by the retroreflecting material. However, this property is ideal and can actually be reflected in a direction different from some incident directions. When a reflective material is used, it is useful to provide the light source 20.
  • the camera 10 can photograph the subject 1 with a sufficient amount of light.
  • a cloth coated with glass beads is used as the retroreflecting material.
  • a retroreflecting material is appropriately selected, it can be used in measurement / inspection using a magnetic resonance imaging apparatus.
  • retroreflecting materials are formed by vapor-depositing aluminum.
  • the retroreflective material includes a metal material, the retroreflective material cannot be used for measurement / inspection (so-called MRI measurement / inspection) using a magnetic resonance imaging apparatus. This is because the captured image may be affected in the gantry of the magnetic resonance imaging apparatus.
  • a non-metallic retroreflective material In the environment where MRI measurement / inspection is performed, it is necessary to use a non-metallic retroreflective material.
  • a PET prism sheet can be used as a retroreflecting material.
  • a material that does not include a metal material may be used.
  • the above-described life activity measurement system can be used for heart rate measurement.
  • the optical absorbing material is installed at a position where the heart beat can be observed. For example, around the chest where the beating heart is located and around the neck where the movement associated with the beat can be measured.
  • Embodiments 1 and 2 may be used as a life activity measurement system for measuring heart rate.
  • FIG. 23 shows a procedure of a first heart rate measurement process performed by the life activity measurement system 100. What is different from the measurement processing procedure of FIG. 7 is step S21 of FIG.
  • the image processing circuit 306 counts the heart rate of the subject using each average luminance value calculated in step S4.
  • the waveform of the low luminance region 104 obtained at the time of heartbeat measurement is, for example, a pulse train waveform including a pulse corresponding to a pulsation.
  • the image processing circuit 306 counts the heart rate within a predetermined period using the pulse as one pulsation.
  • the life activity measurement system 100 can acquire respiratory rate information with high accuracy. Since the amount of infrared light reflected from the infrared absorbing material 40 is sufficiently large, using a moving image taken by the camera 10, it is possible to specify a partial region including body movement due to respiration from the infrared absorbing material 40 in the image. Easy.
  • the heart rate may be measured using the procedure according to the second embodiment.
  • FIG. 24 shows the procedure of the second heart rate measurement process performed by the life activity measurement system 100. What is different from the procedure of the measurement process in FIG. 21 is steps S31 to S33 in FIG. However, a specific difference is that the respiration waveform is changed to a pulse waveform.
  • step S31 the image processing circuit 306 determines a temporal change in the calculated averaged result as a pulse wave waveform, and in step S32, counts the heart rate from the pulse wave waveform.
  • step S33 the image processing circuit 306 sends a video signal to the display 32 to display heart rate information.
  • the heart rate as another example of the biological activity can be measured.
  • This specification discloses the measuring method and measuring system for life activity described in the following items.
  • a measurement method includes a life activity measurement system including an imaging device that generates a moving image based on observation light, and an image processing circuit that measures the life activity of a subject using the moving image. And a method for measuring the biological activity of the subject, wherein (a) at least one absorbent material having an absorption rate equal to or higher than a predetermined value is disposed at a position where a body motion associated with the biological activity of the subject occurs. And (b) the imaging device is configured to receive, at a plurality of times, the light that is partially absorbed by the at least one absorber and the remaining part is reflected by the subject or the at least one absorber. Receiving and generating a moving image composed of a plurality of time-series frame images; and (c) the image processing circuit measures the biological activity of the subject based on luminance information of the plurality of frame images. You Including the step.
  • the position of the absorbent material is specified using the pattern of the absorbent material, and the body movement caused by biological activities such as breathing Can be easily captured from changes in a plurality of frame images.
  • a measurement method is a biological activity measurement including an imaging device that generates a moving image based on observation light, and an image processing circuit that measures the biological activity of a subject using the moving image.
  • a method for measuring the biological activity of the subject using a system wherein (a) the position of occurrence of body movement associated with the biological activity of the subject has an absorptance greater than or equal to a predetermined value, and an optical absorptance Disposing at least one absorber including a plurality of different parts; and (b) the imaging device is partially absorbed by the at least one absorber and the remaining part is the subject or the at least Receiving the light reflected by one absorber at a plurality of times and generating a moving image composed of a plurality of time-series frame images; and (c) the image processing circuit includes the plurality of frames.
  • Image brightness information Based comprising the steps of measuring the biological activities of the subject to.
  • luminance is obtained by photographing the absorber with an imaging device.
  • the absorbent material moves due to the subject's biological activity (for example, respiration)
  • the change in luminance information increases, that is, the amplitude of the luminance signal increases. It is possible to improve accuracy by measuring the life activity using the luminance information.
  • the image processing circuit includes: Using the at least one absorbent material, identify a partial area of each frame image, the partial area including the at least one absorbent material and including the position of occurrence of the body movement, Item 3.
  • the at least one absorbent material has a predetermined absorption pattern;
  • the image processing circuit holds in advance information for specifying the predetermined absorption pattern,
  • the image processing circuit detects a predetermined absorption pattern in each frame image by performing a pattern matching process using the information, and identifies a partial region including the at least one absorber.
  • the image processing circuit specifies a first direction that is the direction of the body movement, and a plurality of the frame images are arranged along a second direction different from the first direction.
  • Item 4 The measurement method according to Item 3, wherein the method is divided into partial areas.
  • the at least one absorbent material has a predetermined absorption pattern;
  • the optical filter that mainly transmits light having the wavelength ⁇ further includes a step of allowing the light reflected without being absorbed by the at least one absorber to pass through the optical filter. Measurement method.
  • the imaging device receives the light reflected by a material around the position marker that is not absorbed by the position marker, and generates a moving image composed of a plurality of frame images;
  • the image processing circuit further includes a step of determining whether or not the imaging device is capturing a predetermined direction based on at least one of the plurality of frame images. 12. The measuring method according to any one of 12.
  • the light source emits infrared light; 14. The measurement method according to any one of items 1 to 13, wherein in the step (a), the at least one absorber disposed absorbs the infrared light.
  • the absorptance greater than or equal to the predetermined value in the step (a) is an absorptivity that causes a difference in luminance that allows the at least one absorber or a material other than the at least one absorber to be significantly identified. 15. The measuring method according to any one of 15.
  • Item 17 The measurement method according to any one of Items 1 to 16, wherein in the step (c), the image processing circuit measures the respiration rate or heart rate of the subject as the sexual activity.
  • a measurement system is a measurement system including an imaging device that generates a moving image based on observation light, and an image processing circuit that measures the biological activity of a subject using the moving image.
  • the imaging device When at least one absorber having an absorption rate equal to or higher than a predetermined value is disposed at a position where body movement associated with the subject's biological activity occurs, the imaging device is partially absorbed by the absorber. The remaining part receives the light reflected by the subject at a plurality of times, generates the moving image composed of a plurality of time-series frame images, and the image processing circuit The moving image is received, and the biological activity of the subject is measured based on luminance information of the plurality of frame images.
  • a measurement system is a measurement system including an imaging device that generates a moving image based on observation light, and an image processing circuit that measures the biological activity of a subject using the moving image. And, when at least one absorbing material including a plurality of portions having a light absorption rate different from the light absorption rate at a position where the body movement associated with the biological activity of the subject is greater than or equal to, The imaging device receives a part of the light that is absorbed by the at least one absorber and the other part is reflected by the subject or the at least one absorber at a plurality of times. The moving image composed of a plurality of frame images is generated, and the image processing circuit measures the biological activity of the subject based on luminance information of the plurality of frame images.
  • a computer program provides image processing in a measurement system including an imaging device that generates a moving image based on observation light, and an image processing circuit that measures the biological activity of a subject using the moving image.
  • a computer program executed by a circuit wherein at least one absorbent material having an absorption rate equal to or higher than a predetermined value is disposed at a position where a body motion associated with a biological activity of the subject is generated.
  • the image processing circuit is a process of receiving a moving image generated by the imaging device, wherein a part of the light is absorbed by the absorber and the remaining part is reflected by the subject or the absorber. Receiving the moving image composed of a plurality of time-series frame images received at a plurality of times; and Based on the degree information to execute a process of measuring the biological activity of the subject.
  • the present invention can be used as a method for analyzing a moving image obtained by photographing a subject and measuring the life activity of the subject, particularly the number of breaths, in a non-contact manner.
  • the present invention can also be used as an apparatus, system, and computer program for analyzing such moving images and measuring life activity.

Landscapes

  • Health & Medical Sciences (AREA)
  • Life Sciences & Earth Sciences (AREA)
  • Heart & Thoracic Surgery (AREA)
  • Medical Informatics (AREA)
  • Physics & Mathematics (AREA)
  • Veterinary Medicine (AREA)
  • Biophysics (AREA)
  • Pathology (AREA)
  • Engineering & Computer Science (AREA)
  • Biomedical Technology (AREA)
  • Physiology (AREA)
  • Public Health (AREA)
  • Molecular Biology (AREA)
  • Surgery (AREA)
  • Animal Behavior & Ethology (AREA)
  • General Health & Medical Sciences (AREA)
  • Oral & Maxillofacial Surgery (AREA)
  • Dentistry (AREA)
  • Pulmonology (AREA)
  • Measurement Of The Respiration, Hearing Ability, Form, And Blood Characteristics Of Living Organisms (AREA)

Abstract

Le problème décrit par la présente invention est de fournir un procédé de mesure de l'activité biologique provoquée par la respiration, pour laquelle les conditions de mesure de l'activité biologique ne sont pas facilement influencées par l'environnement. La solution selon l'invention porte sur un procédé de mesure de l'activité biologique provoquée par la respiration. Le procédé de mesure d'activité biologique comprend (a) une étape consistant à disposer au moins un élément absorbant ayant une vitesse d'absorption supérieure ou égale à une valeur prescrite dans une position où se produit un mouvement corporel qui accompagne la respiration du sujet, (b) une étape consistant, pour un dispositif d'imagerie, à générer une vidéo comprenant une pluralité d'images de trame au moyen d'une réception de lumière, dont une partie est absorbée par le ou les éléments absorbants et la partie restante qui est réfléchie par le sujet ou le ou les éléments absorbants, (c) et une étape consistant, pour un circuit de traitement d'image, à mesurer l'activité biologique provoquée par la respiration du sujet sur la base des informations de luminance de la pluralité d'images de trame.
PCT/JP2016/086876 2016-01-13 2016-12-12 Procédé de mesure d'activité biologique du sujet, système de mesure, et programme informatique WO2017122477A1 (fr)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
JP2016-004180 2016-01-13
JP2016004180A JP6185090B2 (ja) 2016-01-13 2016-01-13 計測システム

Publications (1)

Publication Number Publication Date
WO2017122477A1 true WO2017122477A1 (fr) 2017-07-20

Family

ID=59310933

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/JP2016/086876 WO2017122477A1 (fr) 2016-01-13 2016-12-12 Procédé de mesure d'activité biologique du sujet, système de mesure, et programme informatique

Country Status (2)

Country Link
JP (1) JP6185090B2 (fr)
WO (1) WO2017122477A1 (fr)

Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2015523132A (ja) * 2012-06-12 2015-08-13 コーニンクレッカ フィリップス エヌ ヴェ カメラによる生命徴候測定システム
WO2015186374A1 (fr) * 2014-06-03 2015-12-10 株式会社イデアクエスト Dispositif de mesure de mouvement respiratoire

Patent Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2015523132A (ja) * 2012-06-12 2015-08-13 コーニンクレッカ フィリップス エヌ ヴェ カメラによる生命徴候測定システム
WO2015186374A1 (fr) * 2014-06-03 2015-12-10 株式会社イデアクエスト Dispositif de mesure de mouvement respiratoire

Also Published As

Publication number Publication date
JP2017123966A (ja) 2017-07-20
JP6185090B2 (ja) 2017-08-23

Similar Documents

Publication Publication Date Title
US11657636B2 (en) Human presence detector and human presence detection method thereof
US9436873B2 (en) Method and system for monitoring the skin color of a user
JP6885939B2 (ja) センサ位置案内のためのデバイス、システム、方法及びコンピュータ・プログラム
EP3057487B1 (fr) Dispositif et procédé pour l'obtention d'un signe vital chez un sujet
CN105142516B (zh) 用于确定来自对象的生命体征信息的装置和方法
RU2697291C2 (ru) Система и способ определения информации об основных показателях состояния организма
US10143377B2 (en) Single channel imaging measurement of dynamic changes in heart or respiration rate
US10058272B2 (en) Sleep monitoring system and method
US20190200871A1 (en) System and method for vital signs detection
US20120243747A1 (en) System and Method for Precision Measurement of Position, Motion and Resonances
JP2013524919A (ja) 呼吸運動検出装置
JP2015229101A (ja) 呼吸運動測定装置
CN109009052A (zh) 基于视觉的嵌入式心率测量系统及其测量方法
CN109564382A (zh) 拍摄装置以及拍摄方法
WO2020248543A1 (fr) Procédé et dispositif de détection de cible anormale et support d'informations
JP6280650B2 (ja) 被験体の呼吸に起因する生体活動の計測方法および計測システム
WO2017047734A1 (fr) Dispositif de mesure
CN106033636A (zh) 一种火灾监控方法及系统
JP2006293646A (ja) 画像処理装置
JP2016214937A (ja) 計測システムおよびコンピュータプログラム
JP6185090B2 (ja) 計測システム
JP6002811B1 (ja) 計測システム、被験体の呼吸に起因する生体活動の計測方法およびコンピュータプログラム
CN106778617A (zh) 一种基于图像采集技术的睡眠监测方法及系统
WO2016076009A1 (fr) Système de mesure de l'activité biologique due à la respiration d'un sujet et dispositif de traitement d'image
WO2017119238A1 (fr) Système pour mesurer des fonctions corporelles provoquées par respiration du sujet

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 16885080

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 16885080

Country of ref document: EP

Kind code of ref document: A1