WO2016009901A1 - Procédé de mesure de l'activité biologique résultant de la respiration d'un sujet, système de mesure et programme informatique - Google Patents

Procédé de mesure de l'activité biologique résultant de la respiration d'un sujet, système de mesure et programme informatique Download PDF

Info

Publication number
WO2016009901A1
WO2016009901A1 PCT/JP2015/069550 JP2015069550W WO2016009901A1 WO 2016009901 A1 WO2016009901 A1 WO 2016009901A1 JP 2015069550 W JP2015069550 W JP 2015069550W WO 2016009901 A1 WO2016009901 A1 WO 2016009901A1
Authority
WO
WIPO (PCT)
Prior art keywords
light
processing circuit
subject
image processing
retroreflecting material
Prior art date
Application number
PCT/JP2015/069550
Other languages
English (en)
Japanese (ja)
Inventor
智之 市座
貴行 山内
池田　豊
蔭地　謙作
三木　成一郎
Original Assignee
シャープ株式会社
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by シャープ株式会社 filed Critical シャープ株式会社
Priority to JP2016534383A priority Critical patent/JP6280650B2/ja
Publication of WO2016009901A1 publication Critical patent/WO2016009901A1/fr

Links

Images

Classifications

    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00—Measuring for diagnostic purposes; Identification of persons
    • A61B5/08—Detecting, measuring or recording devices for evaluating the respiratory organs
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00—Measuring for diagnostic purposes; Identification of persons
    • A61B5/103—Detecting, measuring or recording devices for testing the shape, pattern, colour, size or movement of the body or parts thereof, for diagnostic purposes
    • A61B5/11—Measuring movement of the entire body or parts thereof, e.g. head or hand tremor, mobility of a limb

Definitions

  • the present invention relates to a technique for measuring a biological activity caused by respiration, such as a subject's respiration rate, from a subject's video.
  • a technique in which a subject is photographed with a camera, a change in luminance value due to a biological reaction such as body movement or blood flow is detected from the moving image, and a biological activity such as a subject's respiratory rate or heart rate is measured (for example, Patent Documents 1 and 2).
  • the image area in which the subject is photographed is specified by an observer in advance or by using a contour extraction technique.
  • the respiration monitoring device of Patent Literature 1 divides an image obtained by photographing a subject into local regions and analyzes lightness information of each local region. Then, using the three types of threshold values, it is determined whether the subject is observing movement around the chest or observing non-respiratory body movement such as turning over.
  • the heart rate measuring device of Patent Document 2 captures a subject's face with a camera equipped with an infrared light source, extracts a specific region between eyebrows from a face image for each frame, and corrects the average luminance.
  • the heart rate measuring device obtains a waveform of a temporal change in corrected luminance from the corrected average luminance time series, and calculates the heart rate of the subject by filtering the waveform in a frequency band corresponding to the heart rate. .
  • an appropriate threshold necessary for determining non-respiratory body movement varies greatly depending on the imaging environment.
  • the threshold value to be set can vary greatly depending on changes in the brightness of the observation location, the position of the indoor light source, the presence or absence of incident light from the outside, and the movement of people or objects other than the subject. Since there is no method for always obtaining an appropriate threshold value, an area for obtaining biological information such as respiration cannot be calculated if the threshold value is inappropriate.
  • the heart rate measuring device of Patent Document 2 needs to capture the subject's face within the imaging range. Similar to Patent Document 1, when the shooting environment changes such as a change in illuminance, movement of a person, incidence of external light, etc., the luminance value of the image area in which the subject is photographed changes greatly due to a cause other than biological activity. When such disturbance noise occurs, the body movement location caused by the biological reaction cannot be specified, and the biological information may not be extracted accurately.
  • the subject's face moves away from the camera, the accuracy of acquiring the subject's biological information is reduced, so the subject's face must be imaged from a relatively short distance. As a result, a feeling of pressure is given to the subject, and there is a concern about the influence on the biological activity to be measured.
  • the present invention has been made in order to solve the above-described problems, and is a measurement system for biological activity caused by respiration, a measurement method for biological information, etc. I will provide a.
  • a measurement method includes a light source that emits light, an imaging device that receives the light to generate a moving image, and an image processing circuit that measures the biological activity of a subject using the moving image.
  • a biological activity measurement system comprising: (a) a predetermined reflection pattern at a generation position of body movement associated with respiration of the subject. Placing a retroreflecting material; (b) the light source irradiating the subject with the light; and (c) the imaging device receiving the light reflected by the retroreflecting material.
  • the image processing circuit measures the life activity based on a change in luminance value of the plurality of frame images.
  • the image processing circuit divides each frame image into a plurality of partial areas and measures the biological activity based on a change in luminance value of the plurality of partial areas. .
  • the image processing circuit is a partial region of each frame image using the predetermined reflection pattern, the retroreflective material is included, and The partial area including the position where the body movement is generated is specified, and the biological activity is measured using a change in luminance value of the specified partial area.
  • the image processing circuit holds information for specifying the predetermined reflection pattern in advance, and the image processing circuit uses the information to perform pattern matching processing.
  • the predetermined reflection pattern is detected in each frame image, and the partial region including the retroreflecting material is specified.
  • the image processing circuit specifies a partial region of each frame image including a boundary of the retroreflecting material.
  • the image processing circuit specifies a first direction that is a direction of the body movement, and along a second direction different from the first direction, Each frame image is divided into a plurality of partial areas.
  • the predetermined reflection pattern of the retroreflecting material includes a first portion that reflects the light and a second portion that does not reflect the light in the direction of the imaging device.
  • the second portion is provided around the retroreflecting material.
  • the first portion is provided around the retroreflecting material.
  • the predetermined reflection pattern of the retroreflecting material includes a predetermined pattern.
  • the predetermined reflection pattern of the retroreflective material includes a plurality of portions having different light reflectivities.
  • the predetermined reflection pattern of the retroreflecting material includes a portion where the reflectance of the light continuously changes.
  • the measurement method further includes the step of (e) blocking visible light incident on the imaging device using an optical filter.
  • the wavelength of the light when the wavelength of the light is ⁇ , (f) the light reflected by the retroreflecting material is passed through an optical filter that mainly transmits light of the wavelength ⁇ .
  • the method further includes a step of passing.
  • the light source is a light emitting diode that emits light having a wavelength ⁇ of 850 nm or 940 nm.
  • the measurement method includes: (g) passing the light emitted from the light source through a polarizing element having a predetermined polarization direction; and (h) the light reflected by the retroreflecting material. Passing light through a polarizing element having the same polarization direction as the predetermined polarization direction.
  • the measurement method includes (i) a step of further providing a retroreflecting material having a predetermined shape as a position marker at a fixed position; and (j) the imaging device includes the position marker.
  • the imaging device includes the position marker.
  • the measurement method includes: (l) a warning in step (k) when the image processing circuit determines that the imaging device is not shooting a predetermined direction or position. Is further included.
  • the retroreflective material is made of a non-metallic material.
  • a measurement system includes a light source that emits light, an imaging device that receives the light and generates a moving image, and an image processing circuit that measures a biological activity of a subject using the moving image.
  • a retroreflecting material is disposed at a position where body movement occurs due to breathing of the subject, and when the light is emitted from the light source toward the subject, the measurement system includes: The imaging device receives the light reflected by the retroreflecting material at a plurality of times and generates the moving image composed of a plurality of time-series frame images, and the image processing circuit includes the imaging device The moving image is received from the frame, and the biological activity caused by the breathing of the subject is measured based on the change in the luminance value of the plurality of frame images.
  • the image processing circuit specifies a partial region that includes the retroreflecting material and includes the position where the body motion is generated from each frame image, and the luminance value of the specified partial region is determined.
  • the life activity is measured using the change.
  • each of the frame images has a first partial area having a relatively high luminance value corresponding to the light reflected by the retroreflecting material, and a relative luminance value higher than that of the first partial area.
  • the second partial area is low, and the image processing circuit changes over time the luminance value of the coordinate position across the boundary between the first partial area and the second partial area across the plurality of frame images. The life activity is measured by utilizing this.
  • the image processing circuit includes a partial region including a coordinate position crossed by the boundary, and a coordinate position where a ratio of the first partial region and the second partial region changes with time. With respect to the partial area, a change in the luminance value is detected.
  • the image processing circuit sets the processing unit area at the same coordinate position of each frame image.
  • the size of the partial area is variable.
  • the image processing circuit when the image processing circuit detects that the position of the region including the retroreflecting material has moved by a predetermined amount or more, the image processing circuit again performs the recursion from each frame image.
  • a new partial area that includes a reflective reflector and that includes the position of occurrence of the body movement is specified, and the biological activity is measured using a change in luminance value of the specified new partial area.
  • a computer program includes a light source that emits light, an imaging device that receives the light and generates a moving image, and an image processing circuit that measures a subject's biological activity using the moving image.
  • a computer program executed by an image processing circuit in a measurement system comprising: a retroreflecting material disposed at a position where a body motion accompanying breathing of the subject occurs, and from the light source toward the subject
  • the computer program receives, in the image processing circuit, a moving image generated by the imaging device, and the light reflected by the retroreflecting material is received at a plurality of times.
  • a step of measuring the biological activity resulting from respiration of the subject based on.
  • the light source and the retroreflective material are used in combination, even if the surroundings are dark or bright, and even if the distance between the subject and the imaging device is sufficiently separated, it can be used for biological activities such as breathing.
  • the resulting body movement can be captured from changes in a plurality of frame images. Since the imaging device can be set apart from the subject and the imaging environment can be set to be dark, it is possible to acquire biological information with sufficiently high accuracy while sufficiently reducing the feeling of pressure applied to the subject.
  • FIG. It is a figure which shows the structure of the biological activity measurement system 100 by Embodiment 1.
  • FIG. It is a figure which shows the frame image 102 which image
  • FIG. It is a figure which shows the vibration of the high-intensity area
  • FIG. 2 is a diagram illustrating an example of a hardware configuration of an information processing apparatus 30 of the life activity measurement system 100 mainly.
  • FIG. 4 is a flowchart illustrating a procedure of processing performed in the biological activity measurement system 100.
  • (A) And (b) is a figure which shows the example of the partial area Q in two frame images image
  • (c) is a figure which shows the change of the luminance value of the partial area Q. is there.
  • (A)-(f) is a figure which shows the example of the shape of the retroreflection material 40, respectively.
  • FIG. 1 is a figure which shows the example which mounted
  • (b) is a figure which shows the example of an imaging.
  • (A1) to (c1) are diagrams showing a retroreflecting material 40 provided with a reflecting material functioning as a marker around a triangular reflecting portion, and (a2) to (c2) are respectively shown in the marker. It is a figure which shows the two partial area
  • FIG. (A) And (b) is a figure which shows the example in which the area
  • FIG. (A) And (b) is a figure which shows the example which ensured the partial area
  • (C) is a figure which shows the change of the luminance value of the partial area Q.
  • FIG. (A) And (b) is a figure which shows the example which ensured the partial area Q as a process unit area smaller than the partial area Q of FIG. 8
  • (c) is a figure which shows the change of the luminance value of the partial area Q.
  • FIG. 10 is a flowchart illustrating an operation procedure of the biological information monitoring apparatus 300 according to the second embodiment. It is a figure which shows the life activity measurement system 111 by the modification of the life activity measurement system.
  • FIG. 1 shows a configuration of a life activity measurement system 100 according to the present embodiment.
  • the life activity measurement system 100 includes a camera 10, a light source 20, an information processing device 30, and a retroreflecting material 40. Although the subject 1 is shown in FIG. 1, the subject 1 is not included in the life activity measurement system 100.
  • the life activity measurement system 100 is used for observing the life activity of the subject 1.
  • the life activity is the respiration of the subject 1, and the life activity measurement system 100 measures the respiration rate within a predetermined time.
  • the subject 1 is described as being a person, it may be an animal other than a person. Animals (including people) as observation targets may be collectively referred to as “subjects”.
  • the camera 10 is a so-called imaging device, and shoots the subject 1 to generate a moving image.
  • the camera 10 sends moving image data to the information processing apparatus 30 by wire or wirelessly.
  • the light source 20 is a light source that emits light 20a.
  • the light may be visible light or invisible light (for example, infrared light).
  • infrared light will be described as an example.
  • the light 20a is described as “infrared light 20a”.
  • the information processing apparatus 30 receives moving image data captured by the camera 10 and measures the respiration rate of the subject 1 using changes in images between a plurality of frame images constituting the moving image. Details of the operation of the information processing apparatus 30 will be described later.
  • the retroreflective material 40 is a reflective material having an optical characteristic of reflecting incident light toward the incident direction. That is, the incident angle of light incident on the retroreflecting material 40 is equal to the emission angle of light reflected by the retroreflecting material 40. However, this property is ideal and can actually be reflected in a direction different from some incident directions.
  • the optical axis of the light source 20 and the optical axis of the camera 10 are arranged close to each other. Thereby, the infrared light 20a emitted from the light source 20 is reflected by the retroreflecting material 40, and most of the light enters the camera 10 as infrared light 20b. Therefore, the camera 10 can photograph the subject 1 with a sufficient amount of light.
  • a cloth coated with glass beads is used as the retroreflecting material 40.
  • the disturbance light 21a incident on the retroreflecting material 40 is reflected in the incident direction as reflected light 21b. Since the reflected light 21b does not substantially enter the camera 10, the moving image photographed by the camera 10 is hardly affected by disturbance light.
  • the overall operation of the life activity measurement system 100 is outlined as follows.
  • the observer or the subject 1 arranges the retroreflecting material 40 having a predetermined reflection pattern at the position where the body movement accompanying the breathing of the subject 1 occurs.
  • the camera 10 receives the infrared light reflected by the retroreflecting material 40 and captures a moving image of the subject 1.
  • FIG. 2 shows a frame image 102 obtained by photographing the subject 1 wearing the retroreflecting material 40.
  • a high brightness area (white area) 104 in the center of the image is an area where the reflected light from the retroreflecting material 40 is detected.
  • FIG. 3 shows a frame image 106 obtained by photographing a subject who does not wear the retroreflecting material 40. When the retroreflecting material 40 is not present, it can be said that the luminance change in the captured frame image is very small.
  • FIG. 2 and FIG. 3 show a plurality of vertical lines and horizontal lines, which are boundaries virtually provided for image processing. In this specification, an area of an image divided by a boundary line is referred to as a “partial area” of the image.
  • FIG. 2 illustrates the partial region P. Note that the boundary lines of the partial areas P are highlighted for convenience of understanding.
  • a predetermined reflection pattern is provided on the retroreflecting material 40, and the high-intensity region 104 is detected more reliably and more easily using the reflection pattern.
  • the shape of the reflection pattern does not appear.
  • the information processing apparatus 30 analyzes each of a plurality of time-series frame images constituting the moving image as shown in FIG. 2 and determines the body movement of the subject 1 based on the change in the luminance value of the plurality of frame images. To detect. More specifically, the information processing apparatus 30 detects the high luminance region 104 shown in FIG. 2 over a plurality of frame images. Since the body movement of the subject 1 during calm occurs due to breathing, the position of the high-intensity region 104 changes (vibrates) in accordance with the breathing cycle. The information processing apparatus 30 can measure the respiratory rate of the subject 1 during the period by counting the number of respiratory cycles over a predetermined period, where one period of vibration of the high-intensity region 104 is one respiratory period.
  • the respiratory rate is an example of a biological activity resulting from the subject's breathing
  • other biological activities resulting from the subject's breathing may be measured.
  • a subject's breathing motion is measured, and a waveform resulting from breathing (a waveform corresponding to the breathing waveform) is derived from body motion due to breathing.
  • other biological activities that can be evaluated using the waveform, for example, biological activities such as breathing depth, turbulence, apnea periods, frequency of occurrence of apnea periods, This is the category of the biological activity to be measured.
  • FIG. 4 shows the vibration of the high luminance region 104 measured based on the change of the luminance value of the plurality of frame images.
  • Waveforms observed using the retroreflecting material 40 can accurately measure body movement due to respiration even in a dark imaging environment. That is, it is possible to measure body movement, that is, respiration, using the luminance value.
  • FIG. 5 shows changes in luminance values of a plurality of frame images taken in a dark shooting environment without providing the retroreflecting material 40. Due to the absence of the retroreflecting material 40, the luminance change in the image is originally small, and therefore the influence of noise is very large even if the change in the luminance value is observed over a plurality of frame images.
  • the scale of the vertical axis differs by several times.
  • the scale in FIG. 5 is larger than that in FIG.
  • the direction using the retroreflecting material 40 means that the signal-to-noise ratio (SNR) is superior to the direction not using it (FIG. 5).
  • the retroreflecting material 40 by using the retroreflecting material 40, it is possible to perform imaging while ensuring a sufficient amount of reflected infrared light.
  • the subject 1 and the camera 10 can be set apart by, for example, about 6 m.
  • the room to be measured can be darkened.
  • the environment is less susceptible to changes in the brightness of the observation location, the position of the indoor light source, and the presence or absence of incident light from outside, that is, an environment in which the influence of noise is small. It becomes possible to shoot with. Therefore, it becomes possible to measure the biological activity more accurately.
  • FIG. 6 shows an example of the hardware configuration of the information processing apparatus 30 mainly in the life activity measurement system 100.
  • the information processing apparatus 30 is connected to the camera 10 and the display 32.
  • the information processing apparatus 30 receives captured moving image data from the camera 10.
  • the display 32 displays a measurement result of the number of breaths that is the biological activity of the subject 1 as a result of the processing.
  • the information processing apparatus 30 may display a warning on the display 32.
  • the information processing apparatus 30 includes a CPU 301, a ROM 302, a RAM 303, a hard disk drive (HDD) 304, an interface (I / F) 305, and an image processing circuit 306.
  • the CPU 301 controls the operation of the information processing apparatus 30.
  • the ROM 302 stores a computer program.
  • the computer program is a group of instructions for causing the CPU 301 or the image processing circuit 306 to perform processing shown by a flowchart described later, for example.
  • a RAM 303 is a work memory for developing a computer program when executed by the CPU 301.
  • the HDD 304 is a storage device that stores moving image data received from the camera 10 or measured respiratory rate data of the subject 1.
  • the I / F 305 is an interface for the information processing apparatus 30 to receive moving image data from the camera 10.
  • the I / F 305 is, for example, an Ethernet (registered trademark) terminal.
  • the I / F 305 is a transmission / reception circuit that performs communication based on, for example, the Wi-Fi (registered trademark) standard.
  • the I / F 305 may be a wired video input terminal.
  • the image processing circuit 306 is a so-called graphics processor that analyzes moving image data.
  • the image processing circuit 306 detects a high luminance area of each frame image of the moving image, detects a body movement based on the vibration of the high luminance area, and counts the respiration rate based on the vibration waveform of the body movement.
  • the image processing circuit 306 is provided separately from the CPU 301, but this is an example.
  • the CPU 301 may perform processing of an image processing circuit 306 described later.
  • FIG. 7 shows a procedure of processing performed in the life activity measurement system 100.
  • step S1 the camera 10 photographs the subject 1 wearing the retroreflecting material 40.
  • the captured moving image is sent to the information processing apparatus 30.
  • step S2 the image processing circuit 306 of the information processing apparatus 30 divides each of a plurality of frame images constituting the captured moving image into a plurality of partial areas.
  • the partial region (for example, the partial region P in FIG. 2) has, for example, a size of 64 pixels in the horizontal direction and 64 pixels in the vertical direction. Note that “divide” does not require division as an actual operation. For example, the operation of setting the size of the partial area as a unit for cutting out an image or a unit for performing processing may be included in the “dividing” operation described here.
  • step S3 the image processing circuit 306 specifies a partial region where the retroreflective material 40 exists and a partial region including a body movement location due to a biological reaction based on the luminance value of each partial region. This will be described more specifically.
  • the partial region where the retroreflecting material 40 exists can be specified in each frame image.
  • the partial region including the body movement location can be specified over a plurality of frame images, that is, between the plurality of frame images.
  • the partial area where the retroreflective material 40 exists is specified by the following processing.
  • the image processing circuit 306 holds information on luminance values of partial areas observed when the retroreflecting material 40 exists in the ROM 302 in advance. Using this information as a threshold value of the luminance value, a partial region having a luminance value equal to or higher than the threshold value is specified as a partial region where the retroreflecting material 40 exists.
  • the luminance value at this time may be the sum of the luminance values of the pixels included in the partial area, or may be an average value. Depending on whether the sum of luminance values or the average value is adopted, the threshold may also change. Since the arithmetic processing for calculating the sum is smaller than the arithmetic processing for calculating the average value and the calculation load is small and the processing speed can be increased, the present embodiment is the sum of the luminance values of the pixels included in the partial area. And
  • the partial area including the body movement location is specified by the following process.
  • the region where the reflected light from the retroreflecting material 40 is observed varies due to body movement caused by a biological reaction (respiration).
  • a partial region Q existing at a certain common coordinate position FIGS. 8A and 8B show examples of partial areas Q in two frame images taken at different times.
  • a region R shown in FIGS. 8A and 8B is assumed to be a high luminance region in which reflected light from the retroreflecting material 40 is detected.
  • the partial area Q may or may not become a high luminance area due to body movement accompanying breathing.
  • FIG. 8C shows a change in the luminance value of the partial region Q at this time.
  • step S3 of FIG. 7 the partial area including the body movement location is specified as the partial area Q of the coordinate position indicating the luminance change shown in FIG. Then, a luminance value calculation (image processing) is performed with a group of pixels included in the partial region Q as a group.
  • step S4 the image processing circuit 306 calculates an average luminance value of the partial region Q including the body movement location.
  • step S5 the image processing circuit 306 counts the breathing rate of the subject using each calculated average luminance value.
  • Each calculated average luminance value is expressed as a waveform shown in FIG.
  • the image processing circuit 306 counts the number of breaths within a predetermined period, with one period of body movement specified by the average luminance value of the partial region Q oscillating as one breath.
  • the life activity measurement system 100 can acquire respiratory rate information with high accuracy. Since the amount of infrared light reflected from the retroreflecting material 40 is sufficiently large, when a moving image taken by the camera 10 is used, a partial region including body movement due to respiration is specified from the retroreflecting material 40 in the image. It is easy.
  • FIGS. 9 (a) to 9 (f) show examples of the shape of the retroreflecting material 40, respectively.
  • the reference numeral 40 is omitted.
  • the retroreflecting material 40 in FIGS. 9A to 9D has a triangular shape, and the retroreflecting material 40 in FIGS. 9E and 9F is configured by combining rectangular reflecting materials. .
  • FIG. 9A shows an example of a retroreflecting material 40 in which reflecting materials having different directivities are combined.
  • Some prism type retroreflective materials have directivity in the retroreflecting direction. Therefore, as shown in FIG. 9A, the reflectors a1 and a2 whose reflection directions are shifted by 90 ° are alternately arranged in a strip shape. This eliminates the need to consider directivity when installing the retroreflecting material 40.
  • FIG. 9B shows an example of the retroreflecting material 40 including a part b1 that does not reflect infrared light and a part b2 that reflects infrared light.
  • the part b 1 that does not reflect infrared light is provided at the outer edge of the retroreflecting material 40
  • the part b 2 that reflects infrared light is provided in an area inside the retroreflecting material 40.
  • the frame image is divided into a plurality of partial areas using the retroreflecting material 40 and processing is performed using the partial areas with high luminance, it may be difficult to capture body movements due to respiration. is there.
  • the brightness of the clothes or the background wall being worn is high, it is difficult to determine a partial region including body movement due to respiration based on the brightness. Therefore, a portion that does not reflect infrared light is formed in a part of the retroreflecting material 40, and the luminance change is surely generated by body movement due to respiration.
  • FIG. 9C shows an example of the retroreflecting material 40 whose reflectance changes in a gradation.
  • the intensity of the reflected light from the retroreflective material 40 changes in a gradation. Therefore, for example, it is possible to set a partial region Q that is completely included in the region R of the reflected light from the retroreflecting material 40.
  • FIG. 9D shows a retroreflecting material 40 including a predetermined pattern d1.
  • the pattern d1 can be formed using a material that does not reflect infrared light. Since this pattern also appears in the frame image, the position including the direction of the retroreflecting material 40 can be specified.
  • FIG. 9E shows another example of the retroreflective member 40 including a part e1 that does not reflect infrared light and a part e2 that reflects infrared light. Unlike FIG. 9B, in this example, a portion e ⁇ b> 1 that does not reflect infrared light is provided inside the retroreflecting material 40. Since the number of boundaries increases, the conditions for setting the partial areas are easily adjusted.
  • FIG. 9 (f) shows a retroreflecting material 40 in which the portions f1 and f2 that reflect infrared light are dispersed and provided at a plurality of locations.
  • the portions f2 that reflect infrared light are provided at the four corners of the portion f1 that reflects infrared light.
  • the number of boundaries increases, so the conditions for setting the partial areas are easy to be prepared.
  • FIG. 10A shows an example in which the retroreflecting material 40 of FIG. 9A is attached to the subject 1, and FIG. 10B shows an imaging example.
  • the retroreflective material 40 is installed so that the edge portion of the retroreflective material 40 is located at a location (for example, the abdomen or chest) where body movement due to the breathing of the subject 1 occurs.
  • the image processing circuit 306 of the information processing apparatus 30 holds in advance, for example, in the ROM 302 information indicating that the retroreflecting material 40 having such a pattern is used and the characteristics of the pattern.
  • the image processing circuit 306 identifies a region having a high luminance value in a strip shape as shown in FIG. 10B in each frame image of the obtained moving image.
  • the image processing circuit 306 performs a pattern matching process on each frame image using the characteristics of the pattern held in advance, and specifies the position of the retroreflecting material 40.
  • the image processing circuit 306 divides each frame image into two or more.
  • the image processing circuit 306 sets a dividing line (boundary line) at a position across the retroreflecting material 40. Further, the dividing line is set in a direction different from the body movement direction. For example, it is assumed that body movement is recognized in the vertical direction in the frame image.
  • the image processing circuit 306 sets a boundary line in the horizontal direction, divides each frame image into two or more, and sets a partial region.
  • the image processing circuit 306 can count the respiration rate of the subject 1 using the average luminance value of the partial area.
  • 11 (a1) to 11 (c1) each show a retroreflecting material 40 provided with a reflecting material functioning as a marker around a triangular reflecting portion.
  • a reflecting material functioning as a marker around a triangular reflecting portion.
  • the reflective portion 40a and the marker 40b are shown in FIG. 11 (a1).
  • the shape of the illustrated marker is an example. The shape is arbitrary as long as it can be identified in relation to the reflective portion 40a.
  • the processing when such a retroreflective material is used is generally as described above.
  • the position may be specified by using a retroreflecting material 40 having a known shape including the reflecting portion 40 a and the marker 40 b and divided into partial regions around the retroreflecting material 40.
  • the image processing circuit 306 may divide the marker 40b into two or more partial areas based on the searched surrounding marker 40b.
  • FIG. 11 (a2) shows two partial regions Q1 and Q2 provided in the marker 40b. Note that the shapes or sizes of the partial regions Q1 and Q2 may be different from each other. Depending on what type of retroreflecting material 40 is used, the shapes or sizes of the partial regions Q1 and Q2 may be determined in advance.
  • FIGS. 11B2 and 11C2 are the same as those in FIG. 11 (a1). Further, the partial region may be set in a shape exemplified in FIGS. 11B2 and 11C2.
  • the life activity measurement system 100 can be used in measurement / inspection using a magnetic resonance imaging apparatus by appropriately selecting the retroreflecting material 40.
  • the above-described retroreflecting material 40 may be formed by depositing aluminum.
  • the retroreflective material 40 includes a metal material, the retroreflective material 40 cannot be used for measurement / inspection (so-called MRI measurement / inspection) using a magnetic resonance imaging apparatus. This is because the captured image may be affected in the gantry of the magnetic resonance imaging apparatus.
  • a non-metallic retroreflecting material 40 In an environment where MRI measurement / inspection is performed, it is necessary to employ a non-metallic retroreflecting material 40.
  • a PET prism sheet can be used as the retroreflecting material 40.
  • FIG. 12 shows the camera 10 equipped with an optical filter 11 that blocks the wavelength in the visible light region.
  • This optical filter 11 is also called an infrared filter, for example.
  • the filter 11 is provided to photograph the subject 1.
  • the optical filter 11 transmits infrared light emitted from the light source 20 and reflected by the retroreflecting material 40, but blocks visible light.
  • light other than infrared light more specifically visible light, is prevented from entering the camera 10, thereby affecting the change in the luminance value of the captured moving image. Can be reduced. Since fluctuations in the luminance value of each frame image due to visible light can be suppressed, it is possible to reduce the occurrence of disturbance noise due to only visible light and not due to biological reactions.
  • the inventors of the present application consider that it is very useful to provide the optical filter 11 that blocks the wavelength in the visible light region. This is because it is often difficult to realize a complete dark room environment during actual photographing. For example, when the life activity measurement system 100 is operated in a hospital, a night light, an evacuation guide light, etc. are lit in the hospital even at night. In such a photographing environment, it is preferable to block visible light by the optical filter 11.
  • an optical filter that blocks not only visible light but also unnecessary infrared light may be provided.
  • a band pass filter that allows infrared light emitted from the light source 20 to pass therethrough may be provided as the optical filter 11.
  • an LED light source having a steep wavelength characteristic is adopted as the light source 20.
  • the wavelength is, for example, 850 nm or 940 nm and their vicinity.
  • the “steep wavelength characteristic” means that the fluctuation of the wavelength of the emitted infrared light is small here.
  • the camera 10 is provided with an optical filter having a bandpass characteristic that allows infrared light emitted from the light source 20 to pass therethrough as the optical filter 11.
  • the optical filter 11 that transmits infrared light having a wavelength of 850 nm is provided.
  • the camera 10 By matching the wavelength of the light source 20 with the pass band of the optical filter 11, the camera 10 has sensitivity only to light having the same wavelength as that of infrared light emitted from the light source 20. Since not only visible light but also unnecessary infrared light can be blocked, the captured moving image is not affected by disturbance light. Since the retroreflective material 40 is used, the amount of infrared light emitted from the light source 20 and reflected by the retroreflective material 40 is large. Therefore, the ease of capturing the reflected light is the same as that described above.
  • FIG. 13 shows the light source 20 provided with the polarizing filter 12a and the camera 10 provided with the polarizing filter 12b.
  • the camera 10 is provided with the optical filter 11 described above, but the optical filter 11 is not essential.
  • the polarizing filters 12a and 12b are installed in the camera 10 and the light source 20 so that their polarization directions coincide.
  • the camera 10 is sensitive only to light having the same polarization direction as the infrared light emitted from the light source 20 by the polarizing filters 12a and 12b.
  • the infrared light having a predetermined polarization direction that has passed through the polarizing filter 12 a out of the infrared light emitted from the light source 20 is reflected by the retroreflecting material 40 and further enters the camera 10. Therefore, the influence of disturbance light (visible light and infrared light) having a polarization direction different from the polarization direction can be eliminated.
  • FIG. 14 shows the configuration of the life activity measurement system 101 that uses the position marker 41 to determine the imaging direction. Except for the use of the position marker 41 and the processing of the information processing apparatus 30 regarding the position marker 41, the description is the same as the above description.
  • the position marker 41 is a retroreflecting material provided in a fixed place such as a wall surface of a room where the life activity measurement system 101 is constructed. In this example, it is assumed that the position marker 41 has a pentagonal shape. However, this is an example.
  • the position marker 41 may be circular, elliptical, rectangular, or the like.
  • the shape and size of the position marker 41 are arbitrary as long as the camera 10 can identify the shape of the position marker 41. That is, the shape and size of the position marker 41 can be arbitrarily selected according to the resolution of the camera 10 in consideration of the distance between the position marker 41 and the camera 10.
  • the infrared light emitted from the light source 20 spreads in a conical shape and reaches the position marker 41, for example.
  • a region through which infrared light passes is shown as a space S.
  • Part of the infrared light reflected by the retroreflecting material that is the position marker 41 reaches the camera 10. Thereby, the camera 10 can photograph the position marker 41.
  • the image processing circuit 306 of the information processing apparatus 30 holds, in advance, information on the shape of the position marker 41 and information on the position where the position marker 41 is installed, for example, in the ROM 302.
  • the position where the position marker 41 is installed is, for example, where the installation position of the camera 10 and the shooting direction are appropriately determined and when the position marker 41 is shot, in which position of the image where the position marker 41 is shot. This information identifies whether it exists.
  • the image processing circuit 306 analyzes the captured moving image and performs, for example, pattern matching processing using the stored information to determine whether or not the position marker 41 is included in the frame image of the moving image, and If it is included, the position is specified.
  • the image processing circuit 306 determines whether or not the specified position matches the position where the position marker 41 is to be installed with reference to information held in advance. If they do not match, it means that the camera 10 is not installed in the proper position and / or shooting direction.
  • the image processing circuit 306 notifies a warning indicating that they do not match. For example, the image processing circuit 306 sends a video signal to the display 32 to present a message “Camera position or shooting direction is shifted. Please check”. Alternatively, the CPU 301 may present a warning sound or a warning message via a voice processing circuit (not shown).
  • the life activity measurement system 100 detects the situation and issues a warning. Can do.
  • the present embodiment relates to processing for setting a partial region in a frame image including a place where body movement due to respiration has occurred.
  • the life activity measurement system 100 shown in FIGS. 1 and 6 is referred to.
  • the difference between the present embodiment and the first embodiment is mainly the processing of the information processing apparatus 30 (FIGS. 1 and 6).
  • the same configurations and operations as those of the first embodiment, including the modified example of the retroreflecting material 40, can be applied to the present embodiment.
  • the expected respiration waveform may not be obtained due to the relationship between the position and size of the retroreflecting material 40 and the size of the partial area that is one unit of image processing.
  • the partial region Q as shown in FIGS. 8A and 8B may not be specified.
  • a non-ideal region may be set as a unit region for performing luminance value calculation (image processing).
  • FIGS. 15A and 15B show an example in which a region at a coordinate position where a change in luminance value due to body movement does not appear is set as the partial region Q.
  • FIG. Due to body movement caused by respiration the position of the reflected light region R changes with the states of FIGS. 15A and 15B as the lower limit and the upper limit, respectively.
  • the partial area Q is always in the reflected light area R, the luminance value does not change due to body movement.
  • FIG. 15C shows a change in the luminance value of the set partial area Q. It is understood that the state of high brightness continues regardless of whether there is breathing. Since the fluctuation of the luminance value is small, it is very difficult to extract respiration information using the luminance value.
  • FIGS. 16A and 16B show another example in which a region at a coordinate position where a change in luminance value due to body movement does not appear is set as the partial region Q.
  • FIG. Assume that body movement is recognized in the vertical direction of the drawing.
  • the partial region Q is set so as to always include the upper and lower edges of the reflected light region R, the luminance value of the partial region Q does not change even if the reflected light region R changes. Even when the partial area Q is set in this way, it is very difficult to extract respiration information using the luminance value.
  • the image processing circuit 306 (FIG. 6) dynamically changes the size of the partial region Q for detecting a change in luminance value.
  • the image processing circuit 306 (FIG. 6) dynamically changes the size of the partial region Q for detecting a change in luminance value.
  • an example of setting the partial area Q will be described.
  • an area including a group of pixels for calculating a luminance value is referred to as a “processing unit area”.
  • the edge of the reflected light region R is specified, and when the coordinate position of the edge varies according to time, the processing unit region is set so as to include the region that the edge crosses.
  • the edge of the reflected light region R here is assumed to be one edge when there are a plurality of edges facing each other with respect to the fluctuation direction. For example, an area that simultaneously crosses two edges facing each other with respect to the changing direction is not set as a processing unit area.
  • FIGS. 17A and 17B show an example in which the partial region Q as the processing unit region is secured approximately equal to or larger than the region R of the reflected light from the retroreflecting material 40.
  • FIGS. 17A and 17B show two frame images taken at different times.
  • Each frame image includes a region R of reflected light.
  • the coordinate position of the edge (boundary) of the region R changes with time. Therefore, the partial region Q including the region crossed by the edge of the region R is set as the processing unit region.
  • the ratio at which the reflected light region R and the partial region Q overlap changes with time. This change over time appears as a change in the luminance value of the partial region Q. Therefore, an area including such a change over time may be set as a processing unit area.
  • the luminance value of the processing unit region will not change, and counting the respiration rate using the change in luminance value is not possible. Can not.
  • FIG. 17C shows a change in luminance value of the partial region Q. Since the partial area Q is larger than the reflected light area R, the dynamic range of the luminance change of the reflected light from the retroreflecting material 40 can be increased.
  • the size of the partial region Q as the processing unit region in FIGS. 8A and 8B is 64 pixels ⁇ 64 pixels
  • the size of the partial region Q is 256 pixels. x256 pixels.
  • FIGS. 18A and 18B show an example in which the partial area Q as the processing unit area is secured smaller than the partial area Q of FIG.
  • the partial region Q includes the edge (boundary) of the region R of the reflected light. That is, also in this example, the ratio of the reflected light region R and the partial region Q changes with time.
  • FIG. 18C shows a change in luminance value of the partial region Q. According to FIG.18 (c), it is possible to count a respiration rate using the change of a luminance value.
  • the size of the partial area Q as the processing unit area in FIGS. 8A and 8B is 64 pixels ⁇ 64 pixels
  • the size of the partial area Q is 32 pixels. x32 pixels.
  • FIG. 19 shows the fluctuation range of the reflected light region R that varies with time, and the minimum settable processing unit regions Qa and Qb.
  • Both the processing unit areas Qa and Qb are areas that cross the edge of the area R when the area R of the reflected light fluctuates. In other words, both of the processing unit areas Qa and Qb exist at positions where part or all of them enter or leave the area R.
  • the ratio at which the reflected light region R and the partial region Qa or Qb overlap varies with time.
  • the processing unit area Qa includes a boundary (edge) of the reflected light area R when the change of the reflected light area R reaches the upper limit. That is, the processing unit area Qa is an area that exists at a position where a part of the processing unit area Qa enters or does not enter the area R.
  • the processing unit region Qb is a region that exists at a position where the entire region R enters or does not enter the region R as the reflected light region R changes.
  • One region Qc is a region that is always located in the region R of the reflected light regardless of changes in the region R of the reflected light.
  • the partial area Qc and the reflected light area R always have the same ratio of overlapping areas. Therefore, the partial area Qc is not suitable as a processing unit area.
  • the region Qa and / or Qb in the position satisfying the above-described conditions may be specified, and the processing unit region may be set in consideration of the performance of the information processing apparatus 30 and the like.
  • FIG. 20 shows examples of suitable processing unit areas Qd, Qe, and Qf.
  • Each region is a region that crosses the edge of the region R when the region R of the reflected light fluctuates.
  • FIG. 21 shows an operation procedure of the biological information monitoring apparatus 300 according to the present embodiment. This process is mainly executed by the CPU 301 and / or the image processing circuit 306. In the following description, the execution subject is the image processing circuit 306.
  • the image processing circuit 306 specifies a region R where the retroreflective material 40 exists from the acquired image.
  • the image processing circuit 306 holds in advance in the ROM 302 information on the luminance value of the region where the reflected light from the retroreflecting material 40 is observed. This information is used as a threshold value of the luminance value, and a partial region having a luminance value equal to or higher than the threshold value is specified as a region where the retroreflecting material 40 exists.
  • the image processing circuit 306 specifies an area including the edge of the retroreflecting material 40.
  • the image processing circuit 306 specifies a portion where the difference in luminance value between adjacent pixels is equal to or greater than a predetermined value as an edge. Since the technique for detecting the edge is well known, detailed description thereof is omitted.
  • step S13 the image processing circuit 306 selects a region including an edge as a processing unit region.
  • the edge here refers to one edge when there are a plurality of edges facing each other with respect to the fluctuation direction.
  • step S14 the image processing circuit 306 adds and averages the luminance values of the pixels existing in the selected processing unit area.
  • step S15 the image processing circuit 306 determines a temporal change in the calculated average result as a respiratory waveform, and in step S16, counts the respiratory rate from the respiratory waveform.
  • step S17 the image processing circuit 306 sends a video signal to the display 32 to display information on the respiration rate.
  • the above steps S11 to S13 can be performed at any time even after the edge is detected once and the measurement of the respiration rate is started.
  • the image processing circuit 306 may perform the processing of steps S11 to S13 again to reset the processing unit area resulting from the body movement.
  • body movements such as turning over are very large, and the coordinate position where reflected light is detected changes greatly.
  • the image processing circuit 306 performs the processes of steps S11 to S13 again. Note that the image processing circuit 306 continues to monitor the user's body movement in step S15. Therefore, when body movements other than breathing occur in the subject 1, the image processing circuit 306 can observe changes in body movements quickly and easily.
  • the life activity measurement system 100 shown in FIG. 1 has been described as an example.
  • the configuration of the life activity measurement system 100 is an example.
  • FIG. 22 shows a life activity measurement system 111 according to a modification of the life activity measurement system 100.
  • a plurality of cameras 10 are connected to the information processing apparatus 30 via the network 110.
  • the information processing apparatus 30 obtains moving image data output from the plurality of cameras 10 and individually performs the above-described processing.
  • the life activity measurement system 111 is laid, for example, in a hospital.
  • the camera 10 and the light source 20 may be installed in each patient's home, and the information processing apparatus 30 may be installed in a hospital or the like.
  • This specification discloses a respiration rate measurement method, a measurement system, and a computer program described in the following items.
  • a light source that emits light
  • An imaging device that receives the light and generates a moving image
  • a measurement method for measuring a biological activity resulting from respiration of the subject using a biological activity measurement system comprising an image processing circuit for measuring the biological activity of the subject using the moving image, (A) disposing a retroreflecting material having a predetermined reflection pattern at a position where body movement accompanying breathing of the subject occurs; (B) the light source irradiating the subject with the light; (C) The imaging device receives the light reflected by the retroreflecting material and generates a moving image composed of a plurality of frame images; (D)
  • the image processing circuit includes a step of measuring a biological activity caused by respiration of the subject based on changes in the plurality of frame images.
  • the light source and the retroreflecting material are used in combination, even if the surroundings are dark or bright, and the distance between the subject and the imaging device is sufficiently separated, a living body such as breathing
  • the body movement caused by the activity can be grasped from the change of a plurality of frame images. Since the imaging device can be set apart from the subject and the imaging environment can be set to be dark, it is possible to acquire biological information with sufficiently high accuracy while sufficiently reducing the feeling of pressure applied to the subject.
  • the image processing circuit divides each frame image into a plurality of partial areas, and measures the biological activity based on a change in luminance values of the plurality of partial areas. The measurement method described.
  • the image processing circuit includes: Using the predetermined reflection pattern, identify a partial region of each frame image, including the retroreflective material, and including the position where the body movement occurs, Item 3.
  • the image processing circuit holds in advance information specifying the predetermined reflection pattern, From the item 1, the image processing circuit detects the predetermined reflection pattern in each frame image by performing a pattern matching process using the information, and identifies a partial region including the retroreflecting material. 4. The measuring method according to any one of 4 above.
  • the image processing circuit specifies a first direction that is the direction of the body movement, and a plurality of the frame images are arranged along a second direction different from the first direction.
  • Item 4 The measurement method according to Item 3, wherein the method is divided into partial areas.
  • the predetermined reflection pattern of the retroreflecting material includes any one of items 1 to 7, including a first portion that reflects the light and a second portion that does not reflect the light toward the imaging device. The measurement method described.
  • Item 9 The measurement method according to Item 8, wherein the predetermined reflection pattern of the retroreflective material includes a predetermined pattern.
  • Item 16 The measurement method according to Item 15, wherein in the step (b), the light source is a light emitting diode that emits light of 850 nm or 940 nm as the wavelength ⁇ .
  • the image processing circuit further includes a step of notifying a warning when it is determined that the imaging device has not photographed a predetermined direction or position. 18. The measuring method according to 18.
  • a light source that emits light
  • An imaging device that receives the light and generates a moving image
  • An image processing circuit for measuring a subject's biological activity using the moving image, and a measurement system comprising: When a retroreflecting material is disposed at a position where body movement occurs due to breathing of the subject and the light is emitted from the light source toward the subject, The imaging device receives the light reflected by the retroreflecting material at a plurality of times, and generates the moving image composed of a plurality of time-series frame images, The said image processing circuit is a measuring system which receives the said moving image from the said imaging device, and measures the biological activity resulting from the said subject's respiration based on the change of the luminance value of these frame images.
  • the light source and the retroreflective material are used in combination, even if the surrounding is dark and the distance between the subject and the imaging device is sufficiently separated, it is caused by biological activity such as respiration. Body movement can be captured from changes in a plurality of frame images. Since the imaging device can be set apart from the subject and the imaging environment can be set to be dark, it is possible to acquire biological information with sufficiently high accuracy while sufficiently reducing the feeling of pressure applied to the subject.
  • the image processing circuit specifies a partial area including the retroreflecting material and including the position where the body motion is generated from each frame image, and uses a change in luminance value of the specified partial area.
  • Item 22 The measurement system according to Item 21, wherein the biological activity is measured.
  • Each of the frame images includes a first partial region having a relatively high luminance value corresponding to the light reflected by the retroreflecting material, and a second lower luminance value than the first partial region.
  • the image processing circuit measures the biological activity using a change in luminance value of a coordinate position crossing a boundary between the first partial region and the second partial region over time over the plurality of frame images.
  • the image processing circuit is a partial region including a coordinate position crossed by the boundary, and the partial region including a coordinate position where a ratio of the first partial region and the second partial region changes with time. 24.
  • the image processing circuit detects that the position of the region including the retroreflecting material has moved by a predetermined amount or more, the image processing circuit again includes the retroreflecting material from each frame image.
  • a light source that emits light
  • An imaging device that receives the light and generates a moving image
  • a computer program executed by an image processing circuit in a measurement system comprising: an image processing circuit that measures a subject's biological activity using the moving image; When a retroreflecting material is disposed at a position where body movement occurs due to breathing of the subject and the light is emitted from the light source toward the subject, The computer program is stored in the image processing circuit.
  • Receiving the moving image generated by the imaging device receiving the light reflected by the retroreflecting material at a plurality of times and receiving the moving image composed of a plurality of time-series frame images; Steps, A step of measuring a biological activity caused by respiration of the subject based on a change in luminance values of the plurality of frame images.
  • the present invention can be used as a method for analyzing a moving image obtained by photographing a subject and measuring the life activity of the subject, particularly the number of breaths, in a non-contact manner.
  • the present invention can also be used as an apparatus, system, and computer program for analyzing such moving images and measuring life activity.

Landscapes

  • Health & Medical Sciences (AREA)
  • Life Sciences & Earth Sciences (AREA)
  • Medical Informatics (AREA)
  • Molecular Biology (AREA)
  • Veterinary Medicine (AREA)
  • Biophysics (AREA)
  • Pathology (AREA)
  • Engineering & Computer Science (AREA)
  • Biomedical Technology (AREA)
  • Heart & Thoracic Surgery (AREA)
  • Physiology (AREA)
  • Physics & Mathematics (AREA)
  • Surgery (AREA)
  • Animal Behavior & Ethology (AREA)
  • General Health & Medical Sciences (AREA)
  • Public Health (AREA)
  • Pulmonology (AREA)
  • Dentistry (AREA)
  • Oral & Maxillofacial Surgery (AREA)
  • Measurement Of The Respiration, Hearing Ability, Form, And Blood Characteristics Of Living Organisms (AREA)

Abstract

L'invention concerne un procédé de mesure de l'activité biologique résultant de la respiration d'un sujet. Le procédé de mesure de l'activité biologique comprend : une étape (a) dans laquelle un matériau réfléchissant récursif, présentant un modèle de réflexion prédéterminé, est agencé en une position au niveau de laquelle un mouvement corporel qui accompagne la respiration d'un sujet se produit; une étape (b) dans laquelle une source lumineuse irradie le sujet par de la lumière; une étape (c) dans laquelle un dispositif d'imagerie reçoit la lumière réfléchie par le matériau réfléchissant récursif et génère une image animée comprenant une pluralité d'images de trame; et une étape (d) dans laquelle un circuit de traitement d'image mesure l'activité biologique résultant de la respiration du sujet sur base d'un changement dans la pluralité d'images de trame.
PCT/JP2015/069550 2014-07-15 2015-07-07 Procédé de mesure de l'activité biologique résultant de la respiration d'un sujet, système de mesure et programme informatique WO2016009901A1 (fr)

Priority Applications (1)

Application Number Priority Date Filing Date Title
JP2016534383A JP6280650B2 (ja) 2014-07-15 2015-07-07 被験体の呼吸に起因する生体活動の計測方法および計測システム

Applications Claiming Priority (4)

Application Number Priority Date Filing Date Title
JP2014-145475 2014-07-15
JP2014145475 2014-07-15
JP2014-145476 2014-07-15
JP2014145476 2014-07-15

Publications (1)

Publication Number Publication Date
WO2016009901A1 true WO2016009901A1 (fr) 2016-01-21

Family

ID=55078397

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/JP2015/069550 WO2016009901A1 (fr) 2014-07-15 2015-07-07 Procédé de mesure de l'activité biologique résultant de la respiration d'un sujet, système de mesure et programme informatique

Country Status (2)

Country Link
JP (1) JP6280650B2 (fr)
WO (1) WO2016009901A1 (fr)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2016186172A1 (fr) * 2015-05-20 2016-11-24 シャープ株式会社 Système de mesure, procédé de mesure d'activité biologique causée par la respiration d'un sujet, et programme informatique

Families Citing this family (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JPWO2016076009A1 (ja) * 2014-11-10 2017-08-17 シャープライフサイエンス株式会社 被験体の呼吸に起因する生体活動の計測システム、および画像処理装置

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2012120648A (ja) * 2010-12-07 2012-06-28 Alpha Co 姿勢検出装置
WO2013186696A1 (fr) * 2012-06-12 2013-12-19 Koninklijke Philips N.V. Système pour mesure de signes vitaux au moyen d'une caméra
JP2014512905A (ja) * 2011-03-30 2014-05-29 コーニンクレッカ フィリップス エヌ ヴェ 非接触型睡眠障害スクリーニングシステム

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2012120648A (ja) * 2010-12-07 2012-06-28 Alpha Co 姿勢検出装置
JP2014512905A (ja) * 2011-03-30 2014-05-29 コーニンクレッカ フィリップス エヌ ヴェ 非接触型睡眠障害スクリーニングシステム
WO2013186696A1 (fr) * 2012-06-12 2013-12-19 Koninklijke Philips N.V. Système pour mesure de signes vitaux au moyen d'une caméra

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2016186172A1 (fr) * 2015-05-20 2016-11-24 シャープ株式会社 Système de mesure, procédé de mesure d'activité biologique causée par la respiration d'un sujet, et programme informatique

Also Published As

Publication number Publication date
JP6280650B2 (ja) 2018-02-14
JPWO2016009901A1 (ja) 2017-04-27

Similar Documents

Publication Publication Date Title
US20200143156A1 (en) Living body detection device, living body detection method, and recording medium
RU2616175C2 (ru) Определение расстояния до объекта по изображению
CN105142516B (zh) 用于确定来自对象的生命体征信息的装置和方法
JP6544244B2 (ja) 情報処理装置、情報処理方法及びプログラム
US20160086055A1 (en) Enhanced contrast for object detection and characterization by optical imaging using formed difference images
US20140028861A1 (en) Object detection and tracking
JP2009058533A (ja) 法線情報生成装置および法線情報生成方法
WO2015121949A1 (fr) Unité de traitement de signal, procédé de traitement de signal, et programme de traitement de signal
CN109564382A (zh) 拍摄装置以及拍摄方法
JP7122157B2 (ja) 落石検出装置および落石検出システム
JP6280650B2 (ja) 被験体の呼吸に起因する生体活動の計測方法および計測システム
JP6126501B2 (ja) カメラ設置シミュレータ及びそのコンピュータプログラム
US20200196913A1 (en) Method, device and computer program for capturing optical image data of patient surroundings and for identifying a patient check-up
JP2019000474A (ja) 脈拍周期検出装置、脈拍周期検出方法、脈拍周期検出プログラム、及び脈波検出装置
WO2017047734A1 (fr) Dispositif de mesure
JP2017215666A (ja) 制御装置、制御方法およびプログラム
EP3042341A1 (fr) Procédé et appareil de détection oculaire à partir de points brillants
JP2016214937A (ja) 計測システムおよびコンピュータプログラム
JP2012115505A (ja) 視線検出装置及び視線検出方法
JP6244960B2 (ja) 物体認識装置、物体認識方法及び物体認識プログラム
JP6585668B2 (ja) 物体検出装置
JP5761954B2 (ja) 画像センサ
JP6185090B2 (ja) 計測システム
JP6002811B1 (ja) 計測システム、被験体の呼吸に起因する生体活動の計測方法およびコンピュータプログラム
JP2006285696A (ja) 画像処理装置

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 15821998

Country of ref document: EP

Kind code of ref document: A1

ENP Entry into the national phase

Ref document number: 2016534383

Country of ref document: JP

Kind code of ref document: A

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 15821998

Country of ref document: EP

Kind code of ref document: A1