WO2021258644A1 - Indoor environment health degree regulating method and system based on machine vision - Google Patents

Indoor environment health degree regulating method and system based on machine vision Download PDF

Info

Publication number
WO2021258644A1
WO2021258644A1 PCT/CN2020/132843 CN2020132843W WO2021258644A1 WO 2021258644 A1 WO2021258644 A1 WO 2021258644A1 CN 2020132843 W CN2020132843 W CN 2020132843W WO 2021258644 A1 WO2021258644 A1 WO 2021258644A1
Authority
WO
WIPO (PCT)
Prior art keywords
data
heart rate
interval
health
environment
Prior art date
Application number
PCT/CN2020/132843
Other languages
French (fr)
Chinese (zh)
Inventor
李成栋
张桂青
彭伟
邓晓平
Original Assignee
山东建筑大学
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 山东建筑大学 filed Critical 山东建筑大学
Publication of WO2021258644A1 publication Critical patent/WO2021258644A1/en
Priority to ZA2022/05483A priority Critical patent/ZA202205483B/en

Links

Images

Classifications

    • FMECHANICAL ENGINEERING; LIGHTING; HEATING; WEAPONS; BLASTING
    • F24HEATING; RANGES; VENTILATING
    • F24FAIR-CONDITIONING; AIR-HUMIDIFICATION; VENTILATION; USE OF AIR CURRENTS FOR SCREENING
    • F24F11/00Control or safety arrangements
    • F24F11/62Control or safety arrangements characterised by the type of control or by internal processing, e.g. using fuzzy logic, adaptive control or estimation of values
    • F24F11/63Electronic processing
    • F24F11/64Electronic processing using pre-stored data
    • GPHYSICS
    • G16INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR SPECIFIC APPLICATION FIELDS
    • G16HHEALTHCARE INFORMATICS, i.e. INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR THE HANDLING OR PROCESSING OF MEDICAL OR HEALTHCARE DATA
    • G16H50/00ICT specially adapted for medical diagnosis, medical simulation or medical data mining; ICT specially adapted for detecting, monitoring or modelling epidemics or pandemics
    • G16H50/30ICT specially adapted for medical diagnosis, medical simulation or medical data mining; ICT specially adapted for detecting, monitoring or modelling epidemics or pandemics for calculating health indices; for individual health risk assessment
    • GPHYSICS
    • G16INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR SPECIFIC APPLICATION FIELDS
    • G16HHEALTHCARE INFORMATICS, i.e. INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR THE HANDLING OR PROCESSING OF MEDICAL OR HEALTHCARE DATA
    • G16H50/00ICT specially adapted for medical diagnosis, medical simulation or medical data mining; ICT specially adapted for detecting, monitoring or modelling epidemics or pandemics
    • G16H50/50ICT specially adapted for medical diagnosis, medical simulation or medical data mining; ICT specially adapted for detecting, monitoring or modelling epidemics or pandemics for simulation or modelling of medical disorders
    • FMECHANICAL ENGINEERING; LIGHTING; HEATING; WEAPONS; BLASTING
    • F24HEATING; RANGES; VENTILATING
    • F24FAIR-CONDITIONING; AIR-HUMIDIFICATION; VENTILATION; USE OF AIR CURRENTS FOR SCREENING
    • F24F2120/00Control inputs relating to users or occupants
    • F24F2120/20Feedback from users

Definitions

  • the invention relates to a method for judging the health of an indoor environment, in particular to an adjusting method for judging the health of an indoor environment based on machine vision.
  • the method relates to the field of smart home technology.
  • the present invention proposes a method and system for adjusting the health of the indoor environment based on machine vision.
  • the present invention provides a method for adjusting indoor environment health based on machine vision, which includes the following steps:
  • the steps of the step (1) are as follows:
  • the remote photoplethysmography heart rate monitoring method based on the joint blind source separation algorithm is adopted, and the independent vector is used for joint analysis to obtain the human heart rate data.
  • the specific steps of the step (1) are as follows:
  • step (2) the specific steps of the step (2) are as follows:
  • Step 1 Convert monitoring data to interval data
  • sample mean mi and sample standard deviation ⁇ i are first calculated, which are expressed as:
  • n i represents the total amount of data collected on the i day, and data i, j represents the jth data collected on the i day;
  • k represents the constraint coefficient, generally k is 2; after this processing, the data in the i-th day will be left n′′ i (n′′ i ⁇ n i ) Piece;
  • the maximum and minimum values are selected to form a daily interval, and the interval on the i-th day is expressed as:
  • i 1, ..., n, it represents the number of days after the data preprocessing stage above left, c i, and D i respectively represent the left end of the i-th day intervals day and right points;
  • Step 2 Interval data preprocessing
  • Q (.25) is called the lower four-digit score, which means that a quarter of the data value of all observations is smaller than it
  • Q (.75) is called the upper four-digit score , which means that a quarter of the data values in all observations are larger than it
  • IQR is called the interquartile range, which is the difference between the upper four scores and the lower four scores
  • ⁇ * ⁇ (m c ′( ⁇ ′ d ) 2 -m d ′( ⁇ ′ c ) 2 ) ⁇ c ′ ⁇ d ′[(m c ′-m d ′) 2 +2(( ⁇ ′ c ) 2 -( ⁇ ′ d ) 2 )ln( ⁇ c ′/ ⁇ d ′)] 1/2 ⁇ /(( ⁇ ′ c ) 2 -( ⁇ ′ d ) 2 ) (9)
  • Step 3 Build a language word model for environmental health
  • T q L t l [n′*q] +rem(n′*q,1)(t l [n′*q+1] -t l [n′*q] ) (10)
  • the left and right representative intervals of the environmental health language word model are Construct a language word model for environmental health.
  • the facial data in the actual environment is collected, and then the heart rate recognition module is called, and the super-sensing heart rate monitoring method based on the joint blind source separation algorithm is applied to jointly analyze the facial data to obtain the Heart rate data, and then compare the data with the environmental health language word model to determine whether the environmental temperature is high or low, so that the air conditioner can act accordingly.
  • step (3) the specific judgment rules in step (3) are as follows:
  • the monitored heart rate value of the actual environment is x
  • the present invention also provides an indoor environment health adjustment system based on machine vision, which is used to execute the steps of the above-mentioned machine vision-based indoor environment health adjustment method, including:
  • a heart rate recognition module which is used to perform the method of step (1);
  • Environmental health discrimination and adjustment module which is used to execute the method of step (3).
  • the heart rate monitoring adopts the super-sensing method, and the data collection is faster and more convenient, which improves the intelligence of the home.
  • the remote photoplethysmography heart rate monitoring method based on the combined blind source separation algorithm analyzes multiple sub-regions of the face, which can overcome the influence of light changes and exercise and improve the accuracy of the heart rate monitoring value.
  • Figure 1 is a diagram of the environmental health language word model of the present invention
  • Fig. 2 is a flow chart of judging and adjusting the indoor environment health of the present invention.
  • the high-definition camera is used to collect facial data of people living in a healthy environment for a period of time, and the heart rate data is analyzed from the facial data using the remote photoplethysmography heart rate monitoring method based on the joint blind source separation algorithm, and then the data is analyzed Preprocessing, and then convert the collected data into interval data, and then process the interval data, and build an environmental health language word model on this basis. Then, collect the human heart rate data in the actual environment and compare the data with the data in the environmental health language word model to determine whether the environmental temperature is high or low, and then give an adjustment strategy.
  • the invention is composed of a heart rate recognition module, an environmental health degree modeling module, and an environmental health degree discrimination and adjustment module.
  • the heart rate recognition module mainly uses a high-definition camera to collect human facial data, and uses independent vector analysis to analyze periodic signals from the facial data to detect the heart rate.
  • the environmental health modeling module is to call the heart rate recognition module to identify the heart rate in a healthy environment, and then preprocess the heart rate data to construct an environmental health language word model.
  • the environmental health discrimination and adjustment module collects facial data in the actual environment, calls the heart rate recognition module to obtain the heart rate data, compares it with the data in the constructed environmental health model, determines whether the environment is healthy, and gives appropriate adjustment strategies .
  • the function of this module is to analyze the person's heart rate data from the person's facial data.
  • the remote photoplethysmography heart rate monitoring method based on the joint blind source separation algorithm is adopted, and the independent vector is used for joint analysis to obtain the human heart rate data.
  • the skin area for data collection select the skin area for data collection; then calculate the spatial mean of the color RGB from the collected skin data; second, apply the signal processing method to the calculated spatial mean to obtain the components of each skin area containing the heart rate information; third, Use independent vector analysis to extract the common signal components of different mixed signal groups; finally, fast Fourier transform is applied to this component in order to estimate the corresponding frequency (or the number of peaks Ns during the processing duration T(s)).
  • the heart rate in beats per minute will be calculated as 60 ⁇ Fs (or Ns/T ⁇ 60).
  • the processed interval data is constructed into a language word model of environmental health by using the percentile method. details as follows:
  • sample mean mi and sample standard deviation ⁇ i are first calculated, which are expressed as:
  • n i represents the total amount of data collected on the i day, and data i, j represents the jth data collected on the i day;
  • k is the constraint coefficient, generally k is 2; after this processing, the data in the i-th day will be left n′′ i (n′′ i ⁇ n i ) Piece;
  • the maximum and minimum values are selected to form a daily interval, and the interval on the i-th day is expressed as:
  • i 1, ..., n, it represents the number of days after the data preprocessing stage above left, c i, and D i respectively represent the left end of the i-th day intervals day and right points;
  • Q (.25) is called the lower four-digit score, which means that a quarter of the data value of all observations is smaller than it
  • Q (.75) is called the upper four-digit score , which means that a quarter of the data values in all observations are larger than it
  • IQR is called the interquartile range, which is the difference between the upper four scores and the lower four scores
  • ⁇ * ⁇ (m c ′( ⁇ ′ d ) 2 -m d ′( ⁇ ′ c ) 2 ) ⁇ c ′ ⁇ d ′[(m c ′-m d ′) 2 +2(( ⁇ ′ c ) 2 -( ⁇ ′ d ) 2 )ln( ⁇ c ′/ ⁇ d ′)] 1/2 ⁇ /(( ⁇ ′ c ) 2 -( ⁇ ′ d ) 2 ) (9)
  • T q L t l [n′*q] +rem(n′*q,1)(t l [n′*q+1] -t l [n′*q] ) (10)
  • Collect the facial data in the actual environment then call the heart rate recognition module, apply the super-sensing heart rate monitoring method based on the joint blind source separation algorithm to jointly analyze the facial data to obtain the heart rate data in the environment, and then compare the data with the health of the environment
  • the degree language word model ( Figure 1) is compared to determine whether the ambient temperature is high or low, and the air conditioner can act accordingly.
  • the specific judgment rules are as follows: set the monitored heart rate value of the actual environment as x;

Abstract

An indoor environment health degree regulating method and system based on machine vision. The method comprises the following steps: (1) collecting facial data of a person, and applying independent vector analysis to analyze a periodic signal from the facial data to detect the heart rate; (2) preprocessing heart rate data collected in a health environment to construct an environment health degree language word model; and (3) comparing heart rate data collected in an actual environment with data in the constructed environment health degree language word model to determine whether the environment is healthy or not.

Description

基于机器视觉的室内环境健康度调节方法与系统Indoor environment health adjustment method and system based on machine vision 技术领域Technical field
本发明涉及一种室内环境健康度判断的方法,具体涉及一种基于机器视觉的室内环境健康判断的调节方法。该方法涉及智能家居技术领域。The invention relates to a method for judging the health of an indoor environment, in particular to an adjusting method for judging the health of an indoor environment based on machine vision. The method relates to the field of smart home technology.
背景技术Background technique
这里的陈述仅提供与本发明相关的背景技术,而不必然地构成现有技术。The statements here only provide background art related to the present invention, and do not necessarily constitute prior art.
近几年,人们越来越重视生活环境的舒适性和健康度。据调查统计,人们每天大约有80%以上的时间是在室内度过,室内的温度对人们的健康有重要影响。因此,适宜的室内环境温度是判断室内环境健康的重要因素。In recent years, people have paid more and more attention to the comfort and health of the living environment. According to survey statistics, people spend more than 80% of their time indoors every day, and indoor temperature has an important impact on people's health. Therefore, a suitable indoor environment temperature is an important factor in judging the health of the indoor environment.
目前,对室内环境温度进行检测时,多采取传感器检测的方式,然后将采集的数值与主观设定的数值进行比较,来判断环境是否健康。由于每个人的体质以及年龄的不同,对环境温度的需求也不同。因此主观设定数值不能准确地判断环境是否健康。其次,现有的心率检测方法,需要与人的身体接触或穿戴设备。通过这些问题可以看出现有技术缺少更加便利、准确地判断室内居住环境的健康度的方法。At present, when the indoor environment temperature is detected, sensor detection is often used, and then the collected value is compared with a subjectively set value to determine whether the environment is healthy. Due to the difference of each person's physique and age, the need for environmental temperature is also different. Therefore, subjectively set values cannot accurately determine whether the environment is healthy. Secondly, the existing heart rate detection methods need to be in contact with the human body or wear a device. It can be seen from these problems that the prior art lacks a more convenient and accurate method for judging the health of the indoor living environment.
发明内容Summary of the invention
为了更加便利、准确地判断室内居住环境的健康度,本发明提出一种基于机器视觉的室内环境健康度调节方法与系统。In order to judge the health of the indoor living environment more conveniently and accurately, the present invention proposes a method and system for adjusting the health of the indoor environment based on machine vision.
为了实现上述目的,本发明是通过如下的技术方案来实现:In order to achieve the above objectives, the present invention is achieved through the following technical solutions:
本发明提供了一种基于机器视觉的室内环境健康度调节方法,包括以下步骤:The present invention provides a method for adjusting indoor environment health based on machine vision, which includes the following steps:
(1)采集人的面部数据,应用独立矢量分析从面部数据中分析出周期信号,从而检测心率;(1) Collect human face data, apply independent vector analysis to analyze the periodic signal from the face data, so as to detect the heart rate;
(2)对采集的健康环境下的心率数据预处理,构建成环境健康度语言词模型;(2) Preprocess the collected heart rate data in a healthy environment to construct an environmental health language word model;
(3)对采集实际环境下心率数据,与构建的环境健康度模型中的数据进行对比,判断环境是否健康。(3) Collect the heart rate data in the actual environment and compare it with the data in the constructed environmental health model to determine whether the environment is healthy.
优选的,所述步骤(1)步骤如下:Preferably, the steps of the step (1) are as follows:
借助高清摄头实时拍摄人脸上多个皮肤区域的数据,采用基于联合盲源分离算法的远程光电容积脉搏波描记心率监测方法,应用独立矢量进行联合分析,从而得出人的心率数据。With the help of a high-definition camera to take real-time data of multiple skin areas on the human face, the remote photoplethysmography heart rate monitoring method based on the joint blind source separation algorithm is adopted, and the independent vector is used for joint analysis to obtain the human heart rate data.
优选的,所述步骤(1)的具体步骤如下:Preferably, the specific steps of the step (1) are as follows:
首先,选取皮肤区域进行数据采集;然后对采集到的皮肤数据计算颜色RGB的空间均值;第二,对计算出的空间均值应用信号处理方法得到每个皮肤区域包含心率信息的分量;第三,利用独立矢量分析提取不同混合信号组的公共信号分量;最后,将快速傅立叶变换应用于该分量,以便估计相应的频率或处理持续时间T(s)期间的峰值数Ns。每分钟节拍形式下的心率将被计算为60×Fs或Ns/T×60。First, select the skin area for data collection; then calculate the spatial mean of the color RGB from the collected skin data; second, apply the signal processing method to the calculated spatial mean to obtain the components of each skin area containing the heart rate information; third, Use independent vector analysis to extract the common signal components of different mixed signal groups; finally, fast Fourier transform is applied to this component in order to estimate the corresponding frequency or the number of peaks Ns during the processing duration T(s). The heart rate in beats per minute will be calculated as 60×Fs or Ns/T×60.
优选的,所述步骤(2)的具体步骤如下:Preferably, the specific steps of the step (2) are as follows:
步骤1:监测数据转换为区间数据Step 1: Convert monitoring data to interval data
1)日常获取数据的统计计算:1) Statistical calculation of daily acquired data:
假设对第i天收集的数据进行处理,首先计算其样本均值m i和样本标准差σ i,分别表示为: Assuming that the data collected on the i day is processed, the sample mean mi and sample standard deviation σ i are first calculated, which are expressed as:
Figure PCTCN2020132843-appb-000001
Figure PCTCN2020132843-appb-000001
Figure PCTCN2020132843-appb-000002
Figure PCTCN2020132843-appb-000002
其中n i表示第i天内收集的数据总量,data i,j表示为第i天内收集到的第j个数据; Where n i represents the total amount of data collected on the i day, and data i, j represents the jth data collected on the i day;
2)日常数据预处理:2) Daily data preprocessing:
在第1)阶段的基础上,对每一个data i,j判断其是否满足下述方程: On the basis of stage 1) , judge whether each data i, j satisfies the following equation:
|data i,j-m i|≤k*σ i        (3) |data i,j -m i |≤k*σ i (3)
若满足该方程,则接受;否则,将被剔除;k表示约束系数,一般k值为2;经过此处理之后,第i天内的数据将被留下n″ i(n″ i≤n i)个; If the equation is satisfied, then accept; otherwise, it will be eliminated; k represents the constraint coefficient, generally k is 2; after this processing, the data in the i-th day will be left n″ i (n″ i ≤ n i ) Piece;
3)n天内所有留下数据的统计计算:3) Statistical calculation of all data left in n days:
计算n天内所有留下数据的样本均值m和样本标准差σ:Calculate the sample mean m and sample standard deviation σ of all remaining data in n days:
Figure PCTCN2020132843-appb-000003
Figure PCTCN2020132843-appb-000003
Figure PCTCN2020132843-appb-000004
Figure PCTCN2020132843-appb-000004
4)n天内数据的预处理:再对每一个data i,j判断其是否满足方程(3),满足数据被接受,否则,被剔除; 4) Preprocessing of data within n days: judge whether each data i, j satisfies equation (3), and the data that meets the requirements are accepted, otherwise, it will be rejected;
5)获取日常区间:5) Get the daily interval:
在每天收集到的数据中,选择其中的最大值和最小值组成日常区间,第i天的区间表示为:In the data collected every day, the maximum and minimum values are selected to form a daily interval, and the interval on the i-th day is expressed as:
Figure PCTCN2020132843-appb-000005
Figure PCTCN2020132843-appb-000005
其中i=1,...,n,I表示经过上述预处理阶段后留下的日数据数量,c i和d i分别表示第i天的日区间的左端点和右端点; Where i = 1, ..., n, it represents the number of days after the data preprocessing stage above left, c i, and D i respectively represent the left end of the i-th day intervals day and right points;
步骤2:区间数据预处理Step 2: Interval data preprocessing
1)异常值处理:首先对c i和d i执行Box和Whisker测试,然后计算L i=c i-d i;若区间的端点值满足下述方程: 1) abnormal value processing: c i is first performed on the d i Box and Whisker test and then calculate L i = c i -d i; if the inclusive interval satisfies the following equation:
Figure PCTCN2020132843-appb-000006
Figure PCTCN2020132843-appb-000006
则区间被保留,否则被剔除;其中Q(.25)称为下四位分数,表示全部观察值中有四分之一的数据值比它小;Q(.75)称为上四位分数,表示全部观察值中有四分之一的数据值比它大;IQR称为四分位数间距,是上四位分数与下四位分数之差;The interval is retained, otherwise it is eliminated; Q (.25) is called the lower four-digit score, which means that a quarter of the data value of all observations is smaller than it; Q (.75) is called the upper four-digit score , Which means that a quarter of the data values in all observations are larger than it; IQR is called the interquartile range, which is the difference between the upper four scores and the lower four scores;
经过此处理之后,将有m′≤n个数据区间被保留;计算c i,d i和L i的样本均值和标准差,如(m cc),(m dd),(m LL),其中i=1,...,m′; After this treatment, there m'≤n data interval is retained; calculate c i, d i, and L i of the sample mean and standard deviation, as (m c, σ c), (m d, σ d), (m LL ), where i=1,...,m′;
2)容限值处理:如果保留的m′个数据区间的端点值满足下述方程:2) Tolerance value processing: If the endpoint values of the retained m'data intervals satisfy the following equation:
Figure PCTCN2020132843-appb-000007
Figure PCTCN2020132843-appb-000007
Figure PCTCN2020132843-appb-000008
Figure PCTCN2020132843-appb-000008
则区间被保留;否则,将被踢除。其中i=1,...,m′,k表示约束系数,k取值为2;The interval is reserved; otherwise, it will be kicked out. Where i=1,...,m′, k represents the constraint coefficient, and the value of k is 2;
此后,m″≤n个数据区间被保留;再重新计算c i,d i和L i的样本均值和标准偏差,如(m c′,σ c′),(m d′,σ d′),(m L′,σ L′),其中i=1,...,m″; Thereafter, m "≤n data interval is retained; recalculate the sample mean and standard deviation c i, d i and L i, such as (m c ', σ c' ), (m d ', σ d') ,(m L ′,σ L ′), where i=1,...,m″;
3)合理性处理:计算3) Reasonable treatment: calculation
ξ*={(m c′(σ′ d) 2-m d′(σ′ c) 2)±σ c′σ d′[(m c′-m d′) 2+2((σ′ c) 2-(σ′ d) 2)ln(σ c′/σ d′)] 1/2}/((σ′ c) 2-(σ′ d) 2)   (9) ξ*={(m c ′(σ′ d ) 2 -m d ′(σ′ c ) 2 )±σ c ′σ d ′[(m c ′-m d ′) 2 +2((σ′ c ) 2 -(σ′ d ) 2 )ln(σ c ′/σ d ′)] 1/2 }/((σ′ c ) 2 -(σ′ d ) 2 ) (9)
当m c′≤ξ*≤m d′,该区间将被保留;否则,该区间将被剔除; When m c ′≤ξ*≤m d ′, the interval will be retained; otherwise, the interval will be eliminated;
对保留的n′(1≤n′≤n)个数据区间重新编号为1,2,...,n′,并表示为[t i l,t i r],(i=1,2,...,n′); Renumber the reserved n′(1≤n′≤n) data intervals as 1, 2,...,n′, and express them as [t i l ,t i r ],(i=1,2, ...,n′);
步骤3:构建环境健康度语言词模型Step 3: Build a language word model for environmental health
对保留下的n′(1≤n′≤n)个区间应用百分位数法选出两个具有代表性的区间,构建环境健康度语言词模型;Apply the percentile method to the retained n′(1≤n′≤n) intervals to select two representative intervals, and construct an environmental health language word model;
假设保留下的区间数据的左端点和右端点排列为Assume that the left and right endpoints of the retained interval data are arranged as
Figure PCTCN2020132843-appb-000009
Figure PCTCN2020132843-appb-000009
Figure PCTCN2020132843-appb-000010
Figure PCTCN2020132843-appb-000010
对于给定的q(q<0.5),假设第100q和第100(1-q)个百分位分别表示为[T q,T 1-q],此区间间隔包含着(1-2q)比例的数据点。对于左端点,其第100q和第100(1-q)个百分位分别计算为 For a given q (q<0.5), suppose the 100th and 100th (1-q) percentiles are respectively represented as [T q ,T 1-q ], this interval contains the (1-2q) ratio Data points. For the left endpoint, the 100th and 100th (1-q) percentiles are calculated as
T q L=t l [n′*q]+rem(n′*q,1)(t l [n′*q+1]-t l [n′*q])    (10) T q L = t l [n′*q] +rem(n′*q,1)(t l [n′*q+1] -t l [n′*q] ) (10)
Figure PCTCN2020132843-appb-000011
Figure PCTCN2020132843-appb-000011
其中
Figure PCTCN2020132843-appb-000012
Figure PCTCN2020132843-appb-000013
分别表示左端点的第100q和第100(1-q)个百分位,[.]使用floor函数表示对应值的积分部分,rem(·,1)使用mod函数计算除以1后对应值的余数。同样,对于右端点,其第100q和第100(1-q)个百分位可以分别计算并表示 为
Figure PCTCN2020132843-appb-000014
Figure PCTCN2020132843-appb-000015
in
Figure PCTCN2020132843-appb-000012
and
Figure PCTCN2020132843-appb-000013
Respectively represent the 100th and 100th (1-q) percentiles of the left end point, [.] uses the floor function to represent the integral part of the corresponding value, and rem(·, 1) uses the mod function to calculate the corresponding value after dividing by 1 remainder. Similarly, for the right endpoint, the 100th and 100th (1-q) percentiles can be calculated and expressed as
Figure PCTCN2020132843-appb-000014
and
Figure PCTCN2020132843-appb-000015
T q R=t r [n′*q]+rem(n′*q,1)(t r [n′*q+1]-t r [n′*q])   (12) T q R = t r [n′*q] +rem(n′*q,1)(t r [n′*q+1] -t r [n′*q] ) (12)
Figure PCTCN2020132843-appb-000016
Figure PCTCN2020132843-appb-000016
设环境健康度语言词模型的左右代表区间为
Figure PCTCN2020132843-appb-000017
Figure PCTCN2020132843-appb-000018
构建环境健康度语言词模型。
Suppose the left and right representative intervals of the environmental health language word model are
Figure PCTCN2020132843-appb-000017
Figure PCTCN2020132843-appb-000018
Construct a language word model for environmental health.
优选的,所述步骤(3)中采集实际环境中的面部数据,然后调用心率识别模块,应用基于联合盲源分离算法的超感知心率监测方法对面部数据进行联合分析,得出该环境下的心率数据,然后将该数据与环境健康度语言词模型进行对比,以此判断该环境温度偏高或偏低,使空调作出相应动作。Preferably, in the step (3), the facial data in the actual environment is collected, and then the heart rate recognition module is called, and the super-sensing heart rate monitoring method based on the joint blind source separation algorithm is applied to jointly analyze the facial data to obtain the Heart rate data, and then compare the data with the environmental health language word model to determine whether the environmental temperature is high or low, so that the air conditioner can act accordingly.
优选的,所述步骤(3)具体判断规则如下:Preferably, the specific judgment rules in step (3) are as follows:
设实际环境的监测心率数值为x;Suppose the monitored heart rate value of the actual environment is x;
(1)x<<LL,环境温度很低,空调设定温度上升至RR数值;(1) x<<LL, the ambient temperature is very low, and the air conditioner setting temperature rises to the RR value;
(2)x<LL,环境温度较低,空调设定温度上升RL数值;(2) x<LL, the ambient temperature is low, and the air conditioner set temperature increases by the value of RL;
(3)LL<x<LR,环境温度较舒适,空调温度上升1度;(3) LL<x<LR, the ambient temperature is more comfortable, and the air conditioner temperature rises by 1 degree;
(4)LR≤x≤RL,环境温度舒适,空调设定温度不变;(4) LR≤x≤RL, the ambient temperature is comfortable, and the air-conditioning set temperature remains unchanged;
(5)RL<x<RR,环境温度较舒适,空调设定温度下降1度;(5) RL<x<RR, the ambient temperature is more comfortable, and the air-conditioning set temperature drops by 1 degree;
(6)RR<x,环境温度较高,空调设定温度下降至LR数值;(6) RR<x, the ambient temperature is higher, and the air-conditioning set temperature drops to the LR value;
(7)RR<<x,环境温度很高,空调设定温度下降至LL数值。(7) RR<<x, the ambient temperature is very high, and the air conditioner set temperature drops to the LL value.
本发明还提供了一种基于机器视觉的室内环境健康度调节系统,用于在执行时上述的基于机器视觉的室内环境健康度调节方法的步骤,包括:The present invention also provides an indoor environment health adjustment system based on machine vision, which is used to execute the steps of the above-mentioned machine vision-based indoor environment health adjustment method, including:
心率识别模块,该模块用于执行步骤(1)的方法;A heart rate recognition module, which is used to perform the method of step (1);
环境健康度建模模块,该模块用于执行步骤(2)的方法;Environmental health modeling module, which is used to execute the method of step (2);
环境健康度判别与调节模块,该模块用于执行步骤(3)的方法。Environmental health discrimination and adjustment module, which is used to execute the method of step (3).
本发明的技术方案具有以下有益效果:The technical scheme of the present invention has the following beneficial effects:
1.心率监测采用超感知方法,数据收集更加快捷、便利,提高了家居的智能化。1. The heart rate monitoring adopts the super-sensing method, and the data collection is faster and more convenient, which improves the intelligence of the home.
2.基于联合盲源分离算法的远程光电容积脉搏波描记心率监测方法对面部 多子区域进行分析,可以克服光照变化和运动的影响,提高心率监测数值的准确度。2. The remote photoplethysmography heart rate monitoring method based on the combined blind source separation algorithm analyzes multiple sub-regions of the face, which can overcome the influence of light changes and exercise and improve the accuracy of the heart rate monitoring value.
3.把人的“感觉”通过心率量化,排除主观意识的干扰,心率比较稳定,使判断结果更加准确。3. Quantify people's "feeling" through the heart rate, eliminating the interference of subjective consciousness, the heart rate is relatively stable, and the judgment result is more accurate.
附图说明Description of the drawings
构成本发明的一部分的说明书附图用来提供对本发明的进一步理解,本发明的示意性实施例及其说明用于解释本发明,并不构成对本发明的不当限定。The accompanying drawings of the specification constituting a part of the present invention are used to provide a further understanding of the present invention. The exemplary embodiments of the present invention and the description thereof are used to explain the present invention, and do not constitute an improper limitation of the present invention.
图1是本发明环境健康度语言词模型图;Figure 1 is a diagram of the environmental health language word model of the present invention;
图2是本发明室内环境健康度判断与调节流程图。Fig. 2 is a flow chart of judging and adjusting the indoor environment health of the present invention.
具体实施方式detailed description
应该指出,以下详细说明都是例示性的,旨在对本发明提供进一步的说明。除非另有指明,本发明使用的所有技术和科学术语具有与本发明所属技术领域的普通技术人员通常理解的相同含义。It should be pointed out that the following detailed descriptions are all illustrative and are intended to provide further descriptions of the present invention. Unless otherwise specified, all technical and scientific terms used in the present invention have the same meanings as commonly understood by those of ordinary skill in the technical field to which the present invention belongs.
需要注意的是,这里所使用的术语仅是为了描述具体实施方式,而非意图限制根据本发明的示例性实施方式。如在这里所使用的,除非本发明另外明确指出,否则单数形式也意图包括复数形式,此外,还应当理解的是,当在本说明书中使用术语“包含”和/或“包括”时,其指明存在特征、步骤、操作、器件、组件和/或它们的组合;It should be noted that the terms used here are only for describing specific embodiments, and are not intended to limit the exemplary embodiments according to the present invention. As used herein, unless the present invention clearly indicates otherwise, the singular form is also intended to include the plural form. In addition, it should also be understood that when the terms "comprising" and/or "including" are used in this specification, they Indicate the existence of features, steps, operations, devices, components, and/or their combinations;
为了更加便利、准确地判断室内居住环境的健康度,提出了一种基于机器视觉的室内环境健康度调节方法与系统。利用高清摄像头采集一段时间内,居住在健康环境下的人的面部数据,使用基于联合盲源分离算法的远程光电容积脉搏波描记心率监测方法从面部数据中分析出心率数据,然后对这些数据进行预处理,进而将收集的数据转化为区间数据,再对区间数据进行处理,在此基础上构建成环境健康度语言词模型。然后,采集实际环境下人的心率数据,将该数据与环境健康度语言词模型中的数据进行对比,由此判断环境温度偏高或偏低,进而给出调节策略。In order to judge the health of the indoor living environment more conveniently and accurately, a method and system for adjusting the health of the indoor environment based on machine vision is proposed. The high-definition camera is used to collect facial data of people living in a healthy environment for a period of time, and the heart rate data is analyzed from the facial data using the remote photoplethysmography heart rate monitoring method based on the joint blind source separation algorithm, and then the data is analyzed Preprocessing, and then convert the collected data into interval data, and then process the interval data, and build an environmental health language word model on this basis. Then, collect the human heart rate data in the actual environment and compare the data with the data in the environmental health language word model to determine whether the environmental temperature is high or low, and then give an adjustment strategy.
本发明由心率识别模块、环境健康度建模模块、环境健康度判别与调节模块三部分构成。心率识别模块主要是利用高清摄像头采集人的面部数据,应用独立矢量分析从面部数据中分析出周期信号,从而检测心率。环境健康度建模模块是 调用心率识别模块,识别出健康环境下的心率,然后对心率数据预处理,构建成环境健康度语言词模型。环境健康度判别与调节模块是采集实际环境下的面部数据,调用心率识别模块,得出心率数据,与构建的环境健康度模型中的数据进行对比,判断环境是否健康,并给出合适调节策略。The invention is composed of a heart rate recognition module, an environmental health degree modeling module, and an environmental health degree discrimination and adjustment module. The heart rate recognition module mainly uses a high-definition camera to collect human facial data, and uses independent vector analysis to analyze periodic signals from the facial data to detect the heart rate. The environmental health modeling module is to call the heart rate recognition module to identify the heart rate in a healthy environment, and then preprocess the heart rate data to construct an environmental health language word model. The environmental health discrimination and adjustment module collects facial data in the actual environment, calls the heart rate recognition module to obtain the heart rate data, compares it with the data in the constructed environmental health model, determines whether the environment is healthy, and gives appropriate adjustment strategies .
1.心率识别模块1. Heart rate recognition module
该模块的作用是从人的面部数据中分析出人的心率数据。借助高清摄头实时拍摄人脸上多个皮肤区域的数据,采用基于联合盲源分离算法的远程光电容积脉搏波描记心率监测方法,应用独立矢量进行联合分析,从而得出人的心率数据。The function of this module is to analyze the person's heart rate data from the person's facial data. With the help of a high-definition camera to take real-time data of multiple skin areas on the human face, the remote photoplethysmography heart rate monitoring method based on the joint blind source separation algorithm is adopted, and the independent vector is used for joint analysis to obtain the human heart rate data.
首先,选取皮肤区域进行数据采集;然后对采集到的皮肤数据计算颜色RGB的空间均值;第二,对计算出的空间均值应用信号处理方法得到每个皮肤区域包含心率信息的分量;第三,利用独立矢量分析提取不同混合信号组的公共信号分量;最后,将快速傅立叶变换应用于该分量,以便估计相应的频率(或处理持续时间T(s)期间的峰值数Ns)。每分钟节拍形式下的心率将被计算为60×Fs(或Ns/T×60)。First, select the skin area for data collection; then calculate the spatial mean of the color RGB from the collected skin data; second, apply the signal processing method to the calculated spatial mean to obtain the components of each skin area containing the heart rate information; third, Use independent vector analysis to extract the common signal components of different mixed signal groups; finally, fast Fourier transform is applied to this component in order to estimate the corresponding frequency (or the number of peaks Ns during the processing duration T(s)). The heart rate in beats per minute will be calculated as 60×Fs (or Ns/T×60).
2.环境健康度建模模块2. Environmental Health Modeling Module
利用高清摄像头采集在健康环境下人的面部数据,调用心率识别模块,得出对应时刻的心率数据,再对采集来的心率数据需进行预处理。然后将每天的心率数据转化为心率区间,再对区间数据进行奇异值、容限值、合理值三步预处理。将处理好的区间数据使用百分位数法构建成环境健康度语言词模型。具体如下:Use a high-definition camera to collect facial data of a person in a healthy environment, call the heart rate recognition module to obtain the heart rate data at the corresponding time, and then preprocess the collected heart rate data. Then the daily heart rate data is converted into a heart rate interval, and then the interval data is preprocessed in three steps: singular value, tolerance limit, and reasonable value. The processed interval data is constructed into a language word model of environmental health by using the percentile method. details as follows:
1.监测数据转换为区间数据1. Convert monitoring data to interval data
(1)日常获取数据的统计计算:(1) Statistical calculation of daily acquired data:
假设对第i天收集的数据进行处理,首先计算其样本均值m i和样本标准差σ i,分别表示为: Assuming that the data collected on the i day is processed, the sample mean mi and sample standard deviation σ i are first calculated, which are expressed as:
Figure PCTCN2020132843-appb-000019
Figure PCTCN2020132843-appb-000019
Figure PCTCN2020132843-appb-000020
Figure PCTCN2020132843-appb-000020
其中n i表示第i天内收集的数据总量,data i,j表示为第i天内收集到的第j个数据; Where n i represents the total amount of data collected on the i day, and data i, j represents the jth data collected on the i day;
(2)日常数据预处理:(2) Daily data preprocessing:
在第(1)阶段的基础上,对每一个data i,j判断其是否满足下述方程: On the basis of stage (1) , judge whether each data i, j satisfies the following equation:
|data i,j-m i|≤k*σ i          (3) |data i,j -m i |≤k*σ i (3)
若满足该方程,则接受;否则,将被剔除;k为约束系数,一般k值为2;经过此处理之后,第i天内的数据将被留下n″ i(n″ i≤n i)个; If the equation is satisfied, then accept; otherwise, it will be eliminated; k is the constraint coefficient, generally k is 2; after this processing, the data in the i-th day will be left n″ i (n″ i ≤ n i ) Piece;
(3)n天内所有留下数据的统计计算:(3) Statistical calculation of all data left in n days:
计算n天内所有留下数据的样本均值m和样本标准差σ:Calculate the sample mean m and sample standard deviation σ of all remaining data in n days:
Figure PCTCN2020132843-appb-000021
Figure PCTCN2020132843-appb-000021
Figure PCTCN2020132843-appb-000022
Figure PCTCN2020132843-appb-000022
(4)n天内数据的预处理:再对每一个data i,j判断其是否满足方程(3),满足数据被接受,否则,被剔除; (4) Data preprocessing within n days: judge whether each data i, j satisfies equation (3), and the data is accepted if it satisfies it, otherwise, it is rejected;
(5)获取日常区间:(5) Get the daily interval:
在每天收集到的数据中,选择其中的最大值和最小值组成日常区间,第i天的区间表示为:In the data collected every day, the maximum and minimum values are selected to form a daily interval, and the interval on the i-th day is expressed as:
Figure PCTCN2020132843-appb-000023
Figure PCTCN2020132843-appb-000023
其中i=1,...,n,I表示经过上述预处理阶段后留下的日数据数量,c i和d i分别表示第i天的日区间的左端点和右端点; Where i = 1, ..., n, it represents the number of days after the data preprocessing stage above left, c i, and D i respectively represent the left end of the i-th day intervals day and right points;
2.区间数据预处理2. Interval data preprocessing
(1)异常值处理:首先对c i和d i执行Box和Whisker测试,然后计算L i=c i-d i;若区间的端点值满足下述方程: (1) handling an abnormal value: c i is first performed on the d i Box and Whisker test and then calculate L i = c i -d i; if the inclusive interval satisfies the following equation:
Figure PCTCN2020132843-appb-000024
Figure PCTCN2020132843-appb-000024
则区间被保留,否则被剔除;其中Q(.25)称为下四位分数,表示全部观察值中有四分之一的数据值比它小;Q(.75)称为上四位分数,表示全部观察值中有四分之一的数据值比它大;IQR称为四分位数间距,是上四位分数与下四位分数 之差;The interval is retained, otherwise it is eliminated; Q (.25) is called the lower four-digit score, which means that a quarter of the data value of all observations is smaller than it; Q (.75) is called the upper four-digit score , Which means that a quarter of the data values in all observations are larger than it; IQR is called the interquartile range, which is the difference between the upper four scores and the lower four scores;
经过此处理之后,将有m′≤n个数据区间被保留;计算c i,d i和L i的样本均值和标准差,如(m cc),(m dd),(m LL),其中i=1,...,m′; After this treatment, there m'≤n data interval is retained; calculate c i, d i, and L i of the sample mean and standard deviation, as (m c, σ c), (m d, σ d), (m LL ), where i=1,...,m′;
(2)容限值处理:如果保留的m′个数据区间的端点值满足下述方程:(2) Tolerance value processing: If the endpoint values of the retained m'data intervals satisfy the following equation:
Figure PCTCN2020132843-appb-000025
Figure PCTCN2020132843-appb-000025
则区间被保留;否则,将被踢除;其中i=1,...,m′,k表示约束系数,k取值为2;Then the interval is reserved; otherwise, it will be kicked out; where i=1,...,m′, k represents the constraint coefficient, and the value of k is 2;
此后,m″≤n个数据区间被保留;再重新计算c i,d i和L i的样本均值和标准偏差,如(m c′,σ c′),(m d′,σ d′),(m L′,σ L′),其中i=1,...,m″; Thereafter, m "≤n data interval is retained; recalculate the sample mean and standard deviation c i, d i and L i, such as (m c ', σ c' ), (m d ', σ d') ,(m L ′,σ L ′), where i=1,...,m″;
3)合理性处理:计算3) Reasonable treatment: calculation
ξ*={(m c′(σ′ d) 2-m d′(σ′ c) 2)±σ c′σ d′[(m c′-m d′) 2+2((σ′ c) 2-(σ′ d) 2)ln(σ c′/σ d′)] 1/2}/((σ′ c) 2-(σ′ d) 2)   (9) ξ*={(m c ′(σ′ d ) 2 -m d ′(σ′ c ) 2 )±σ c ′σ d ′[(m c ′-m d ′) 2 +2((σ′ c ) 2 -(σ′ d ) 2 )ln(σ c ′/σ d ′)] 1/2 }/((σ′ c ) 2 -(σ′ d ) 2 ) (9)
当m c′≤ξ*≤m d′,该区间将被保留;否则,该区间将被剔除; When m c ′≤ξ*≤m d ′, the interval will be retained; otherwise, the interval will be eliminated;
对保留的n′(1≤n′≤n)个数据区间重新编号为1,2,...,n′,并表示为[t i l,t i r],(i=1,2,...,n′); Renumber the reserved n′(1≤n′≤n) data intervals as 1, 2,...,n′, and express them as [t i l ,t i r ],(i=1,2, ...,n′);
3.构建环境健康度语言词模型3. Building a language word model for environmental health
对保留下的n′(1≤n′≤n)个区间应用百分位数法选出两个具有代表性的区间,构建环境健康度语言词模型;Apply the percentile method to the retained n′(1≤n′≤n) intervals to select two representative intervals, and construct an environmental health language word model;
假设保留下的区间数据的左端点和右端点排列为Assume that the left and right endpoints of the retained interval data are arranged as
Figure PCTCN2020132843-appb-000026
Figure PCTCN2020132843-appb-000026
Figure PCTCN2020132843-appb-000027
Figure PCTCN2020132843-appb-000027
对于给定的q(q<0.5),假设第100q和第100(1-q)个百分位分别表示为[T q,T 1-q],此区间间隔包含着(1-2q)比例的数据点;对于左端点,其第100q和第 100(1-q)个百分位分别计算为 For a given q (q<0.5), suppose the 100th and 100th (1-q) percentiles are respectively represented as [T q ,T 1-q ], this interval contains the (1-2q) ratio For the left endpoint, the 100th and 100th (1-q) percentiles are calculated as
T q L=t l [n′*q]+rem(n′*q,1)(t l [n′*q+1]-t l [n′*q])    (10) T q L = t l [n′*q] +rem(n′*q,1)(t l [n′*q+1] -t l [n′*q] ) (10)
Figure PCTCN2020132843-appb-000028
Figure PCTCN2020132843-appb-000028
其中
Figure PCTCN2020132843-appb-000029
Figure PCTCN2020132843-appb-000030
分别表示左端点的第100q和第100(1-q)个百分位,[.]使用floor函数表示对应值的积分部分,rem(·,1)使用mod函数计算除以1后对应值的余数。同样,对于右端点,其第100q和第100(1-q)个百分位可以分别计算并表示为
Figure PCTCN2020132843-appb-000031
Figure PCTCN2020132843-appb-000032
in
Figure PCTCN2020132843-appb-000029
and
Figure PCTCN2020132843-appb-000030
Respectively represent the 100th and 100th (1-q) percentiles of the left end point, [.] uses the floor function to represent the integral part of the corresponding value, and rem(·, 1) uses the mod function to calculate the corresponding value after dividing by 1 remainder. Similarly, for the right endpoint, the 100th and 100th (1-q) percentiles can be calculated and expressed as
Figure PCTCN2020132843-appb-000031
and
Figure PCTCN2020132843-appb-000032
T q R=t r [n′*q]+rem(n′*q,1)(t r [n′*q+1]-t r [n′*q])    (12) T q R = t r [n′*q] +rem(n′*q,1)(t r [n′*q+1] -t r [n′*q] ) (12)
Figure PCTCN2020132843-appb-000033
Figure PCTCN2020132843-appb-000033
设环境健康度语言词模型的左右代表区间为
Figure PCTCN2020132843-appb-000034
Figure PCTCN2020132843-appb-000035
则构建如图1所示的环境健康度语言词模型。
Suppose the left and right representative intervals of the environmental health language word model are
Figure PCTCN2020132843-appb-000034
Figure PCTCN2020132843-appb-000035
Then build the environmental health language word model as shown in Figure 1.
3.环境健康度判别模块3. Environmental Health Judgment Module
采集实际环境中的面部数据,然后调用心率识别模块,应用基于联合盲源分离算法的超感知心率监测方法对面部数据进行联合分析,得出该环境下的心率数据,然后将该数据与环境健康度语言词模型(图1)进行对比,以此判断该环境温度偏高或偏低,使空调作出相应动作。具体判断规则如下:设实际环境的监测心率数值为x;Collect the facial data in the actual environment, then call the heart rate recognition module, apply the super-sensing heart rate monitoring method based on the joint blind source separation algorithm to jointly analyze the facial data to obtain the heart rate data in the environment, and then compare the data with the health of the environment The degree language word model (Figure 1) is compared to determine whether the ambient temperature is high or low, and the air conditioner can act accordingly. The specific judgment rules are as follows: set the monitored heart rate value of the actual environment as x;
(1)x<<LL,环境温度很低,空调设定温度上升至RR数值;(1) x<<LL, the ambient temperature is very low, and the air conditioner setting temperature rises to the RR value;
(2)x<LL,环境温度较低,空调设定温度上升RL数值;(2) x<LL, the ambient temperature is low, and the air conditioner set temperature increases by the value of RL;
(3)LL<x<LR,环境温度较舒适,空调温度上升1度;(3) LL<x<LR, the ambient temperature is more comfortable, and the air conditioner temperature rises by 1 degree;
(4)LR≤x≤RL,环境温度舒适,空调设定温度不变;(4) LR≤x≤RL, the ambient temperature is comfortable, and the air-conditioning set temperature remains unchanged;
(5)RL<x<RR,环境温度较舒适,空调设定温度下降1度;(5) RL<x<RR, the ambient temperature is more comfortable, and the air-conditioning set temperature drops by 1 degree;
(6)RR<x,环境温度较高,空调设定温度下降至LR数值;(6) RR<x, the ambient temperature is higher, and the air-conditioning set temperature drops to the LR value;
(7)RR<<x,环境温度很高,空调设定温度下降至LL数值。(7) RR<<x, the ambient temperature is very high, and the air conditioner set temperature drops to the LL value.
本发明的整体步骤如图2所示。The overall steps of the present invention are shown in Figure 2.
以上所述仅为本发明的优选实施例而已,并不用于限制本发明,对于本领域 的技术人员来说,本发明可以有各种更改和变化。凡在本发明的精神和原则之内,所作的任何修改、等同替换、改进等,均应包含在本发明的保护范围之内。The above descriptions are only preferred embodiments of the present invention and are not intended to limit the present invention. For those skilled in the art, the present invention can have various modifications and changes. Any modification, equivalent replacement, improvement, etc. made within the spirit and principle of the present invention should be included in the protection scope of the present invention.

Claims (7)

  1. 一种基于机器视觉的室内环境健康度调节方法,其特征在于,包括以下步骤:A method for adjusting indoor environment health based on machine vision, which is characterized in that it comprises the following steps:
    (1)采集人的面部数据,应用独立矢量分析从面部数据中分析出周期信号,从而检测心率;(1) Collect human face data, apply independent vector analysis to analyze the periodic signal from the face data, so as to detect the heart rate;
    (2)对采集的健康环境下的心率数据预处理,构建成环境健康度语言词模型;(2) Preprocess the collected heart rate data in a healthy environment to construct an environmental health language word model;
    (3)对采集实际环境下心率数据,与构建的环境健康度模型中的数据进行对比,判断环境是否健康。(3) Collect the heart rate data in the actual environment and compare it with the data in the constructed environmental health model to determine whether the environment is healthy.
  2. 根据权利要求1所述的基于机器视觉的室内环境健康度调节方法,其特征在于,所述步骤(1)步骤如下:The method for adjusting indoor environment health based on machine vision according to claim 1, wherein the steps of step (1) are as follows:
    借助高清摄头实时拍摄人脸上多个皮肤区域的数据,采用基于联合盲源分离算法的远程光电容积脉搏波描记心率监测方法,应用独立矢量进行联合分析,从而得出人的心率数据。With the help of a high-definition camera to take real-time data of multiple skin areas on the human face, the remote photoplethysmography heart rate monitoring method based on the joint blind source separation algorithm is adopted, and the independent vector is used for joint analysis to obtain the human heart rate data.
  3. 根据权利要求2所述的基于机器视觉的室内环境健康度调节方法,其特征在于,所述步骤(1)的具体步骤如下:The method for adjusting indoor environment health based on machine vision according to claim 2, wherein the specific steps of the step (1) are as follows:
    首先,选取皮肤区域进行数据采集;然后对采集到的皮肤数据计算颜色RGB的空间均值;第二,对计算出的空间均值应用信号处理方法得到每个皮肤区域包含心率信息的分量;第三,利用独立矢量分析提取不同混合信号组的公共信号分量;最后,将快速傅立叶变换应用于该分量,以便估计相应的频率或处理持续时间T(s)期间的峰值数Ns;每分钟节拍形式下的心率将被计算为60×Fs或Ns/T×60。First, select the skin area for data collection; then calculate the spatial mean of the color RGB from the collected skin data; second, apply the signal processing method to the calculated spatial mean to obtain the components of each skin area containing the heart rate information; third, Use independent vector analysis to extract the common signal components of different mixed signal groups; finally, apply the fast Fourier transform to this component to estimate the corresponding frequency or the number of peaks Ns during the processing duration T(s); in the form of beats per minute The heart rate will be calculated as 60×Fs or Ns/T×60.
  4. 根据权利要求1所述的基于机器视觉的室内环境健康度调节方法,其特征在于,所述步骤(2)的具体步骤如下:The indoor environment health adjustment method based on machine vision according to claim 1, wherein the specific steps of the step (2) are as follows:
    步骤1:监测数据转换为区间数据Step 1: Convert monitoring data to interval data
    1)日常获取数据的统计计算:1) Statistical calculation of daily acquired data:
    假设对第i天收集的数据进行处理,首先计算其样本均值m i和样本标准差σ i,分别表示为: Assuming that the data collected on the i day is processed, the sample mean mi and sample standard deviation σ i are first calculated, which are expressed as:
    Figure PCTCN2020132843-appb-100001
    Figure PCTCN2020132843-appb-100001
    Figure PCTCN2020132843-appb-100002
    Figure PCTCN2020132843-appb-100002
    其中n i表示第i天内收集的数据总量,data i,j表示为第i天内收集到的第j个数据; Where n i represents the total amount of data collected on the i day, and data i, j represents the jth data collected on the i day;
    2)日常数据预处理:2) Daily data preprocessing:
    在第1)阶段的基础上,对每一个data i,j判断其是否满足下述方程: On the basis of stage 1) , judge whether each data i, j satisfies the following equation:
    |data i,j-m i|≤k*σ i   (3) |data i,j -m i |≤k*σ i (3)
    若满足该方程,则接受;否则,将被剔除;k表示约束系数,经过此处理之后,第i天内的数据将被留下n″ i(n″ i≤n i)个; If the equation is satisfied, then accept; otherwise, it will be eliminated; k represents the constraint coefficient, after this processing, the data of the i-th day will be left n″ i (n″ i ≤ n i );
    3)n天内所有留下数据的统计计算:3) Statistical calculation of all data left in n days:
    计算n天内所有留下数据的样本均值m和样本标准差σ:Calculate the sample mean m and sample standard deviation σ of all remaining data in n days:
    Figure PCTCN2020132843-appb-100003
    Figure PCTCN2020132843-appb-100003
    Figure PCTCN2020132843-appb-100004
    Figure PCTCN2020132843-appb-100004
    4)n天内数据的预处理:再对每一个data i,j判断其是否满足方程(3),满足数据被接受,否则,被剔除; 4) Preprocessing of data within n days: judge whether each data i, j satisfies equation (3), and the data that meets the requirements are accepted, otherwise, it will be rejected;
    5)获取日常区间:5) Get the daily interval:
    在每天收集到的数据中,选择其中的最大值和最小值组成日常区间,第i天的区间表示为:In the data collected every day, the maximum and minimum values are selected to form a daily interval, and the interval on the i-th day is expressed as:
    Figure PCTCN2020132843-appb-100005
    Figure PCTCN2020132843-appb-100005
    其中i=1,...,n,I表示经过上述预处理阶段后留下的日数据数量;c i和d i分别表示第i天的日区间的左端点和右端点; Where i = 1, ..., n, it represents the number of days after the data preprocessing stage above the left; C i and D i respectively represent the left end of the i-th day intervals day and right points;
    步骤2:区间数据预处理Step 2: Interval data preprocessing
    1)异常值处理:首先对c i和d i执行Box和Whisker测试,然后计算L i=c i-d i;若区间的端点值满足下述方程: 1) abnormal value processing: c i is first performed on the d i Box and Whisker test and then calculate L i = c i -d i; if the inclusive interval satisfies the following equation:
    c i∈[Q c(.25)-1.5IQR c,Q c(.75)+1.5IQR c] c i ∈[Q c (.25)-1.5IQR c ,Q c (.75)+1.5IQR c ]
    d i∈[Q d(.25)-1.5IQR d,Q d(.75)+1.5IQR d]  (7) d i ∈[Q d (.25)-1.5IQR d ,Q d (.75)+1.5IQR d ] (7)
    L i∈[Q L(.25)-1.5IQR L,Q L(.75)+1.5IQR L] L i ∈[Q L (.25)-1.5IQR L ,Q L (.75)+1.5IQR L ]
    则区间被保留,否则被剔除;其中Q(.25)称为下四位分数,表示全部观察值中有四分之一的数据值比它小;Q(.75)称为上四位分数,表示全部观察值中有四分之一的数据值比它大;IQR称为四分位数间距,是上四位分数与下四位分数之差;The interval is retained, otherwise it is eliminated; Q (.25) is called the lower four-digit score, which means that a quarter of the data value of all observations is smaller than it; Q (.75) is called the upper four-digit score , Which means that a quarter of the data values in all observations are larger than it; IQR is called the interquartile range, which is the difference between the upper four scores and the lower four scores;
    经过此处理之后,将有m′≤n个数据区间被保留;计算c i,d i和L i的样本均值和标准差,如(m cc),(m dd),(m LL),其中i=1,...,m′; After this treatment, there m'≤n data interval is retained; calculate c i, d i, and L i of the sample mean and standard deviation, as (m c, σ c), (m d, σ d), (m LL ), where i=1,...,m′;
    2)容限值处理:如果保留的m′个数据区间的端点值满足下述方程:2) Tolerance value processing: If the endpoint values of the retained m'data intervals satisfy the following equation:
    c i∈[m c-kσ c,m c+kσ c] c i ∈[m c -kσ c ,m c +kσ c ]
    d i∈[m d-kσ d,m d+kσ d]  (8) d i ∈[m d -kσ d ,m d +kσ d ] (8)
    L i∈[m L-kσ L,m L+kσ L] L i ∈[m L -kσ L ,m L +kσ L ]
    则区间被保留;否则,将被踢除;其中i=1,...,m′,k表示约束系数,k取值为2;Then the interval is reserved; otherwise, it will be kicked out; where i=1,...,m′, k represents the constraint coefficient, and the value of k is 2;
    此后,m″≤n个数据区间被保留;再重新计算c i,d i和L i的样本均值和标准偏差,如(m c′,σ c′),(m d′,σ d′),(m L′,σ L′),其中i=1,...,m″; Thereafter, m "≤n data interval is retained; recalculate the sample mean and standard deviation c i, d i and L i, such as (m c ', σ c' ), (m d ', σ d') ,(m L ′,σ L ′), where i=1,...,m″;
    3)合理性处理:计算3) Reasonable treatment: calculation
    ξ*={(m c′(σ′ d) 2-m d′(σ′ c) 2)±σ c′σ d′[(m c′-m d′) 2+2((σ′ c) 2-(σ′ d) 2)ln(σ c′/σ d′)] 1/2}/((σ′ c) 2-(σ′ d) 2)  (9) ξ*={(m c ′(σ′ d ) 2 -m d ′(σ′ c ) 2 )±σ c ′σ d ′[(m c ′-m d ′) 2 +2((σ′ c ) 2 -(σ′ d ) 2 )ln(σ c ′/σ d ′)] 1/2 }/((σ′ c ) 2 -(σ′ d ) 2 ) (9)
    当m c′≤ξ*≤m d′,该区间将被保留;否则,该区间将被剔除; When m c ′≤ξ*≤m d ′, the interval will be retained; otherwise, the interval will be eliminated;
    对保留的n′(1≤n′≤n)个数据区间重新编号为1,2,...,n′,并表示为[t i l,t i r],(i=1,2,...,n′); Renumber the reserved n′(1≤n′≤n) data intervals as 1, 2,...,n′, and express them as [t i l ,t i r ],(i=1,2, ...,n′);
    步骤3:构建环境健康度语言词模型Step 3: Build a language word model for environmental health
    对保留下的n′(1≤n′≤n)个区间应用百分位数法选出两个具有代表性的区间,构建环境健康度语言词模型;Apply the percentile method to the retained n′(1≤n′≤n) intervals to select two representative intervals, and construct an environmental health language word model;
    假设保留下的区间数据的左端点和右端点排列为Assume that the left and right endpoints of the retained interval data are arranged as
    Figure PCTCN2020132843-appb-100006
    Figure PCTCN2020132843-appb-100006
    Figure PCTCN2020132843-appb-100007
    Figure PCTCN2020132843-appb-100007
    对于给定的q,假设第100q和第100(1-q)个百分位分别表示为[T q,T 1-q],此区间间隔包含着(1-2q)比例的数据点;对于左端点,其第100q和第100(1-q)个百分位分别计算为 For a given q, suppose the 100th and 100th (1-q) percentiles are respectively represented as [T q ,T 1-q ], this interval contains the data points of the (1-2q) ratio; For the left endpoint, the 100th and 100th (1-q) percentiles are calculated as
    T q L=t l [n′*q]+rem(n′*q,1)(t l [n′*q+1]-t l [n′*q])  (10) T q L = t l [n′*q] +rem(n′*q,1)(t l [n′*q+1] -t l [n′*q] ) (10)
    Figure PCTCN2020132843-appb-100008
    Figure PCTCN2020132843-appb-100008
    其中
    Figure PCTCN2020132843-appb-100009
    Figure PCTCN2020132843-appb-100010
    分别表示左端点的第100q和第100(1-q)个百分位,[.]使用floor函数表示对应值的积分部分,rem(·,1)使用mod函数计算除以1后对应值的余数;同样,对于右端点,其第100q和第100(1-q)个百分位可以分别计算并表示为
    Figure PCTCN2020132843-appb-100011
    Figure PCTCN2020132843-appb-100012
    in
    Figure PCTCN2020132843-appb-100009
    and
    Figure PCTCN2020132843-appb-100010
    Respectively represent the 100th and 100th (1-q) percentiles of the left end point, [.] uses the floor function to represent the integral part of the corresponding value, and rem(·, 1) uses the mod function to calculate the corresponding value after dividing by 1 Remainder; Similarly, for the right endpoint, the 100th and 100th (1-q) percentiles can be calculated and expressed as
    Figure PCTCN2020132843-appb-100011
    and
    Figure PCTCN2020132843-appb-100012
    T q R=t r [n′*q]+rem(n′*q,1)(t r [n′*q+1]-t r [n′*q])  (12) T q R = t r [n′*q] +rem(n′*q,1)(t r [n′*q+1] -t r [n′*q] ) (12)
    Figure PCTCN2020132843-appb-100013
    Figure PCTCN2020132843-appb-100013
    设环境健康度语言词模型的左右代表区间为
    Figure PCTCN2020132843-appb-100014
    Figure PCTCN2020132843-appb-100015
    构建环境健康度语言词模型。
    Suppose the left and right representative interval of the environmental health language word model is
    Figure PCTCN2020132843-appb-100014
    Figure PCTCN2020132843-appb-100015
    Construct a language word model for environmental health.
  5. 根据权利要求1所述的基于机器视觉的室内环境健康度调节方法,其特征在于,所述步骤(3)中采集实际环境中的面部数据,然后调用心率识别模块,应用基于联合盲源分离算法的超感知心率监测方法对面部数据进行联合分析,得出该环境下的心率数据,然后将该数据与环境健康度语言词模型进行对比,以此判断该环境温度偏高或偏低,使空调作出相应动作。The indoor environment health adjustment method based on machine vision according to claim 1, characterized in that, in the step (3), facial data in the actual environment is collected, and then the heart rate recognition module is called, and the algorithm based on joint blind source separation is applied The super-sensing heart rate monitoring method jointly analyzes the face data to obtain the heart rate data in the environment, and then compares the data with the environmental health language word model to determine whether the environment temperature is high or low, so that the air conditioner Make corresponding actions.
  6. 根据权利要求5所述的基于机器视觉的室内环境健康度调节方法,其特征在于,所述步骤(3)具体判断规则如下:The method for adjusting the health of an indoor environment based on machine vision according to claim 5, characterized in that the specific judgment rules of the step (3) are as follows:
    设实际环境的监测心率数值为xSuppose the monitored heart rate value of the actual environment is x
    (1)x<<LL,环境温度很低,空调设定温度上升至RR数值;(1) x<<LL, the ambient temperature is very low, and the air conditioner setting temperature rises to the RR value;
    (2)x<LL,环境温度较低,空调设定温度上升RL数值;(2) x<LL, the ambient temperature is low, and the air-conditioning set temperature rises by the value of RL;
    (3)LL<x<LR,环境温度较舒适,空调温度上升1度;(3) LL<x<LR, the ambient temperature is more comfortable, and the air-conditioning temperature rises by 1 degree;
    (4)LR≤x≤RL,环境温度舒适,空调设定温度不变;(4) LR≤x≤RL, the ambient temperature is comfortable, and the air-conditioning set temperature remains unchanged;
    (5)RL<x<RR,环境温度较舒适,空调设定温度下降1度;(5) RL<x<RR, the ambient temperature is more comfortable, and the air-conditioning set temperature drops by 1 degree;
    (6)RR<x,环境温度较高,空调设定温度下降至LR数值;(6) RR<x, the ambient temperature is higher, and the air conditioner set temperature drops to the LR value;
    (7)RR<<x,环境温度很高,空调设定温度下降至LL数值。(7) RR<<x, the ambient temperature is very high, and the air conditioner set temperature drops to the LL value.
  7. 一种基于机器视觉的室内环境健康度调节系统,其特征在于,用于在执行时实现权利要求1-6任一项所述的基于机器视觉的室内环境健康度调节方法的步骤,包括:A machine vision-based indoor environment health adjustment system, which is characterized in that it is used to implement the steps of the machine vision-based indoor environment health adjustment method according to any one of claims 1-6 when executed, comprising:
    心率识别模块,该模块用于执行步骤(1)的方法;A heart rate recognition module, which is used to perform the method of step (1);
    环境健康度建模模块,该模块用于执行步骤(2)的方法;Environmental health modeling module, which is used to execute the method of step (2);
    环境健康度判别与调节模块,该模块用于执行步骤(3)的方法。Environmental health discrimination and adjustment module, which is used to execute the method of step (3).
PCT/CN2020/132843 2020-06-24 2020-11-30 Indoor environment health degree regulating method and system based on machine vision WO2021258644A1 (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
ZA2022/05483A ZA202205483B (en) 2020-06-24 2022-05-18 Indoor environment health degree regulating method and system based on machine vision

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN202010590624.9A CN111637610B (en) 2020-06-24 2020-06-24 Indoor environment health degree adjusting method and system based on machine vision
CN202010590624.9 2020-06-24

Publications (1)

Publication Number Publication Date
WO2021258644A1 true WO2021258644A1 (en) 2021-12-30

Family

ID=72328412

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2020/132843 WO2021258644A1 (en) 2020-06-24 2020-11-30 Indoor environment health degree regulating method and system based on machine vision

Country Status (3)

Country Link
CN (1) CN111637610B (en)
WO (1) WO2021258644A1 (en)
ZA (1) ZA202205483B (en)

Families Citing this family (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN111637610B (en) * 2020-06-24 2022-04-01 山东建筑大学 Indoor environment health degree adjusting method and system based on machine vision

Citations (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20140367079A1 (en) * 2013-06-18 2014-12-18 Lennox Industries Inc. External body temperature sensor for use with a hvac system
CN104235997A (en) * 2013-06-08 2014-12-24 广东美的制冷设备有限公司 Air conditioner control method and air conditioner system
WO2016175219A1 (en) * 2015-04-28 2016-11-03 Mitsubishi Electric Corporation Method and system for personalizing a heating ventilation and air conditioning system
CN109028473A (en) * 2018-07-26 2018-12-18 珠海格力电器股份有限公司 Starting of air conditioner method, apparatus, system and air-conditioning
CN109009052A (en) * 2018-07-02 2018-12-18 南京工程学院 The embedded heart rate measurement system and its measurement method of view-based access control model
CN109631255A (en) * 2018-12-10 2019-04-16 珠海格力电器股份有限公司 A kind of air conditioning control method, device, storage medium and air-conditioning
CN109993068A (en) * 2019-03-11 2019-07-09 华南理工大学 A kind of contactless human emotion's recognition methods based on heart rate and facial characteristics
WO2019157514A2 (en) * 2018-02-12 2019-08-15 University Of Maryland, College Park Occupant monitoring method and system for building energy management
CN111637610A (en) * 2020-06-24 2020-09-08 山东建筑大学 Indoor environment health degree adjusting method and system based on machine vision

Family Cites Families (12)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR100557043B1 (en) * 2003-01-30 2006-03-03 엘지전자 주식회사 Method for dehumidification of air conditioner
CN1942720B (en) * 2004-12-02 2010-05-12 松下电器产业株式会社 Control device, control method and control system
CN104490371B (en) * 2014-12-30 2016-09-21 天津大学 A kind of thermal comfort detection method based on human body physiological parameter
CN104864558A (en) * 2015-04-30 2015-08-26 广东美的制冷设备有限公司 Air conditioner control method, device and terminal
JP6090382B2 (en) * 2015-07-31 2017-03-08 ダイキン工業株式会社 Air conditioning control system
US10250403B2 (en) * 2015-11-23 2019-04-02 International Business Machines Corporation Dynamic control of smart home using wearable device
CN105352127A (en) * 2015-11-24 2016-02-24 珠海格力电器股份有限公司 Air conditioner control method and intelligent housing system
DE102016215250A1 (en) * 2016-08-16 2018-02-22 Audi Ag A method of operating a motor vehicle using a user's mobile terminal and physiological vital signs
CN109099551A (en) * 2018-07-20 2018-12-28 珠海格力电器股份有限公司 A kind of control method of air conditioner, device, storage medium and air conditioner
CN109724217A (en) * 2018-12-21 2019-05-07 奥克斯空调股份有限公司 It is a kind of based on hospital data and user's physiological signal controllable health-care air-conditioner system and its control method
CN109857043A (en) * 2019-03-29 2019-06-07 大连理工大学 A kind of monitoring indoor environment and the associated Internet of things system of People health and monitoring method
CN110751051B (en) * 2019-09-23 2024-03-19 江苏大学 Abnormal driving behavior detection method based on machine vision

Patent Citations (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN104235997A (en) * 2013-06-08 2014-12-24 广东美的制冷设备有限公司 Air conditioner control method and air conditioner system
US20140367079A1 (en) * 2013-06-18 2014-12-18 Lennox Industries Inc. External body temperature sensor for use with a hvac system
WO2016175219A1 (en) * 2015-04-28 2016-11-03 Mitsubishi Electric Corporation Method and system for personalizing a heating ventilation and air conditioning system
WO2019157514A2 (en) * 2018-02-12 2019-08-15 University Of Maryland, College Park Occupant monitoring method and system for building energy management
CN109009052A (en) * 2018-07-02 2018-12-18 南京工程学院 The embedded heart rate measurement system and its measurement method of view-based access control model
CN109028473A (en) * 2018-07-26 2018-12-18 珠海格力电器股份有限公司 Starting of air conditioner method, apparatus, system and air-conditioning
CN109631255A (en) * 2018-12-10 2019-04-16 珠海格力电器股份有限公司 A kind of air conditioning control method, device, storage medium and air-conditioning
CN109993068A (en) * 2019-03-11 2019-07-09 华南理工大学 A kind of contactless human emotion's recognition methods based on heart rate and facial characteristics
CN111637610A (en) * 2020-06-24 2020-09-08 山东建筑大学 Indoor environment health degree adjusting method and system based on machine vision

Also Published As

Publication number Publication date
CN111637610B (en) 2022-04-01
ZA202205483B (en) 2022-08-31
CN111637610A (en) 2020-09-08

Similar Documents

Publication Publication Date Title
CN109009017B (en) Intelligent health monitoring system and data processing method thereof
CN103400146B (en) Chinese medicine complexion recognition method based on color modeling
CN105022929A (en) Cognition accuracy analysis method for personality trait value test
WO2023036015A1 (en) Fatigue detection method and system based on multi-dimensional body state sensing
Beringer et al. Reliability and validity of machine vision for the assessment of facial expressions
CN116269355B (en) Safety monitoring system based on figure gesture recognition
CN109993068A (en) A kind of contactless human emotion&#39;s recognition methods based on heart rate and facial characteristics
CN107887032A (en) A kind of data processing method and device
WO2021258644A1 (en) Indoor environment health degree regulating method and system based on machine vision
WO2023040577A1 (en) Method and system for intelligent management and control of use of screen terminal by child
CN105956512A (en) Air conditioner temperature automatic regulating system and air conditioner temperature automatic regulating method based on machine vision
WO2024021359A1 (en) Built environment dominant color measurement method and system based on image eeg sensitivity data
CN111428655A (en) Scalp detection method based on deep learning
CN112069986A (en) Machine vision tracking method and device for eye movements of old people
CN111476196A (en) Facial action-based nursing demand identification method for old disabled people
CN110970114A (en) Traditional Chinese medicine health guidance system
CN106485232A (en) A kind of personal identification method based on nose image feature in respiratory
CN115349828A (en) Neonate pain assessment system based on computer deep learning
Feng et al. Using eye aspect ratio to enhance fast and objective assessment of facial paralysis
CN108520283A (en) A kind of classification method of medical image based on brain area indirect relation network struction
Hani et al. Body surface area measurement and soft clustering for PASI area assessment
CN111658931B (en) Intelligent intranasal high-flow humidifying oxygen therapy system
CN115908388B (en) Full period detection method and system for sensitive skin
CN111281403A (en) Fine-grained human body fatigue detection method and device based on embedded equipment
Ma et al. Research on drowsy-driving monitoring and warning system based on multi-feature comprehensive evaluation

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 20942204

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 20942204

Country of ref document: EP

Kind code of ref document: A1