CN111637610A - Indoor environment health degree adjusting method and system based on machine vision - Google Patents

Indoor environment health degree adjusting method and system based on machine vision Download PDF

Info

Publication number
CN111637610A
CN111637610A CN202010590624.9A CN202010590624A CN111637610A CN 111637610 A CN111637610 A CN 111637610A CN 202010590624 A CN202010590624 A CN 202010590624A CN 111637610 A CN111637610 A CN 111637610A
Authority
CN
China
Prior art keywords
data
heart rate
interval
environment
health degree
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN202010590624.9A
Other languages
Chinese (zh)
Other versions
CN111637610B (en
Inventor
李成栋
张金萍
彭伟
李银萍
李文峰
张桂青
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Shandong Jianzhu University
Original Assignee
Shandong Jianzhu University
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Shandong Jianzhu University filed Critical Shandong Jianzhu University
Priority to CN202010590624.9A priority Critical patent/CN111637610B/en
Publication of CN111637610A publication Critical patent/CN111637610A/en
Priority to PCT/CN2020/132843 priority patent/WO2021258644A1/en
Application granted granted Critical
Publication of CN111637610B publication Critical patent/CN111637610B/en
Priority to ZA2022/05483A priority patent/ZA202205483B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • FMECHANICAL ENGINEERING; LIGHTING; HEATING; WEAPONS; BLASTING
    • F24HEATING; RANGES; VENTILATING
    • F24FAIR-CONDITIONING; AIR-HUMIDIFICATION; VENTILATION; USE OF AIR CURRENTS FOR SCREENING
    • F24F11/00Control or safety arrangements
    • F24F11/62Control or safety arrangements characterised by the type of control or by internal processing, e.g. using fuzzy logic, adaptive control or estimation of values
    • F24F11/63Electronic processing
    • F24F11/64Electronic processing using pre-stored data
    • GPHYSICS
    • G16INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR SPECIFIC APPLICATION FIELDS
    • G16HHEALTHCARE INFORMATICS, i.e. INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR THE HANDLING OR PROCESSING OF MEDICAL OR HEALTHCARE DATA
    • G16H50/00ICT specially adapted for medical diagnosis, medical simulation or medical data mining; ICT specially adapted for detecting, monitoring or modelling epidemics or pandemics
    • G16H50/30ICT specially adapted for medical diagnosis, medical simulation or medical data mining; ICT specially adapted for detecting, monitoring or modelling epidemics or pandemics for calculating health indices; for individual health risk assessment
    • GPHYSICS
    • G16INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR SPECIFIC APPLICATION FIELDS
    • G16HHEALTHCARE INFORMATICS, i.e. INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR THE HANDLING OR PROCESSING OF MEDICAL OR HEALTHCARE DATA
    • G16H50/00ICT specially adapted for medical diagnosis, medical simulation or medical data mining; ICT specially adapted for detecting, monitoring or modelling epidemics or pandemics
    • G16H50/50ICT specially adapted for medical diagnosis, medical simulation or medical data mining; ICT specially adapted for detecting, monitoring or modelling epidemics or pandemics for simulation or modelling of medical disorders
    • FMECHANICAL ENGINEERING; LIGHTING; HEATING; WEAPONS; BLASTING
    • F24HEATING; RANGES; VENTILATING
    • F24FAIR-CONDITIONING; AIR-HUMIDIFICATION; VENTILATION; USE OF AIR CURRENTS FOR SCREENING
    • F24F2120/00Control inputs relating to users or occupants
    • F24F2120/20Feedback from users

Abstract

The invention discloses a method and a system for adjusting the health degree of an indoor environment based on machine vision, which comprises the following steps: (1) collecting face data of a person, and analyzing periodic signals from the face data by applying independent vector analysis so as to detect a heart rate; (2) preprocessing acquired heart rate data in a healthy environment to construct an environmental health degree language word model; (3) and comparing the heart rate data collected in the actual environment with the data in the constructed environment health degree model, and judging whether the environment is healthy. The heart rate monitoring method can improve the accuracy of the heart rate monitoring value, quantizes the feeling of a person through the heart rate, eliminates the interference of subjective consciousness, and ensures that the heart rate is relatively stable and the judgment result is more accurate.

Description

Indoor environment health degree adjusting method and system based on machine vision
Technical Field
The invention relates to a method for judging the health degree of an indoor environment, in particular to a method for adjusting the health degree of the indoor environment based on machine vision. The method relates to the technical field of intelligent home furnishing.
Background
In recent years, people pay more and more attention to the comfort and health of living environments. According to survey statistics, more than 80% of the time of people spent indoors every day, and the indoor temperature has important influence on the health of people. Therefore, an appropriate indoor environment temperature is an important factor for judging the health of the indoor environment.
At present, when the indoor environment temperature is detected, a sensor detection mode is mostly adopted, and then the acquired numerical value is compared with the subjectively set numerical value to judge whether the environment is healthy. The environmental temperature requirements vary with each individual's constitution and age. Therefore, subjectively setting the numerical value cannot accurately judge whether the environment is healthy or not. Second, existing heart rate detection methods require contact with a person's body or wearing equipment. The prior art can be seen to lack a method for more conveniently and accurately judging the health degree of the indoor living environment through the problems.
Disclosure of Invention
In order to more conveniently and accurately judge the health degree of the indoor living environment, the invention provides an indoor environment health degree adjusting method and system based on machine vision.
In order to achieve the purpose, the invention adopts the following technical scheme:
the invention provides a machine vision-based indoor environment health degree adjusting method, which comprises the following steps of:
(1) collecting face data of a person, and analyzing periodic signals from the face data by applying independent vector analysis so as to detect a heart rate;
(2) preprocessing acquired heart rate data in a healthy environment to construct an environmental health degree language word model;
(3) and comparing the heart rate data collected in the actual environment with the data in the constructed environment health degree model, and judging whether the environment is healthy.
Preferably, the step (1) is as follows:
the method comprises the steps of shooting data of a plurality of skin areas on a face in real time by means of a high-definition camera, adopting a remote photoplethysmography heart rate monitoring method based on a combined blind source separation algorithm, and applying independent vectors to carry out combined analysis, so that heart rate data of a person are obtained.
Preferably, the specific steps of step (1) are as follows:
firstly, selecting a skin area for data acquisition; then calculating the spatial mean value of the RGB color of the collected skin data; secondly, applying a signal processing method to the calculated spatial mean value to obtain a component of each skin area containing heart rate information; thirdly, common signal components of different mixed signal groups are extracted by utilizing independent vector analysis; finally, a fast fourier transform is applied to the component in order to estimate the number of peaks Ns during the corresponding frequency or processing duration t(s). The heart rate in beats per minute will be calculated as 60 x Fs or Ns/T x 60.
Preferably, the specific steps of step (2) are as follows:
step 1: conversion of monitoring data into interval data
1) Statistical calculation of daily acquired data:
assuming that the data collected on day i are processed, the mean m of the samples is first calculatediSum sample standard deviation σiRespectively expressed as:
Figure BDA0002556147300000021
Figure BDA0002556147300000022
wherein n isiRepresents the total amount of data collected on day i, datai,jExpressed as the jth data collected on day i;
2) daily data preprocessing:
on the basis of the stage 1), for each datai,jJudging whether the following equation is satisfied:
|datai,j-mi|≤k*σi(3)
if the equation is satisfied, accepting; otherwise, the data are removed; k represents a constraint coefficient, and the general k value is 2; after this processing, the data for the i-th day will be left n "i(n”i≤ni) A plurality of;
3) statistical calculation of all remaining data over n days:
calculate the sample mean m and sample standard deviation σ of all remaining data over n days:
Figure BDA0002556147300000023
Figure BDA0002556147300000024
4) preprocessing data in n days: for each datai,jJudging whether the data meets the equation (3) or not, wherein the data is accepted, and if not, the data is rejected;
5) acquiring a daily interval:
from the data collected each day, the maximum and minimum values were selected to make up the daily interval, and the interval on day i was expressed as:
Figure BDA0002556147300000031
where I1, n, I denotes the amount of daily data left after the above-mentioned preprocessing stage, ciAnd diLeft and right endpoints representing the day interval of the ith day, respectively;
step 2: interval data preprocessing
1) Abnormal value processing: first to ciAnd diBox and Whisser tests were performed and L was calculatedi=ci-di(ii) a If the end point values of the interval satisfy the following equation:
Figure BDA0002556147300000032
the interval is reserved, otherwise, the interval is removed; where Q (.25) is referred to as the lower four-digit score, indicating that one-fourth of all observations are smaller than it; q (.75) is called the upper four-digit score, indicating that one-fourth of all observations are larger than it; IQR is called the interquartile range, which is the difference between the upper and lower quartile scores;
after the processing, reserving a data interval with m' less than or equal to n; calculation of ci,diAnd LiSample mean and standard deviation of (e.g., (m)cc),(mdd),(mLL) Wherein i ═ 1.., m';
2) and (4) processing a tolerance value: if the endpoint values of the remaining m' data intervals satisfy the following equation:
Figure BDA0002556147300000033
the interval is reserved; otherwise, it will be kicked away. Wherein i is 1., m', k represents a constraint coefficient, and k takes a value of 2;
thereafter, m ≦ n data intervals are retained; recalculate ci,diAnd LiSample mean and standard deviation of (e.g., (m)c',σc'),(md',σd'),(mL',σL'), wherein i ═ 1,. m ";
3) and (3) rationality treatment: computing
ξ*={((c'(σ'd)2-md'(σ’c)2)±σcd'[(mc'-md')2+2((σ’c)2-(σ'd)2)ln(σc'/σd')]1/2}/((σ’c)2-(σ'd)2) (9)
When m isc'≤ξ*≤md', this interval is to be reserved; otherwise, the interval is rejected;
the remaining n '(1. ltoreq. n'. ltoreq.n) data intervals are renumbered with 1,2
Figure BDA0002556147300000041
And step 3: constructing environmental health degree language word model
Selecting two representative intervals from n '(n' is more than or equal to 1 and less than or equal to n) reserved intervals by applying a percentile method, and constructing an environmental health degree language word model;
left and right end points of section data assumed to be left are arranged in order
Figure BDA0002556147300000042
Figure BDA0002556147300000043
For a given q (q < 0.5), assume that the 100q th and 100(1-q) th percentiles are denoted as [ Tq,T1-q]The interval contains data points in the ratio of (1-2 q). For the left endpoint, its 100q and 100(1-q) th percentiles were calculated as
Figure BDA0002556147300000044
Figure BDA0002556147300000045
Wherein
Figure BDA0002556147300000046
And
Figure BDA0002556147300000047
100q th and 100(1-q) th percentiles, respectively, representing the left endpoints.]Expressing the integrals of the corresponding values using floor functionsPart rem (, 1) uses a mod function to calculate the remainder of the corresponding value after dividing by 1. Likewise, for the right endpoint, its 100q and 100(1-q) th percentiles may be calculated and expressed as the right endpoint, respectively
Figure BDA0002556147300000048
And
Figure BDA0002556147300000049
Figure BDA00025561473000000410
Figure BDA00025561473000000411
the left and right representative intervals of the environmental health degree language word model are set as
Figure BDA00025561473000000412
Figure BDA00025561473000000413
And constructing an environment health degree language word model.
Preferably, the facial data in the actual environment are collected in the step (3), then a heart rate recognition module is called, the facial data are subjected to joint analysis by using an ultra-perception heart rate monitoring method based on a joint blind source separation algorithm to obtain heart rate data in the environment, and then the data are compared with an environment health degree language word model to judge whether the environment temperature is higher or lower, so that the air conditioner can make corresponding actions.
Preferably, the specific judgment rule in step (3) is as follows:
let the monitored heart rate value of the actual environment be x
(1) When x is LL, the ambient temperature is very low, and the set temperature of the air conditioner is increased to an RR value;
(2) x is less than LL, the ambient temperature is lower, and the set temperature of the air conditioner is increased by RL numerical value;
(3) LL is more than x and less than LR, the ambient temperature is more comfortable, and the temperature of the air conditioner rises by 1 ℃;
(4) x is more than or equal to LR and less than or equal to RL, the ambient temperature is comfortable, and the set temperature of the air conditioner is not changed;
(5) RL < x < RR, the ambient temperature is more comfortable, and the set temperature of the air conditioner is reduced by 1 DEG;
(6) RR is less than x, the ambient temperature is higher, and the set temperature of the air conditioner is reduced to an LR value;
(7) and RR is x, the ambient temperature is high, and the set temperature of the air conditioner is reduced to LL value.
The invention also provides an indoor environment health degree adjusting system based on machine vision, which is used for executing the steps of the indoor environment health degree adjusting method based on machine vision, and comprises the following steps:
a heart rate identification module for performing the method of step (1);
an environmental health modeling module for performing the method of step (2);
and (4) an environmental health degree judging and adjusting module which is used for executing the method in the step (3).
The technical scheme of the invention has the following beneficial effects:
1. the heart rate monitoring adopts an ultra-sensing method, so that data collection is quicker and more convenient, and the intelligence of the home is improved.
2. The remote photoplethysmography heart rate monitoring method based on the combined blind source separation algorithm analyzes multiple facial subregions, can overcome the influence of illumination change and movement, and improves the accuracy of heart rate monitoring numerical values.
3. The 'feeling' of a person is quantified through the heart rate, the interference of subjective consciousness is eliminated, the heart rate is stable, and the judgment result is more accurate.
Drawings
The above and/or additional aspects and advantages of the present invention will become apparent and readily appreciated from the following description of the embodiments, taken in conjunction with the accompanying drawings of which:
FIG. 1 is a diagram of an environmental health language word model of the present invention;
fig. 2 is a flow chart of the present invention for determining and adjusting the health of the indoor environment.
Detailed Description
Reference will now be made in detail to embodiments of the present invention, examples of which are illustrated in the accompanying drawings, wherein like or similar reference numerals refer to the same or similar elements or elements having the same or similar function throughout. The embodiments described below with reference to the accompanying drawings are illustrative only for the purpose of explaining the present invention, and are not to be construed as limiting the present invention.
In order to more conveniently and accurately judge the health degree of the indoor living environment, a method and a system for regulating the health degree of the indoor environment based on machine vision are provided. The method comprises the steps of collecting facial data of people living in a healthy environment within a period of time by using a high-definition camera, analyzing the heart rate data from the facial data by using a remote photoplethysmography heart rate monitoring method based on a joint blind source separation algorithm, preprocessing the data, converting the collected data into interval data, processing the interval data, and constructing an environment health degree language word model on the basis. And then, acquiring heart rate data of people in an actual environment, and comparing the heart rate data with data in the environmental health degree language word model, so as to judge whether the environmental temperature is higher or lower, and further give out an adjusting strategy.
The invention is composed of a heart rate identification module, an environmental health degree modeling module and an environmental health degree judging and adjusting module. The heart rate identification module mainly utilizes a high-definition camera to collect face data of a person, and applies independent vector analysis to separate out periodic signals from the face data, so that the heart rate is detected. The environment health degree modeling module calls a heart rate recognition module to recognize the heart rate in the health environment, and then preprocesses heart rate data to construct an environment health degree language word model. The environment health degree judging and adjusting module collects facial data in an actual environment, calls the heart rate identification module to obtain heart rate data, compares the heart rate data with data in the constructed environment health degree model, judges whether the environment is healthy or not, and gives a proper adjusting strategy.
1. Heart rate identification module
The module functions to extract heart rate data of the person from the face data of the person. The method comprises the steps of shooting data of a plurality of skin areas on a face in real time by means of a high-definition camera, adopting a remote photoplethysmography heart rate monitoring method based on a combined blind source separation algorithm, and applying independent vectors to carry out combined analysis, so that heart rate data of a person are obtained.
Firstly, selecting a skin area for data acquisition; then calculating the spatial mean value of the RGB color of the collected skin data; secondly, applying a signal processing method to the calculated spatial mean value to obtain a component of each skin area containing heart rate information; thirdly, common signal components of different mixed signal groups are extracted by utilizing independent vector analysis; finally, a fast fourier transform is applied to the component in order to estimate the corresponding frequency (or number of peaks Ns during the processing duration t (s)). The heart rate in beats per minute will be calculated as 60 × Fs (or Ns/T × 60).
2. Environmental health degree modeling module
Utilize high definition digtal camera to gather people's facial data under healthy environment, call rhythm of the heart identification module, obtain the rhythm of the heart data that corresponds constantly, need carry out the preliminary treatment to the rhythm of the heart data that come to gather again. Then converting the daily heart rate data into a heart rate interval, and then preprocessing the interval data by three steps of singular value, tolerance value and reasonable value. And constructing the processed interval data into an environmental health degree language word model by using a percentile method. The method comprises the following specific steps:
1. conversion of monitoring data into interval data
(1) Statistical calculation of daily acquired data:
assuming that the data collected on day i are processed, the mean m of the samples is first calculatediSum sample standard deviation σiRespectively expressed as:
Figure BDA0002556147300000071
Figure BDA0002556147300000072
wherein n isiData collected during day iTotal amount, datai,jExpressed as the jth data collected on day i;
(2) daily data preprocessing:
on the basis of the stage (1), for each datai,jJudging whether the following equation is satisfied:
|datai,j-mi|≤k*σi(3)
if the equation is satisfied, accepting; otherwise, the data are removed; k is a constraint coefficient, and the general k value is 2; after this processing, the data for the i-th day will be left n "i(n”i≤ni) A plurality of;
(3) statistical calculation of all remaining data over n days:
calculate the sample mean m and sample standard deviation σ of all remaining data over n days:
Figure BDA0002556147300000073
Figure BDA0002556147300000074
(4) preprocessing data in n days: for each datai,jJudging whether the data meets the equation (3) or not, wherein the data is accepted, and if not, the data is rejected;
(5) acquiring a daily interval:
from the data collected each day, the maximum and minimum values were selected to make up the daily interval, and the interval on day i was expressed as:
Figure BDA0002556147300000075
where I1, n, I denotes the amount of daily data left after the above-mentioned preprocessing stage, ciAnd diLeft and right endpoints representing the day interval of the ith day, respectively;
2. interval data preprocessing
(1) Abnormal value processing: first to ciAnd diExecuteBox and Whisker test, then calculate Li=ci-di(ii) a If the end point values of the interval satisfy the following equation:
Figure BDA0002556147300000081
the interval is reserved, otherwise, the interval is removed; where Q (.25) is referred to as the lower four-digit score, indicating that one-fourth of all observations are smaller than it; q (.75) is called the upper four-digit score, indicating that one-fourth of all observations are larger than it; IQR is called the interquartile range, which is the difference between the upper and lower quartile scores;
after the processing, reserving a data interval with m' less than or equal to n; calculation of ci,diAnd LiSample mean and standard deviation of (e.g., (m)cc),(mdd),(mLL) Wherein i ═ 1.., m';
(2) and (4) processing a tolerance value: if the endpoint values of the remaining m' data intervals satisfy the following equation:
Figure BDA0002556147300000082
the interval is reserved; otherwise, the utility model is kicked; wherein i is 1., m', k represents a constraint coefficient, and k takes a value of 2;
thereafter, m ≦ n data intervals are retained; recalculate ci,diAnd LiSample mean and standard deviation of (e.g., (m)c',σc'),(md',σd'),(mL',σL'), wherein i ═ 1,. m ";
3) and (3) rationality treatment: computing
ξ*={(mc'(σ'd)2-md'(σ’c)2)±σcd'[(mc'-md')2+2((σ’c)2-(σ'd)2)ln(σc'/σd')]1/2}/((σ’c)2-(σ'd)2) (9)
When m isc'≤ξ*≤md', this interval is to be reserved; otherwise, the interval is rejected;
the remaining n '(1. ltoreq. n'. ltoreq.n) data intervals are renumbered with 1,2
Figure BDA0002556147300000083
3. Constructing environmental health degree language word model
Selecting two representative intervals from n '(n' is more than or equal to 1 and less than or equal to n) reserved intervals by applying a percentile method, and constructing an environmental health degree language word model;
left and right end points of section data assumed to be left are arranged in order
Figure BDA0002556147300000091
Figure BDA0002556147300000092
For a given q (q < 0.5), assume that the 100q th and 100(1-q) th percentiles are denoted as [ Tq,T1-q]The interval contains data points in the ratio of (1-2 q); for the left endpoint, its 100q and 100(1-q) th percentiles were calculated as
Figure BDA0002556147300000093
Figure BDA0002556147300000094
Wherein
Figure BDA0002556147300000095
And
Figure BDA0002556147300000096
100q th and 100(1-q) th percentiles, respectively, representing the left endpoints.]The integrated part of the corresponding value is represented using a floor function, rem (·, 1) the remainder of the corresponding value after dividing by 1 is calculated using a mod function. Likewise, for the right endpoint, its 100q and 100(1-q) th percentiles may be calculated and expressed as the right endpoint, respectively
Figure BDA0002556147300000097
And
Figure BDA0002556147300000098
Figure BDA0002556147300000099
Figure BDA00025561473000000910
the left and right representative intervals of the environmental health degree language word model are set as
Figure BDA00025561473000000911
Figure BDA00025561473000000912
The environmental health language word model as shown in fig. 1 is constructed.
3. Environment health degree judging module
The method comprises the steps of collecting facial data in an actual environment, calling a heart rate recognition module, carrying out combined analysis on the facial data by using an ultra-perception heart rate monitoring method based on a combined blind source separation algorithm to obtain heart rate data in the environment, comparing the heart rate data with an environment health degree language word model (shown in figure 1), and judging whether the environment temperature is higher or lower so as to enable an air conditioner to make corresponding actions. The specific judgment rule is as follows: let the monitored heart rate value of the actual environment be x
(1) When x is LL, the ambient temperature is very low, and the set temperature of the air conditioner is increased to an RR value;
(2) x is less than LL, the ambient temperature is lower, and the set temperature of the air conditioner is increased by RL numerical value;
(3) LL is more than x and less than LR, the ambient temperature is more comfortable, and the temperature of the air conditioner rises by 1 ℃;
(4) x is more than or equal to LR and less than or equal to RL, the ambient temperature is comfortable, and the set temperature of the air conditioner is not changed;
(5) RL < x < RR, the ambient temperature is more comfortable, and the set temperature of the air conditioner is reduced by 1 DEG;
(6) RR is less than x, the ambient temperature is higher, and the set temperature of the air conditioner is reduced to an LR value;
(7) and RR is x, the ambient temperature is high, and the set temperature of the air conditioner is reduced to LL value.
The overall steps of the present invention are shown in figure 2.
While embodiments of the invention have been shown and described, it will be understood by those of ordinary skill in the art that: various changes, modifications, substitutions and alterations can be made to the embodiments without departing from the principles and spirit of the invention, the scope of which is defined by the claims and their equivalents.

Claims (7)

1. A method for adjusting the health degree of an indoor environment based on machine vision is characterized by comprising the following steps:
(1) collecting face data of a person, and analyzing periodic signals from the face data by applying independent vector analysis so as to detect a heart rate;
(2) preprocessing acquired heart rate data in a healthy environment to construct an environmental health degree language word model;
(3) and comparing the heart rate data collected in the actual environment with the data in the constructed environment health degree model, and judging whether the environment is healthy.
2. The machine-vision-based indoor environment health adjustment method according to claim 1, wherein the step (1) comprises the steps of:
the method comprises the steps of shooting data of a plurality of skin areas on a face in real time by means of a high-definition camera, adopting a remote photoplethysmography heart rate monitoring method based on a combined blind source separation algorithm, and applying independent vectors to carry out combined analysis, so that heart rate data of a person are obtained.
3. The machine vision based indoor environment health adjustment method according to claim 2, wherein the specific steps of the step (1) are as follows:
firstly, selecting a skin area for data acquisition; then calculating the spatial mean value of the RGB color of the collected skin data; secondly, applying a signal processing method to the calculated spatial mean value to obtain a component of each skin area containing heart rate information; thirdly, common signal components of different mixed signal groups are extracted by utilizing independent vector analysis; finally, a fast fourier transform is applied to the component in order to estimate the number of peaks Ns during the corresponding frequency or processing duration t(s); the heart rate in beats per minute will be calculated as 60 x Fs or Ns/T x 60.
4. The machine vision based indoor environment health adjustment method according to claim 1, wherein the specific steps of the step (2) are as follows:
step 1: conversion of monitoring data into interval data
1) Statistical calculation of daily acquired data:
assuming that the data collected on day i are processed, the mean m of the samples is first calculatediSum sample standard deviation σiRespectively expressed as:
Figure FDA0002556147290000011
Figure FDA0002556147290000012
wherein n isiRepresents the total amount of data collected on day i, datai,jExpressed as the jth data collected on day i;
2) daily data preprocessing:
on the basis of the stage 1), for each datai,jJudging whether the following equation is satisfied:
|datai,j-mi|≤k*σi(3) if the equation is satisfied, accepting; otherwise, the data are removed; k represents the constraint coefficient, after which the data for day i will be left n ″i(n″i≤ni) A plurality of;
3) statistical calculation of all remaining data over n days:
calculate the sample mean m and sample standard deviation σ of all remaining data over n days:
Figure FDA0002556147290000021
Figure FDA0002556147290000022
4) preprocessing data in n days: for each datai,jJudging whether the data meets the equation (3) or not, wherein the data is accepted, and if not, the data is rejected;
5) acquiring a daily interval:
from the data collected each day, the maximum and minimum values were selected to make up the daily interval, and the interval on day i was expressed as:
Figure FDA0002556147290000023
wherein I1., n, I represents the amount of daily data left after the above-described preprocessing stage; c. CiAnd diLeft and right endpoints representing the day interval of the ith day, respectively;
step 2: interval data preprocessing
1) Abnormal value processing: first to ciAnd diBox and Whisser tests were performed and L was calculatedi=ci-di(ii) a If the end point values of the interval satisfy the following equation:
Figure FDA0002556147290000024
the interval is reserved, otherwise, the interval is removed; where Q (.25) is referred to as the lower four-digit score, indicating that one-fourth of all observations are smaller than it; q (.75) is called the upper four-digit score, indicating that one-fourth of all observations are larger than it; IQR is called the interquartile range, which is the difference between the upper and lower quartile scores;
after the processing, reserving a data interval with m' less than or equal to n; calculation of ci,diAnd LiSample mean and standard deviation of (e.g., (m)cc),(mdd),(mLL) Wherein i ═ 1.., m';
2) and (4) processing a tolerance value: if the endpoint values of the remaining m' data intervals satisfy the following equation:
Figure FDA0002556147290000031
the interval is reserved; otherwise, the utility model is kicked; wherein i is 1., m', k represents a constraint coefficient, and k takes a value of 2;
thereafter, m ≦ n data intervals are retained; recalculate ci,diAnd LiSample mean and standard deviation of (e.g., (m)c',σc'),(md',σd'),(mL',σL'), wherein i ═ 1,. m ";
3) and (3) rationality treatment: computing
ξ*={(mc'(σ'd)2-md'(σc')2)±σcd'[(mc'-md')2+2((σ′c)2-(σ′d)2)ln(σc'/σd')]1/2}/((σ′c)2-(σ′d)2) (9)
When m isc'≤ξ*≤md', this interval is to be reserved; otherwise, the interval is rejected;
renumbering the reserved n' (1 ≦ n) data intervals to1,2, and is denoted as [ t ]i l,ti r],(i=1,2,...,n′);
And step 3: constructing environmental health degree language word model
Selecting two representative intervals from n '(n' is more than or equal to 1 and less than or equal to n) reserved intervals by applying a percentile method, and constructing an environmental health degree language word model;
left and right end points of section data assumed to be left are arranged in order
Figure FDA0002556147290000032
Figure FDA0002556147290000033
For a given q, assume that the 100q th and 100(1-q) th percentiles are denoted as [ T ] respectivelyq,T1-q]The interval contains data points in the ratio of (1-2 q); for the left endpoint, its 100q and 100(1-q) th percentiles were calculated as
Tq L=tl [n'*q]+rem(n'*q,1)(tl [n'*q+1]-tl [n'*q]) (10)
Figure FDA0002556147290000034
Wherein
Figure FDA0002556147290000041
And
Figure FDA0002556147290000042
100q th and 100(1-q) th percentiles, respectively, representing the left endpoints.]Representing the integral part of the corresponding value using a floor function, rem (·, 1) calculating the remainder of the corresponding value after dividing by 1 using a mod function; likewise, for the right endpoint, its 100q and 100(1-q) th percentiles may be calculated and expressed as the right endpoint, respectively
Figure FDA0002556147290000043
And
Figure FDA0002556147290000044
Tq R=tr [n'*q]+rem(n'*q,1)(tr [n'*q+1]-tr [n'*q]) (12)
Figure FDA0002556147290000045
the left and right representative intervals of the environmental health degree language word model are set as
Figure FDA0002556147290000046
Figure FDA0002556147290000047
And constructing an environment health degree language word model.
5. The indoor environment health degree adjusting method based on machine vision according to claim 1, wherein in the step (3), facial data in an actual environment are collected, then a heart rate recognition module is called, the facial data are subjected to joint analysis by using an ultra-perception heart rate monitoring method based on a joint blind source separation algorithm, heart rate data in the environment are obtained, and then the data are compared with an environment health degree language word model, so that the fact that the environment temperature is higher or lower is judged, and an air conditioner can make corresponding actions.
6. The machine-vision-based indoor environment health adjustment method according to claim 5, wherein the step (3) specifically judges as follows:
let the monitored heart rate value of the actual environment be x
(1) When x is LL, the ambient temperature is very low, and the set temperature of the air conditioner is increased to an RR value;
(2) x is less than LL, the ambient temperature is lower, and the set temperature of the air conditioner is increased by RL numerical value;
(3) LL is more than x and less than LR, the ambient temperature is more comfortable, and the temperature of the air conditioner rises by 1 ℃;
(4) x is more than or equal to LR and less than or equal to RL, the ambient temperature is comfortable, and the set temperature of the air conditioner is not changed;
(5) RL < x < RR, the ambient temperature is more comfortable, and the set temperature of the air conditioner is reduced by 1 DEG;
(6) RR is less than x, the ambient temperature is higher, and the set temperature of the air conditioner is reduced to an LR value;
(7) and RR is x, the ambient temperature is high, and the set temperature of the air conditioner is reduced to LL value.
7. A machine vision based indoor environment health adjustment system, configured to implement the steps of the machine vision based indoor environment health adjustment method of any one of claims 1-6 when executed, comprising:
a heart rate identification module for performing the method of step (1);
an environmental health modeling module for performing the method of step (2);
and (4) an environmental health degree judging and adjusting module which is used for executing the method in the step (3).
CN202010590624.9A 2020-06-24 2020-06-24 Indoor environment health degree adjusting method and system based on machine vision Active CN111637610B (en)

Priority Applications (3)

Application Number Priority Date Filing Date Title
CN202010590624.9A CN111637610B (en) 2020-06-24 2020-06-24 Indoor environment health degree adjusting method and system based on machine vision
PCT/CN2020/132843 WO2021258644A1 (en) 2020-06-24 2020-11-30 Indoor environment health degree regulating method and system based on machine vision
ZA2022/05483A ZA202205483B (en) 2020-06-24 2022-05-18 Indoor environment health degree regulating method and system based on machine vision

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202010590624.9A CN111637610B (en) 2020-06-24 2020-06-24 Indoor environment health degree adjusting method and system based on machine vision

Publications (2)

Publication Number Publication Date
CN111637610A true CN111637610A (en) 2020-09-08
CN111637610B CN111637610B (en) 2022-04-01

Family

ID=72328412

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202010590624.9A Active CN111637610B (en) 2020-06-24 2020-06-24 Indoor environment health degree adjusting method and system based on machine vision

Country Status (3)

Country Link
CN (1) CN111637610B (en)
WO (1) WO2021258644A1 (en)
ZA (1) ZA202205483B (en)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2021258644A1 (en) * 2020-06-24 2021-12-30 山东建筑大学 Indoor environment health degree regulating method and system based on machine vision

Citations (15)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR20040069615A (en) * 2003-01-30 2004-08-06 엘지전자 주식회사 Method for dehumidification of air conditioner
CN1942720A (en) * 2004-12-02 2007-04-04 松下电器产业株式会社 Control device, control method, control program, computer-readable recording medium having control program recorded threreon, and control system
CN104490371A (en) * 2014-12-30 2015-04-08 天津大学 Heat comfort detection method based on physiological parameters of human body
CN104864558A (en) * 2015-04-30 2015-08-26 广东美的制冷设备有限公司 Air conditioner control method, device and terminal
US20170149580A1 (en) * 2015-11-23 2017-05-25 International Business Machines Corporation Dynamic control of smart home using wearable device
WO2017088562A1 (en) * 2015-11-24 2017-06-01 珠海格力电器股份有限公司 Air conditioner control method and intelligent household system
WO2018033258A1 (en) * 2016-08-16 2018-02-22 Audi Ag Method for operating a motor vehicle with the aid of a mobile terminal of a user and physiological vital data
CN109009052A (en) * 2018-07-02 2018-12-18 南京工程学院 The embedded heart rate measurement system and its measurement method of view-based access control model
CN109028473A (en) * 2018-07-26 2018-12-18 珠海格力电器股份有限公司 Starting of air conditioner method, apparatus, system and air-conditioning
CN109099551A (en) * 2018-07-20 2018-12-28 珠海格力电器股份有限公司 A kind of control method of air conditioner, device, storage medium and air conditioner
CN109724217A (en) * 2018-12-21 2019-05-07 奥克斯空调股份有限公司 It is a kind of based on hospital data and user's physiological signal controllable health-care air-conditioner system and its control method
US20190137136A1 (en) * 2015-07-31 2019-05-09 Daikin Industries, Ltd. Air-conditioning control system
CN110751051A (en) * 2019-09-23 2020-02-04 江苏大学 Abnormal driving behavior detection method based on machine vision
US20200305714A1 (en) * 2019-03-29 2020-10-01 Dalian University Of Technology Iot system and monitoring method for monitoring association between indoor environment and health of elderly people
US20210068673A1 (en) * 2018-02-12 2021-03-11 University Of Maryland, College Park Occupant monitoring method and system for building energy management

Family Cites Families (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN104235997B (en) * 2013-06-08 2017-03-08 广东美的制冷设备有限公司 Air conditioning control method and air-conditioning system
US9546796B2 (en) * 2013-06-18 2017-01-17 Lennox Industries Inc. External body temperature sensor for use with a HVAC system
US20160320081A1 (en) * 2015-04-28 2016-11-03 Mitsubishi Electric Research Laboratories, Inc. Method and System for Personalization of Heating, Ventilation, and Air Conditioning Services
CN109631255A (en) * 2018-12-10 2019-04-16 珠海格力电器股份有限公司 A kind of air conditioning control method, device, storage medium and air-conditioning
CN109993068B (en) * 2019-03-11 2023-07-21 华南理工大学 Non-contact human emotion recognition method based on heart rate and facial features
CN111637610B (en) * 2020-06-24 2022-04-01 山东建筑大学 Indoor environment health degree adjusting method and system based on machine vision

Patent Citations (15)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR20040069615A (en) * 2003-01-30 2004-08-06 엘지전자 주식회사 Method for dehumidification of air conditioner
CN1942720A (en) * 2004-12-02 2007-04-04 松下电器产业株式会社 Control device, control method, control program, computer-readable recording medium having control program recorded threreon, and control system
CN104490371A (en) * 2014-12-30 2015-04-08 天津大学 Heat comfort detection method based on physiological parameters of human body
CN104864558A (en) * 2015-04-30 2015-08-26 广东美的制冷设备有限公司 Air conditioner control method, device and terminal
US20190137136A1 (en) * 2015-07-31 2019-05-09 Daikin Industries, Ltd. Air-conditioning control system
US20170149580A1 (en) * 2015-11-23 2017-05-25 International Business Machines Corporation Dynamic control of smart home using wearable device
WO2017088562A1 (en) * 2015-11-24 2017-06-01 珠海格力电器股份有限公司 Air conditioner control method and intelligent household system
WO2018033258A1 (en) * 2016-08-16 2018-02-22 Audi Ag Method for operating a motor vehicle with the aid of a mobile terminal of a user and physiological vital data
US20210068673A1 (en) * 2018-02-12 2021-03-11 University Of Maryland, College Park Occupant monitoring method and system for building energy management
CN109009052A (en) * 2018-07-02 2018-12-18 南京工程学院 The embedded heart rate measurement system and its measurement method of view-based access control model
CN109099551A (en) * 2018-07-20 2018-12-28 珠海格力电器股份有限公司 A kind of control method of air conditioner, device, storage medium and air conditioner
CN109028473A (en) * 2018-07-26 2018-12-18 珠海格力电器股份有限公司 Starting of air conditioner method, apparatus, system and air-conditioning
CN109724217A (en) * 2018-12-21 2019-05-07 奥克斯空调股份有限公司 It is a kind of based on hospital data and user's physiological signal controllable health-care air-conditioner system and its control method
US20200305714A1 (en) * 2019-03-29 2020-10-01 Dalian University Of Technology Iot system and monitoring method for monitoring association between indoor environment and health of elderly people
CN110751051A (en) * 2019-09-23 2020-02-04 江苏大学 Abnormal driving behavior detection method based on machine vision

Non-Patent Citations (2)

* Cited by examiner, † Cited by third party
Title
CHENGDONG LI: "《ELSEVIER》", 12 November 2018 *
任伟娜: "《万方数据库》", 23 September 2016 *

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2021258644A1 (en) * 2020-06-24 2021-12-30 山东建筑大学 Indoor environment health degree regulating method and system based on machine vision

Also Published As

Publication number Publication date
CN111637610B (en) 2022-04-01
WO2021258644A1 (en) 2021-12-30
ZA202205483B (en) 2022-08-31

Similar Documents

Publication Publication Date Title
CN109009017B (en) Intelligent health monitoring system and data processing method thereof
CN103400146B (en) Chinese medicine complexion recognition method based on color modeling
CN109480833A (en) The pretreatment and recognition methods of epileptic&#39;s EEG signals based on artificial intelligence
CN108847279B (en) Sleep breathing state automatic discrimination method and system based on pulse wave data
CN111091074A (en) Motor imagery electroencephalogram signal classification method based on optimal region common space mode
CN116269355B (en) Safety monitoring system based on figure gesture recognition
WO2024021359A1 (en) Built environment dominant color measurement method and system based on image eeg sensitivity data
CN115563484A (en) Street greening quality detection method based on physiological awakening identification
CN111637610B (en) Indoor environment health degree adjusting method and system based on machine vision
CN114027857B (en) Method for measuring exercise capacity based on electroencephalogram signals
CN109934179B (en) Human body action recognition method based on automatic feature selection and integrated learning algorithm
CN114569096A (en) Non-contact continuous blood pressure measuring method and system based on video stream
CN113591769A (en) Non-contact heart rate detection method based on photoplethysmography
CN111281403B (en) Fine-grained human body fatigue detection method and device based on embedded equipment
CN115908388B (en) Full period detection method and system for sensitive skin
CN112826507A (en) Brain function network evolution modeling method for sensorineural deafness
CN111671421A (en) Electroencephalogram-based children demand sensing method
CN116530981A (en) Facial recognition-based qi and blood state analysis system and method
CN113907770B (en) Ratchet composite wave detection and identification method and system based on feature fusion
Li et al. Multi-label constitution identification based on tongue image in traditional Chinese medicine
CN114983434A (en) System and method based on multi-mode brain function signal recognition
CN114068020A (en) Intelligent health monitoring and optimizing system
CN114742090A (en) Cockpit man-machine interaction system based on mental fatigue monitoring
CN113850192A (en) Blink artifact detection method based on EMD-CSP electroencephalogram feature learning and intelligent fusion
Melinda et al. A novel autism spectrum disorder children dataset based on thermal imaging

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant