CN109998501A - Physical signs and the detection method of psychological indicator, device and terminal device - Google Patents
Physical signs and the detection method of psychological indicator, device and terminal device Download PDFInfo
- Publication number
- CN109998501A CN109998501A CN201910233982.1A CN201910233982A CN109998501A CN 109998501 A CN109998501 A CN 109998501A CN 201910233982 A CN201910233982 A CN 201910233982A CN 109998501 A CN109998501 A CN 109998501A
- Authority
- CN
- China
- Prior art keywords
- target person
- signal
- physical signs
- target area
- reference signal
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Classifications
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B5/00—Measuring for diagnostic purposes; Identification of persons
- A61B5/0059—Measuring for diagnostic purposes; Identification of persons using light, e.g. diagnosis by transillumination, diascopy, fluorescence
- A61B5/0077—Devices for viewing the surface of the body, e.g. camera, magnifying lens
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B5/00—Measuring for diagnostic purposes; Identification of persons
- A61B5/02—Detecting, measuring or recording pulse, heart rate, blood pressure or blood flow; Combined pulse/heart-rate/blood pressure determination; Evaluating a cardiovascular condition not otherwise provided for, e.g. using combinations of techniques provided for in this group with electrocardiography or electroauscultation; Heart catheters for measuring blood pressure
- A61B5/0205—Simultaneously evaluating both cardiovascular conditions and different types of body conditions, e.g. heart and respiratory condition
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B5/00—Measuring for diagnostic purposes; Identification of persons
- A61B5/145—Measuring characteristics of blood in vivo, e.g. gas concentration, pH value; Measuring characteristics of body fluids or tissues, e.g. interstitial fluid, cerebral tissue
- A61B5/14542—Measuring characteristics of blood in vivo, e.g. gas concentration, pH value; Measuring characteristics of body fluids or tissues, e.g. interstitial fluid, cerebral tissue for measuring blood gases
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B5/00—Measuring for diagnostic purposes; Identification of persons
- A61B5/16—Devices for psychotechnics; Testing reaction times ; Devices for evaluating the psychological state
Abstract
The present invention is suitable for field of computer technology, provide detection method, device and the terminal device of a kind of physical signs and psychological indicator, the described method includes: obtaining the face video of the target person of multiple images acquisition device acquisition respectively, and corresponding color signal is extracted from each face video；Wherein, described multiple images acquisition device for acquiring the face video of target person from different perspectives；According to the corresponding color signal of each image collecting device, the reference signal of the target person is determined；According to the reference signal of the target person, the physical signs and psychological indicator of the target person are obtained.The present invention obtains the face video of user by multiple images acquisition device from different perspectives, make user that can also get accurate face video during exercise, and then compare each face video, determine the reference signal of target person, to not only improve the accuracy of the detection of physical signs and psychological indicator, but also the experience of user can be optimized.
Description
Technical field
The invention belongs to field of computer technology more particularly to a kind of physical signs and the detection method of psychological indicator, dress
It sets and terminal device.
Background technique
Physical signs is to reflect the important evidence of Human Physiology health, is occupied an important position in medical practice, with
Modern medical service means be constantly progressive and the rapid development of portable medical, based on portable equipment human health status detection
Have become a hot spot.
And in the human health status detection method based on portable equipment, the health status based on image is detected due to only
The image that some position of human body need to be shot can be detected corresponding physical signs, therefore by public extensive concern.
But physical signs is being detected using the detection device of Human Physiology index and psychological indicator based on image at present
When, it is desirable that detection position must keep opposing stationary, and face image collecting device, and otherwise image collecting device can not detect
Clearly image, and then lead to the problem of the physical signs of output and the testing result accuracy difference of psychological indicator.
Summary of the invention
In view of this, the embodiment of the invention provides physical signs and the detection method of psychological indicator, device and terminal to set
It is standby, to solve in the prior art because physical signs caused by can not detecting clear image and the testing result of psychological indicator are quasi-
The problem of true property difference.
The first aspect of the embodiment of the present invention provides the detection method of a kind of physical signs and psychological indicator, comprising:
The face video of the target person of multiple images acquisition device acquisition is obtained respectively, and is mentioned from each face video
Take corresponding color signal；Wherein, described multiple images acquisition device for acquiring the face view of target person from different perspectives
Frequently；
According to the corresponding color signal of each image collecting device, the reference signal of the target person is determined；
According to the reference signal of the target person, the physical signs and psychological indicator of the target person are obtained.
The second aspect of the embodiment of the present invention provides the detection device of a kind of physical signs and psychological indicator, comprising:
Color signal obtains module, the face view of the target person for obtaining the acquisition of multiple images acquisition device respectively
Frequently, and from each face video extract corresponding color signal；Wherein, described multiple images acquisition device is used for from different angles
The face video of degree acquisition target person；
Reference signal obtains module, for determining the target according to the corresponding color signal of each image collecting device
The reference signal of personage；
Indexs measure module, for the reference signal according to the target person, the physiology for obtaining the target person refers to
Mark and psychological indicator.
The third aspect of the embodiment of the present invention provides a kind of terminal device, including memory, processor and is stored in
In the memory and the computer program that can run on the processor, when the processor executes the computer program
The step of realizing the detection method of physical signs as described above and psychological indicator.
The fourth aspect of the embodiment of the present invention provides a kind of computer readable storage medium, the computer-readable storage
Media storage has computer program, and the computer program realizes that physical signs and psychology as described above refer to when being executed by processor
The step of object detection method.
Existing beneficial effect is the embodiment of the present invention compared with prior art: the embodiment of the present invention obtains multiple figures respectively
As the face video for the target person that acquisition device acquires, and corresponding color signal is extracted from each face video；Wherein,
Described multiple images acquisition device for acquiring the face video of target person from different perspectives；According to each image collecting device
Corresponding color signal determines the reference signal of the target person；According to the reference signal of the target person, described in acquisition
The physical signs and psychological indicator of target person.The embodiment of the present invention obtains use by multiple images acquisition device from different perspectives
The face video at family makes user that can also get accurate face video during exercise, and then compares each face video, determines
The reference signal of the target person to not only improve the accuracy of the detection of physical signs and psychological indicator, but also can optimize use
The experience at family.
Detailed description of the invention
It to describe the technical solutions in the embodiments of the present invention more clearly, below will be to embodiment or description of the prior art
Needed in attached drawing be briefly described, it should be apparent that, the accompanying drawings in the following description is only of the invention some
Embodiment for those of ordinary skill in the art without any creative labor, can also be according to these
Attached drawing obtains other attached drawings.
Fig. 1 is the implementation process schematic diagram of the detection method of physical signs provided in an embodiment of the present invention and psychological indicator；
Fig. 2 is the implementation process schematic diagram of S101 in Fig. 1 provided in an embodiment of the present invention；
Fig. 3 is the implementation process schematic diagram of S202 in Fig. 2 provided in an embodiment of the present invention；
Fig. 4 is the implementation process schematic diagram of S102 in Fig. 1 provided in an embodiment of the present invention；
Fig. 5 is the structural schematic diagram of the detection device of physical signs provided in an embodiment of the present invention and psychological indicator；
Fig. 6 is the schematic diagram of terminal device provided in an embodiment of the present invention；
Fig. 7 is the signal of relationship between image collecting device provided in an embodiment of the present invention, human face region and target area
Figure.
Specific embodiment
In being described below, for illustration and not for limitation, the tool of such as particular system structure, technology etc is proposed
Body details, to understand thoroughly the embodiment of the present invention.However, it will be clear to one skilled in the art that there is no these specific
The present invention also may be implemented in the other embodiments of details.In other situations, it omits to well-known system, device, electricity
The detailed description of road and method, in case unnecessary details interferes description of the invention.
Description and claims of this specification and term " includes " and their any deformations in above-mentioned attached drawing, meaning
Figure, which is to cover, non-exclusive includes.Such as process, method or system comprising a series of steps or units, product or equipment do not have
It is defined in listed step or unit, but optionally further comprising the step of not listing or unit, or optionally also wrap
Include the other step or units intrinsic for these process, methods, product or equipment.In addition, term " first ", " second " and
" third " etc. is for distinguishing different objects, not for description particular order.
In order to illustrate technical solutions according to the invention, the following is a description of specific embodiments.
Embodiment 1:
Fig. 1 shows the reality of a kind of physical signs of one embodiment of the present of invention offer and the detection method of psychological indicator
Existing process, the process executing subject of the present embodiment can be terminal device, and details are as follows for process:
S101: the face video of the target person of multiple images acquisition device acquisition is obtained respectively, and is regarded from each face
Corresponding color signal is extracted in frequency；Wherein, described multiple images acquisition device for acquiring target person from different perspectives
Face video.
In the present embodiment, physical signs and the detection system of psychological indicator may include that image collecting device and terminal are set
Standby, terminal device obtains the face video that image collecting device is sent.The facial image of image acquisition device target person,
And synthesize face video.It may be by shadows such as movement, the ambient lights of people when shooting face video due to single image acquisition device
It rings, the obtained face video situation unclear there may be shooting.Therefore, in the present embodiment, in order to solve single image
The problem of the video noise difference of shooting caused by acquisition device, can take multiple images acquisition device, image collecting device can
Multiple and different orientation in daily life region are arranged in, for example, driver is target person, image in vehicle travel process
Acquisition device can be set in front of operator seat, left front, the position of right front three, for from three directions shooting drivers'
Face video in driving process.In office process, target person is staff, and image collecting device, which can be set, is handling official business
Position front, left front and the position of right front three, for shooting the face video of staff.
In the present embodiment, 3 image collecting devices had both can be set in image collecting device, or are arranged in face
The multiple images acquisition device in field of front vision region has image and adopts in this way, target person arbitrarily changes the direction of face
Acquisition means can capture the face video of complete display.
In the present embodiment, image collecting device includes camera, video camera, camera, scanner, mobile phone, tablet computer
The equipment and video frequency collection card of camera function are had Deng other.
When image acquisition device is to face video, each image collecting device regards face according to preset time period
Frequency is sent to terminal device, and preset time period can be 5s or 10s.Terminal device can be mobile phone, computer computer, notes
This grade intelligent terminal.
In the present embodiment, after terminal device gets face video, the corresponding face of each image collecting device is extracted
The color signal of video, color signal can be rgb signal.
S102: according to the corresponding color signal of each image collecting device, the reference signal of the target person is determined.
S103: according to the reference signal of the target person, the physical signs and psychological indicator of the target person are obtained.
In the present embodiment, the physical signs includes in heart rate, breathing, heart rate variability, blood oxygen and blood pressure value
It is one or more, the psychological indicator include regain consciousness, physical weariness, it is drowsy, nervous, loosen, in pain, pleasure etc.
It is one or more.
From above-described embodiment it is found that the embodiment of the present invention obtains the target person of multiple images acquisition device acquisition respectively
Face video, and corresponding color signal is extracted from each face video；Wherein, described multiple images acquisition device be used for from
The face video of different angle acquisition target person；According to the corresponding color signal of each image collecting device, the mesh is determined
Mark the reference signal of personage；According to the reference signal of the target person, the physical signs and psychology of the target person are obtained
Index.The embodiment of the present invention obtains the face video of user by multiple images acquisition device from different perspectives, is transporting user
Also accurate face video can be got when dynamic, and then compares each face video, determine the reference signal of the target person,
To not only improve the accuracy of the detection of physical signs and psychological indicator, but also the experience of user can be optimized.
As shown in Fig. 2, in one embodiment of the invention, Fig. 2 shows the specific implementation flow of S101 in Fig. 1,
Details are as follows for process:
S201: human face region video and the characteristic point in each face video are detected, and utilizes the characteristic point by first
Human face region is divided at least one target area, and first human face region is the face area of any image acquisition device acquisition
Domain.
In the present embodiment, after getting face video, human face region and characteristic point, feature are detected in face video
Point is some location point in the face identified, can be the wing of nose, and human face region is drawn according to this feature point in the positions such as corners of the mouth
It is divided at least one target area, obtains the corresponding face video in each target area.
S202: the color signal of the corresponding each target area of first human face region is extracted respectively.
In the present embodiment, the color signal of the corresponding face video in each target area is extracted respectively.
In the present embodiment, after getting color signal, color signal can also be filtered, is filtered
Color signal afterwards.
In one embodiment of the invention, described image acquisition device includes RGB color camera and infrared camera,
The color signal includes rgb signal and grey scale signal.
In the present embodiment, image collecting device can be RGB color camera, or infrared camera works as figure
When picture acquisition device is infrared camera, the interference that detect to physical signs can be changed to avoid ambient.
As shown in figure 3, in one embodiment of the invention, Fig. 3 shows the specific implementation flow of S202 in Fig. 2,
Details are as follows for process:
S301: the color value for calculating the first frame image of the corresponding target area in first position in first human face region is flat
Mean value, the first position are any position in face, and the first frame image is the corresponding face view in the target area
Any frame image of frequency.
It in the present embodiment, can since the pixel of the image of the corresponding target area in first position may be different
In each target area to obtain each human face region in each frame image all pixels point color value, then calculate some mesh
Mark the corresponding color value averages of each frame image in region.
Specifically, if image collector is set to RGB color camera, then each target area of each human face region is obtained
In domain in every frame image all pixels point rgb value, then to institute in the first frame image of some target area of human face region
There is the rgb value of pixel to be averaging, obtains the RGB average value of the target area first frame image, and then respectively obtain the target
The RGB average value of the every frame image in region.
If image collector is set to infrared camera, then every frame figure in each target area of each human face region is obtained
The gray value of all pixels point, then asks flat to the gray value of all pixels point in the first frame image of the target area as in
, the average gray of first frame image is obtained, to respectively obtain the average gray of the every frame image in the target area.
S302: flat according to the color value of the first frame image of the corresponding target area in first position in first human face region
Mean value obtains the color value averages matrix of the corresponding target area in first position in first human face region.
In the present embodiment, as shown in Figure 7, it is assumed that K image collecting device in total, each image collecting device are adopted respectively
Collection one include M frame image face video, if image collector is set to RGB color camera, first position corresponding the
The color value averages matrix of the m frame of one target area is
In formula (1), R11 (m), G11 (m) and B11 (m) are respectively the color value of the m frame image R red channel of first position
The color value averages of average value, the color value averages of G green channel and B blue channel, R1K (m), G1K (m) and B1K (m) are respectively
It include the color value averages of the color value averages of R of the m frame image of the k-th image collecting device of pixel, G for first position
With the color value averages of B.
Specifically, the R average value square of the corresponding target area in first position including K image collecting device M frame video
Battle array is as shown in formula (2):
In addition, G1 with B1 matrix is similar.WhereinFor the vector of a 1xM.
Assuming that image collector is set to infrared camera, then it include the first position pair of K image collecting device M frame video
The color value averages matrix for the target area answered are as follows:
Wherein, H11 (m) is that the gray scale of the first frame image of the corresponding first position of first image collecting device is average
Value, H1K (m) are the average gray of the m frame image of the first position of k-th image collecting device.
S303: by the color in first human face region in the color value averages matrix of the corresponding target area in first position
Value average value is normalized, and obtains the normalizing of the corresponding target area in first position in first human face region
Change color value matrix.
In the present embodiment, in the first human face region the corresponding target area in first position normalization color value matrix are as follows:The RGB normalization matrix of the corresponding target area in first position isThe corresponding mesh in first position
Mark the RGB normalization matrix expansion in region specifically:
In formula (4) (5) (6),Mean represents mean value,
Var represents variance.
As shown in figure 4, in one embodiment of the invention, Fig. 4 shows the specific implementation flow of S102 in Fig. 1,
Details are as follows for process:
S401: according to the normalization color value matrix of the corresponding target area in the first position of each image collecting device, really
The signal-to-noise ratio of the corresponding target area in first position of fixed each image collecting device.
In the present embodiment, after there is M normalization in the target area of the corresponding each image collecting device in first position
Signal, wherein the signal after the normalization of the corresponding target area in the first position of k-th of image collecting device are as follows:
In formula (7), for all road K normalized signals, calculates separately its signal-to-noise ratio and obtain SNRk, wherein 1≤k≤
K。
S402: the highest color letter of signal-to-noise ratio in the corresponding target area in first position of each image collecting device is chosen
Reference subsignal number as the first position.
Wherein, the reference subsignal in the first aim region of first positionK ' satisfaction
SNRkmax=max (SNR) wherein kmaxWhat is represented is that highest image capture device of signal-to-noise ratio.
S403: the reference subsignal of the face of the target person is obtained, the reference signal of the target person is obtained
In the present embodiment, compare the color letter of the face video of the face same position of multiple images acquisition device acquisition
Number signal-to-noise ratio, and using the highest RGB of signal-to-noise ratio or gray scale discrete signal as the reference subsignal of the same position, reference
The above method, successively obtains the reference subsignal of each position, to obtain the reference signal of target person face.Such as face
The reference signal RGBface of color can be written as:
The reference signal of face color isWherein RGBnRepresent face nth bit
The RGB of corresponding target area is set with reference to subsignal.
The gray reference signal of face isWherein HuenIt is corresponding to represent face nth position
Target area gray reference subsignal.
From above-described embodiment it is found that by obtaining color signal of each target area from different images acquisition equipment
Signal-to-noise ratio, the target area of same position takes the highest reference signal as the position of signal-to-noise ratio, to improve target person
The whole signal-to-noise ratio of the reference signal of the face of object, and then obtain more accurate physical signs and psychological indicator.
In the present embodiment, we can use such as the methods of PCA, be such as heart rate physical signs by RGBface dimensionality reduction
Signal.
In the present embodiment, if multiple images acquisition device shoots face video, and some image collecting device is shot
Face video a certain frame image in be not present first position target area when, then delete the first of the image collecting device
All frame images of position simultaneously obtain the mesh according to the color signal of the target area of the first position of residual image acquisition device
Mark the reference subsignal in region.
Specifically, when the figure of the target area of first position lacked in the face video of some image collecting device shooting
When being less than default frame number as frame number, then lack the image of frame using interpolating method interpolation, if the shooting of some image collecting device
When the number of image frames of the target area of the first position lacked in face video is greater than default frame number, then directly deletes the image and adopt
All frame images of the first position of acquisition means, and the color of the target area according to the first position of residual image acquisition device
Signal obtains the reference subsignal of the target area.
In the present embodiment, the specific implementation flow of S102 can also include: in Fig. 1
Using maximum rate merging method, the corresponding color signal of each image collecting device is merged into the target person
The reference signal of object.
In the present embodiment, if color signal is rgb signal, the reference subsignal in first position first object region can
To be obtained by following formula (8):
In formula (8),After the target area normalization for indicating the corresponding first position of first image collecting device
Signal value, RGBHuiFor the reference subsignal value of first position.
In one embodiment of the invention, the physical signs includes heart rate, breath data, heart rate variability, blood oxygen
With blood pressure value, the specific implementation flow of S103 in Fig. 1, comprising:
According to the reference signal of the target person, the changing rule of the target person capillary is detected, institute is obtained
State heart rate, blood oxygen and the heart rate variability of target person；And the changing rule of muscle when the target person breathes is detected, it obtains
The breath data of the target person, and detect the phase of the blood flow of any two target area of the target person
Difference obtains the blood pressure value of the target person.
In the present embodiment, when reference signal is rgb signal, the variation of capillary when by being breathed to target person
Rule is tested and analyzed, and the physical signs such as heart rate, heart rate variability, blood oxygen and the blood pressure of target person are obtained.And according to RGB
Signal, the changing rule of muscle, obtains the breath data of target person when detection target person breathes.And according to rgb signal,
By choosing the phase difference of two direct blood flows in target area, to calculate the opposite variation speed of blood flow velocity, thus
Extrapolate blood pressure value.Further, the physical signs of target person can also be determined by deep learning method.
When reference signal is grey scale signal, the changing rule of capillary is detected when by breathing to target person
Analysis, obtains the physical signs such as heart rate, heart rate variability, blood oxygen and the blood pressure of target person.And according to grey scale signal, mesh is detected
The changing rule of muscle, obtains the breath data of target person when marking personage's breathing.And according to grey scale signal, by choosing two
The phase difference of a direct blood flow in target area, to calculate the opposite variation speed of blood flow velocity, to extrapolate blood pressure
Changing value.Further, the physical signs of target person can also be determined by deep learning method.
In the present embodiment, it after getting the physical signs of target person, can also be regarded by the face of target person
Frequency determines micro- expression information of target person, and physical signs and micro- expression information further according to target person determine target person
Psychological indicator, psychological indicator may include include awake, physical weariness, it is drowsy, nervous, loosen, in pain, pleasure etc.
It is one or more.
It should be understood that the size of the serial number of each step is not meant that the order of the execution order in above-described embodiment, each process
Execution sequence should be determined by its function and internal logic, the implementation process without coping with the embodiment of the present invention constitutes any limit
It is fixed.
Embodiment 2:
As shown in figure 5, the detection device 100 of physical signs and psychological indicator that one embodiment of the present of invention provides, is used
Method and step in the embodiment corresponding to execution Fig. 1 comprising:
Color signal obtains module 110, the face of the target person for obtaining the acquisition of multiple images acquisition device respectively
Video, and corresponding color signal is extracted from each face video；Wherein, described multiple images acquisition device is used for from difference
The face video of angle acquisition target person；
Reference signal obtains module 120, for determining the mesh according to the corresponding color signal of each image collecting device
Mark the reference signal of personage；
Indexs measure module 130 obtains the physiology of the target person for the reference signal according to the target person
Index and psychological indicator.
From above-described embodiment it is found that the embodiment of the present invention obtains the target person of multiple images acquisition device acquisition respectively
Face video, and corresponding color signal is extracted from each face video；Wherein, described multiple images acquisition device be used for from
The face video of different angle acquisition target person；According to the corresponding color signal of each image collecting device, the mesh is determined
Mark the reference signal of personage；According to the reference signal of the target person, the physical signs and psychology of the target person are obtained
Index.The embodiment of the present invention obtains the face video of user by multiple images acquisition device from different perspectives, is transporting user
Also accurate face video can be got when dynamic, and then compares each face video, determine the reference signal of the target person,
To not only improve the accuracy of the detection of physical signs and psychological indicator, but also the experience of user can be optimized.
In one embodiment of the invention, it further includes for executing reality corresponding to Fig. 2 that color signal, which obtains module 110,
The step of applying the method and step in example comprising:
Target area division unit for detecting human face region video and characteristic point in each face video, and utilizes
First face region division is at least one target area by the characteristic point, and first human face region is any image acquisition
The human face region of device acquisition；
Color signal extraction unit, for extracting the color of the corresponding each target area of first human face region respectively
Signal.
In one embodiment of the invention, the color signal includes normalization color value matrix, and color signal extracts single
Member further includes the steps that for executing the method and step in embodiment corresponding to Fig. 3 comprising:
Color value averages computation subunit, for calculating the corresponding target area in first position in first human face region
First frame image color value averages, the first position be face in any position, the first frame image is described
Any frame image of the corresponding face video in target area；
Color value averages matrix obtains subelement, for corresponding according to first position in first human face region
The color value averages of the first frame image of target area obtain the corresponding target area in first position in first human face region
Color value averages matrix；
It normalizes color value matrix and obtains subelement, be used for the corresponding target area in first position in first human face region
Color value averages in the color value averages matrix in domain are normalized, and obtain first in first human face region
The normalization color value matrix of the corresponding target area in position.
In one embodiment of the invention, it further includes for executing reality corresponding to Fig. 4 that reference signal, which obtains module 120,
The step of applying the method and step in example comprising:
Signal-to-noise ratio computation unit, the normalizing for the corresponding target area in first position according to each image collecting device
Change color value matrix, determines the signal-to-noise ratio of the corresponding target area in the first position of each image collecting device；
First position reference signal acquiring unit, the corresponding target in first position for choosing each image collecting device
Reference subsignal of the highest color signal of signal-to-noise ratio as the first position in region；
Reference signal obtains subelement, and the reference subsignal of each position of face for obtaining the target person obtains
To the reference signal of the target person.
In one embodiment of the invention, reference signal obtains module 120 further include: uses maximum rate merging side
The corresponding color signal of each image collecting device is merged into the reference signal of the target person by method.
In one embodiment of the invention, the physical signs includes heart rate, breath data, heart rate variability, blood oxygen
With blood pressure value, Indexs measure module 130 includes:
According to the reference signal of the target person, the changing rule of the target person capillary is detected, institute is obtained
State heart rate, blood oxygen and the heart rate variability of target person；And the changing rule of muscle when the target person breathes is detected, it obtains
The breath data of the target person, and detect the phase of the blood flow of any two target area of the target person
Difference obtains the blood pressure value of the target person.
In one embodiment of the invention, described image acquisition device includes RGB color camera and infrared camera,
The color signal includes rgb signal and grey scale signal.
Embodiment 3:
The embodiment of the invention also provides a kind of terminal device 6, including memory 61, processor 60 and it is stored in storage
In device 61 and the computer program 62 that can run on processor 60, the processor 60 execute real when the computer program 62
Step in each embodiment now as described in example 1 above, such as step S101 shown in FIG. 1 to step S103.Alternatively, described
Processor 60 realizes the function of each module in each Installation practice as described in example 2 above when executing the computer program 62
Can, such as the function of module 110 to 130 shown in fig. 5.
The terminal device 6 can be the calculating such as desktop PC, notebook, palm PC and cloud server and set
It is standby.The terminal device 6 may include, but be not limited only to, processor 60, memory 61.Such as the terminal device 6 can also wrap
Include input-output equipment, network access equipment, bus etc..
Alleged processor 60 can be central processing unit (Central Processing Unit, CPU), can also be
Other general processors, digital signal processor (Digital Signal Processor, DSP), specific integrated circuit
(Application Specific Integrated Circuit, ASIC), ready-made programmable gate array (Field-
Programmable Gate Array, FPGA) either other programmable logic device, discrete gate or transistor logic,
Discrete hardware components etc..General processor can be microprocessor or the processor is also possible to any conventional processor 60
Deng.
The memory 61 can be the internal storage unit of the terminal device 6, such as the hard disk or interior of terminal device 6
It deposits.The memory 61 is also possible to the External memory equipment of the terminal device 6, such as be equipped on the terminal device 6
Plug-in type hard disk, intelligent memory card (Smart Media Card, SMC), secure digital (Secure Digital, SD) card dodge
Deposit card (Flash Card) etc..Further, the memory 61 can also both including terminal device 6 internal storage unit or
Including External memory equipment.The memory 61 is for storing needed for the computer program 62 and the terminal device 6
Other programs and data.The memory 61 can be also used for temporarily storing the data that has exported or will export.
Embodiment 4:
The embodiment of the invention also provides a kind of computer readable storage medium, computer-readable recording medium storage has meter
Calculation machine program 62 realizes the step in each embodiment as described in example 1 above when computer program 62 is executed by processor 60,
Such as step S101 shown in FIG. 1 to step S103.Alternatively, being realized when the computer program 62 is executed by processor 60 strictly according to the facts
Apply the function of each module in each Installation practice described in example 2, such as the function of module 110 to 130 shown in fig. 5.
The computer program 62 can be stored in a computer readable storage medium, which is being located
It manages when device 60 executes, it can be achieved that the step of above-mentioned each embodiment of the method.Wherein, the computer program 62 includes computer journey
Sequence code, the computer program code can be source code form, object identification code form, executable file or certain intermediate shapes
Formula etc..The computer-readable medium may include: any entity or device, note that can carry the computer program code
Recording medium, USB flash disk, mobile hard disk, magnetic disk, CD, computer storage, read-only memory (ROM, Read-Only Memory),
Random access memory (RAM, RandomAccess Memory), electric carrier signal, telecommunication signal and software distribution medium
Deng.It should be noted that the content that the computer-readable medium includes can be real according to legislation in jurisdiction and patent
The requirement trampled carries out increase and decrease appropriate, such as in certain jurisdictions, according to legislation and patent practice, computer-readable medium
Not including is electric carrier signal and telecommunication signal.
The steps in the embodiment of the present invention can be sequentially adjusted, merged and deleted according to actual needs.
Module or unit in system of the embodiment of the present invention can be combined, divided and deleted according to actual needs.
The foregoing is merely illustrative of the preferred embodiments of the present invention, is not intended to limit the invention, all in essence of the invention
Made any modifications, equivalent replacements, and improvements etc., should all be included in the protection scope of the present invention within mind and principle.
Claims (10)
1. the detection method of a kind of physical signs and psychological indicator characterized by comprising
The face video of the target person of multiple images acquisition device acquisition, and the extraction pair from each face video are obtained respectively
The color signal answered；Wherein, described multiple images acquisition device for acquiring the face video of target person from different perspectives；
According to the corresponding color signal of each image collecting device, the reference signal of the target person is determined；
According to the reference signal of the target person, the physical signs and psychological indicator of the target person are obtained.
2. the detection method of physical signs as described in claim 1 and psychological indicator, which is characterized in that described from each face
Corresponding color signal is extracted in video, comprising:
The human face region and characteristic point in each face video are detected, and is by the first face region division using the characteristic point
At least one target area, first human face region are the human face region of any image acquisition device acquisition；
The color signal of the corresponding each target area of first human face region is extracted respectively.
3. the detection method of physical signs as claimed in claim 2 and psychological indicator, which is characterized in that the color signal packet
Include normalization color value matrix, the color signal for extracting the corresponding each target area of first human face region respectively, packet
It includes:
The color value averages of the first frame image of the corresponding target area in first position in first human face region are calculated,
The first position is any position in face, and the first frame image is appointing for the corresponding face video in the target area
One frame image；
According to the color value averages of the first frame image of the corresponding target area in first position in first human face region, obtain
The color value averages matrix of the corresponding target area in first position into first human face region；
By the color value averages in first human face region in the color value averages matrix of the corresponding target area in first position
It is normalized, obtains the normalization color value square of the corresponding target area in first position in first human face region
Battle array.
4. the detection method of physical signs as claimed in claim 3 and psychological indicator, which is characterized in that described according to each figure
As the corresponding color signal of acquisition device, the reference signal of the target person is determined, comprising:
According to the normalization color value matrix of the corresponding target area in the first position of each image collecting device, each image is determined
The signal-to-noise ratio of the corresponding target area in the first position of acquisition device；
The highest color signal of signal-to-noise ratio is chosen in the corresponding target area in first position of each image collecting device as institute
State the reference subsignal of first position；
The reference subsignal for obtaining each position of face of the target person, obtains the reference signal of the target person.
5. the detection method of physical signs as claimed in claim 3 and psychological indicator, which is characterized in that described according to each figure
As the corresponding color signal of acquisition device, the reference signal of the target person is determined, comprising:
Using maximum rate merging method, the corresponding color signal of each image collecting device is merged into the target person
Reference signal.
6. such as the described in any item physical signs of claim 2 to 5 and the detection method of psychological indicator, which is characterized in that described
Physical signs includes heart rate, breath data, heart rate variability, blood oxygen and blood pressure value, described according to the target person
Reference signal obtains the physical signs of the target person, comprising:
According to the reference signal of the target person, the changing rule of the target person capillary is detected, the mesh is obtained
Mark heart rate, blood oxygen and the heart rate variability of personage；And the changing rule of muscle when the target person breathes is detected, it obtains described
The breath data of target person, and the phase difference of the blood flow of any two target area of the target person is detected,
Obtain the blood pressure value of the target person.
7. the detection method of physical signs as described in claim 1 and psychological indicator, which is characterized in that described image acquisition dress
It sets including RGB color camera and infrared camera, the color signal includes rgb signal and grey scale signal.
8. the detection device of a kind of physical signs and psychological indicator characterized by comprising
Color signal obtains module, the face video of the target person for obtaining the acquisition of multiple images acquisition device respectively, and
Corresponding color signal is extracted from each face video；Wherein, described multiple images acquisition device for adopting from different perspectives
Collect the face video of target person；
Reference signal obtains module, for determining the target person according to the corresponding color signal of each image collecting device
Reference signal；
Indexs measure module, for the reference signal according to the target person, obtain the target person physical signs and
Psychological indicator.
9. a kind of terminal device, including memory, processor and storage are in the memory and can be on the processor
The computer program of operation, which is characterized in that the processor realizes such as claim 1 to 7 when executing the computer program
The step of any one the method.
10. a kind of computer readable storage medium, the computer-readable recording medium storage has computer program, and feature exists
In when the computer program is executed by processor the step of any one of such as claim 1 to 7 of realization the method.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910233982.1A CN109998501A (en) | 2019-03-26 | 2019-03-26 | Physical signs and the detection method of psychological indicator, device and terminal device |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910233982.1A CN109998501A (en) | 2019-03-26 | 2019-03-26 | Physical signs and the detection method of psychological indicator, device and terminal device |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN109998501A true CN109998501A (en) | 2019-07-12 |
Family
ID=67168238
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201910233982.1A Pending CN109998501A (en) | 2019-03-26 | 2019-03-26 | Physical signs and the detection method of psychological indicator, device and terminal device |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN109998501A (en) |
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN112580410A (en) * | 2019-09-30 | 2021-03-30 | 梅州市青塘实业有限公司 | Closestool and closestool-based heart rate acquisition method and device |
| CN115376657A (en) * | 2022-10-24 | 2022-11-22 | 北京亮亮视野科技有限公司 | Method and device for quantifying influence of product usage on human body characterization information |
Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN106264568A (en) * | 2016-07-28 | 2017-01-04 | 深圳科思创动实业有限公司 | Contactless emotion detection method and device |
| CN106510736A (en) * | 2016-12-06 | 2017-03-22 | 山东瀚岳智能科技股份有限公司 | Psychological state judging method and system based on multidimensional psychological state indexes |
| CN107169419A (en) * | 2017-04-19 | 2017-09-15 | 中国电子科技集团公司电子科学研究院 | Contactless humanbody sign detection method and device based on machine vision |
| CN108720825A (en) * | 2018-03-29 | 2018-11-02 | 合肥工业大学 | A kind of seamless detection method of the non-contact vital sign parameter based on multi-cam |
| CN109044322A (en) * | 2018-08-29 | 2018-12-21 | 北京航空航天大学 | A kind of contactless heart rate variability measurement method |
| CN109259749A (en) * | 2018-08-29 | 2019-01-25 | 南京邮电大学 | A kind of contactless method for measuring heart rate of view-based access control model camera |
-
2019
- 2019-03-26 CN CN201910233982.1A patent/CN109998501A/en active Pending
Patent Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN106264568A (en) * | 2016-07-28 | 2017-01-04 | 深圳科思创动实业有限公司 | Contactless emotion detection method and device |
| CN106510736A (en) * | 2016-12-06 | 2017-03-22 | 山东瀚岳智能科技股份有限公司 | Psychological state judging method and system based on multidimensional psychological state indexes |
| CN107169419A (en) * | 2017-04-19 | 2017-09-15 | 中国电子科技集团公司电子科学研究院 | Contactless humanbody sign detection method and device based on machine vision |
| CN108720825A (en) * | 2018-03-29 | 2018-11-02 | 合肥工业大学 | A kind of seamless detection method of the non-contact vital sign parameter based on multi-cam |
| CN109044322A (en) * | 2018-08-29 | 2018-12-21 | 北京航空航天大学 | A kind of contactless heart rate variability measurement method |
| CN109259749A (en) * | 2018-08-29 | 2019-01-25 | 南京邮电大学 | A kind of contactless method for measuring heart rate of view-based access control model camera |
Cited By (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN112580410A (en) * | 2019-09-30 | 2021-03-30 | 梅州市青塘实业有限公司 | Closestool and closestool-based heart rate acquisition method and device |
| CN115376657A (en) * | 2022-10-24 | 2022-11-22 | 北京亮亮视野科技有限公司 | Method and device for quantifying influence of product usage on human body characterization information |
| CN115376657B (en) * | 2022-10-24 | 2023-04-28 | 北京亮亮视野科技有限公司 | Method and device for quantifying influence of product usage on human body characterization information |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| WO2020207423A1 (en) | Skin type detection method, skin type grade classification method and skin type detection apparatus | |
| CN103116763B (en) | A kind of living body faces detection method based on hsv color Spatial Statistical Character | |
| CN107886503A (en) | A kind of alimentary canal anatomical position recognition methods and device | |
| EP2573696A2 (en) | Apparatus and method for assisting user to maintain correct posture | |
| CN109284737A (en) | A kind of students ' behavior analysis and identifying system for wisdom classroom | |
| CN105989331B (en) | Face feature extraction element, facial feature extraction method, image processing equipment and image processing method | |
| CN101853286B (en) | Intelligent selection method of video thumbnails | |
| CN105184246A (en) | Living body detection method and living body detection system | |
| CN112101124B (en) | Sitting posture detection method and device | |
| CN110136144B (en) | Image segmentation method and device and terminal equipment | |
| CN111444748B (en) | Sitting posture detection method, device, equipment and storage medium | |
| CN113592817A (en) | Method and device for detecting respiration rate, storage medium and electronic equipment | |
| CN109784230A (en) | A kind of facial video image quality optimization method, system and equipment | |
| CN109998501A (en) | Physical signs and the detection method of psychological indicator, device and terminal device | |
| CN111639702A (en) | Multimedia data analysis method, equipment, server and readable storage medium | |
| CN110660454A (en) | Cancer pain real-time assessment instrument and assessment method thereof | |
| CN109876416A (en) | A kind of rope skipping method of counting based on image information | |
| CN110458792A (en) | Method and device for evaluating quality of face image | |
| CN110728242A (en) | Image matching method and device based on portrait recognition, storage medium and application | |
| CN109977764A (en) | Vivo identification method, device, terminal and storage medium based on plane monitoring-network | |
| Zheng et al. | Heart rate prediction from facial video with masks using eye location and corrected by convolutional neural networks | |
| CN108062521A (en) | Method for detecting human face, device, terminal and medium based on convolutional neural networks | |
| CN111563492B (en) | Fall detection method, fall detection device and storage device | |
| CN106980818B (en) | Personalized preprocessing method, system and terminal for face image | |
| CN112580531A (en) | Method and system for identifying and detecting true and false license plates |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20190712 |
|
| RJ01 | Rejection of invention patent application after publication |