CN108197595A - A kind of method, apparatus, storage medium and computer for obtaining evaluation information - Google Patents
A kind of method, apparatus, storage medium and computer for obtaining evaluation information Download PDFInfo
- Publication number
- CN108197595A CN108197595A CN201810064459.6A CN201810064459A CN108197595A CN 108197595 A CN108197595 A CN 108197595A CN 201810064459 A CN201810064459 A CN 201810064459A CN 108197595 A CN108197595 A CN 108197595A
- Authority
- CN
- China
- Prior art keywords
- user
- heart rate
- rate data
- image
- evaluation information
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
- G06V40/10—Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
- G06V40/16—Human faces, e.g. facial parts, sketches or expressions
- G06V40/161—Detection; Localisation; Normalisation
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B5/00—Measuring for diagnostic purposes; Identification of persons
- A61B5/02—Detecting, measuring or recording pulse, heart rate, blood pressure or blood flow; Combined pulse/heart-rate/blood pressure determination; Evaluating a cardiovascular condition not otherwise provided for, e.g. using combinations of techniques provided for in this group with electrocardiography or electroauscultation; Heart catheters for measuring blood pressure
- A61B5/024—Detecting, measuring or recording pulse rate or heart rate
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B5/00—Measuring for diagnostic purposes; Identification of persons
- A61B5/72—Signal processing specially adapted for physiological signals or for diagnostic purposes
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
- G06V40/10—Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
- G06V40/16—Human faces, e.g. facial parts, sketches or expressions
- G06V40/174—Facial expression recognition
Landscapes
- Health & Medical Sciences (AREA)
- Engineering & Computer Science (AREA)
- Life Sciences & Earth Sciences (AREA)
- Physics & Mathematics (AREA)
- General Health & Medical Sciences (AREA)
- Public Health (AREA)
- Animal Behavior & Ethology (AREA)
- Theoretical Computer Science (AREA)
- Physiology (AREA)
- Biophysics (AREA)
- Pathology (AREA)
- Biomedical Technology (AREA)
- Heart & Thoracic Surgery (AREA)
- Medical Informatics (AREA)
- Molecular Biology (AREA)
- Surgery (AREA)
- Multimedia (AREA)
- General Physics & Mathematics (AREA)
- Human Computer Interaction (AREA)
- Veterinary Medicine (AREA)
- Cardiology (AREA)
- Oral & Maxillofacial Surgery (AREA)
- Artificial Intelligence (AREA)
- Computer Vision & Pattern Recognition (AREA)
- Signal Processing (AREA)
- Psychiatry (AREA)
- Image Analysis (AREA)
Abstract
A kind of method, apparatus, storage medium and computer for obtaining evaluation information, including：Acquire the face-image that user watches corresponding content；Collected face-image is analyzed, obtains the heart rate data of user；Heart rate data based on acquisition, evaluation information of the generation user to the content watched.The embodiment of the present invention realizes the acquisition of user's evaluation information, improves the operational efficiency of display device.
Description
Technical field
Present document relates to but be not limited to image processing techniques, it is espespecially a kind of to obtain the method, apparatus of evaluation information, storage medium
And computer.
Background technology
With the rapid development of Internet industry, after paper mold paintings are more and more converted into digital picture, pass through electricity
The display devices such as sub- picture frame are shown.Since display device has the advantages such as content may be updated, amount of storage is big, consumption is received
Person more and more welcomes.
At present, some display devices, can show the artistic paintings and image of a large amount of high quality, and user checks digitized map
During picture, due to the time, the problems such as inconvenient is inputted, user does not evaluate the content of display generally, and display terminal can not basis
Actual conditions carry out the display of digital picture, affect the operation efficiency of display device.
Invention content
It is the general introduction of the theme to being described in detail herein below.This general introduction is not the protection model in order to limit claim
It encloses.
The embodiment of the present invention provides a kind of method, apparatus, storage medium and computer for obtaining evaluation information, can realize
The acquisition of user's evaluation information promotes the operational efficiency of display device.
An embodiment of the present invention provides it is a kind of obtain evaluation information method, including：
Acquire the face-image that user watches corresponding content；
Collected face-image is analyzed, obtains the heart rate data of user；
Heart rate data based on acquisition, evaluation information of the generation user to the content watched.
Optionally, the collected face-image of analysis includes：
Determine the area-of-interest in the collected face-image；
Fourier transformation is carried out to the determining area-of-interest, determines the pixel of one or more pixel accesses
Change information；
The heart rate data of user is determined according to the determining pixel change information.
Optionally, the area-of-interest includes：
The distributed areas of the user's face blood vessel；
Wherein, the distributed areas of the facial vessels include following part or all of region：Forehead, canthus, the corners of the mouth, nose
Son.
Optionally, the pixel change information that the basis determines determines that the heart rate data of user includes：
Fourier transformation analysis is carried out to the pixel change information of determining green pixel；
According to the pixel change information progress Fourier transformation analysis to green pixel as a result, determining the heart rate number of user
According to.
Optionally, the evaluation information of content of the generation user to being watched includes：
Heart rate variability is calculated according to the heart rate data, evaluation letter is determined according to the heart rate variability for calculating acquisition
Breath；
Wherein, the evaluation information includes one or more opinion ratings of the corresponding heart rate variability.
Optionally, the method further includes：
The user images for including complete user's face region are obtained, by the determining area-of-interest and the user
Image is compared, and determines the disturbed part in the area-of-interest；
Delete the disturbed part in the determining area-of-interest.
On the other hand, the embodiment of the present invention also provides a kind of device for obtaining evaluation information, including：Collecting unit, analysis
Unit and generation unit；Wherein,
Collecting unit is used for：Acquire the face-image that user watches corresponding content；
Analytic unit is used for：Collected face-image is analyzed, obtains the heart rate data of user；
Generation unit is used for：Heart rate data based on acquisition, evaluation information of the generation user to the content watched.
Optionally, the analytic unit is specifically used for：
Determine the area-of-interest in the collected face-image；
Fourier transformation is carried out to the determining area-of-interest, determines the pixel of one or more pixel accesses
Change information；
The heart rate data of user is determined according to the determining pixel change information.
Optionally, the analytic unit is used to determine the heart rate data packet of user according to the determining pixel change information
It includes：
Fourier transformation analysis is carried out to the pixel change information of determining green pixel；
According to the pixel change information progress Fourier transformation analysis to green pixel as a result, determining the heart rate number of user
According to.
Optionally, the generation unit is specifically used for：
Heart rate variability is calculated according to the heart rate data, evaluation letter is determined according to the heart rate variability for calculating acquisition
Breath；
Wherein, the evaluation information includes one or more opinion ratings of the corresponding heart rate variability.
In another aspect, the embodiment of the present invention also provides a kind of storage medium, it is stored in storage medium and is run by processor
Computer executable instructions, computer executable instructions be used for perform above-mentioned acquisition evaluation information method.
Further aspect, the embodiment of the present invention also provide a kind of computer, including：Processor, the storage being connect with processor
Device；Wherein,
Processor is configured as performing the program instruction in memory；
Program instruction reads in processor and performs following operate：
Acquire the face-image that user watches corresponding content；
Collected face-image is analyzed, obtains the heart rate data of user；
Heart rate data based on acquisition, evaluation information of the generation user to the content watched.
Compared with the relevant technologies, technical scheme includes：Acquire the face-image that user watches corresponding content；Analysis
Collected face-image obtains the heart rate data of user；Heart rate data based on acquisition, generation user is to the content watched
Evaluation information of the evaluation information generation user to the content watched.The embodiment of the present invention realizes obtaining for user's evaluation information
It takes, improves the operational efficiency of display device.
Other features and advantages of the present invention will be illustrated in the following description, also, partly becomes from specification
It obtains it is clear that being understood by implementing the present invention.The purpose of the present invention and other advantages can be by specification, rights
Specifically noted structure is realized and is obtained in claim and attached drawing.
Description of the drawings
Attached drawing is used for providing further understanding technical solution of the present invention, and a part for constitution instruction, with this
The embodiment of application technical solution for explaining the present invention together, does not form the limitation to technical solution of the present invention.
Fig. 1 is the flow chart for the method that the embodiment of the present invention obtains evaluation information；
Fig. 2 is the composition schematic diagram for the device for implementing present invention method using neural network；
Fig. 3 is the structure diagram for the device that the embodiment of the present invention obtains evaluation information.
Specific embodiment
To make the objectives, technical solutions, and advantages of the present invention clearer, below in conjunction with attached drawing to the present invention
Embodiment be described in detail.It should be noted that in the absence of conflict, in the embodiment and embodiment in the application
Feature mutually can arbitrarily combine.
Step shown in the flowchart of the accompanying drawings can be in the computer system of such as a group of computer-executable instructions
It performs.Also, although logical order is shown in flow charts, it in some cases, can be to be different from herein suitable
Sequence performs shown or described step.
In the following embodiments, the content of user's viewing can include the content that perhaps number is shown in material object；It such as can
To be shown in the digital content of display screen, including image, video etc.；The drafting that can also be shown on paper printed matter or
Print content, including paintings etc..
Fig. 1 is the flow chart for the method that the embodiment of the present invention obtains evaluation information, as shown in Figure 1, including：
Step 101, acquisition user watch the face-image of corresponding content；
It should be noted that when the content of user of embodiment of the present invention viewing is digital picture, digital picture can pass through
The display device of digital picture can be shown with the long period, digital picture can include the image of high quality, for paper drawing
Make progress high definition to show；For example, digital picture is displayed for a user by electronics picture frame；In the relevant technologies, other are used to show number
The display device of word image can also be applied to the present invention.By display device provide to the user the more time it is longer and display matter
Measure stable digital picture；
In addition, present invention method can be implemented by display device, may be set to be independently of display device,
It is realized and communicated to connect by wired or wireless way.
The face-image of user of the embodiment of the present invention can be acquired by the sensor including camera.
Step 102, the collected face-image of analysis obtain the heart rate data of user；
Optionally, the embodiment of the present invention is analyzed collected face-image and is included：
Determine the area-of-interest in the collected face-image；
Fourier transformation is carried out to the determining area-of-interest, determines the pixel of one or more pixel accesses
Change information；
The heart rate data of user is determined according to the determining pixel change information.
Optionally, area-of-interest of the embodiment of the present invention includes：
The distributed areas of the user's face blood vessel；
Wherein, the distributed areas of the facial vessels include following part or all of region：Forehead, canthus, the corners of the mouth, nose
Son.
The distributed areas of user's face blood vessel of the embodiment of the present invention can include：User is with frontal face towards the number
The distributed areas of facial vessels during image；When area-of-interest includes forehead, canthus, the corners of the mouth, nose, area-of-interest can be with
Including：Forehead front, nasospinale both sides, the region that the corners of the mouth is extended to below eye.
Optionally, pixel of embodiment of the present invention change information includes following part or all of：
The pixel change information of red, the pixel change information of green, blue pixel change information.
Optionally, the embodiment of the present invention determines that the heart rate data of user includes according to the determining pixel change information：
Fourier transformation analysis is carried out to the pixel change information of determining green pixel；
According to the pixel change information progress Fourier transformation analysis to green pixel as a result, determining the heart rate number of user
According to.
This application example is by taking user watches digital picture as an example, it is contemplated that when user watches digital picture, user is general
The bracelet with identification heart rate will not be worn；The embodiment of the present invention carries out face using collecting unit to the user for watching digital picture
After the identification of portion's image, analysis obtains the heart rate data of user, and the digital picture of display is evaluated without user.
The embodiment of the present invention can be realized based on user's face color and/or the minor change of action.In medical domain,
There is correlation technique of the correlation theory research based on full-face feature, but this kind of method operand is larger, and easily by other light
Line image；The embodiment of the present invention using environment light source identification user facial characteristics after, by Fourier transform find out it is red, green,
Variation under blue each Color Channel, so as to find out heart rate data signal；It can generally be wrapped using green as characteristic signal
It includes：
Vascular distribution based on face face is chosen to obtain the face area-of-interest of heart rate data (according to biology
Instruction, the color change essential reason of changes in heart rate skin surface is the contraction or expansion of blood vessel, this be also heart rate in itself
Source).The embodiment of the present invention can determine area-of-interest by two schemes；One kind is all towards display with frontal face
The facial vessels region of unit is area-of-interest, and as the characteristic point for obtaining heart rate data, this mode hind computation amount is low,
But foreground requirement user checks that the time of display content is longer, and usually at ten seconds or so, this mode is suitable for consumer to drawing
Make to carry out depth appreciation；Another kind is to be based on local feature region, such as the regional areas such as canthus, the corners of the mouth, nose are as interested
Region.The facial area most suitable as local feature region can be obtained by the methods of machine learning, statistics.
In some embodiments of the present disclosure, forehead front, nose ridge two side areas, eye lower section is selected to extend to the corners of the mouth
Region as area-of-interest.
In some embodiments of the present disclosure, nose ridge two side areas is selected as area-of-interest, effectively to obtain
Heart rate data.
It is imaged based on above-mentioned area-of-interest.It, can be simultaneously to comprehensive in order to avoid inactive area is interfered in imaging
Portion carries out Polaroid, Polaroid to the progress of alternative area-of-interest, the portion being imaged based on diversity ratio to abandoning interference region
Point.
After Fast Fourier Transform processing may be used in the acquisition of heart rate data, the heart is obtained based on the spectrum analysis to imaging
Rate data.In order to filter out the clutter unrelated with heart rate data, an independent component analysis can be carried out before Fast Fourier Transform
Processing.
In order to carry out Fourier transform processing, it should ensure that facial area-of-interest has enough imaging numbers, the present invention is real
As long as it is (FPS) per second higher than 100 frames to apply example imaging picture transmission frame number per second；Such as imaging picture transmission frame number per second
Higher than 200FPS, for imaging picture transmission frame number per second higher than 400FPS etc., the acquisition of image data can pass through the tools such as camera
The device for having image-forming component is realized.
The embodiment of the present invention carries out area-of-interest the imaging in required time and obtains the green average value in image,
Fast Fourier Transform (FFT) processing is carried out to the variation of green average value, finds out heart rate data therein.The embodiment of the present invention is to the heart
Rate data carry out heart rate variability (HRV) and analyze, and the heart rate variability of heart rate data is calculated to the heart rate data of output；Including when
Domain analysis and frequency-domain analysis；Wherein, time-domain analysis is used for analyzing the time domain index that heart rate changes over time；The including but not limited to heart
Rate statistical average, heart rate data and heart rate data standard error of the mean), the root mean square of heart rate data)；Frequency-domain analysis is used for
Variation range of the heart rate in frequency is analyzed, in embodiments of the present invention using power spectral density function (PSD) as measurement index,
Change the power spectral density function range for calculating heart rate variability using fast Fourier, and export high frequency (HF), low frequency (LF)
With the ratio (LF/HF) of the two.
The embodiment of the present invention, in order to inhibit local heart rate mutation caused by Changes in weather, changes in diet etc., to the spy of hrv
Value indicative carries out normalization, as a simple realization, for ith feature value siRegular data sinSuch as lower section can be passed through
Formula calculates：sin=(si-smin)/(smax-smin)；Certainly, other regularization Algorithms in logistic regression analysis field are used equally for this
Inventive embodiments.
Step 103, the heart rate data based on acquisition, evaluation information of the generation user to the content watched.
Optionally, the evaluation information of content of generation of the embodiment of the present invention user to being watched includes：
Heart rate variability is calculated according to the heart rate data, evaluation letter is determined according to the heart rate variability for calculating acquisition
Breath；
Wherein, the evaluation information includes one or more opinion ratings of the corresponding heart rate variability.
In some embodiments of the present disclosure, one or more opinion ratings of the corresponding heart rate variability；It such as can
Be evaluation score, with different score sections corresponds to user to viewing content evaluation impression；Such as can be subjective
Impression：Pleasant, glad, general, dejected, detest etc. (is based on R.Picard, E Vyzaz, " Toward Machine
Emotional Intelligence:17alysis of Affective Physiological State,"IEEE
Transactions on Pattern Analysis and Machine Intelligence,23,10,1175-1191
(2001)、C.L.Lisetti,"Using Noninvasive Wearable Computers to Recognize Human
Emotion from Physiological Signal,"EURASIP Journal on Applied Signal
The documents such as Processing, 2004,1672-1687 (2004) are it is found that the subjective feeling of people is to can be quantified analysis).
The embodiment of the present invention can be to push suitable paintings to user make data support by the evaluation information of generation,
Interested image is selected to be pushed and shown for user, promote the pushing efficiency of digital picture.
Optionally, present invention method further includes：
The user images for including complete user's face region are obtained, by the determining area-of-interest and the user
Image is compared, and determines the disturbed part in the area-of-interest；
Delete the disturbed part in the determining area-of-interest.
The embodiment of the present invention can be implemented, such as by way of Training by the method for neural network, by non-
Specific user checks selected picture, such as the online datas such as imagenet, cifar (existing database in the relevant technologies)
The picture in picture or international Emotional Picture system (IAPS) in library, as training sample.It acquires it and observes training sample
When HRV features, and using the evaluation that it is provided as label, HRV and the corresponding neural network of evaluation are established by training process
Model, so as to which HRV features is associated with evaluation information.It (can by the output layer connection evaluation information disaggregated model of neural network
Be mood classification model) and grader, such as SVM, SoftMax etc., the HRV features that can correspond to user evaluated
Classification output；As shown in Fig. 2, the display embodiment of the present invention implements present invention method using the method for neural network
Process.
The so-called neural network in some embodiments of the present disclosure, can be real by including convolutional neural networks (CNN)
It is existing, connect SoftMax graders in the output layer of CNN.
The embodiment of the present invention can directly apply mechanically existing Emotion identification device in the relevant technologies.Generate and heart rate data
Corresponding evaluation information can from the background recorded and stored.
Compared with the relevant technologies, technical scheme includes：Acquire the face-image that user watches corresponding content；Analysis
Collected face-image obtains the heart rate data of user；Heart rate data based on acquisition, generation user is to the content watched
Evaluation information.The embodiment of the present invention realizes the acquisition of user's evaluation information, improves the operational efficiency of display device.
Fig. 3 is the structure diagram for the device that the embodiment of the present invention obtains evaluation information, as shown in figure 3, including：Acquisition is single
Member, analytic unit and generation unit；Wherein,
Collecting unit is used for：Acquire the face-image that user watches corresponding content；Here, collecting unit can be by including
Image acquisition element including camera is realized.
It should be noted that when the content of user of embodiment of the present invention viewing is digital picture, digital picture can pass through
The display device of digital picture can be shown with the long period；For example, digital picture is displayed for a user by electronics picture frame；Related skill
In art, other are used to show that the display device of digital picture can also to be applied to the present invention.
It in addition, device of the embodiment of the present invention can be set to display device, may be set to be independently of display device, lead to
It crosses wired or wireless way and realizes communication connection.
Analytic unit is used for：Collected face-image is analyzed, obtains the heart rate data of user；
The embodiment of the present invention, analytic unit can be realized by the chip including processor.
Optionally, analytic unit of the embodiment of the present invention is specifically used for：
Determine the area-of-interest in the collected face-image；
Fourier transformation is carried out to the determining area-of-interest, determines the pixel of one or more pixel accesses
Change information；
The heart rate data of user is determined according to the determining pixel change information.
Optionally, area-of-interest of the embodiment of the present invention includes：
The distributed areas of the user's face blood vessel；
Wherein, the distributed areas of the facial vessels include following part or all of region：Forehead, canthus, the corners of the mouth, nose
Son.
The distributed areas of user's face blood vessel of the embodiment of the present invention can include：User is with frontal face towards the number
The distributed areas of facial vessels during image；When area-of-interest includes forehead, canthus, the corners of the mouth, nose, area-of-interest can be with
Including：Forehead front, nasospinale both sides, the region that the corners of the mouth is extended to below eye.
Optionally, pixel of embodiment of the present invention change information includes following part or all of：
The pixel change information of red, the pixel change information of green, blue pixel change information.
Optionally, analytic unit of the embodiment of the present invention is used to determine the heart of user according to the determining pixel change information
Rate data include：
Fourier transformation analysis is carried out to the pixel change information of determining green pixel；
According to the pixel change information progress Fourier transformation analysis to green pixel as a result, determining the heart rate number of user
According to.
Generation unit is used for：Heart rate data based on acquisition, evaluation information of the generation user to the content watched.
Optionally, generation unit of the embodiment of the present invention is specifically used for：
Heart rate variability is calculated according to the heart rate data, evaluation letter is determined according to the heart rate variability for calculating acquisition
Breath；
Wherein, the evaluation information includes one or more opinion ratings of the corresponding heart rate variability.
Optionally, device of the embodiment of the present invention can also include interference processing unit, be used for：
The user images for including complete user's face region are obtained, by the determining area-of-interest and the user
Image is compared, and determines the disturbed part in the area-of-interest；
Delete the disturbed part in the determining area-of-interest.
In some embodiments of the present disclosure, disclose it is a kind of obtain evaluation information computer system, including processor,
The memory being connect with processor.According to the needs that function performs, processor can also connect image acquisition element, such as image
Head, for acquiring user's face image；Processor can also connect display driving element, for display screen to be driven to show image
Deng.
For example, network can be passed through between processor, memory and the image acquisition element of outside and display driving element
Connection carries out direct or indirect communication.
Optionally, network can include arbitrary group of wireless network, cable network, and/or wireless network and cable network
It closes.Network can include LAN, internet, telecommunications network, Internet of Things (the Internet of based on internet and/or telecommunications network
), and/or the arbitrary combination of Yi Shang network etc. Things.Cable network for example may be used twisted-pair feeder, coaxial cable or optical fiber and pass
The modes such as defeated communicate, and 3G/4G/5G mobile communications networks, bluetooth, Zigbee or Wi- for example may be used in wireless network
The communication modes such as Fi.This is not restricted for type and function of the disclosure to network.
For example, processor can be with other components in control computer system to perform desired function.Processor can be with
It is central processing unit (CPU) either at Field Programmable Logic Array (FPGA) or microcontroller (MCU) or digital signal
Managing device (DSP) etc. has the device of data-handling capacity and/or program executive capability.
For example, memory can include the arbitrary combination of one or more computer program products, computer program product
It can include various forms of computer readable storage mediums, such as volatile memory and/or nonvolatile memory.It is volatile
Property memory such as can include random access memory (RAM) and/or cache memory (cache).It is non-volatile
Memory can for example include read-only memory (ROM), hard disk, Erasable Programmable Read Only Memory EPROM (EPROM), portable tight
Cause disk read-only memory (CD-ROM), USB storage, flash memory etc..
One or more computer instructions can be stored on a memory, processor can run the computer instruction,
To realize various functions, such as the method for performing the acquisition evaluation information of the embodiment of the present invention.In computer readable storage medium
In can also store various application programs and various data, such as sample image, training data and application program use and/or
Various data generated etc..
In some embodiments of the present disclosure, a kind of storage medium is also disclosed.The storage medium be stored with suitable for by
Manage the computer instruction of device operation.It can at least perform when computer instruction is executed by processor and be evaluated according to described above obtain
One or more of information approach step.
For example, in an example of the embodiment of the present disclosure, which can be applied to any of the above-described embodiment institute
In the computer system stated, for example, it can be memory.
Although disclosed herein embodiment as above, the content only for ease of understanding the present invention and use
Embodiment is not limited to the present invention.Technical staff in any fields of the present invention is taken off not departing from the present invention
Under the premise of the spirit and scope of dew, any modification and variation, but the present invention can be carried out in the form and details of implementation
Scope of patent protection, still should be subject to the scope of the claims as defined in the appended claims.
Claims (12)
1. a kind of method for obtaining evaluation information, including：
Acquire the face-image that user watches corresponding content；
Collected face-image is analyzed, obtains the heart rate data of user；
Heart rate data based on acquisition, evaluation information of the generation user to the content watched.
2. according to the method described in claim 1, it is characterized in that, the collected face-image of analysis includes：
Determine the area-of-interest in the collected face-image；
Fourier transformation is carried out to the determining area-of-interest, determines the pixel variation of one or more pixel accesses
Information；
The heart rate data of user is determined according to the determining pixel change information.
3. according to the method described in claim 2, it is characterized in that, the area-of-interest includes：
The distributed areas of the user's face blood vessel；
Wherein, the distributed areas of the facial vessels include following part or all of region：Forehead, canthus, the corners of the mouth, nose.
4. according to the method in claim 2 or 3, which is characterized in that the pixel change information that the basis determines is true
The heart rate data for determining user includes：
Fourier transformation analysis is carried out to the pixel change information of determining green pixel；
According to the pixel change information progress Fourier transformation analysis to green pixel as a result, determining the heart rate data of user.
5. according to claims 1 to 3 any one of them method, which is characterized in that the generation user is to the content watched
Evaluation information include：
Heart rate variability is calculated according to the heart rate data, evaluation information is determined according to the heart rate variability for calculating acquisition；
Wherein, the evaluation information includes one or more opinion ratings of the corresponding heart rate variability.
6. according to the method in claim 2 or 3, which is characterized in that the method further includes：
The user images for including complete user's face region are obtained, by the determining area-of-interest and the user images
It is compared, determines the disturbed part in the area-of-interest；
Delete the disturbed part in the determining area-of-interest.
7. a kind of device for obtaining evaluation information, including：Collecting unit, analytic unit and generation unit；Wherein,
Collecting unit is used for：Acquire the face-image that user watches corresponding content；
Analytic unit is used for：Collected face-image is analyzed, obtains the heart rate data of user；
Generation unit is used for：Heart rate data based on acquisition, evaluation information of the generation user to the content watched.
8. device according to claim 7, which is characterized in that the analytic unit is specifically used for：
Determine the area-of-interest in the collected face-image；
Fourier transformation is carried out to the determining area-of-interest, determines the pixel variation of one or more pixel accesses
Information；
The heart rate data of user is determined according to the determining pixel change information.
9. device according to claim 8, which is characterized in that the analytic unit is used to be become according to the determining pixel
Change information and determine that the heart rate data of user includes：
Fourier transformation analysis is carried out to the pixel change information of determining green pixel；
According to the pixel change information progress Fourier transformation analysis to green pixel as a result, determining the heart rate data of user.
10. according to claim 7~9 any one of them device, which is characterized in that the generation unit is specifically used for：
Heart rate variability is calculated according to the heart rate data, evaluation information is determined according to the heart rate variability for calculating acquisition；
Wherein, the evaluation information includes one or more opinion ratings of the corresponding heart rate variability.
11. a kind of storage medium, the computer executable instructions run by processor are stored in storage medium, computer can be held
Row instruction is for the execution method that such as claim 1~6 any one of them obtains evaluation information.
12. a kind of computer, including：Processor, the memory being connect with processor；Wherein,
Processor is configured as performing the program instruction in memory；
Program instruction reads in processor and performs following operate：
Acquire the face-image that user watches corresponding content；
Collected face-image is analyzed, obtains the heart rate data of user；
Heart rate data based on acquisition, evaluation information of the generation user to the content watched.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201810064459.6A CN108197595A (en) | 2018-01-23 | 2018-01-23 | A kind of method, apparatus, storage medium and computer for obtaining evaluation information |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201810064459.6A CN108197595A (en) | 2018-01-23 | 2018-01-23 | A kind of method, apparatus, storage medium and computer for obtaining evaluation information |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN108197595A true CN108197595A (en) | 2018-06-22 |
Family
ID=62590420
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201810064459.6A Pending CN108197595A (en) | 2018-01-23 | 2018-01-23 | A kind of method, apparatus, storage medium and computer for obtaining evaluation information |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN108197595A (en) |
Cited By (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN110766502A (en) * | 2018-07-27 | 2020-02-07 | 北京京东尚科信息技术有限公司 | Commodity evaluation method and system |
| CN110866146A (en) * | 2019-11-26 | 2020-03-06 | 杭州市第一人民医院 | Video recommendation method and device, computer equipment and storage medium |
| CN111784163A (en) * | 2020-07-01 | 2020-10-16 | 深圳前海微众银行股份有限公司 | Data evaluation method, device, equipment and storage medium |
| CN113892930A (en) * | 2021-12-10 | 2022-01-07 | 之江实验室 | Facial heart rate measuring method and device based on multi-scale heart rate signals |
| CN114469036A (en) * | 2022-01-27 | 2022-05-13 | 无锡博奥玛雅医学科技有限公司 | Remote heart rate monitoring method and system based on video images |
| CN116681700A (en) * | 2023-08-01 | 2023-09-01 | 首都医科大学附属北京天坛医院 | Method, device and readable storage medium for evaluating heart rate and heart rate variability of user |
Citations (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20150099987A1 (en) * | 2010-06-07 | 2015-04-09 | Affectiva, Inc. | Heart rate variability evaluation for mental state analysis |
| CN104769596A (en) * | 2012-12-07 | 2015-07-08 | 英特尔公司 | Physiological cue processing |
-
2018
- 2018-01-23 CN CN201810064459.6A patent/CN108197595A/en active Pending
Patent Citations (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20150099987A1 (en) * | 2010-06-07 | 2015-04-09 | Affectiva, Inc. | Heart rate variability evaluation for mental state analysis |
| CN104769596A (en) * | 2012-12-07 | 2015-07-08 | 英特尔公司 | Physiological cue processing |
Cited By (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN110766502A (en) * | 2018-07-27 | 2020-02-07 | 北京京东尚科信息技术有限公司 | Commodity evaluation method and system |
| CN110866146A (en) * | 2019-11-26 | 2020-03-06 | 杭州市第一人民医院 | Video recommendation method and device, computer equipment and storage medium |
| CN111784163A (en) * | 2020-07-01 | 2020-10-16 | 深圳前海微众银行股份有限公司 | Data evaluation method, device, equipment and storage medium |
| CN113892930A (en) * | 2021-12-10 | 2022-01-07 | 之江实验室 | Facial heart rate measuring method and device based on multi-scale heart rate signals |
| CN113892930B (en) * | 2021-12-10 | 2022-04-22 | 之江实验室 | Facial heart rate measuring method and device based on multi-scale heart rate signals |
| CN114469036A (en) * | 2022-01-27 | 2022-05-13 | 无锡博奥玛雅医学科技有限公司 | Remote heart rate monitoring method and system based on video images |
| CN116681700A (en) * | 2023-08-01 | 2023-09-01 | 首都医科大学附属北京天坛医院 | Method, device and readable storage medium for evaluating heart rate and heart rate variability of user |
| CN116681700B (en) * | 2023-08-01 | 2023-10-31 | 首都医科大学附属北京天坛医院 | Method, device and readable storage medium for evaluating heart rate and heart rate variability of user |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN108197595A (en) | A kind of method, apparatus, storage medium and computer for obtaining evaluation information | |
| JP5827225B2 (en) | Age estimation method | |
| US20190282153A1 (en) | Presentation Measure Using Neurographics | |
| JP7248820B2 (en) | Apparatus and method for determining cosmetic skin attributes | |
| US11416988B2 (en) | Apparatus and method for visualizing visually imperceivable cosmetic skin attributes | |
| Kaufmann et al. | The faces you remember: Caricaturing shape facilitates brain processes reflecting the acquisition of new face representations | |
| CN104105953B (en) | Device and method for color calibration | |
| Wang et al. | Analyses of a multimodal spontaneous facial expression database | |
| Beringer et al. | Reliability and validity of machine vision for the assessment of facial expressions | |
| US20100215289A1 (en) | Personalized media morphing | |
| CN103649987A (en) | Face impression analysis method, cosmetic counseling method, and face image generation method | |
| CN107729882A (en) | Emotion identification decision method based on image recognition | |
| CN105120747A (en) | Skin darkening evaluation device and skin darkening evaluation method | |
| US20170105668A1 (en) | Image analysis for data collected from a remote computing device | |
| US20210386343A1 (en) | Remote prediction of human neuropsychological state | |
| US20200350057A1 (en) | Remote computing analysis for cognitive state data metrics | |
| Danner et al. | Automatic facial expressions analysis in consumer science | |
| JP2007252891A (en) | Estimation method of evaluation value by visual recognition of beauty of skin | |
| CA3199439A1 (en) | Digital imaging and learning systems and methods for analyzing pixel data of an image of a hair region of a user's head to generate one or more user-specific recommendations | |
| Butt et al. | Multimodal personality trait recognition using wearable sensors in response to public speaking | |
| Zheng et al. | Heart rate prediction from facial video with masks using eye location and corrected by convolutional neural networks | |
| KR101949152B1 (en) | Method and Appartus for Skin Condition Diagnosis and System for Providing Makeup Information suitable Skin Condition Using the Same | |
| TWI430776B (en) | Smart video skin test system and method of the same | |
| CN106339658A (en) | Data processing method and device | |
| Jaswal et al. | Empirical analysis of multiple modalities for emotion recognition using convolutional neural network |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20180622 |
|
| RJ01 | Rejection of invention patent application after publication |