CN108197595A - A kind of method, apparatus, storage medium and computer for obtaining evaluation information - Google Patents
A kind of method, apparatus, storage medium and computer for obtaining evaluation information Download PDFInfo
- Publication number
- CN108197595A CN108197595A CN201810064459.6A CN201810064459A CN108197595A CN 108197595 A CN108197595 A CN 108197595A CN 201810064459 A CN201810064459 A CN 201810064459A CN 108197595 A CN108197595 A CN 108197595A
- Authority
- CN
- China
- Prior art keywords
- user
- heart rate
- rate data
- determining
- region
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000011156 evaluation Methods 0.000 title claims abstract description 59
- 238000000034 method Methods 0.000 title claims abstract description 35
- 230000001815 facial effect Effects 0.000 claims description 38
- 238000004458 analytical method Methods 0.000 claims description 32
- 210000004204 blood vessel Anatomy 0.000 claims description 15
- 210000001061 forehead Anatomy 0.000 claims description 9
- 238000004364 calculation method Methods 0.000 claims description 8
- 238000012545 processing Methods 0.000 description 8
- 238000003384 imaging method Methods 0.000 description 7
- 230000006870 function Effects 0.000 description 6
- 238000012549 training Methods 0.000 description 6
- 238000013528 artificial neural network Methods 0.000 description 5
- 238000010422 painting Methods 0.000 description 5
- 238000010586 diagram Methods 0.000 description 4
- 238000004891 communication Methods 0.000 description 3
- 238000013145 classification model Methods 0.000 description 2
- 238000013527 convolutional neural network Methods 0.000 description 2
- 230000008451 emotion Effects 0.000 description 2
- 238000005516 engineering process Methods 0.000 description 2
- 230000003595 spectral effect Effects 0.000 description 2
- 238000012706 support-vector machine Methods 0.000 description 2
- 206010063659 Aversion Diseases 0.000 description 1
- 230000005540 biological transmission Effects 0.000 description 1
- 230000001149 cognitive effect Effects 0.000 description 1
- 238000004590 computer program Methods 0.000 description 1
- 230000008602 contraction Effects 0.000 description 1
- 238000011161 development Methods 0.000 description 1
- 235000021045 dietary change Nutrition 0.000 description 1
- 230000008909 emotion recognition Effects 0.000 description 1
- 238000012880 independent component analysis Methods 0.000 description 1
- 238000007477 logistic regression Methods 0.000 description 1
- 238000010801 machine learning Methods 0.000 description 1
- 238000010295 mobile communication Methods 0.000 description 1
- 230000035772 mutation Effects 0.000 description 1
- 238000003062 neural network model Methods 0.000 description 1
- 238000010606 normalization Methods 0.000 description 1
- 239000013307 optical fiber Substances 0.000 description 1
- 230000008447 perception Effects 0.000 description 1
- 238000007639 printing Methods 0.000 description 1
- 238000011160 research Methods 0.000 description 1
- 238000010183 spectrum analysis Methods 0.000 description 1
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
- G06V40/10—Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
- G06V40/16—Human faces, e.g. facial parts, sketches or expressions
- G06V40/161—Detection; Localisation; Normalisation
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B5/00—Measuring for diagnostic purposes; Identification of persons
- A61B5/02—Detecting, measuring or recording pulse, heart rate, blood pressure or blood flow; Combined pulse/heart-rate/blood pressure determination; Evaluating a cardiovascular condition not otherwise provided for, e.g. using combinations of techniques provided for in this group with electrocardiography or electroauscultation; Heart catheters for measuring blood pressure
- A61B5/024—Detecting, measuring or recording pulse rate or heart rate
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B5/00—Measuring for diagnostic purposes; Identification of persons
- A61B5/72—Signal processing specially adapted for physiological signals or for diagnostic purposes
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
- G06V40/10—Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
- G06V40/16—Human faces, e.g. facial parts, sketches or expressions
- G06V40/174—Facial expression recognition
Landscapes
- Health & Medical Sciences (AREA)
- Engineering & Computer Science (AREA)
- Life Sciences & Earth Sciences (AREA)
- Physics & Mathematics (AREA)
- General Health & Medical Sciences (AREA)
- Public Health (AREA)
- Animal Behavior & Ethology (AREA)
- Theoretical Computer Science (AREA)
- Physiology (AREA)
- Biophysics (AREA)
- Pathology (AREA)
- Biomedical Technology (AREA)
- Heart & Thoracic Surgery (AREA)
- Medical Informatics (AREA)
- Molecular Biology (AREA)
- Surgery (AREA)
- Multimedia (AREA)
- General Physics & Mathematics (AREA)
- Human Computer Interaction (AREA)
- Veterinary Medicine (AREA)
- Cardiology (AREA)
- Oral & Maxillofacial Surgery (AREA)
- Artificial Intelligence (AREA)
- Computer Vision & Pattern Recognition (AREA)
- Signal Processing (AREA)
- Psychiatry (AREA)
- Image Analysis (AREA)
Abstract
A kind of method, apparatus, storage medium and computer for obtaining evaluation information, including：Acquire the face-image that user watches corresponding content；Collected face-image is analyzed, obtains the heart rate data of user；Heart rate data based on acquisition, evaluation information of the generation user to the content watched.The embodiment of the present invention realizes the acquisition of user's evaluation information, improves the operational efficiency of display device.
Description
Technical Field
The present disclosure relates to, but not limited to, image processing technologies, and more particularly, to a method, an apparatus, a storage medium, and a computer for obtaining evaluation information.
Background
With the rapid development of the internet industry, more and more paper paintings are converted into digital images and then displayed through a display device such as an electronic picture frame. The display device has the advantages of updatable content, large storage capacity and the like, so that the display device is more and more popular among consumers.
At present, some display devices can display a large amount of high-quality art paintings and images, when a user views digital images, due to the problems of time, inconvenience in input and the like, the user generally does not evaluate displayed contents, a display terminal cannot display the digital images according to actual conditions, and the application efficiency of the display device is influenced.
Disclosure of Invention
The following is a summary of the subject matter described in detail herein. This summary is not intended to limit the scope of the claims.
The embodiment of the invention provides a method, a device, a storage medium and a computer for acquiring evaluation information, which can realize acquisition of user evaluation information and improve the operation efficiency of a display device.
The embodiment of the invention provides a method for acquiring evaluation information, which comprises the following steps:
acquiring a facial image of a user watching corresponding content;
analyzing the collected facial image to obtain heart rate data of the user;
based on the obtained heart rate data, evaluation information of the user on the viewed content is generated.
Optionally, the analyzing the acquired facial image includes:
determining a region of interest in the acquired facial image;
performing Fourier transform on the determined region of interest, and determining pixel change information of one or more pixel channels;
and determining heart rate data of the user according to the determined pixel change information.
Optionally, the region of interest includes:
a distribution region of the blood vessels of the user's face;
wherein the distribution region of the facial blood vessels comprises the following partial or whole regions: forehead, canthus, corner of mouth, nose.
Optionally, the determining heart rate data of the user according to the determined pixel variation information includes:
performing Fourier transform analysis on the pixel change information of the determined green pixels;
and determining heart rate data of the user according to the result of Fourier transform analysis on the pixel change information of the green pixels.
Optionally, the generating of the evaluation information of the viewed content by the user includes:
calculating heart rate variability according to the heart rate data, and determining evaluation information according to the heart rate variability obtained through calculation;
wherein the evaluation information comprises one or more evaluation levels corresponding to the heart rate variability.
Optionally, the method further includes:
acquiring a user image comprising a complete user face area, comparing the determined region of interest with the user image, and determining an interfered part in the region of interest;
deleting the determined disturbed part in the region of interest.
On the other hand, an embodiment of the present invention further provides an apparatus for acquiring evaluation information, including: the device comprises a collecting unit, an analyzing unit and a generating unit; wherein,
the acquisition unit is used for: acquiring a facial image of a user watching corresponding content;
the analysis unit is used for: analyzing the collected facial image to obtain heart rate data of the user;
the generation unit is used for: based on the obtained heart rate data, evaluation information of the user on the viewed content is generated.
Optionally, the analysis unit is specifically configured to:
determining a region of interest in the acquired facial image;
performing Fourier transform on the determined region of interest, and determining pixel change information of one or more pixel channels;
and determining heart rate data of the user according to the determined pixel change information.
Optionally, the determining, by the analysis unit, heart rate data of the user according to the determined pixel variation information includes:
performing Fourier transform analysis on the pixel change information of the determined green pixels;
and determining heart rate data of the user according to the result of Fourier transform analysis on the pixel change information of the green pixels.
Optionally, the generating unit is specifically configured to:
calculating heart rate variability according to the heart rate data, and determining evaluation information according to the heart rate variability obtained through calculation;
wherein the evaluation information comprises one or more evaluation levels corresponding to the heart rate variability.
In still another aspect, an embodiment of the present invention further provides a storage medium, where computer-executable instructions executed by a processor are stored in the storage medium, and the computer-executable instructions are configured to perform the method for acquiring evaluation information.
In another aspect, an embodiment of the present invention further provides a computer, including: the device comprises a processor and a memory connected with the processor; wherein,
the processor is configured to execute program instructions in the memory;
the program instructions read on the processor to perform the following operations:
acquiring a facial image of a user watching corresponding content;
analyzing the collected facial image to obtain heart rate data of the user;
based on the obtained heart rate data, evaluation information of the user on the viewed content is generated.
Compared with the related art, the technical scheme of the application comprises the following steps: acquiring a facial image of a user watching corresponding content; analyzing the collected facial image to obtain heart rate data of the user; based on the obtained heart rate data, generating user evaluation information of the viewed content and generating user evaluation information of the viewed content. The embodiment of the invention realizes the acquisition of the user evaluation information and improves the operation efficiency of the display device.
Additional features and advantages of the invention will be set forth in the description which follows, and in part will be obvious from the description, or may be learned by practice of the invention. The objectives and other advantages of the invention will be realized and attained by the structure particularly pointed out in the written description and claims hereof as well as the appended drawings.
Drawings
The accompanying drawings are included to provide a further understanding of the invention and are incorporated in and constitute a part of this specification, illustrate embodiments of the invention and together with the example serve to explain the principles of the invention and not to limit the invention.
FIG. 1 is a flow chart of a method of obtaining assessment information according to an embodiment of the present invention;
FIG. 2 is a schematic diagram of an apparatus for implementing a method according to an embodiment of the present invention using a neural network;
fig. 3 is a block diagram of an apparatus for acquiring evaluation information according to an embodiment of the present invention.
Detailed Description
In order to make the objects, technical solutions and advantages of the present invention more apparent, embodiments of the present invention will be described in detail below with reference to the accompanying drawings. It should be noted that the embodiments and features of the embodiments in the present application may be arbitrarily combined with each other without conflict.
The steps illustrated in the flow charts of the figures may be performed in a computer system such as a set of computer-executable instructions. Also, while a logical order is shown in the flow diagrams, in some cases, the steps shown or described may be performed in an order different than here.
In the following embodiments, the content viewed by the user may include physical content or digitally displayed content; for example, digital content including images, videos, etc. displayed on a display screen; the drawing or the printing contents displayed on the paper printed matter may include a painting.
Fig. 1 is a flowchart of a method for acquiring evaluation information according to an embodiment of the present invention, as shown in fig. 1, including:
step 101, collecting a face image of a user watching corresponding content;
it should be noted that, in the embodiment of the present invention, when the content viewed by the user is a digital image, the digital image may pass through a display device capable of displaying the digital image for a long time, and the digital image may include a high-quality image for performing high-definition display on a paper painting; for example, displaying a digital image for a user via an electronic picture frame; in the related art, other display devices for displaying digital images may be applied to the present invention. Providing a digital image with longer time and stable display quality for a user through a display device;
in addition, the method of the embodiment of the invention can be implemented by a display device, and can also be set to be independent of the display device, and the communication connection can be realized in a wired or wireless mode.
The facial image of the user can be collected through the sensor comprising the camera.
102, analyzing the acquired facial image to obtain heart rate data of the user;
optionally, analyzing the acquired facial image according to the embodiment of the present invention includes:
determining a region of interest in the acquired facial image;
performing Fourier transform on the determined region of interest, and determining pixel change information of one or more pixel channels;
and determining heart rate data of the user according to the determined pixel change information.
Optionally, the region of interest according to the embodiment of the present invention includes:
a distribution region of the blood vessels of the user's face;
wherein the distribution region of the facial blood vessels comprises the following partial or whole regions: forehead, canthus, corner of mouth, nose.
The distribution area of the blood vessels on the face of the user in the embodiment of the invention can comprise: a distribution region of facial blood vessels when a user faces the digital image with a face front; when the region of interest includes forehead, canthus, mouth corner, nose, the region of interest may include: the frontal face of the forehead, both sides of the nasal ridge, and under the eyes extend to the area of the corners of the mouth.
Optionally, the pixel change information in the embodiment of the present invention includes part or all of the following:
red pixel change information, green pixel change information, and blue pixel change information.
Optionally, the determining heart rate data of the user according to the determined pixel variation information in the embodiment of the present invention includes:
performing Fourier transform analysis on the pixel change information of the determined green pixels;
and determining heart rate data of the user according to the result of Fourier transform analysis on the pixel change information of the green pixels.
The application example takes the digital image watched by the user as an example, and considers that the user generally does not wear a bracelet with a recognized heart rate when the user watches the digital image; according to the embodiment of the invention, after the acquisition unit is used for identifying the facial image of the user watching the digital image, the heart rate data of the user is obtained through analysis, and the user does not need to evaluate the displayed digital image.
Embodiments of the present invention may be implemented based on small changes in the color and/or motion of a user's face. In the medical field, related theoretical researches have been conducted on related methods based on comprehensive characteristics, but such methods have a large calculation amount and are easily subjected to other light images; after the facial features of a user are identified by utilizing an ambient light source, the change of each color channel of red, green and blue is found out through Fourier transform, so that a heart rate data signal is found out; green may be generally used as the characteristic signal, and may include:
the region of interest of the face for acquiring heart rate data is selected based on the blood vessel distribution of the face (according to biological indication, the color change of the skin surface due to heart rate change is caused by the contraction or expansion of blood vessels, which is also the source of the heart rate itself). The embodiment of the invention can determine the region of interest through two schemes; one method is that all blood vessel regions of the face facing a display unit on the front face of the face are taken as interested regions and are taken as characteristic points for acquiring heart rate data, the background calculation amount is low, but the foreground requires a user to check the display content for a long time, usually about ten seconds, and the method is suitable for deep appreciation of the painting by consumers; the other is based on local feature points such as the corners of the eyes, mouth, nose, etc. as the regions of interest. The face region most suitable as the local feature point can be obtained by a method such as machine learning and statistics.
In some embodiments of the present disclosure, the frontal area of the forehead, the area on both sides of the nose ridge, the area under the eyes extending to the corner of the mouth are selected as the region of interest.
In some embodiments of the present disclosure, regions on both sides of the nose ridge are selected as regions of interest to effectively obtain heart rate data.
Imaging is performed based on the region of interest. In imaging, in order to avoid interference of the invalid region, the whole portion can be imaged once, the alternative region of interest can be imaged once, and the imaged part of the interference region can be discarded based on the difference ratio.
The heart rate data may be obtained by fast fourier transform processing and then based on spectral analysis of the imaging. To filter out clutter that is not related to the heart rate data, an independent component analysis process may be performed prior to the fast fourier transform.
In order to perform fourier transform processing, it should be ensured that the facial region of interest has a sufficient imaging number, the embodiment of the present invention only needs to transmit the frame number per second of the imaging picture to be higher than 100 Frames Per Second (FPS); for example, the number of frames per second of the imaged picture is higher than 200FPS, the number of frames per second of the imaged picture is higher than 400FPS, and the like, and the acquisition of the image data can be realized by a device having an imaging element such as a camera.
The method and the device for detecting the heart rate of the region of interest perform imaging on the region of interest within a required time, acquire a green average value in the image, perform fast Fourier transform processing on changes of the green average value, and find out heart rate data in the region of interest. The embodiment of the invention analyzes the Heart Rate Variability (HRV) of the heart rate data, and calculates the heart rate variability of the heart rate data of the output heart rate data; including time domain analysis and frequency domain analysis; wherein, the time domain analysis is used for analyzing a time domain index of the heart rate changing along with the time; including but not limited to the mean of the heart rate data, the standard deviation of the heart rate data from the mean of the heart rate data), the root mean square of the heart rate data); the frequency domain analysis is used to analyze the variation range of the heart rate in frequency, and in the embodiment of the invention, the power spectral density function (PSD) is used as a measure, the fast fourier transform is used to calculate the power spectral density function range of the heart rate variability, and the High Frequency (HF), the Low Frequency (LF) and the ratio (LF/HF) of the two are output.
In the embodiment of the invention, in order to inhibit local heart rate mutation caused by weather change, diet change and the like, hrv characteristic values are normalized as a simple implementation, and for the ith characteristic value siNormalized data s ofinCan be calculated by: sin＝(si-smin)/(smax-smin) (ii) a Of course, other normalization algorithms in the field of logistic regression analysis may be used with embodiments of the present invention.
And 103, generating evaluation information of the watched content by the user based on the acquired heart rate data.
Optionally, the generating of the evaluation information of the content viewed by the user according to the embodiment of the present invention includes:
calculating heart rate variability according to the heart rate data, and determining evaluation information according to the heart rate variability obtained through calculation;
wherein the evaluation information comprises one or more evaluation levels corresponding to the heart rate variability.
In some embodiments of the present disclosure, one or more ratings corresponding to the heart rate variability; for example, the evaluation score may be a score of the evaluation, and the evaluation feeling of the user on the viewed content is corresponded to in different score intervals; this may be for example subjective perception: pleasure, happiness, generality, depression, aversion, etc. (based on R.Picard, E Vyzaz, "heated mechanical Analysis of 17 Analysis of influence physical State," IEEETransactions on Pattern Analysis and Machine Analysis, 23,10,1175 + 1191(2001), "C.L.Lisett," Using Noninnovative Wearrable Computers to recognite human Analysis physical Signal, "EURASIP Applied Signal processing,2004,1672 + 1687(2004), etc., it is known that human subjective feelings can be quantitatively analyzed).
According to the embodiment of the invention, through the generated evaluation information, data support can be provided for pushing a proper picture to the user, an interested image is selected for the user to be pushed and displayed, and the pushing efficiency of the digital image is improved.
Optionally, the method in the embodiment of the present invention further includes:
acquiring a user image comprising a complete user face area, comparing the determined region of interest with the user image, and determining an interfered part in the region of interest;
deleting the determined disturbed part in the region of interest.
The embodiment of the invention can be implemented by a neural network method, for example, by a mode of supervised training, a selected picture, for example, a picture in an online database such as imagenet, cifar (an existing database in the related art), or a picture in an international emotion picture system (IAPS), is viewed by a non-specific user as a training sample. HRV characteristics of the training sample are collected when the training sample is observed, the given evaluation is used as a label, and a neural network model corresponding to the HRV and the evaluation is established through a training process, so that the HRV characteristics are associated with the evaluation information. Connecting an output layer of the neural network with an evaluation information classification model (which can be an emotion classification model) and a classifier, such as an SVM (support vector machine), a SoftMax (soft max) and the like, and performing classification output for evaluation corresponding to the HRV (human cognitive vision) characteristics of the user; as shown in fig. 2, a process of implementing the method of the embodiment of the present invention by using the neural network method is shown.
The neural network referred to in some embodiments of the present disclosure may be implemented by including a Convolutional Neural Network (CNN) to which a SoftMax classifier is connected at an output layer.
The embodiment of the invention can directly apply the existing emotion recognition device in the related technology. The generated evaluation information corresponding to the heart rate data may be recorded and stored in the background.
Compared with the related art, the technical scheme of the application comprises the following steps: acquiring a facial image of a user watching corresponding content; analyzing the collected facial image to obtain heart rate data of the user; based on the obtained heart rate data, evaluation information of the user on the viewed content is generated. The embodiment of the invention realizes the acquisition of the user evaluation information and improves the operation efficiency of the display device.
Fig. 3 is a block diagram of an apparatus for acquiring evaluation information according to an embodiment of the present invention, as shown in fig. 3, including: the device comprises a collecting unit, an analyzing unit and a generating unit; wherein,
the acquisition unit is used for: acquiring a facial image of a user watching corresponding content; here, the acquisition unit may be implemented by an image acquisition element including a camera.
It should be noted that, in the embodiment of the present invention, when the content viewed by the user is a digital image, the digital image may pass through the display device that can display the digital image for a longer time; for example, displaying a digital image for a user via an electronic picture frame; in the related art, other display devices for displaying digital images may be applied to the present invention.
In addition, the device of the embodiment of the invention can be arranged on the display device, and can also be arranged independently from the display device to realize communication connection in a wired or wireless mode.
The analysis unit is used for: analyzing the collected facial image to obtain heart rate data of the user;
in the embodiment of the present invention, the analysis unit may be implemented by a chip including a processor.
Optionally, the analysis unit in the embodiment of the present invention is specifically configured to:
determining a region of interest in the acquired facial image;
performing Fourier transform on the determined region of interest, and determining pixel change information of one or more pixel channels;
and determining heart rate data of the user according to the determined pixel change information.
Optionally, the region of interest according to the embodiment of the present invention includes:
a distribution region of the blood vessels of the user's face;
wherein the distribution region of the facial blood vessels comprises the following partial or whole regions: forehead, canthus, corner of mouth, nose.
The distribution area of the blood vessels on the face of the user in the embodiment of the invention can comprise: a distribution region of facial blood vessels when a user faces the digital image with a face front; when the region of interest includes forehead, canthus, mouth corner, nose, the region of interest may include: the frontal face of the forehead, both sides of the nasal ridge, and under the eyes extend to the area of the corners of the mouth.
Optionally, the pixel change information in the embodiment of the present invention includes part or all of the following:
red pixel change information, green pixel change information, and blue pixel change information.
Optionally, the determining, by the analysis unit according to the determined pixel variation information, the heart rate data of the user includes:
performing Fourier transform analysis on the pixel change information of the determined green pixels;
and determining heart rate data of the user according to the result of Fourier transform analysis on the pixel change information of the green pixels.
The generation unit is used for: based on the obtained heart rate data, evaluation information of the user on the viewed content is generated.
Optionally, the generating unit in the embodiment of the present invention is specifically configured to:
calculating heart rate variability according to the heart rate data, and determining evaluation information according to the heart rate variability obtained through calculation;
wherein the evaluation information comprises one or more evaluation levels corresponding to the heart rate variability.
Optionally, the apparatus in this embodiment of the present invention may further include an interference processing unit, configured to:
acquiring a user image comprising a complete user face area, comparing the determined region of interest with the user image, and determining an interfered part in the region of interest;
deleting the determined disturbed part in the region of interest.
In some embodiments of the present disclosure, a computer system for obtaining assessment information is disclosed that includes a processor, a memory coupled to the processor. The processor can also be connected with an image acquisition element, such as a camera, for acquiring a face image of the user according to the requirement of function execution; the processor may also be connected to a display driving element for driving the display screen to display images and the like.
For example, the processor, memory, and external image capture elements and display driver elements may be in direct or indirect communication via a network connection.
Alternatively, the network may include a wireless network, a wired network, and/or any combination of wireless and wired networks. The network may include a local area network, the Internet, a telecommunications network, an Internet of things (Internet of things) based on the Internet and/or a telecommunications network, and/or any combination thereof, and/or the like. The wired network may communicate by using twisted pair, coaxial cable, or optical fiber transmission, for example, and the wireless network may communicate by using 3G/4G/5G mobile communication network, bluetooth, Zigbee, or Wi-Fi, for example. The present disclosure is not limited herein as to the type and function of the network.
For example, the processor may control other components in the computer system to perform desired functions. The processor may be a Central Processing Unit (CPU), a field programmable logic array (FPGA), a single chip Microcomputer (MCU), a Digital Signal Processor (DSP), or other devices having data processing capability and/or program execution capability.
For example, the memory may comprise any combination of one or more computer program products, which may include various forms of computer-readable storage media, such as volatile memory and/or non-volatile memory. Volatile memory can include, for example, Random Access Memory (RAM), cache memory (or the like). The non-volatile memory may include, for example, Read Only Memory (ROM), a hard disk, an Erasable Programmable Read Only Memory (EPROM), a portable compact disc read only memory (CD-ROM), USB memory, flash memory, and the like.
One or more computer instructions may be stored on the memory and executed by the processor to perform various functions, such as performing the method of obtaining ratings information of embodiments of the present invention. Various applications and various data, such as sample images, training data, and various data used and/or generated by the applications, may also be stored in the computer-readable storage medium.
In some embodiments of the present disclosure, a storage medium is also disclosed. The storage medium stores computer instructions adapted to be executed by a processor. The computer instructions, when executed by the processor, may perform at least one or more of the steps of the method for obtaining ratings information as described above.
For example, in one example of the embodiment of the present disclosure, the storage medium may be applied to the computer system described in any of the above embodiments, and may be a memory, for example.
Although the embodiments of the present invention have been described above, the above description is only for the convenience of understanding the present invention, and is not intended to limit the present invention. It will be understood by those skilled in the art that various changes in form and details may be made therein without departing from the spirit and scope of the invention as defined by the appended claims.
Claims (12)
1. A method of obtaining assessment information, comprising:
acquiring a facial image of a user watching corresponding content;
analyzing the collected facial image to obtain heart rate data of the user;
based on the obtained heart rate data, evaluation information of the user on the viewed content is generated.
2. The method of claim 1, wherein analyzing the captured facial image comprises:
determining a region of interest in the acquired facial image;
performing Fourier transform on the determined region of interest, and determining pixel change information of one or more pixel channels;
and determining heart rate data of the user according to the determined pixel change information.
3. The method of claim 2, wherein the region of interest comprises:
a distribution region of the blood vessels of the user's face;
wherein the distribution region of the facial blood vessels comprises the following partial or whole regions: forehead, canthus, corner of mouth, nose.
4. The method of claim 2 or 3, wherein determining heart rate data of a user from the determined pixel variation information comprises:
performing Fourier transform analysis on the pixel change information of the determined green pixels;
and determining heart rate data of the user according to the result of Fourier transform analysis on the pixel change information of the green pixels.
5. The method according to any one of claims 1 to 3, wherein the generating of the user evaluation information of the viewed content comprises:
calculating heart rate variability according to the heart rate data, and determining evaluation information according to the heart rate variability obtained through calculation;
wherein the evaluation information comprises one or more evaluation levels corresponding to the heart rate variability.
6. A method according to claim 2 or 3, characterized in that the method further comprises:
acquiring a user image comprising a complete user face area, comparing the determined region of interest with the user image, and determining an interfered part in the region of interest;
deleting the determined disturbed part in the region of interest.
7. An apparatus for acquiring evaluation information, comprising: the device comprises a collecting unit, an analyzing unit and a generating unit; wherein,
the acquisition unit is used for: acquiring a facial image of a user watching corresponding content;
the analysis unit is used for: analyzing the collected facial image to obtain heart rate data of the user;
the generation unit is used for: based on the obtained heart rate data, evaluation information of the user on the viewed content is generated.
8. The apparatus according to claim 7, wherein the analysis unit is specifically configured to:
determining a region of interest in the acquired facial image;
performing Fourier transform on the determined region of interest, and determining pixel change information of one or more pixel channels;
and determining heart rate data of the user according to the determined pixel change information.
9. The apparatus of claim 8, wherein the analysis unit to determine heart rate data of a user from the determined pixel variation information comprises:
performing Fourier transform analysis on the pixel change information of the determined green pixels;
and determining heart rate data of the user according to the result of Fourier transform analysis on the pixel change information of the green pixels.
10. The apparatus according to any one of claims 7 to 9, wherein the generating unit is specifically configured to:
calculating heart rate variability according to the heart rate data, and determining evaluation information according to the heart rate variability obtained through calculation;
wherein the evaluation information comprises one or more evaluation levels corresponding to the heart rate variability.
11. A storage medium having stored thereon computer-executable instructions for execution by a processor, the computer-executable instructions being for performing the method of obtaining ratings information as claimed in any one of claims 1 to 6.
12. A computer, comprising: the device comprises a processor and a memory connected with the processor; wherein,
the processor is configured to execute program instructions in the memory;
the program instructions read on the processor to perform the following operations:
acquiring a facial image of a user watching corresponding content;
analyzing the collected facial image to obtain heart rate data of the user;
based on the obtained heart rate data, evaluation information of the user on the viewed content is generated.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201810064459.6A CN108197595A (en) | 2018-01-23 | 2018-01-23 | A kind of method, apparatus, storage medium and computer for obtaining evaluation information |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201810064459.6A CN108197595A (en) | 2018-01-23 | 2018-01-23 | A kind of method, apparatus, storage medium and computer for obtaining evaluation information |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN108197595A true CN108197595A (en) | 2018-06-22 |
Family
ID=62590420
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201810064459.6A Pending CN108197595A (en) | 2018-01-23 | 2018-01-23 | A kind of method, apparatus, storage medium and computer for obtaining evaluation information |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN108197595A (en) |
Cited By (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN110766502A (en) * | 2018-07-27 | 2020-02-07 | 北京京东尚科信息技术有限公司 | Commodity evaluation method and system |
| CN110866146A (en) * | 2019-11-26 | 2020-03-06 | 杭州市第一人民医院 | Video recommendation method and device, computer equipment and storage medium |
| CN111784163A (en) * | 2020-07-01 | 2020-10-16 | 深圳前海微众银行股份有限公司 | Data evaluation method, device, equipment and storage medium |
| CN113892930A (en) * | 2021-12-10 | 2022-01-07 | 之江实验室 | Facial heart rate measuring method and device based on multi-scale heart rate signals |
| CN114469036A (en) * | 2022-01-27 | 2022-05-13 | 无锡博奥玛雅医学科技有限公司 | Remote heart rate monitoring method and system based on video images |
| CN116681700A (en) * | 2023-08-01 | 2023-09-01 | 首都医科大学附属北京天坛医院 | Method, device and readable storage medium for evaluating heart rate and heart rate variability of user |
Citations (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20150099987A1 (en) * | 2010-06-07 | 2015-04-09 | Affectiva, Inc. | Heart rate variability evaluation for mental state analysis |
| CN104769596A (en) * | 2012-12-07 | 2015-07-08 | 英特尔公司 | Physiological cue processing |
-
2018
- 2018-01-23 CN CN201810064459.6A patent/CN108197595A/en active Pending
Patent Citations (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20150099987A1 (en) * | 2010-06-07 | 2015-04-09 | Affectiva, Inc. | Heart rate variability evaluation for mental state analysis |
| CN104769596A (en) * | 2012-12-07 | 2015-07-08 | 英特尔公司 | Physiological cue processing |
Cited By (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN110766502A (en) * | 2018-07-27 | 2020-02-07 | 北京京东尚科信息技术有限公司 | Commodity evaluation method and system |
| CN110866146A (en) * | 2019-11-26 | 2020-03-06 | 杭州市第一人民医院 | Video recommendation method and device, computer equipment and storage medium |
| CN111784163A (en) * | 2020-07-01 | 2020-10-16 | 深圳前海微众银行股份有限公司 | Data evaluation method, device, equipment and storage medium |
| CN113892930A (en) * | 2021-12-10 | 2022-01-07 | 之江实验室 | Facial heart rate measuring method and device based on multi-scale heart rate signals |
| CN113892930B (en) * | 2021-12-10 | 2022-04-22 | 之江实验室 | Facial heart rate measuring method and device based on multi-scale heart rate signals |
| CN114469036A (en) * | 2022-01-27 | 2022-05-13 | 无锡博奥玛雅医学科技有限公司 | Remote heart rate monitoring method and system based on video images |
| CN116681700A (en) * | 2023-08-01 | 2023-09-01 | 首都医科大学附属北京天坛医院 | Method, device and readable storage medium for evaluating heart rate and heart rate variability of user |
| CN116681700B (en) * | 2023-08-01 | 2023-10-31 | 首都医科大学附属北京天坛医院 | Method, device and readable storage medium for evaluating heart rate and heart rate variability of user |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN108197595A (en) | A kind of method, apparatus, storage medium and computer for obtaining evaluation information | |
| US10517521B2 (en) | Mental state mood analysis using heart rate collection based on video imagery | |
| Niu et al. | Rhythmnet: End-to-end heart rate estimation from face via spatial-temporal representation | |
| US11151610B2 (en) | Autonomous vehicle control using heart rate collection based on video imagery | |
| US10867197B2 (en) | Drowsiness mental state analysis using blink rate | |
| US10911829B2 (en) | Vehicle video recommendation via affect | |
| US11430260B2 (en) | Electronic display viewing verification | |
| US10074024B2 (en) | Mental state analysis using blink rate for vehicles | |
| TWI585711B (en) | Method for obtaining care information, method for sharing care information, and electronic apparatus therefor | |
| US20190034706A1 (en) | Facial tracking with classifiers for query evaluation | |
| US20120243751A1 (en) | Baseline face analysis | |
| JP7248820B2 (en) | Apparatus and method for determining cosmetic skin attributes | |
| US10185869B2 (en) | Filter and shutter based on image emotion content | |
| Irani et al. | Thermal super-pixels for bimodal stress recognition | |
| US20170095192A1 (en) | Mental state analysis using web servers | |
| US11430561B2 (en) | Remote computing analysis for cognitive state data metrics | |
| US11227161B1 (en) | Physiological signal prediction method | |
| US20130102854A1 (en) | Mental state evaluation learning for advertising | |
| Beringer et al. | Reliability and validity of machine vision for the assessment of facial expressions | |
| US20170105668A1 (en) | Image analysis for data collected from a remote computing device | |
| US20120133753A1 (en) | System, device, method, and computer program product for facial defect analysis using angular facial image | |
| McDuff | Crowdsourcing affective responses for predicting media effectiveness | |
| KR102347551B1 (en) | Method, apparatus and system for providing informations of face condition based on analysis of face image | |
| CN113326781B (en) | Non-contact anxiety recognition method and device based on face video | |
| CN106339658A (en) | Data processing method and device |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20180622 |
|
| RJ01 | Rejection of invention patent application after publication |