CN111079555A - User preference degree determining method and device, electronic equipment and readable storage medium - Google Patents
User preference degree determining method and device, electronic equipment and readable storage medium Download PDFInfo
- Publication number
- CN111079555A CN111079555A CN201911166220.0A CN201911166220A CN111079555A CN 111079555 A CN111079555 A CN 111079555A CN 201911166220 A CN201911166220 A CN 201911166220A CN 111079555 A CN111079555 A CN 111079555A
- Authority
- CN
- China
- Prior art keywords
- user
- millimeter wave
- determining
- information
- gazing
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000000034 method Methods 0.000 title claims abstract description 65
- 230000004044 response Effects 0.000 claims abstract description 137
- 210000000038 chest Anatomy 0.000 claims description 32
- 210000000115 thoracic cavity Anatomy 0.000 claims description 27
- 210000001508 eye Anatomy 0.000 claims description 20
- 210000005252 bulbus oculi Anatomy 0.000 claims description 13
- 238000004590 computer program Methods 0.000 claims description 12
- 238000012549 training Methods 0.000 claims description 12
- 230000005540 biological transmission Effects 0.000 claims description 11
- 230000001815 facial effect Effects 0.000 claims description 11
- 230000008859 change Effects 0.000 claims description 7
- 230000000875 corresponding effect Effects 0.000 description 45
- 238000010586 diagram Methods 0.000 description 12
- 210000001747 pupil Anatomy 0.000 description 9
- 230000005855 radiation Effects 0.000 description 5
- 239000000284 extract Substances 0.000 description 4
- 238000005259 measurement Methods 0.000 description 3
- 238000012545 processing Methods 0.000 description 3
- 230000029058 respiratory gaseous exchange Effects 0.000 description 3
- 238000013473 artificial intelligence Methods 0.000 description 2
- 230000008921 facial expression Effects 0.000 description 2
- 230000006870 function Effects 0.000 description 2
- 210000003128 head Anatomy 0.000 description 2
- 230000001360 synchronised effect Effects 0.000 description 2
- 241000218378 Magnolia Species 0.000 description 1
- 230000009471 action Effects 0.000 description 1
- 238000013459 approach Methods 0.000 description 1
- 238000004364 calculation method Methods 0.000 description 1
- 230000001276 controlling effect Effects 0.000 description 1
- 238000007796 conventional method Methods 0.000 description 1
- 238000013527 convolutional neural network Methods 0.000 description 1
- 230000002596 correlated effect Effects 0.000 description 1
- 238000005516 engineering process Methods 0.000 description 1
- 230000004424 eye movement Effects 0.000 description 1
- 238000005286 illumination Methods 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 230000003287 optical effect Effects 0.000 description 1
- 230000008569 process Effects 0.000 description 1
- 230000001179 pupillary effect Effects 0.000 description 1
- 210000001525 retina Anatomy 0.000 description 1
- 210000000697 sensory organ Anatomy 0.000 description 1
- 230000003068 static effect Effects 0.000 description 1
- 238000012360 testing method Methods 0.000 description 1
- 210000003813 thumb Anatomy 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
- G06V40/10—Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
- G06V40/18—Eye characteristics, e.g. of the iris
- G06V40/19—Sensors therefor
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
- G06Q30/00—Commerce
- G06Q30/06—Buying, selling or leasing transactions
- G06Q30/0601—Electronic shopping [e-shopping]
- G06Q30/0631—Item recommendations
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
- G06V40/10—Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
- G06V40/16—Human faces, e.g. facial parts, sketches or expressions
- G06V40/174—Facial expression recognition
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F2218/00—Aspects of pattern recognition specially adapted for signal processing
Landscapes
- Engineering & Computer Science (AREA)
- Physics & Mathematics (AREA)
- Business, Economics & Management (AREA)
- Theoretical Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Human Computer Interaction (AREA)
- Accounting & Taxation (AREA)
- Multimedia (AREA)
- Finance (AREA)
- Health & Medical Sciences (AREA)
- General Health & Medical Sciences (AREA)
- Oral & Maxillofacial Surgery (AREA)
- Ophthalmology & Optometry (AREA)
- Development Economics (AREA)
- Economics (AREA)
- Marketing (AREA)
- Strategic Management (AREA)
- General Business, Economics & Management (AREA)
- Measurement Of The Respiration, Hearing Ability, Form, And Blood Characteristics Of Living Organisms (AREA)
Abstract
The application provides a user preference degree determining method and device, electronic equipment and a readable storage medium. The method comprises the following steps: acquiring a fixation point coordinate; determining a gazing object according to the gazing point coordinates; acquiring a millimeter wave response signal when watching the watching object; determining user biological characteristic information when the user watches the watching object according to the millimeter wave response signal, wherein the user biological characteristic information comprises user chest vibration information and user expression information; and inputting the biological characteristic information of the user into a preference recognition model to obtain the preference degree of the user corresponding to the gazing object, wherein the preference recognition model is trained according to the biological characteristic information of the user. By adopting the method, the accuracy of determining the preference degree of the user can be improved.
Description
Technical Field
The present application relates to the field of computer technologies, and in particular, to a method and an apparatus for obtaining user preferences, an electronic device, and a computer-readable storage medium.
Background
When the preference of the user is determined, the conventional method is to determine the preference of the user for the gazing object according to the gazing duration of the user. This approach can reflect the user's preference for the fixation target to some extent, but the resulting determination of the user's preference is not accurate.
Disclosure of Invention
The embodiment of the application provides a method and a device for determining the preference degree of a user, electronic equipment and a computer-readable storage medium, and can improve the accuracy of determining the preference degree of the user.
A method for determining a user preference level, applied to an electronic device, the electronic device including a millimeter wave detector, the millimeter wave detector being configured to transmit a millimeter wave transmission signal and receive a millimeter wave response signal generated in response to the millimeter wave transmission signal, the method comprising:
acquiring a fixation point coordinate;
determining a gazing object according to the gazing point coordinate;
acquiring a millimeter wave response signal when the gazing object is watched;
determining user biological characteristic information when the user watches the watching object according to the millimeter wave response signal, wherein the user biological characteristic information comprises user chest vibration information and user expression information;
and inputting the user biological characteristic information into a preference recognition model to obtain the user preference degree corresponding to the gazing object, wherein the preference recognition model is trained according to the user biological characteristic information.
An information pushing method is applied to an electronic device, the electronic device comprises a millimeter wave detector, the millimeter wave detector is used for transmitting a millimeter wave transmitting signal and receiving a millimeter wave response signal generated by the millimeter wave transmitting signal, and the method comprises the following steps:
acquiring a fixation point coordinate;
determining a gazing object according to the gazing point coordinate;
acquiring a millimeter wave response signal when the gazing object is watched;
determining user biological characteristic information when the user watches the watching object according to the millimeter wave response signal, wherein the user biological characteristic information comprises user chest vibration information and user expression information;
inputting the user biological characteristic information into a preference recognition model to obtain a user preference degree corresponding to the gazing object, wherein the preference recognition model is trained according to the user biological characteristic information;
sending the gazing object and the corresponding user preference degree to a server;
and receiving push information returned by the server, wherein the push information is determined by the server according to the gazing object and the preference degree of the user.
A user preference level determining apparatus comprising:
the fixation point coordinate acquisition module is used for acquiring fixation point coordinates;
the gazing object determining module is used for determining a gazing object according to the gazing point coordinate;
the millimeter wave response signal acquisition module is used for acquiring a millimeter wave response signal when the watching object is watched;
the biological characteristic information determining module is used for determining the biological characteristic information of the user when the user watches the watching object according to the millimeter wave response signal, wherein the biological characteristic information of the user comprises the thoracic vibration information and the expression information of the user;
and the preference degree determining module is used for inputting the biological characteristic information of the user into a preference recognition model to obtain the preference degree of the user corresponding to the gazing object, wherein the preference recognition model is formed by training according to the chest vibration information and the expression information of the user.
An electronic device comprising a memory and a processor, the memory having stored therein a computer program that, when executed by the processor, causes the processor to perform the steps of:
acquiring a fixation point coordinate;
determining a gazing object according to the gazing point coordinate;
acquiring a millimeter wave response signal when the gazing object is watched;
determining user biological characteristic information when the user watches the watching object according to the millimeter wave response signal, wherein the user biological characteristic information comprises user chest vibration information and user expression information;
and inputting the user biological characteristic information into a preference recognition model to obtain the user preference degree corresponding to the gazing object, wherein the preference recognition model is trained according to the user biological characteristic information.
A computer-readable storage medium, on which a computer program is stored, which, when being executed by a processor, carries out the steps of:
acquiring a fixation point coordinate;
determining a gazing object according to the gazing point coordinate;
acquiring a millimeter wave response signal when the gazing object is watched;
determining user biological characteristic information when the user watches the watching object according to the millimeter wave response signal, wherein the user biological characteristic information comprises user chest vibration information and user expression information;
and inputting the user biological characteristic information into a preference recognition model to obtain the user preference degree corresponding to the gazing object, wherein the preference recognition model is trained according to the user biological characteristic information.
The method and the device for determining the preference degree of the user, the electronic equipment and the readable storage medium obtain the coordinates of the fixation point, determine the fixation object according to the coordinates of the fixation point, obtain the millimeter wave response signal when the fixation object is fixed, determine the biological characteristic information of the user when the fixation object is fixed according to the millimeter wave response signal, input the biological characteristic information of the user into the preference identification model to obtain the preference degree of the user, extract the biological characteristic information of the user by combining the millimeter wave under the condition of fixing the fixation object, and can obtain more accurate biological characteristic information of the user, thereby obtaining the preference degree of the user corresponding to the fixation object and improving the accuracy of determining the preference degree of the user.
Drawings
In order to more clearly illustrate the embodiments of the present application or the technical solutions in the prior art, the drawings used in the description of the embodiments or the prior art will be briefly described below, it is obvious that the drawings in the following description are only some embodiments of the present application, and for those skilled in the art, other drawings can be obtained according to the drawings without creative efforts.
FIG. 1 is a diagram of an application environment of a method for determining user preference level according to an embodiment;
FIG. 2 is a flow diagram of a method for determining user preference level in one embodiment;
FIG. 3 is a flow diagram illustrating a manner in which a preference recognition model may be trained in one embodiment;
FIG. 4 is a flow chart of a method for determining user preference level in another embodiment;
FIG. 5 is a flow chart of a method for pushing information in one embodiment;
FIG. 6 is a schematic illustration of an online shopping interface in one embodiment;
FIG. 7 is a schematic diagram of an adjusted online shopping interface in one embodiment;
FIG. 8 is a block diagram showing the structure of a user preference level determining apparatus according to an embodiment;
fig. 9 is a schematic diagram of an internal structure of an electronic device in one embodiment.
Detailed Description
In order to make the objects, technical solutions and advantages of the present application more apparent, the present application is described in further detail below with reference to the accompanying drawings and embodiments. It should be understood that the specific embodiments described herein are merely illustrative of the present application and are not intended to limit the present application.
It will be understood that, as used herein, the terms "first," "second," and the like may be used herein to describe various elements, but these elements are not limited by these terms. These terms are only used to distinguish one element from another. For example, the first millimeter wave detector may be referred to as a second millimeter wave detector, and similarly, the second millimeter wave detector may be referred to as a first millimeter wave detector, without departing from the scope of the present application. Both the first millimeter wave detector and the second millimeter wave detector are millimeter wave detectors, but they are not the same millimeter wave detector.
Fig. 1 is a diagram illustrating an application environment of a method for determining user preference level according to an embodiment. As shown in fig. 1, the application environment includes an electronic device 110 and a server 120. The electronic device 110 may include a millimeter wave detector. The millimeter wave is an electromagnetic wave with a wavelength of 1-10 mm. Millimeter waves can measure distances from 100 meters to 200 meters. The millimeter wave detector is used for transmitting a millimeter wave transmitting signal and receiving a millimeter wave response signal generated by the millimeter wave transmitting signal. The millimeter wave signal emitted by the millimeter wave detector can cover the face range and the chest range of the user. Or the millimeter wave detector may comprise a first millimeter wave detector and a second millimeter wave detector. The first millimeter wave detector can be used for receiving millimeter wave response signals to the face of the user. The second millimeter wave detector may be operable to receive millimeter wave response signals to the user's chest. An eye tracker may also be included in the electronic device, and may be configured to emit an infrared signal. The eye tracker may be located in the camera. The embodiment of the present application may be applied to only the electronic device 110, or the server 120, or to both the electronic device 110 and the server 120. For example, the electronic device 110 obtains the gazing point coordinates, determines a gazing object according to the gazing point coordinates, obtains a millimeter wave response signal when gazing the object, determines the user biometric information when gazing the object according to the millimeter wave response signal, sends the user biometric information to the server 120, and the server inputs the user biometric information into the preference recognition model to obtain the user preference degree corresponding to the gazing object.
FIG. 2 is a flow diagram of a method for determining user preference in one embodiment. The method for determining the user preference level in the present embodiment is described by taking the electronic device in fig. 1 as an example. As shown in fig. 2, the method for determining user preference is applied to an electronic device, which includes a millimeter wave detector for emitting a millimeter wave emission signal and receiving a millimeter wave response signal generated from the millimeter wave emission signal, and includes steps 202 to 210.
Wherein, the gazing point coordinate refers to the coordinate of a point on the screen of the electronic device which is gazed by the user.
Specifically, the electronic device may include an eye tracker, and the eye tracker includes an infrared detector. The eye tracker may be located in the camera. The infrared detector is used for emitting infrared emission signals and receiving infrared response signals generated by the infrared emission signals. The electronic device can control the eyeball tracker to emit infrared emission signals towards the eyeball direction and receive infrared response signals.
And step 204, determining the gazing object according to the gazing point coordinates.
The gazing object may be an object such as an icon or a commodity displayed in the electronic device. Wherein the icon may be a program icon.
Specifically, after the electronic device determines the coordinates of the gaze point, the coordinate range of the candidate object in the interface is obtained. And the electronic equipment determines the gazing object according to the gazing point coordinate and the range of the candidate object. For example, the first candidate object is located in a coordinate range of (10, 10) to (50, 50), i.e., the x-axis direction is 10 to 50, and the y-axis direction is also 10 to 50. The second candidate object is located in a coordinate range of (60, 60) to (100 ). And the fixation point coordinate is (15, 20), and the fixation object is determined as the first candidate object.
Specifically, while the user gazes at the gazing object, the electronic device acquires the millimeter wave response signal. That is, when the electronic device transmits and receives an infrared signal, the electronic device also transmits and receives a millimeter wave signal.
And step 208, determining the biological characteristic information of the user when the user gazes at the gazing object according to the millimeter wave response signal, wherein the biological characteristic information of the user comprises the thoracic vibration information and the expression information of the user.
Wherein the user biometric information may be used to characterize a user's preference for an object. The thoracic vibration information of the user refers to thoracic vibration information generated when the user breathes. The thoracic vibration information may specifically include, but is not limited to, a thoracic vibration frequency, a thoracic vibration distance, and the like. The user expression information refers to expression information of the user when gazing at the gazing object. The user expression information may specifically be a user expression image. For example, smile expression information, laugh expression information, anger expression information, surprised expression information, fear expression information, keeping away from magnolia expression information, and the like are not limited thereto.
Specifically, the electronic device may determine, according to the millimeter wave response signal, user chest vibration information and user expression information while gazing at the gazing object. And the electronic equipment acquires the user expression information image according to the millimeter wave response signal. The electronic equipment can also acquire the image of the user's chest according to the millimeter wave response signal, thereby determining the chest vibration information. Or the electronic equipment determines the chest vibration distance of the user according to the millimeter wave transmitting and receiving time, and the like.
Specifically, the electronic device may determine the biometric information of the user when gazing at the gazing object through the millimeter wave response signal returned by the same millimeter wave detector. The millimeter wave emission signal emitted by the millimeter wave detector can cover the range from the head to the chest of the user. The electronic device may determine user expression information from the head region in the received millimeter wave response signal. The electronic device may determine the user's chest vibration information from the chest region in the received millimeter wave response signal.
In this embodiment, the user biometric information may further include user action information. Such as the user holding his thumb up, etc., are not limited thereto.
Wherein the like degree can be expressed by a user's pleasure degree. The higher the pleasure, the higher the preference. The pleasure level is positively correlated with the preference level. The preference level may be expressed in terms of a level. Such as, but not limited to, first-level preference, second-level preference, third-level preference, etc. Wherein, the highest preference degree can be represented by a first-level preference degree, and the highest preference degree can also be represented by a third-level preference degree. The user preference degree corresponding to the gazing object may be, but is not limited to, a preference degree for an application icon, a preference degree for an article, a preference degree for a certain type of picture, or the like.
In particular, the preference recognition model is used to recognize the user's preference for a certain gaze object. The preference recognition model can be obtained through training of a convolutional neural network and the like. For example, when the user expression information is smiling expression information and the chest vibration frequency is high, the user preference degree may be a secondary preference degree. The electronic equipment inputs the chest vibration information and the user expression information into the preference identification model to obtain the user preference degree corresponding to the gazing object. The electronic equipment inputs the biological characteristic information of the user into the preference identification model, and the preference degree of the user corresponding to the gazing object can be obtained through processing of the preference identification model.
The user preference degree determining method in the embodiment includes the steps of obtaining a fixation point coordinate, determining a fixation object according to the fixation point coordinate, obtaining a millimeter wave response signal when the fixation object is fixed, determining user biological characteristic information when the fixation object is fixed according to the millimeter wave response signal, inputting the user biological characteristic information into a preference recognition model, obtaining user preference degree, extracting the biological characteristic information of a user by combining millimeter waves under the condition that the fixation object is fixed, obtaining more accurate user biological characteristic information, obtaining the user preference degree corresponding to the fixation object, and improving accuracy of determining the user preference degree.
In one embodiment, determining the user expression when gazing at the gazing object according to the millimeter wave response signal comprises: and determining a face image according to the millimeter wave response signal, and determining user expression information when the gazing object is watched according to the face image.
Specifically, the electronic device forms a face image from the millimeter wave response signal. For example, the distances of the nose and the eyes are not the same, the features are not the same in the face image formed by the millimeter wave. The face image contains face information of different distances. The electronic equipment extracts the information of the five sense organs of the user according to the facial image so as to determine the expression information of the user.
According to the method for determining the preference degree of the user, the face image is determined according to the millimeter wave response signal, the expression information of the user is obtained according to the face image, and the millimeter wave mode is adopted, so that the radiation quantity to a human body is small, and the method is safer.
In one embodiment, determining a face image from the millimeter wave response signal includes: and determining the face image corresponding to the millimeter wave response signal received each time aiming at the received millimeter wave response signals which are continuously received at least twice, and obtaining at least two face images. Obtaining user expression information according to the facial image, comprising: and determining user expression change information when gazing at the gazing object according to at least two facial images.
The user expression change information may be that the mouth angle of the user rises, the pupil of the user increases, and the like.
Specifically, the millimeter wave detector may transmit the millimeter wave transmission signal once at intervals of a preset duration. Or the millimeter wave detector continuously transmits the millimeter wave transmitting signal. The millimeter wave detector transmits millimeter wave transmitting signals for at least two times continuously, and the electronic equipment determines face images corresponding to the received millimeter wave response signals for at least two times continuously, so as to obtain at least two face images. For example, the millimeter wave detector sends out a first millimeter wave emission signal, the electronic device receives the first millimeter wave emission signal, and a first face image is obtained after processing. And the millimeter wave detector sends out a second millimeter wave emission signal, the electronic equipment receives the second millimeter wave emission signal, and a second face image is obtained after processing. The electronic equipment determines user expression change information according to at least two continuous facial images.
According to the method for determining the preference degree of the user, the face image corresponding to the millimeter wave response signal received each time is determined according to the millimeter wave response signals received at least twice continuously, at least two face images are obtained, the expression change information of the user is determined according to the at least two face images, and more accurate expression information of the user can be obtained, so that the accuracy of preference recognition is improved.
In one embodiment, determining the chest vibration information while gazing at the gazing object according to the millimeter wave response signals comprises: acquiring the transmitting time of a millimeter wave transmitting signal and the receiving time of a corresponding millimeter wave response signal; and determining the thoracic vibration distance when the gazing object is watched according to the transmitting time and the receiving time.
Wherein, the thoracic cavity vibration distance can reflect the breathing amplitude of the user to a certain extent. If the thoracic cavity vibration distance is large, the breathing amplitude of the user is large; the thorax shakes for a short distance, then the user's breathing amplitude is little.
Specifically, the electronic device acquires the transmission time of the millimeter wave transmission signal and the reception time of the corresponding millimeter wave response signal. Namely, the transmission time and the response time for the electronic device to acquire the same transmitted millimeter wave. And the electronic equipment calculates the thoracic vibration distance according to the transmitting time and the receiving time. For example, the chest vibration distance is (reception time-transmission time) × millimeter wave transmission speed.
The method for determining the preference degree of the user in the embodiment obtains the transmitting time of the millimeter wave transmitting signal and the receiving time of the corresponding millimeter wave response signal, determines the thoracic vibration distance according to the transmitting time and the receiving time, adopts a millimeter wave mode, has small radiation amount to a human body, and is safer.
In one embodiment, the millimeter wave detector includes a first millimeter wave detector and a second millimeter wave detector. According to the millimeter wave response signal, determining the biological characteristic information of the user when gazing at the gazing object, wherein the biological characteristic information of the user comprises the thoracic vibration information and the expression information of the user, and the method comprises the following steps: acquiring a first millimeter wave response signal through a first millimeter wave detector, and determining the user chest vibration information when watching the watching object according to the first millimeter wave response signal; and acquiring a second millimeter wave response signal through a second millimeter wave detector, and determining user expression information when the gazing object is watched according to the second millimeter wave response signal.
The emission parameters of the first millimeter wave detector can be calibrated in advance according to the thoracic vibration information of the user. The emission parameters of the second millimeter wave detector can also be calibrated in advance according to the expression information of the user. Emission parameters such as emission range, reflection angle, etc. are not limited thereto.
Specifically, the electronic device acquires a first millimeter wave response signal through a first millimeter wave detector, and determines the user chest vibration information when gazing at the gazing object according to the first millimeter wave response signal. The electronic equipment acquires a second millimeter wave response signal through a second millimeter wave detector, generates a user expression image according to the second millimeter wave response signal, and determines user expression information when the user gazes at the gazing object according to the user expression image.
According to the method for determining the preference degree of the user, the millimeter wave detector comprises a first millimeter wave detector and a second millimeter wave detector, a first millimeter wave response signal is obtained through the first millimeter wave detector, and the thoracic cavity vibration information of the user when the user watches the watching object is determined according to the first millimeter wave response signal; the second millimeter wave response signal is obtained through the second millimeter wave detector, the user expression information when the user watches the watching object is determined according to the second millimeter wave response signal, the thoracic vibration information and the user expression information of the user are easily distinguished through the two millimeter wave detectors, the time for distinguishing the thoracic vibration information and the user expression information of the user is reduced, preference recognition is carried out, and the efficiency for determining the preference degree of the user is improved.
In one embodiment, determining the gaze object from the gaze point coordinates comprises: acquiring a coordinate range of a candidate object in an interface; and determining the gazing object according to the gazing point coordinate and the coordinate range of the candidate object.
Wherein the candidate object refers to an object to be watched on a screen of the electronic device. The candidate object may be an application icon, a commodity, etc. without being limited thereto.
Specifically, the electronic device obtains a coordinate range where the candidate object is located in the interface, and determines the gazing object according to the gazing point coordinate and the coordinate range where the candidate object is located. For example, the first candidate object is located in a coordinate range of (10, 10) to (50, 50), i.e., the x-axis direction is 10 to 50, and the y-axis direction is also 10 to 50. The second candidate object is located in a coordinate range of (60, 60) to (100 ). And the fixation point coordinate is (15, 20), and the fixation object is determined as the first candidate object.
According to the method for determining the preference degree of the user, the coordinate range of the candidate object in the interface is obtained, the gazing object is determined according to the gazing point coordinate and the coordinate range of the candidate object, the current gazing object of the user can be determined, and therefore the preference degree of the user on a certain specific object is determined.
In an embodiment, as shown in fig. 3, a flowchart illustrating a training method of a preference recognition model in an embodiment includes:
The reference label may be a label of the user, such as a technician, on the user biometric information. The reference label can be considered to be the correct label.
Specifically, the electronic device may collect the user biometric information in real time, and obtain a reference label corresponding to the user biometric information. For example, when the electronic device a collects the user biometric information, the user biometric information may be uploaded to a server and stored by the server as sample information.
And the target label is the label obtained by the preference recognition model in the training process.
Specifically, the electronic device may input the user biometric information as sample information into the preference recognition model to obtain the target label.
And step 306, adjusting parameters of the preference recognition model according to the matching degree of the reference label and the target label, and obtaining the trained preference recognition model when the iteration condition is met.
The iteration condition may refer to that the training reaches a preset number of times, and the matching degree of the reference label and the target label is greater than a preset matching degree threshold, and the like.
Specifically, the electronic device adjusts the weight parameters of the preference recognition model according to the matching degree of the reference label and the target label, and obtains the trained preference recognition model when the iteration condition is met. The electronic equipment can take the user biological characteristic information samples with preset proportion as training samples and take the rest user biological characteristic information samples as test samples.
The method for determining the user preference degree in the embodiment acquires the biological feature information of the user, acquires the reference label corresponding to the biological feature information of the user, inputs the biological feature information of the user into the preference recognition model to obtain the target label, adjusts the parameters of the preference recognition model according to the matching degree of the reference label and the target label, obtains the trained preference recognition model when the iteration condition is met, can obtain the user preference through the artificial intelligence training method, and improves the accuracy of determining the user preference degree.
In one embodiment, the electronic device includes an eye tracker. Acquiring fixation point coordinates, comprising: controlling the eyeball tracker to emit an infrared emission signal; receiving an infrared response signal generated according to the infrared emission signal; and determining the coordinates of the fixation point according to the infrared response signal.
The infrared emission signal refers to an electromagnetic wave between a wavelength and visible light, and the wavelength can be 760 nanometers to 1 millimeter.
Specifically, the electronic device controls the eyeball tracker to emit an infrared emission signal and receives an infrared response signal generated according to the infrared emission signal. An image can be formed according to the infrared response signal, and the electronic equipment determines the fixation point coordinate according to the image. The eye cannot detect infrared illumination, but the camera can. When the retina detects visible light entering through the pupil, we see the world. Infrared light also enters the eye through this pupil. Outside the pupillary region, infrared light does not enter the eye. Instead, it is reflected back to the camera. Thus, the camera treats the pupil as a dark area, i.e. no reflection, while the rest of the eye is brighter. This may be referred to as "dark pupil eye tracking". If the infrared light source is close to the optical axis, it may reflect from behind the eye. In this case, the pupil appears bright, which is "bright pupil eye tracking". The images captured by the camera are processed and then the position of the pupil is determined, and the direction of the gaze can be estimated in dependence on the detected eye. If the eye tracker detects both eyes, the gaze readings of both eyes can be combined to estimate the gaze point coordinates of the user on the screen.
In this embodiment, before obtaining the gazing point coordinates, the method for obtaining the user preference degree further includes: and receiving an infrared response signal of the user gazing at a preset point, and calibrating the eyeball tracker according to the infrared response signal. Specifically, the electronic device receives an infrared response signal of the user's gaze at the preset point, and determines the eyeball characteristics of the user's gaze at the preset point according to the infrared response signal, so as to obtain the eyeball calibration information of the user's gaze at the preset point. For example, the preset point is a center point, and the eyeball characteristic at this time is the maximum pupil, etc.
In the method for determining the user preference degree in the embodiment, the eyeball tracker is controlled to emit the infrared emission signal; the infrared response signal generated according to the infrared emission signal is received, the fixation point coordinate is determined according to the infrared response signal, the current fixation point coordinate of the user can be obtained, and the accuracy of determining the preference degree of the user is improved by combining the biological characteristics of the user.
In one embodiment, as shown in fig. 4, a flowchart of a method for determining user preference level in another embodiment includes:
in step 402, the electronic device turns on eye tracking.
Specifically, the electronic device starts the eyeball tracker to realize the eye movement tracking function.
In step 404, the electronic device obtains the coordinates of the gaze point.
At step 406, the electronic device determines a gaze object of the user.
In step 408, the electronic device starts millimeter wave measurement.
Specifically, the electronic device turns on the millimeter wave detector to perform millimeter wave measurement. Step 402 may be performed concurrently with step 408.
In step 410, the electronic device obtains biometric information of the user.
Specifically, the user biometric information includes user chest vibration information and user expression information.
In step 412, the electronic device inputs the user biometric information into the preference recognition model to obtain the user preference degree corresponding to the gazing object.
In step 414, the electronic device sends the gazing object and the corresponding user preference to the server.
In step 416, the server adjusts the push policy according to the gazing object and the corresponding user preference.
In step 418, the server arranges the candidate objects on the interface according to the preference of the user.
The user preference degree determining method in the embodiment comprises the steps of obtaining a fixation point coordinate, determining a fixation object according to the fixation point coordinate, obtaining a millimeter wave response signal when the fixation object is fixed, determining user biological characteristic information when the fixation object is fixed according to the millimeter wave response signal, inputting the user biological characteristic information into a preference recognition model to obtain the user preference degree, extracting the biological characteristic information of a user by combining millimeter waves under the condition of fixing the fixation object, and obtaining more accurate user biological characteristic information, so that the user preference degree corresponding to the fixation object is obtained, the accuracy of determining the user preference degree is improved, and in addition, the radiation quantity to a human body is smaller and the method is safer due to the adoption of a millimeter wave mode; the server can carry out information push according to the biological characteristic information of the user, and the accuracy of the information push is improved.
In an embodiment, as shown in fig. 5, a schematic flow chart of an information pushing method in an embodiment is shown, and includes:
And step 508, determining the biological characteristic information of the user when the user watches the watching object according to the millimeter wave response signal, wherein the biological characteristic information of the user comprises the chest vibration information and the expression information of the user.
And step 514, receiving push information returned by the server, wherein the push information is determined by the server according to the gazing object and the preference degree of the user.
Specifically, the electronic device sends the gaze object and the corresponding user preference to the server. And the server determines the type of the push information and the corresponding push information according to the gazing object and the preference degree of the user. Fig. 6 is a schematic diagram of an online shopping interface according to an embodiment. Fig. 6 includes four items, namely, a mobile phone, a computer, shoes, and clothes. On the online shopping interface, the electronic equipment determines that the preference degree of the user to clothes is the highest, and the preference degree to shoes is the second highest. Then, when the electronic device refreshes the interface, for example, reopens the online shopping program or switches from background to foreground, the server may reorder the interface according to the preference level. Fig. 7 is a schematic diagram of an adjusted online shopping interface in an embodiment. The electronic device may arrange the garment in the first position or the center position of the interface, the shoe behind the garment, etc., without being limited thereto.
In this embodiment, the electronic device receives push information returned by the server, where the push information is determined by the server adjusting the push policy according to the gazing object and the preference of the user. For example, the original push policy of the server pushes application update information for any application. The server determines that the user has a higher preference for application a than application B based on the user biometric information and the server may adjust the push policy for the user. For example, the push policy of application a is to push application update information once per release of a new version. The push policy of application B is to push application update information twice for every two releases of the new version.
The information pushing method in the embodiment comprises the steps of obtaining a fixation point coordinate, determining a fixation object according to the fixation point coordinate, obtaining a millimeter wave response signal when the fixation object is fixed, determining user biological characteristic information when the fixation object is fixed according to the millimeter wave response signal, inputting the user biological characteristic information into a preference recognition model to obtain a user preference degree, extracting the biological characteristic information of a user by combining millimeter waves under the condition of fixing the fixation object, and obtaining more accurate user biological characteristic information, so that the user preference degree corresponding to the fixation object is obtained, the accuracy of determining the user preference degree is improved, and in addition, the radiation quantity to a human body is smaller and the method is safer due to the adoption of the millimeter wave mode; the method comprises the steps of sending a watching object and the corresponding user preference degree to a server, and receiving push information returned by the server, wherein the push information is determined by the server according to the watching object and the preference degree of the user, and can be pushed according to the preference degree of the user to a certain object, so that information push resources are saved, and the information push efficiency and the user experience are improved.
It should be understood that although the various steps in the flowcharts of fig. 2, 3, 4 and 6 are shown in order as indicated by the arrows, the steps are not necessarily performed in order as indicated by the arrows. The steps are not performed in the exact order shown and described, and may be performed in other orders, unless explicitly stated otherwise. Moreover, at least some of the steps in fig. 2, 3, 4, and 6 may include multiple sub-steps or multiple stages that are not necessarily performed at the same time, but may be performed at different times, and the order of performing the sub-steps or stages is not necessarily sequential, but may be performed alternately or alternatingly with other steps or at least some of the sub-steps or stages of other steps.
Fig. 8 is a block diagram illustrating a configuration of a user preference level determining apparatus according to an embodiment. As shown in fig. 8, a user preference degree determining apparatus includes a gaze point coordinate acquiring module 802, a gaze object determining module 804, a millimeter wave response signal acquiring module 806, a biometric information determining module 808, and a preference degree determining module 810, wherein:
a gazing point coordinate obtaining module 802, configured to obtain gazing point coordinates.
A gazing object determining module 804, configured to determine a gazing object according to the gazing point coordinates.
A millimeter wave response signal obtaining module 806, configured to obtain a millimeter wave response signal when gazing at the gazing object.
And a biological characteristic information determining module 808, configured to determine, according to the millimeter wave response signal, biological characteristic information of the user when gazing at the gazing object, where the biological characteristic information of the user includes thoracic vibration information and expression information of the user.
The like degree determining module 810 is configured to input the user biometric information into a like recognition model, and obtain a like degree of the user corresponding to the gazing object, where the like recognition model is trained according to the chest vibration information and the facial expression information of the user.
The user preference degree determining device in the embodiment obtains the fixation point coordinate, determines a fixation object according to the fixation point coordinate, obtains a millimeter wave response signal when the fixation object is fixed, determines user biological characteristic information when the fixation object is fixed according to the millimeter wave response signal, inputs the user biological characteristic information into the preference identification model, obtains the user preference degree, extracts the biological characteristic information of a user by combining millimeter waves under the condition of fixing the fixation object, can obtain more accurate user biological characteristic information, thereby obtaining the user preference degree corresponding to the fixation object, and improves the accuracy of determining the user preference degree.
In one embodiment, the biometric information determination module 808 is configured to determine a facial image from the millimeter wave response signal, and determine user expression information from the facial image when gazing at the gazing object.
The user preference degree determining device in the embodiment determines the face image according to the millimeter wave response signal, obtains the expression information of the user according to the face image, and is smaller in radiation amount to a human body and safer by adopting a millimeter wave mode.
In one embodiment, the biometric information determination module 808 is configured to determine, for at least two consecutive received millimeter wave response signals, a face image corresponding to the received millimeter wave response signal each time, so as to obtain at least two face images; and determining user expression change information when gazing at the gazing object according to at least two facial images.
The user preference degree determining device in this embodiment determines, for at least two received millimeter wave response signals that are continuous, a face image corresponding to the millimeter wave response signal received each time, obtains at least two face images, determines user expression change information according to the at least two face images, and can obtain more accurate user expression information, thereby improving accuracy of preference recognition.
In one embodiment, the biometric information determination module 808 is configured to obtain the transmission time of the millimeter wave transmission signal and the reception time of the corresponding millimeter wave response signal; and determining the thoracic vibration distance when the gazing object is watched according to the transmitting time and the receiving time.
The user preference degree determining device in the embodiment obtains the transmitting time of the millimeter wave transmitting signal and the receiving time of the corresponding millimeter wave response signal, determines the thoracic vibration distance according to the transmitting time and the receiving time, adopts a millimeter wave mode, has small radiant quantity to a human body, is safer, and has high precision of the thoracic vibration distance calculated by adopting the millimeter waves compared with other modes due to high measurement precision of the millimeter waves.
In one embodiment, the millimeter wave detector includes a first millimeter wave detector and a second millimeter wave detector. The biological characteristic information determining module 808 is configured to obtain a first millimeter wave response signal through the first millimeter wave detector, and determine, according to the first millimeter wave response signal, user chest vibration information when gazing at the gazing object; and acquiring a second millimeter wave response signal through a second millimeter wave detector, and determining user expression information when the gazing object is watched according to the second millimeter wave response signal.
In the device for determining the preference degree of the user in the embodiment, the millimeter wave detector comprises a first millimeter wave detector and a second millimeter wave detector, a first millimeter wave response signal is obtained through the first millimeter wave detector, and the thoracic cavity vibration information of the user when the user watches the watching object is determined according to the first millimeter wave response signal; the second millimeter wave response signal is obtained through the second millimeter wave detector, the user expression information when the user watches the watching object is determined according to the second millimeter wave response signal, the thoracic vibration information and the user expression information of the user are easily distinguished through the two millimeter wave detectors, the time for distinguishing the thoracic vibration information and the user expression information of the user is reduced, preference recognition is carried out, and the efficiency for determining the preference degree of the user is improved.
In one embodiment, the gazing object determining module 804 is configured to obtain a coordinate range of the candidate object in the interface; and determining the gazing object according to the gazing point coordinate and the coordinate range of the candidate object.
The user preference degree determining device in the embodiment obtains a coordinate range where the candidate object is located in the interface, determines the gazing object according to the gazing point coordinate and the coordinate range where the candidate object is located, and can determine the current gazing object of the user, so that the preference degree of the user on a certain specific object is determined.
In one embodiment, the user preference level determining apparatus further comprises a training module. The training module is used for acquiring user biological characteristic information and acquiring a reference label corresponding to the user biological characteristic information; inputting the biological feature information of the user into the preference identification model to obtain a target label; and adjusting parameters of the preference recognition model according to the matching degree of the reference label and the target label, and obtaining the trained preference recognition model when the iteration condition is met.
The user preference degree determining device in the embodiment acquires the biological feature information of the user, acquires the reference label corresponding to the biological feature information of the user, inputs the biological feature information of the user into the preference recognition model to obtain the target label, adjusts the parameters of the preference recognition model according to the matching degree of the reference label and the target label, obtains the trained preference recognition model when the iteration condition is met, can obtain the preference of the user through the artificial intelligence training device, and improves the accuracy of determining the preference degree of the user.
In one embodiment, the gazing point coordinate obtaining module 802 is configured to control the eyeball tracker to emit an infrared emission signal; receiving an infrared response signal generated according to the infrared emission signal; and determining the coordinates of the fixation point according to the infrared response signal.
The user preference degree determining device in the embodiment controls the eyeball tracker to emit the infrared emission signal; the infrared response signal generated according to the infrared emission signal is received, the fixation point coordinate is determined according to the infrared response signal, the current fixation point coordinate of the user can be obtained, and the accuracy of determining the preference degree of the user is improved by combining the biological characteristics of the user.
In one embodiment, an information pushing apparatus includes a gaze point coordinate acquisition module 802, a gaze object determination module 804, a millimeter wave response signal acquisition module 806, a biometric information determination module 808, a like degree determination module 810, and a pushed information acquisition module, wherein:
a gazing point coordinate obtaining module 802, configured to obtain gazing point coordinates.
A gazing object determining module 804, configured to determine a gazing object according to the gazing point coordinates.
A millimeter wave response signal obtaining module 806, configured to obtain a millimeter wave response signal when gazing at the gazing object.
And a biological characteristic information determining module 808, configured to determine, according to the millimeter wave response signal, biological characteristic information of the user when gazing at the gazing object, where the biological characteristic information of the user includes thoracic vibration information and expression information of the user.
The like degree determining module 810 is configured to input the user biometric information into a like recognition model, and obtain a like degree of the user corresponding to the gazing object, where the like recognition model is trained according to the chest vibration information and the facial expression information of the user.
The push information acquisition module is used for sending the gazing object and the corresponding user preference degree to the server; and receiving push information returned by the server, wherein the push information is determined by the server according to the gazing object and the preference degree of the user.
The information pushing device in the embodiment acquires the fixation point coordinate, determines a fixation object according to the fixation point coordinate, acquires a millimeter wave response signal when the fixation object is fixed, determines user biological characteristic information when the fixation object is fixed according to the millimeter wave response signal, inputs the user biological characteristic information into the preference recognition model to acquire the preference degree of a user, extracts the biological characteristic information of the user by combining millimeter waves under the condition of fixing the fixation object, and can acquire more accurate user biological characteristic information, thereby acquiring the preference degree of the user corresponding to the fixation object and improving the accuracy of determining the preference degree of the user; the method comprises the steps of sending a watching object and the corresponding user preference degree to a server, and receiving push information returned by the server, wherein the push information is determined by the server according to the watching object and the preference degree of the user, and can be pushed according to the preference degree of the user to a certain object, so that information push resources are saved, and the information push efficiency and the user experience are improved.
The division of the modules in the user preference degree determining apparatus is only used for illustration, and in other embodiments, the user preference degree determining apparatus may be divided into different modules as required to complete all or part of the functions of the user preference degree determining apparatus.
For the specific definition of the user preference determining device, reference may be made to the above definition of the user preference determining method, which is not described herein again. The various modules in the user preference determining apparatus described above may be implemented in whole or in part by software, hardware, and combinations thereof. The modules can be embedded in a hardware form or independent from a processor in the computer device, and can also be stored in a memory in the computer device in a software form, so that the processor can call and execute operations corresponding to the modules.
Fig. 9 is a schematic diagram of an internal structure of an electronic device in one embodiment. As shown in fig. 9, the electronic device includes a processor and a memory connected by a system bus. Wherein, the processor is used for providing calculation and control capability and supporting the operation of the whole electronic equipment. The memory may include a non-volatile storage medium and an internal memory. The non-volatile storage medium stores an operating system and a computer program. The computer program is executable by a processor for implementing a method for determining user preference level provided in the following embodiments. The internal memory provides a cached execution environment for the operating system computer programs in the non-volatile storage medium. The electronic device may be a mobile phone, a tablet computer, or a personal digital assistant or a wearable device, etc.
The respective modules in the user preference degree determining apparatus provided in the embodiments of the present application may be implemented in the form of a computer program. The computer program may be run on a terminal or a server. The program modules constituted by the computer program may be stored on the memory of the terminal or the server. Which when executed by a processor, performs the steps of the method described in the embodiments of the present application.
The embodiment of the application also provides a computer readable storage medium. One or more non-transitory computer-readable storage media containing computer-executable instructions that, when executed by one or more processors, cause the processors to perform the steps of the user preference determination method.
A computer program product comprising instructions which, when run on a computer, cause the computer to perform a method of determining user preference.
The embodiment of the application also provides a computer readable storage medium. One or more non-transitory computer-readable storage media containing computer-executable instructions that, when executed by one or more processors, cause the processors to perform the steps of the information push method.
A computer program product comprising instructions which, when run on a computer, cause the computer to perform an information push method.
Any reference to memory, storage, database, or other medium used herein may include non-volatile and/or volatile memory. Non-volatile memory can include read-only memory (ROM), Programmable ROM (PROM), Electrically Programmable ROM (EPROM), Electrically Erasable Programmable ROM (EEPROM), or flash memory. Volatile memory can include Random Access Memory (RAM), which acts as external cache memory. By way of illustration and not limitation, RAM is available in a variety of forms, such as Static RAM (SRAM), Dynamic RAM (DRAM), Synchronous DRAM (SDRAM), double data rate SDRAM (DDR SDRAM), Enhanced SDRAM (ESDRAM), synchronous Link (Synchlink) DRAM (SLDRAM), Rambus Direct RAM (RDRAM), direct bus dynamic RAM (DRDRAM), and bus dynamic RAM (RDRAM).
The above-mentioned embodiments only express several embodiments of the present application, and the description thereof is more specific and detailed, but not construed as limiting the scope of the present application. It should be noted that, for a person skilled in the art, several variations and modifications can be made without departing from the concept of the present application, which falls within the scope of protection of the present application. Therefore, the protection scope of the present patent shall be subject to the appended claims.
Claims (12)
1. A method for determining a degree of preference of a user, the method being applied to an electronic device including a millimeter wave detector for emitting a millimeter wave emission signal and receiving a millimeter wave response signal generated in response to the millimeter wave emission signal, the method comprising:
acquiring a fixation point coordinate;
determining a gazing object according to the gazing point coordinate;
acquiring a millimeter wave response signal when the gazing object is watched;
determining user biological characteristic information when the user watches the watching object according to the millimeter wave response signal, wherein the user biological characteristic information comprises user chest vibration information and user expression information;
and inputting the user biological characteristic information into a preference recognition model to obtain the user preference degree corresponding to the gazing object, wherein the preference recognition model is trained according to the user biological characteristic information.
2. The method of claim 1, wherein determining user expression information when gazing at the gazing object according to the millimeter wave response signals comprises:
determining a face image according to the millimeter wave response signal;
and determining user expression information when the gazing object is watched according to the facial image.
3. The method of claim 2, wherein determining the facial image from the millimeter wave response signal comprises:
determining a face image corresponding to the millimeter wave response signal received each time aiming at the received millimeter wave response signals which are continuously received at least twice to obtain at least two face images;
the method for acquiring the expression information of the user according to the facial image comprises the following steps
And determining user expression change information when the gazing object is watched according to at least two facial images.
4. The method of claim 1, wherein determining thorax vibration information while gazing at the gazing object from the millimeter wave response signals comprises:
acquiring the transmitting time of the millimeter wave transmitting signal and the receiving time of the corresponding millimeter wave response signal;
and determining the thoracic vibration distance when the gazing object is watched according to the transmitting time and the receiving time.
5. The method of claim 1, wherein the millimeter wave detector comprises a first millimeter wave detector and a second millimeter wave detector;
according to the millimeter wave response signal, determining user biological characteristic information when gazing the gazing object, wherein the user biological characteristic information comprises user chest vibration information and user expression information, and the method comprises the following steps:
acquiring a first millimeter wave response signal through the first millimeter wave detector, and determining user chest vibration information when the user watches the watching object according to the first millimeter wave response signal;
and acquiring a second millimeter wave response signal through the second millimeter wave detector, and determining user expression information when the gazing object is gazed according to the second millimeter wave response signal.
6. The method of claim 1, wherein determining the gaze object from the gaze point coordinates comprises:
acquiring a coordinate range of a candidate object in an interface;
and determining the gazing object according to the gazing point coordinate and the coordinate range of the candidate object.
7. The method of claim 1, wherein the training of the preference recognition model comprises:
acquiring user biological characteristic information and acquiring a reference label corresponding to the user biological characteristic information;
inputting the user biological characteristic information into a preference recognition model to obtain a target label;
and adjusting parameters of the preference recognition model according to the matching degree of the reference label and the target label, and obtaining the trained preference recognition model when an iteration condition is met.
8. The method of any one of claims 1 to 7, wherein the electronic device comprises an eye tracker;
the acquiring of the fixation point coordinate includes:
controlling the eyeball tracker to emit an infrared emission signal;
receiving an infrared response signal generated according to the infrared emission signal;
and determining the coordinates of the fixation point according to the infrared response signal.
9. An information pushing method is applied to an electronic device, wherein the electronic device comprises a millimeter wave detector, the millimeter wave detector is used for transmitting a millimeter wave transmission signal and receiving a millimeter wave response signal generated by the millimeter wave transmission signal, and the method comprises the following steps:
acquiring a fixation point coordinate;
determining a gazing object according to the gazing point coordinate;
acquiring a millimeter wave response signal when the gazing object is watched;
determining user biological characteristic information when the user watches the watching object according to the millimeter wave response signal, wherein the user biological characteristic information comprises user chest vibration information and user expression information;
inputting the user biological characteristic information into a preference recognition model to obtain a user preference degree corresponding to the gazing object, wherein the preference recognition model is trained according to the user biological characteristic information;
sending the gazing object and the corresponding user preference degree to a server;
and receiving push information returned by the server, wherein the push information is determined by the server according to the gazing object and the preference degree of the user.
10. A user preference level determining apparatus, comprising:
the fixation point coordinate acquisition module is used for acquiring fixation point coordinates;
the gazing object determining module is used for determining a gazing object according to the gazing point coordinate;
the millimeter wave response signal acquisition module is used for acquiring a millimeter wave response signal when the watching object is watched;
the biological characteristic information determining module is used for determining the biological characteristic information of the user when the user watches the watching object according to the millimeter wave response signal, wherein the biological characteristic information of the user comprises the thoracic vibration information and the expression information of the user;
and the preference degree determining module is used for inputting the biological characteristic information of the user into a preference recognition model to obtain the preference degree of the user corresponding to the gazing object, wherein the preference recognition model is formed by training according to the chest vibration information and the expression information of the user.
11. An electronic device comprising a memory and a processor, the memory having stored therein a computer program that, when executed by the processor, causes the processor to carry out the steps of the method according to any one of claims 1 to 9.
12. A computer-readable storage medium, on which a computer program is stored, which, when being executed by a processor, carries out the steps of the method according to any one of claims 1 to 9.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201911166220.0A CN111079555A (en) | 2019-11-25 | 2019-11-25 | User preference degree determining method and device, electronic equipment and readable storage medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201911166220.0A CN111079555A (en) | 2019-11-25 | 2019-11-25 | User preference degree determining method and device, electronic equipment and readable storage medium |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN111079555A true CN111079555A (en) | 2020-04-28 |
Family
ID=70311548
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201911166220.0A Pending CN111079555A (en) | 2019-11-25 | 2019-11-25 | User preference degree determining method and device, electronic equipment and readable storage medium |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN111079555A (en) |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2023280141A1 (en) * | 2021-07-09 | 2023-01-12 | 华为技术有限公司 | Method for refreshing user interface, and electronic device |
Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2016123777A1 (en) * | 2015-02-05 | 2016-08-11 | 华为技术有限公司 | Object presentation and recommendation method and device based on biological characteristic |
| CN108803866A (en) * | 2018-03-27 | 2018-11-13 | 北京七鑫易维信息技术有限公司 | The methods, devices and systems of output information |
| CN109640119A (en) * | 2019-02-21 | 2019-04-16 | 百度在线网络技术（北京）有限公司 | Method and apparatus for pushed information |
| CN109636442A (en) * | 2018-11-12 | 2019-04-16 | 咪咕文化科技有限公司 | Like the determination method, apparatus and storage medium of content |
| CN109766491A (en) * | 2018-12-18 | 2019-05-17 | 深圳壹账通智能科技有限公司 | Product search method, device, computer equipment and storage medium |
| CN109767258A (en) * | 2018-12-15 | 2019-05-17 | 深圳壹账通智能科技有限公司 | Intelligent shopping guide method and device based on eyes image identification |
-
2019
- 2019-11-25 CN CN201911166220.0A patent/CN111079555A/en active Pending
Patent Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2016123777A1 (en) * | 2015-02-05 | 2016-08-11 | 华为技术有限公司 | Object presentation and recommendation method and device based on biological characteristic |
| CN108803866A (en) * | 2018-03-27 | 2018-11-13 | 北京七鑫易维信息技术有限公司 | The methods, devices and systems of output information |
| CN109636442A (en) * | 2018-11-12 | 2019-04-16 | 咪咕文化科技有限公司 | Like the determination method, apparatus and storage medium of content |
| CN109767258A (en) * | 2018-12-15 | 2019-05-17 | 深圳壹账通智能科技有限公司 | Intelligent shopping guide method and device based on eyes image identification |
| CN109766491A (en) * | 2018-12-18 | 2019-05-17 | 深圳壹账通智能科技有限公司 | Product search method, device, computer equipment and storage medium |
| CN109640119A (en) * | 2019-02-21 | 2019-04-16 | 百度在线网络技术（北京）有限公司 | Method and apparatus for pushed information |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2023280141A1 (en) * | 2021-07-09 | 2023-01-12 | 华为技术有限公司 | Method for refreshing user interface, and electronic device |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| EP3453316B1 (en) | Eye tracking using eyeball center position | |
| US10327633B2 (en) | Computational array camera with dynamic illumination for eye tracking | |
| US9924866B2 (en) | Compact remote eye tracking system including depth sensing capacity | |
| CN107003721B (en) | Improved calibration for eye tracking systems | |
| US10845620B2 (en) | Smart contact lens | |
| JP6577454B2 (en) | On-axis gaze tracking system and method | |
| JP2019519859A (en) | System and method for performing gaze tracking | |
| US10820796B2 (en) | Pupil radius compensation | |
| EP3681371B1 (en) | Reliability of gaze tracking data for left and right eye | |
| CN109696954B (en) | Sight tracking method, device, equipment and storage medium | |
| KR101471488B1 (en) | Device and Method for Tracking Sight Line | |
| US20210319585A1 (en) | Method and system for gaze estimation | |
| US11163994B2 (en) | Method and device for determining iris recognition image, terminal apparatus, and storage medium | |
| US10722112B2 (en) | Measuring device and measuring method | |
| US10248852B2 (en) | Method for recognizing facial expression of headset wearing user and apparatus enabling the same | |
| US10867252B2 (en) | Continuous calibration based on pupil characteristics | |
| US20220060666A1 (en) | Wearable device for performing detection of events by utilizing camera module and wireless communication device | |
| JP6870474B2 (en) | Gaze detection computer program, gaze detection device and gaze detection method | |
| CN111079555A (en) | User preference degree determining method and device, electronic equipment and readable storage medium | |
| KR101619656B1 (en) | Gaze Tracking Apparatus and Method for Detecting Pupil thereof | |
| EP3683658A1 (en) | Continuous calibration based on pupil characteristics | |
| JP7228885B2 (en) | Pupil detector | |
| KR20190085604A (en) | Method, apparatus and computer program for recognition of a user activity | |
| KR20220106217A (en) | Three-dimensional (3D) modeling | |
| JP2020098474A (en) | Attribute determination device, attribute determination system, attribute determination method, program, and recording medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20200428 |
|
| RJ01 | Rejection of invention patent application after publication |