CN110058693B - Data acquisition method and device, electronic equipment and storage medium - Google Patents
Data acquisition method and device, electronic equipment and storage medium Download PDFInfo
- Publication number
- CN110058693B CN110058693B CN201910329727.7A CN201910329727A CN110058693B CN 110058693 B CN110058693 B CN 110058693B CN 201910329727 A CN201910329727 A CN 201910329727A CN 110058693 B CN110058693 B CN 110058693B
- Authority
- CN
- China
- Prior art keywords
- user
- information
- effective
- image
- electronic equipment
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/011—Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
- G06F3/013—Eye tracking input arrangements
Abstract
The application provides a data acquisition method, a data acquisition device, electronic equipment and a storage medium, wherein effective gazing information of a user, which is acquired by an eyeball tracking device, is acquired; the effective watching information is effective data of the watching information formed on a screen of the display by a user; acquiring a user image acquired by an image acquisition module; the user image at least comprises eye image information of the user; and correspondingly storing the effective gazing information and the user image of the user. Because the effective watching information obtained by the method is the effective data of the watching information formed on the display screen by the user, the user image acquisition can be carried out without watching a specific displayed target point by the user, and further the inaccuracy of the acquired user image or the watching information corresponding to the user image caused by the fact that the specific condition that the user watches the target point is not met during data acquisition is avoided, and the accuracy of the acquired eye pattern data is improved.
Description
Technical Field
The present invention relates to the field of electronic information technologies, and in particular, to a data acquisition method and apparatus, an electronic device, and a storage medium.
Background
The gaze point refers to a point of an object aligned with the eye sight line, and the gaze point of the eye needs to be estimated in the eyeball tracking technology. Currently, supervised learning algorithms are usually adopted to perform regression estimation on the fixation point. I.e. by creating an eye pattern data set comprising images of the human eye and gaze information corresponding to the images of the human eye. The data in the eye pattern data set can be used for constructing a model or a function through a supervised learning algorithm. This model or function can calculate the gaze information corresponding to the eye image from the eye image. The accuracy of the calculated gaze information depends primarily on whether the data in the eye data set is accurate.
In the prior art, data in an eye pattern data set is collected mainly by displaying a target point on a screen of a mobile device, and a user can obtain an eye image of the user by shooting the target point with a camera on the mobile device. And then, storing the eye image and the space coordinate value of the target point on the screen of the mobile equipment into an eye pattern data set, and finishing data acquisition.
However, the existing eye pattern data acquisition scheme must complete more accurate human eye image acquisition under the specific condition when the user looks at the target point. However, the existing solutions cannot determine whether the acquisition is performed under the specific condition, so that the acquired eye diagram data may be inaccurate.
Disclosure of Invention
Based on the defects of the prior art, the application provides a data acquisition method, a data acquisition device, electronic equipment and a storage medium, so as to improve the accuracy of the acquired eye pattern data.
In order to achieve the above object, the following solutions are proposed:
the invention discloses a data acquisition method, which is applied to electronic equipment, wherein the electronic equipment comprises an image acquisition module, and the data acquisition method comprises the following steps:
obtaining effective watching information of a user, which is acquired by an eyeball tracking device; wherein the valid gazing information is valid data of gazing information formed by the user on a screen of a display;
acquiring a user image acquired by an image acquisition module; the user image at least comprises eye image information of a user;
and correspondingly storing the effective gazing information of the user and the user image.
Optionally, the criteria for valid gaze information formed by the user on the screen of the display comprises:
the time that the user's gaze falls on some identification on the screen of the display exceeds a threshold.
Optionally, after obtaining the effective gazing information of the user collected by the eyeball tracking device, the method further includes:
converting the effective watching information into effective watching information of the electronic equipment according to the mapping relation between the electronic equipment and the display;
and storing the effective gazing information of the electronic equipment as the effective gazing information of the user.
Optionally, the correspondingly storing the effective gazing information of the user and the user image includes:
correspondingly storing the effective gazing information of the user and the user image in the local electronic equipment;
or uploading the effective gazing information of the user and the user image to a server, and correspondingly storing the effective gazing information of the user and the user image by the server.
The second aspect of the present invention discloses a data acquisition apparatus comprising:
the first acquisition unit is used for acquiring effective gazing information of the user, which is acquired by the eyeball tracking device; wherein the valid gazing information is valid data of gazing information formed by the user on a screen of a display;
the second acquisition unit is used for acquiring the user image acquired by the image acquisition module; wherein the user image at least comprises eye image information of the user;
and the storage unit is used for correspondingly storing the effective gazing information of the user and the user image.
Optionally, the data acquisition apparatus further comprises:
the conversion unit is used for converting the effective gazing information into the effective gazing information of the electronic equipment according to the mapping relation between the electronic equipment and the display;
and storing the effective gazing information of the electronic equipment as the effective gazing information of the user.
Optionally, the storage unit includes: the storage subunit is used for correspondingly storing the effective gazing information of the user and the user image in the local electronic equipment;
alternatively, the storage unit includes: and the sending unit is used for uploading the effective gazing information of the user and the user image to a server, and the server correspondingly stores the effective gazing information of the user and the user image.
A third aspect of the present invention discloses an electronic device, comprising:
the image acquisition module is used for acquiring a user image; the user image at least comprises eye image information of a user;
the control module is used for acquiring effective gazing information of a user, which is acquired by the eyeball tracking device, acquiring a user image, which is acquired by the image acquisition module, and correspondingly storing the effective gazing information of the user and the user image; wherein the valid gazing information is valid data of gazing information formed by the user on a screen of a display.
Optionally, after obtaining the valid gazing information of the user collected by the eyeball tracking device, the control module is further configured to: converting the effective watching information into effective watching information of the electronic equipment according to the mapping relation between the electronic equipment and the display;
and storing the effective gazing information of the electronic equipment as the effective gazing information of the user.
The fourth aspect of the present invention discloses a storage medium, where the storage medium includes stored instructions, and when the instructions are executed, the device where the storage medium is located is controlled to execute any of the data acquisition methods disclosed in the first aspect.
According to the technical scheme, the data acquisition method is applied to the electronic equipment, and the user image acquired by the image acquisition module is acquired by acquiring the effective gazing information of the user acquired by the eyeball tracking device. And finally, correspondingly storing the effective gazing information of the user and the user image. The effective watching information is effective data of the watching information formed on the display screen by the user; the user image at least comprises the eye image information of the user. Because the effective watching information obtained by the method is the effective data of the watching information formed on the display screen by the user, the user image acquisition can be carried out without watching a specific displayed target point by the user, and further the inaccuracy of the acquired user image or the watching data corresponding to the user image caused by the fact that the specific condition that the user watches the target point is not met during data acquisition is avoided, and the accuracy of the acquired eye pattern data is improved.
Drawings
In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the drawings used in the embodiments or the prior art descriptions will be briefly described below, it is obvious that the drawings in the following description are only embodiments of the present invention, and for those skilled in the art, other drawings can be obtained according to the provided drawings without creative efforts.
Fig. 1 is a schematic physical diagram of a data acquisition system according to an embodiment of the present invention;
fig. 2 is a schematic structural diagram of an electronic device according to an embodiment of the disclosure;
FIG. 3 is a schematic flow chart of a data acquisition method according to an embodiment of the present invention;
fig. 4 is a schematic flowchart illustrating a method for acquiring effective gazing information of a user by an eyeball tracking apparatus according to an embodiment of the present disclosure;
fig. 5 is a schematic structural diagram of a data acquisition device according to an embodiment of the present invention.
Detailed Description
The technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the drawings in the embodiments of the present invention, and it is obvious that the described embodiments are only a part of the embodiments of the present invention, and not all of the embodiments. All other embodiments, which can be obtained by a person skilled in the art without making any creative effort based on the embodiments in the present invention, belong to the protection scope of the present invention.
In one embodiment of the present application, referring to fig. 1, the display 101, the electronic device 102, and the eye tracking apparatus 103 form a system that cooperate to perform a data acquisition method.
The display 101 is used to provide a display screen, the electronic device 102 can be placed on the display screen of the display 101, the screen of the electronic device 102 can play video information, and the user's sight line falls on the display screen of the display 101 or the screen of the electronic device 102. The eyeball tracking device 103 is used for tracking the eyeballs of the user and collecting the gazing information of the eyeballs of the user.
As shown in fig. 2, the electronic device 102 mainly includes: the image acquisition module 201 can acquire user images, and the control module 202 is mainly in communication with the eyeball tracking device 103 and completes a data acquisition method.
The electronic device can be a mobile device with a communication function, such as a mobile phone and a tablet computer.
Basically, the system disclosed in the above embodiment and the data acquisition method disclosed in another embodiment of the present application are shown in fig. 3, and include:
s301, the eyeball tracking device collects effective gazing information of the user.
Wherein the valid gazing information is valid data of gazing information formed on a screen of the display by a user. Specifically, the eye tracking device collects coordinate information of an effective gaze point at which the user's gaze falls on the screen of the display. The coordinate information may be a coordinate value of the effective gaze point on the screen of the display, or may be a vector value of the effective gaze point on the screen of the display, or the like.
It should be noted that, since the electronic device is placed on the screen of the display, when the user looks at a certain point on the screen of the electronic device, the line of sight of the user falls on both the screen of the display and the screen of the electronic device. The eyeball tracking apparatus collects valid data of the gaze information formed on the screen of the display by the user instead of the valid data of the gaze information formed on the screen of the electronic device when step S301 is executed.
Optionally, referring to fig. 4, in an embodiment of the present application, an implementation manner of step S301 includes:
s401, the eyeball tracking device collects the gazing information of the user in real time.
Because the eyeball tracking device has the eyeball tracking technology, when the sight of a user falls on a display screen of the display, the eyeball tracking device can acquire the gazing information of the user in real time. Wherein, the gaze information of the user refers to gaze information of which the user's sight line falls on the screen of the display.
Optionally, in a specific embodiment of the present application, an implementation manner of step S401 includes: the eyeball tracking device collects the coordinate information of light spots formed by the reflection of the pupil cornea of a user in real time.
Specifically, when a user gazes at a screen of a display or a screen of an electronic device, a pupil cornea of the user is reflected to the screen of the display to form a light spot, and the eyeball tracking device can acquire coordinate information of the light spot through a pupil cornea reflection technology, so that the gazing information of the user can be acquired in real time. The coordinate information can be a vector value or a coordinate value, and the coordinate information only needs to reflect the position information of the light spot.
Optionally, in another specific embodiment of the present application, another implementation manner of step S401 includes:
the eyeball tracking device calculates coordinate information of the three-dimensional sight line starting from the position of the eyes of the user and falling on a screen of a display according to the position of the eyes of the user and the three-dimensional sight line direction of the eyes of the user.
Because the eyeball tracking device calculates the coordinate information according to the eye position of the user and the three-dimensional sight, the user can obtain the gazing information only by forming an intersection point between the sight and the screen of the display or the screen of the electronic equipment.
S402, judging whether a user forms effective watching information on a screen of a display by the eyeball tracking device; wherein the criteria for effective gazing information formed by the user on the screen of the display comprises:
the time that the user's gaze falls on some identification on the screen of the display exceeds a threshold.
The gaze information obtained after performing step S401 may be valid gaze information or invalid gaze information. And the collected invalid gazing information may not be accurate enough and the accuracy rate is not high.
It should be noted that a certain mark where the user's sight line falls on the screen of the display is an intersection point formed by the user's sight line and the screen of the display, and may be any point on the screen of the display, and does not have a specific meaning. The user pays attention to a certain mark and obtains the information of the mark, and the mark is effectively watched by eyes, namely, after the time that the fovea of the eyes of the user aligns at the mark on an object exceeds a threshold value, the watched object can be imaged on the fovea of the eyes of the user, so that effective watching is formed, and the watching information collected by the eyeball tracking device meets an effective standard.
In general, to create a valid gaze, the time for a user to look at a certain mark on the screen of the display takes more than 100 milliseconds. In practical applications, this threshold value can be set according to practical needs. If it is quicker to need to gather effective gaze information, then the threshold setting can be smaller, if it is more accurate to need to gather effective gaze information, then the threshold setting can be larger.
If the eyeball tracking device judges that the user forms effective gazing information on the screen of the display, step S403 is executed, and if the eyeball tracking device judges that the user does not form effective gazing information on the screen of the display, the process returns to execute the eyeball tracking device to collect the gazing information of the user in real time, namely, the process returns to execute step S401.
S403, the eye tracking apparatus determines the gaze information of the user as valid gaze information.
If it is determined that the user forms valid gazing information on the screen of the display when the step S402 is executed, the gazing information of the user is determined to be valid gazing information. When the gazing information of the user meets the effective standard of the gazing information, the accuracy rate of the gazing information collected by the eyeball tracking device is higher. Since the gaze information collected when step S301 is performed is valid gaze information, the accuracy of the collected eye diagram data is also improved.
In step S301, the eyeball tracking apparatus is used to collect the effective gazing information of the user. In the prior art, a screen of the device generates a target point, a user looks at the target point in a matching manner, and the coordinate value of the target point is used as effective data of a gaze point for processing. However, the related art scheme lacks a specific condition for determining whether the user gazes at the target point, and thus the coordinate values of the target point are not necessarily valid gaze information.
According to the method and the device, when the step S301 is executed, the eyeball tracking device collects the effective data of the watching information formed on the screen of the display by the user instead of watching the target point which is displayed specifically, so that the inaccuracy of the collected data caused by the fact that the user watches the target point is not met during data collection is avoided, and the accuracy of the collected eye diagram data is improved.
S302, the electronic equipment acquires the effective gazing information of the user, which is acquired by the eyeball tracking device.
It should be noted that the effective gazing information of the user collected by the eyeball tracking device is obtained by a control module in the electronic device. Because the control module in the electronic device can establish communication connection with the eyeball tracking device, the eyeball tracking device can send the collected effective gazing information of the user to the control module of the electronic device. The electronic device stores the valid gaze information of the user.
Optionally, in another embodiment of the present application, after performing step S302, the data acquisition method may further include:
and the electronic equipment converts the effective gazing information into the effective gazing information of the electronic equipment according to the mapping relation between the electronic equipment and the display.
Wherein the valid gazing information of the electronic device is stored as valid gazing information of the user.
When the eyeball tracking apparatus executes step S301, the effective gazing information of the user in the coordinate system established by the screen of the display can be given, wherein the effective gazing information of the user is the coordinate information of the gazing point formed by the user on the screen of the display. For example, the upper left corner of the screen of the display may be used as the origin of the local coordinate system of the screen of the display, and the eyeball tracking device may obtain the coordinate value of the gaze point p formed on the screen of the display by the user relative to the origin of the upper left corner of the screen of the display
If the electronic device is fixedly placed on the screen of the display, the mapping relation [ R, t ] of the user's gaze point p in the coordinate system of the screen of the display under the coordinate system of the screen of the electronic device can be determined]. Therefore, the coordinate value of the user's gaze point p with respect to the origin of the upper left corner of the display screen
Can be converted into the coordinate value under the screen of the electronic device according to the mapping relation
The concrete formula is as follows:
the position of the gazing point on the screen of the electronic device or the screen of the display is not necessarily represented by coordinate values, and may be represented by polar coordinates, vectors, and the like, as long as the positional relationship of the gazing point can be represented.
It should be noted that the step of converting the valid gaze information into valid gaze information of the electronic device is performed by a control module in the electronic device. The screen of the electronic equipment and the screen of the display have a certain mapping relation. This mapping relationship means that, since the electronic device is placed on the screen of the display, the gaze point formed on the electronic device by the user can be mapped onto the screen of the display. It should be noted that the position relationship between the electronic device and the display may be that the electronic device is placed on the display, or the electronic device is placed parallel to the screen of the display without contacting the display, as long as the intersection point formed by the line of sight of the user and the electronic device can be mapped onto the screen of the display.
It should be noted that, the reason why the effective gazing information on the display screen is converted into the effective gazing information on the electronic device is that the electronic device has an image capturing module therein, and the image of the user is captured by the image capturing module in the electronic device, so that the effective gazing information on the display screen needs to be converted into gazing information corresponding to the captured image of the user, that is, into the effective gazing information of the electronic device.
In practical applications, the eyeball tracking apparatus does not include an image capturing module, and therefore, it is necessary to perform a data capturing method in cooperation with an electronic device having the image capturing module. When the user browses the content on the screen of the electronic device, the behavior of the user browsing the information can be reflected according to the converted effective watching information of the electronic device, for example, the user pays more attention to the content of which part on the screen of the electronic device.
It should be noted that, after step S302 is executed, the effective gazing information may not be converted into the effective gazing information of the electronic device, and when the image of the user and the corresponding effective gazing information need to be used, the conversion may be performed according to the mapping relationship between the electronic device and the display.
Optionally, the effective gazing information of the sight line falling on the electronic device may be obtained by the electronic device according to the user's eyes and the three-dimensional sight line of the user's eyes without the mapping relationship between the electronic device and the display.
S303, an image acquisition module of the electronic equipment acquires a user image.
It should be noted that the user image at least includes the user eye image information, so as to obtain or fit the user eye image from the acquired user image.
Alternatively, the image acquisition module of the electronic device may directly acquire the eye image of the user without further fitting or extracting the eye image information of the user. The image acquisition module can be a camera and is used for shooting images of users.
It should be noted that the user image captured by the image capturing module of the electronic device when step S303 is executed is the user image corresponding to the effective gazing information formed by the screen of the display in step S302. When a user gazes at a certain mark and effective watching is formed, the eyeball tracking device executes the step S301 to collect effective gazing information when the user gazes at the mark, after the electronic equipment acquires the effective gazing information, the image collection module of the electronic equipment collects a user image when the user gazes at the mark, and the user image and the effective gazing information have a corresponding relation.
S304, the electronic equipment acquires the user image acquired by the image acquisition module.
The control module in the electronic equipment acquires the user image acquired by the image acquisition module. The control module in the electronic equipment is in communication connection with the image acquisition module, and the user image acquired by the image acquisition module is transmitted to the control module.
S305, the electronic device correspondingly stores the effective gazing information of the user and the user image.
It should be noted that, if the step of converting the valid gaze information into the valid gaze information of the electronic device according to the mapping relationship between the electronic device and the display is not executed by the electronic device after the step S302 is executed, the stored valid gaze information of the user is the valid gaze information formed on the screen of the display when the step S305 is executed, and if the step of converting the valid gaze information into the valid gaze information of the electronic device according to the mapping relationship between the electronic device and the display is executed by the electronic device after the step S302 is executed, the stored valid gaze information of the user is the valid gaze information of the electronic device when the step S305 is executed.
Optionally, in a specific embodiment of the present application, an implementation manner of performing step S305 includes:
correspondingly storing the effective gazing information of the user and the user image in the local electronic equipment; or uploading the effective gazing information and the user image of the user to the server, and correspondingly storing the effective gazing information and the user image of the user by the server.
The user image at least comprises eye image information of the user. The electronic device may store valid gaze information and user images of the user locally to the electronic device. The control module in the electronic equipment can also be used for establishing communication connection with the server, uploading the effective gazing information of the user and the image of the user to the server, and correspondingly storing the effective gazing information and the image of the user by the server. Wherein the correspondingly stored valid gaze information and the user image may all be concentrated in an eye data set, which may be stored locally or in a server of the electronic device. The data in the eye pattern data set can be used for constructing a model or a function through a supervised learning algorithm. This model or function may calculate gaze information corresponding to the user image from the user image.
According to the data acquisition method, for the electronic equipment, the effective watching information of the user acquired by the eyeball tracking device is acquired, and then the user image acquired by the image acquisition module is acquired. And finally, correspondingly storing the effective gazing information of the user and the user image. The effective watching information is effective data of the watching information formed on the display screen by the user; the user image at least comprises the eye image information of the user. Because the effective watching information acquired by the method is the effective data of the watching information formed by the user on the display screen, the user image acquisition can be carried out without watching a specific displayed target point by the user, and further, the inaccuracy of the acquired user image or the watching data corresponding to the user image caused by the fact that the user does not watch the specific condition of the target point when the data is acquired is avoided, and the accuracy of the acquired eye pattern data is improved.
Based on the data acquisition method disclosed by the embodiment of the application, the embodiment of the application also correspondingly discloses a data acquisition device. Referring to fig. 5, the data acquisition apparatus mainly includes: a first acquisition unit 501, a second acquisition unit 502, and a storage unit 503.
A first obtaining unit 501, configured to obtain effective gazing information of a user, which is collected by an eyeball tracking device. Wherein the effective watching information is effective data of the watching information formed on the screen of the display by the user.
A second obtaining unit 502, configured to obtain the user image collected by the image collecting module. The user image at least comprises eye image information of the user.
A storage unit 503 for correspondingly storing the effective gazing information of the user and the user image.
Optionally, in a specific embodiment of the present application, the storage unit 503 includes:
and the storage subunit is used for correspondingly storing the effective gazing information of the user and the user image in the local electronic equipment.
Alternatively, the storage unit 503 includes: and the sending unit is used for uploading the effective gazing information and the user image of the user to the server, and the server correspondingly stores the effective gazing information and the user image of the user.
Optionally, in a specific embodiment of the present application, the data acquisition device may further include:
and the conversion unit is used for converting the effective watching information into the effective watching information of the electronic equipment according to the mapping relation between the electronic equipment and the display. Wherein the valid gazing information of the electronic device is stored as valid gazing information of the user.
The specific principle and the implementation process of each unit in the data acquisition device disclosed in the above embodiment of the present invention are the same as those of the data acquisition method disclosed in the above embodiment of the present invention, and reference may be made to the corresponding parts in the data acquisition method disclosed in the above embodiment of the present invention, which are not described herein again.
In the data acquisition device provided by the application, the first acquisition unit 501 is used for acquiring the effective gazing information of the user acquired by the eyeball tracking device, and the second acquisition unit 502 is used for acquiring the user image acquired by the image acquisition module. Finally, the storage unit 503 correspondingly stores the effective gazing information of the user and the user image. The effective watching information is effective data of the watching information formed on the display screen by the user; the user image at least comprises the eye image information of the user. In the application, the effective gazing information acquired by the first acquiring unit 501 is effective data of the gazing information formed by the user on the display screen, so that the user image acquisition can be performed without watching a specific displayed target point by the user, further, the inaccuracy of the acquired user image or the gazing data corresponding to the user image caused by the fact that the specific condition that the user gazes the target point is not met during data acquisition is avoided, and the accuracy of the acquired eye pattern data is improved.
Referring to fig. 2, the present application discloses an electronic device, mainly comprising: an image acquisition module 201 and a control module 202.
The image capturing module 201 is used for capturing a user image. The user image at least comprises eye image information of the user.
The control module 202 is configured to obtain effective gazing information of the user collected by the eyeball tracking device, obtain a user image collected by the image collection module, and store the effective gazing information of the user and the user image correspondingly. Wherein the effective watching information is effective data of the watching information formed on the screen of the display by the user.
Optionally, in an embodiment of the present application, after obtaining the valid gazing information of the user collected by the eye tracking apparatus, the control module 202 is further configured to: and converting the effective gazing information into the effective gazing information of the electronic equipment according to the mapping relation between the electronic equipment and the display.
Wherein the valid gazing information of the electronic device is stored as valid gazing information of the user.
It should be noted that the specific implementation principle and process of the control module 202 are the same as those of the data acquisition method shown in the above embodiment. The control module 202 is mainly in communication with the eyeball tracking device and completes the data acquisition method shown in the above embodiment, and the specific execution principle and process of the control module 202 may refer to the corresponding parts in the data acquisition method shown in the above embodiment, which are not described herein again.
The embodiment of the application also discloses a storage medium, wherein the storage medium comprises a stored instruction, and when the instruction runs, the device where the storage medium is located is controlled to execute the data acquisition method shown in the embodiment. The device where the storage medium is located is an electronic device, and the electronic device may be a mobile device such as a mobile phone and a tablet computer. Furthermore, the present application may take the form of a computer program product embodied on one or more computer-usable storage media (including, but not limited to, disk storage, CD-ROM, optical storage, and the like) having computer-usable program code embodied therein.
Those skilled in the art will be able to make and use the invention. Various modifications to these embodiments will be readily apparent to those skilled in the art, and the generic principles defined herein may be applied to other embodiments without departing from the spirit or scope of the invention. Thus, the present invention is not intended to be limited to the embodiments shown herein but is to be accorded the widest scope consistent with the principles and novel features disclosed herein.
It is further noted that, herein, relational terms such as first and second, and the like may be used solely to distinguish one entity or action from another entity or action without necessarily requiring or implying any actual such relationship or order between such entities or actions. Also, the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or apparatus. Without further limitation, an element defined by the phrase "comprising an … …" does not exclude the presence of other identical elements in a process, method, article, or apparatus that comprises the element.
Claims (10)
1. A data acquisition method is applied to electronic equipment, and the electronic equipment comprises an image acquisition module, wherein the data acquisition method comprises the following steps:
acquiring effective gazing information of a user, which is acquired by an eyeball tracking device; wherein the effective gazing information is effective data of gazing information formed by the user on a screen of a display; the gaze information characterizes information that the user's gaze falls on a display screen;
acquiring a user image acquired by an image acquisition module; the user image at least comprises eye image information of a user;
and correspondingly storing the effective gazing information of the user and the user image.
2. The data collection method of claim 1, wherein the criteria for valid gaze information formed by the user on the screen of the display comprises:
the time that the user's gaze falls on some identification on the screen of the display exceeds a threshold.
3. The data collection method according to claim 1, further comprising, after obtaining the effective gaze information of the user collected by the eye tracking device:
converting the effective gazing information into effective gazing information of the electronic equipment according to the mapping relation between the electronic equipment and the display;
and storing the effective gazing information of the electronic equipment as the effective gazing information of the user.
4. The data acquisition method according to any one of claims 1 to 3, wherein the correspondingly storing the effective gaze information of the user and the user image comprises:
correspondingly storing the effective gazing information of the user and the user image in the local electronic equipment;
or uploading the effective gazing information of the user and the user image to a server, and correspondingly storing the effective gazing information of the user and the user image by the server.
5. A data acquisition device is applied to electronic equipment, wherein the electronic equipment comprises an image acquisition module, and the data acquisition device comprises:
the first acquisition unit is used for acquiring effective gazing information of the user, which is acquired by the eyeball tracking device; wherein the effective gazing information is effective data of gazing information formed by the user on a screen of a display; the gaze information characterizes information that the user's gaze falls on a display screen;
the second acquisition unit is used for acquiring the user image acquired by the image acquisition module; wherein the user image at least comprises eye image information of the user;
and the storage unit is used for correspondingly storing the effective gazing information of the user and the user image.
6. The data acquisition device of claim 5, further comprising:
the conversion unit is used for converting the effective watching information into the effective watching information of the electronic equipment according to the mapping relation between the electronic equipment and the display;
and storing the effective gazing information of the electronic equipment as the effective gazing information of the user.
7. The data acquisition device according to claim 5 or 6, wherein the storage unit comprises: the storage subunit is used for correspondingly storing the effective gazing information of the user and the user image in the local electronic equipment;
alternatively, the storage unit includes: and the sending unit is used for uploading the effective gazing information of the user and the user image to a server, and the server correspondingly stores the effective gazing information of the user and the user image.
8. An electronic device, comprising:
the image acquisition module is used for acquiring a user image; the user image at least comprises eye image information of a user;
the control module is used for acquiring the effective gazing information of the user acquired by the eyeball tracking device, acquiring the user image acquired by the image acquisition module, and correspondingly storing the effective gazing information of the user and the user image; wherein the valid gazing information is valid data of gazing information formed by the user on a screen of a display.
9. The electronic device of claim 8, wherein the control module, after obtaining the valid gaze information of the user collected by the eye tracking apparatus, is further configured to: converting the effective watching information into effective watching information of the electronic equipment according to the mapping relation between the electronic equipment and the display;
and storing the effective gazing information of the electronic equipment as the effective gazing information of the user.
10. A storage medium comprising stored instructions, wherein the instructions, when executed, control a device on which the storage medium resides to perform a data acquisition method as claimed in any one of claims 1 to 4.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910329727.7A CN110058693B (en) | 2019-04-23 | 2019-04-23 | Data acquisition method and device, electronic equipment and storage medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910329727.7A CN110058693B (en) | 2019-04-23 | 2019-04-23 | Data acquisition method and device, electronic equipment and storage medium |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN110058693A CN110058693A (en) | 2019-07-26 |
| CN110058693B true CN110058693B (en) | 2022-07-15 |
Family
ID=67320350
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201910329727.7A Active CN110058693B (en) | 2019-04-23 | 2019-04-23 | Data acquisition method and device, electronic equipment and storage medium |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN110058693B (en) |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN106709398A (en) * | 2015-07-29 | 2017-05-24 | 财团法人资讯工业策进会 | Gaze analysis method and device |
| CN107533634A (en) * | 2015-03-23 | 2018-01-02 | 控制辐射系统有限公司 | Eyes tracking system |
| US10082865B1 (en) * | 2015-09-29 | 2018-09-25 | Rockwell Collins, Inc. | Dynamic distortion mapping in a worn display |
| KR20190030140A (en) * | 2017-09-13 | 2019-03-21 | 주식회사 비주얼캠프 | Method for eye-tracking and user terminal for executing the same |
| CN109522789A (en) * | 2018-09-30 | 2019-03-26 | 北京七鑫易维信息技术有限公司 | Eyeball tracking method, apparatus and system applied to terminal device |
Family Cites Families (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US10310597B2 (en) * | 2013-09-03 | 2019-06-04 | Tobii Ab | Portable eye tracking device |
| EP4123425A1 (en) * | 2017-05-31 | 2023-01-25 | Magic Leap, Inc. | Eye tracking calibration techniques |
-
2019
- 2019-04-23 CN CN201910329727.7A patent/CN110058693B/en active Active
Patent Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN107533634A (en) * | 2015-03-23 | 2018-01-02 | 控制辐射系统有限公司 | Eyes tracking system |
| CN106709398A (en) * | 2015-07-29 | 2017-05-24 | 财团法人资讯工业策进会 | Gaze analysis method and device |
| US10082865B1 (en) * | 2015-09-29 | 2018-09-25 | Rockwell Collins, Inc. | Dynamic distortion mapping in a worn display |
| KR20190030140A (en) * | 2017-09-13 | 2019-03-21 | 주식회사 비주얼캠프 | Method for eye-tracking and user terminal for executing the same |
| CN109522789A (en) * | 2018-09-30 | 2019-03-26 | 北京七鑫易维信息技术有限公司 | Eyeball tracking method, apparatus and system applied to terminal device |
Also Published As
| Publication number | Publication date |
|---|---|
| CN110058693A (en) | 2019-07-26 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN108919958B (en) | Image transmission method and device, terminal equipment and storage medium | |
| KR101868597B1 (en) | Apparatus and method for assisting in positioning user`s posture | |
| CN108681399B (en) | Equipment control method, device, control equipment and storage medium | |
| CN108334191B (en) | Method and device for determining fixation point based on eye movement analysis equipment | |
| CN109343700B (en) | Eye movement control calibration data acquisition method and device | |
| EP2991027B1 (en) | Image processing program, image processing method and information terminal | |
| CN110780742B (en) | Eyeball tracking processing method and related device | |
| WO2020020022A1 (en) | Method for visual recognition and system thereof | |
| US10146306B2 (en) | Gaze position detection apparatus and gaze position detection method | |
| CN112666705A (en) | Eye movement tracking device and eye movement tracking method | |
| CN105068646A (en) | Terminal control method and system | |
| US9619707B2 (en) | Gaze position estimation system, control method for gaze position estimation system, gaze position estimation device, control method for gaze position estimation device, program, and information storage medium | |
| CN110546596A (en) | Sight tracking method and terminal for executing same | |
| CN112987910A (en) | Testing method, device, equipment and storage medium of eyeball tracking equipment | |
| CN110058693B (en) | Data acquisition method and device, electronic equipment and storage medium | |
| JPWO2018220963A1 (en) | Information processing apparatus, information processing method, and program | |
| CN110262663B (en) | Schedule generation method based on eyeball tracking technology and related product | |
| CN112651270A (en) | Gaze information determination method and apparatus, terminal device and display object | |
| CN113093907B (en) | Man-machine interaction method, system, equipment and storage medium | |
| CN113132642B (en) | Image display method and device and electronic equipment | |
| CN114740966A (en) | Multi-modal image display control method and system and computer equipment | |
| CN110377158B (en) | Eyeball tracking calibration method based on variable field range and electronic equipment | |
| CN113342157A (en) | Eyeball tracking processing method and related device | |
| CN111610886A (en) | Method and device for adjusting brightness of touch screen and computer readable storage medium | |
| CN113491502A (en) | Eyeball tracking calibration inspection method, device, equipment and storage medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |