CN110262663B - Schedule generation method based on eyeball tracking technology and related product - Google Patents

Schedule generation method based on eyeball tracking technology and related product Download PDF

Info

Publication number
CN110262663B
CN110262663B CN201910538691.3A CN201910538691A CN110262663B CN 110262663 B CN110262663 B CN 110262663B CN 201910538691 A CN201910538691 A CN 201910538691A CN 110262663 B CN110262663 B CN 110262663B
Authority
CN
China
Prior art keywords
schedule
information
screen
gazing
frequency
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN201910538691.3A
Other languages
Chinese (zh)
Other versions
CN110262663A (en
Inventor
韩世广
方攀
陈岩
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Guangdong Oppo Mobile Telecommunications Corp Ltd
Original Assignee
Guangdong Oppo Mobile Telecommunications Corp Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Guangdong Oppo Mobile Telecommunications Corp Ltd filed Critical Guangdong Oppo Mobile Telecommunications Corp Ltd
Priority to CN201910538691.3A priority Critical patent/CN110262663B/en
Publication of CN110262663A publication Critical patent/CN110262663A/en
Application granted granted Critical
Publication of CN110262663B publication Critical patent/CN110262663B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/90Details of database functions independent of the retrieved data types
    • G06F16/95Retrieval from the web
    • G06F16/953Querying, e.g. by the use of web search engines
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/011Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
    • G06F3/013Eye tracking input arrangements
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06QINFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
    • G06Q10/00Administration; Management
    • G06Q10/10Office automation; Time management
    • G06Q10/109Time management, e.g. calendars, reminders, meetings or time accounting

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Business, Economics & Management (AREA)
  • Physics & Mathematics (AREA)
  • Human Resources & Organizations (AREA)
  • Databases & Information Systems (AREA)
  • General Engineering & Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Data Mining & Analysis (AREA)
  • Entrepreneurship & Innovation (AREA)
  • Strategic Management (AREA)
  • Operations Research (AREA)
  • General Business, Economics & Management (AREA)
  • Tourism & Hospitality (AREA)
  • Quality & Reliability (AREA)
  • Marketing (AREA)
  • Human Computer Interaction (AREA)
  • Economics (AREA)
  • User Interface Of Digital Computer (AREA)

Abstract

The embodiment of the application discloses a schedule generation method based on an eyeball tracking technology and a related product. The method and the device effectively avoid the condition that the user forgets to browse the schedule related to the content after browsing and misses the schedule, optimize the existing schedule generation method, generate the schedule based on the eyeball tracking technology, and are beneficial to improving the use experience of the user in the schedule generation aspect.

Description

Schedule generation method based on eyeball tracking technology and related product
Technical Field
The application relates to the technical field of electronic equipment, in particular to a schedule generation method based on an eyeball tracking technology and a related product.
Background
The eye tracking technology can be used to detect eye movements (e.g., gazing time, sequence of gazing points, pupil size, etc.) of the viewer to track the gazing target of the viewer; nowadays, the wide application of the eyeball tracking technology makes people live more conveniently, and the eyeball tracking technology has the advantages of low implementation cost, convenient use, high sight line tracking precision and the like
With the rapid development of the mobile internet technology, the contact between people becomes more compact, people face a large amount of information every day, and deal with a large amount of affairs, so that the schedule arrangement of the people becomes more and more complicated, people often think of a thing when browsing the content, but still browse the content and forget the thing, so that the related schedule of the affairs is missed, and the existing schedule generation method is very inconvenient.
Disclosure of Invention
The embodiment of the application provides a schedule generation method based on an eyeball tracking technology and a related product, so that the schedule generation efficiency and convenience based on the eyeball tracking technology are improved.
In a first aspect, an embodiment of the present application provides a schedule generation method based on an eyeball tracking technology, which is applied to an electronic device; the method comprises the following steps:
detecting a high-frequency watching area of human eyes relative to a screen when the screen is detected to be in an unlocked state;
determining a schedule to be displayed according to the high-frequency watching area to generate inquiry information;
popping up a query window in the screen to display the schedule generation query information;
and executing schedule generation operation according to the control operation aiming at the inquiry window.
In a second aspect, an embodiment of the present application provides a schedule generating apparatus based on an eye tracking technology, which is applied to an electronic device; the schedule generation device based on the eyeball tracking technology comprises a processing unit and a communication unit, wherein,
the processing unit is used for detecting a high-frequency gazing area of human eyes relative to the screen through the eyeball tracking module when the screen is detected to be in an unlocked state; the high-frequency watching area is used for determining a schedule to be displayed according to the high-frequency watching area to generate inquiry information; and a query window pops up in the screen to display the schedule generation query information; and executing schedule generation operation according to the control operation aiming at the inquiry window.
In a third aspect, an embodiment of the present application provides an electronic device, including a processor, a memory, a communication interface, and one or more programs, where the one or more programs are stored in the memory and configured to be executed by the processor, and the program includes instructions for executing steps in any method of the first aspect of the embodiment of the present application.
In a fourth aspect, the present application provides a computer-readable storage medium, where the computer-readable storage medium stores a computer program for electronic data exchange, where the computer program makes a computer perform part or all of the steps described in any one of the methods in the second aspect of the present application.
In a fifth aspect, the present application provides a computer program product, wherein the computer program product includes a non-transitory computer-readable storage medium storing a computer program, and the computer program is operable to cause a computer to perform some or all of the steps described in any one of the methods of the second aspect of the present application. The computer program product may be a software installation package.
It can be seen that in the embodiment of the present application, a schedule generation method based on an eyeball tracking technology and a related product are provided, where an electronic device starts to detect a high-frequency gazing area of human eyes relative to a screen when detecting that the screen is in an unlocked state, determines schedule generation inquiry information to be displayed according to the detected high-frequency gazing area, then pops out an inquiry window in the screen to display the schedule generation inquiry information, and the electronic device executes a schedule generation operation according to a control operation for the inquiry window. Therefore, when the unlocking of the screen is detected, a high-frequency watching area focused by eyeballs of a user is determined through an eyeball tracking technology, a schedule generation inquiry window is popped up, relevant schedule information is generated according to feedback of the user aiming at the inquiry information, and schedule prompt is carried out on the user in a corresponding time period, so that the condition that the user forgets to browse the schedule related to the content after browsing and misses the schedule is effectively avoided, the schedule is favorably and timely processed by the user, the existing schedule generation method is optimized, the schedule generation is carried out based on the eyeball tracking technology, and the use experience of the user in the schedule generation aspect is favorably improved.
Drawings
In order to more clearly illustrate the embodiments of the present application or the technical solutions in the prior art, the drawings used in the description of the embodiments or the prior art will be briefly described below, it is obvious that the drawings in the following description are only some embodiments of the present application, and for those skilled in the art, other drawings can be obtained according to the drawings without creative efforts.
Fig. 1A is a schematic flowchart of a schedule generation method based on an eye tracking technology according to an embodiment of the present disclosure;
FIG. 1B is a schematic diagram of detecting a high-frequency gaze region of a human eye relative to the screen according to an embodiment of the present application;
fig. 2 is a schematic flowchart of another schedule generation method based on eye tracking technology according to an embodiment of the present application;
fig. 3 is a schematic flowchart of another schedule generation method based on eye tracking technology according to an embodiment of the present application;
fig. 4 is a schematic structural diagram of an electronic device provided in an embodiment of the present application;
fig. 5 is a block diagram illustrating functional units of a schedule generating apparatus based on an eye tracking technology according to an embodiment of the present disclosure.
Detailed Description
In order to make the technical solutions of the present application better understood, the technical solutions in the embodiments of the present application will be clearly and completely described below with reference to the drawings in the embodiments of the present application, and it is obvious that the described embodiments are only a part of the embodiments of the present application, and not all of the embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present application.
The terms "first," "second," and the like in the description and claims of the present application and in the above-described drawings are used for distinguishing between different objects and not for describing a particular order. Furthermore, the terms "include" and "have," as well as any variations thereof, are intended to cover non-exclusive inclusions. For example, a process, method, system, article, or apparatus that comprises a list of steps or elements is not limited to only those steps or elements listed, but may alternatively include other steps or elements not listed, or inherent to such process, method, article, or apparatus.
Reference herein to "an embodiment" means that a particular feature, structure, or characteristic described in connection with the embodiment can be included in at least one embodiment of the application. The appearances of the phrase in various places in the specification are not necessarily all referring to the same embodiment, nor are separate or alternative embodiments mutually exclusive of other embodiments. It is explicitly and implicitly understood by one skilled in the art that the embodiments described herein can be combined with other embodiments.
The electronic device according to the embodiment of the present application may include various handheld devices, vehicle-mounted devices, wearable devices, computing devices or other processing devices connected to a wireless modem, which have wireless communication functions, and various forms of User Equipment (UE), Mobile Stations (MS), terminal devices (terminal device), and the like.
The following describes embodiments of the present application in detail.
Referring to fig. 1A, fig. 1A is a schematic flowchart of a schedule generation method based on an eye tracking technology according to an embodiment of the present application, and is applied to an electronic device; the method comprises the following steps:
s101, when the electronic equipment detects that a screen is in an unlocked state, detecting a high-frequency watching area of human eyes relative to the screen;
the unlocking state comprises that the screen is in a shooting interface, and at the moment, a high-frequency watching area of the screen only exists in a screen area outside a shooting view range.
S102, the electronic equipment determines a schedule to be displayed according to the high-frequency watching area to generate inquiry information;
the schedule generation inquiry information comprises text prompt information and/or voice prompt information for inquiring whether to generate a related schedule.
The schedule generation inquiry information comprises modifiable text prompt information and/or voice prompt information of the related schedule.
S103, the electronic equipment pops out an inquiry window in the screen to display the schedule generation inquiry information;
wherein the inquiry window comprises the schedule generation inquiry information and a selection operation button.
And S104, the electronic equipment executes schedule generation operation according to the control operation aiming at the inquiry window.
It can be seen that in the embodiment of the present application, a schedule generation method based on an eyeball tracking technology and a related product are provided, where an electronic device starts to detect a high-frequency gazing area of human eyes relative to a screen when detecting that the screen is in an unlocked state, determines schedule generation inquiry information to be displayed according to the detected high-frequency gazing area, then pops out an inquiry window in the screen to display the schedule generation inquiry information, and the electronic device executes a schedule generation operation according to a control operation for the inquiry window. Therefore, when the unlocking of the screen is detected, a high-frequency watching area focused by eyeballs of a user is determined through an eyeball tracking technology, a schedule generation inquiry window is popped up, relevant schedule information is generated according to feedback of the user aiming at the inquiry information, and schedule prompt is carried out on the user in a corresponding time period, so that the condition that the user forgets to browse the schedule related to the content after browsing and misses the schedule is effectively avoided, the schedule is favorably and timely processed by the user, the existing schedule generation method is optimized, the schedule generation is carried out based on the eyeball tracking technology, and the use experience of the user in the schedule generation aspect is favorably improved.
In one possible example, the electronic device detects a high frequency gaze region of a human eye relative to the screen, comprising: the electronic equipment collects eyeball tracking information; the electronic equipment determines at least one fixation point of the human eyes relative to the screen according to the eyeball tracking information; the electronic equipment acquires gazing information of each gazing point in the at least one gazing point; and the electronic equipment determines and detects a high-frequency gazing area of the human eyes relative to the screen according to the gazing information of each gazing point.
The method comprises the steps that the eyeball tracking information is collected by electronic equipment, the eyeball position of a gagger is collected, cornea reflected light is tracked by utilizing a camera and an infrared sensor in combination with a 3D model algorithm to calculate the position coordinate watched by the human eyes, and the position coordinate is fed back to an electronic equipment processing device in a two-dimensional coordinate mode; establishing a three-dimensional model of eyeball movement, and performing algorithm correction on the fed back two-dimensional coordinates of the gaze position of the human eyes to obtain the corrected eyeball position of the gaze person; and corresponding the corrected eyeball position of the observer to the pixel point of the screen.
Wherein the gazing information comprises the gazing times of each gazing point within a first time threshold value and/or the single gazing duration of each gazing point.
In specific implementation, as shown in fig. 1B, the electronic device collects eyeball tracking information of a user, determines gaze points a and B of the human eyes relative to the screen, obtains a single gaze duration of the gaze point a of 2 seconds, determines a single gaze duration of the gaze point B of 5 seconds, determines that the gaze point B is a high-frequency gaze region, and detects the gaze point B, i.e., the high-frequency gaze region.
In this example, the electronic device collects eye tracking information, determines at least one fixation point of the human eye relative to the screen according to the eye tracking information, and determines and detects a high-frequency fixation area of the human eye relative to the screen according to the fixation information of each fixation point; the human eyes are detected based on the eyeball tracking technology, so that the high-frequency watching area of the screen is determined and detected more efficiently and accurately, an effective and accurate detection area is provided, a certificate is provided for subsequent schedule generation, the subsequent schedule generation prompt content is optimized, and the use experience of a user is improved.
In one possible example, the electronic device determines a high frequency gaze region of the human eye relative to the screen based on the gaze information, including: the electronic equipment selects one or more fixation points with fixation times larger than a first time threshold from the at least one fixation point; the electronic device determines that a gazing area formed by the one or more gazing points is a high-frequency gazing area of the human eye relative to the screen.
Wherein, one or more fixation points include when there are a plurality of regions of gazing that a plurality of fixation points formed to do the human eye for when the region is watched to the high frequency of screen, the region is watched to the high frequency includes that first high frequency gazes regional and second high frequency and watches the region, a plurality of fixation points include first fixation point and second fixation point, the number of times of gazing of first fixation point is greater than the number of times of gazing of second fixation point, first high frequency is watched regional for first region of gazing that first fixation point formed, the region is watched to the second high frequency is watched regional the second that second fixation point formed, the regional processing priority of gazing to the first high frequency is higher than the region is watched to the second high frequency.
In a specific implementation, the first-time threshold is 3 times, the gazing times of the gazing point X are 2 times, the gazing times of the gazing point Y are 4 times, the gazing times of the gazing point Z are 3 times, the electronic device performs screening from the gazing points X, Y and Z to determine the gazing point Y with the gazing times larger than 3 times, and a gazing area M formed by the gazing point Y is a high-frequency gazing area of the human eyes relative to the screen.
In a specific implementation, the first-time threshold is 3 times, the gazing frequency of the gazing point X is 2 times, the gazing frequency of the gazing point Y is 4 times, the gazing frequency of the gazing point Z is 5 times, the electronic device performs screening from the gazing points X, Y and Z to determine the gazing point Y and the gazing point Z with the gazing frequency greater than 3 times, and gazing areas M and N formed by the gazing point Y and the gazing point Z are high-frequency gazing areas of human eyes relative to the screen.
In this example, the electronic device selects one or more fixation points with fixation times larger than a first time threshold from the at least one fixation point, and determines that a fixation area formed by the one or more fixation points is a high-frequency fixation area of the human eye relative to the screen; the corresponding area is determined to be the high-frequency watching area according to the watching times within a certain time, the watching times are more, the attention degree and the demand degree of the user are higher, the interest point of the user can be found quickly and effectively through the method, the demand information of the user can be identified more efficiently and accurately, preparation is made for subsequent schedule generation, and the accuracy and the efficiency of schedule generation are improved.
In one possible example, the electronic device determines a high frequency gaze region of the human eye relative to the screen based on the gaze information, including: the electronic equipment screens one or more fixation points with the fixation time length larger than a first time threshold from the at least one fixation point; the electronic device determines that a gazing area formed by the one or more gazing points is a high-frequency gazing area of the human eye relative to the screen.
Wherein, one or more fixation points include when there are a plurality of regions of gazing formed of a plurality of fixation points to do the human eye for the high frequency of screen is gazed at when regional, the high frequency is gazed at regional including first high frequency and is watched regional and the second high frequency and is watched regionally, a plurality of fixation points include first fixation point and second fixation point, the time length is watched at a single time of first fixation point is greater than the time length is watched at a single time of second fixation point, first high frequency is gazed at regional being the first region of gazing formed of first fixation point, the region is watched at a second high frequency to be the region is watched at a second fixation point formed of second fixation point, the regional processing priority of gazing at a first high frequency is higher than the region is watched at a second high frequency.
In the specific implementation, the first time threshold is 3 seconds, the single watching time duration of the gazing point X is 1 second, the single watching time duration of the gazing point Y is 4 seconds, the single watching time duration of the gazing point Z is 2 seconds, the electronic device performs screening from the gazing points X, Y and Z to determine the gazing point Y with the single watching time duration being greater than 3 seconds, and a gazing area M formed by the gazing point Y is a high-frequency gazing area of human eyes relative to the screen.
In the specific implementation, the first time threshold is 3 seconds, the single watching time duration of the gazing point X is 2 seconds, the single watching time duration of the gazing point Y is 4 seconds, the single watching time duration of the gazing point Z is 5 seconds, the electronic device performs screening from the gazing points X, Y and Z to determine the gazing point Y and the gazing point Z, the single watching time duration of which is greater than 3 seconds, and gazing areas M and N formed by the gazing point Y and the gazing point Z are high-frequency gazing areas of human eyes relative to the screen.
In this example, the electronic device screens one or more fixation points with a fixation time greater than a first time threshold from the at least one fixation point, and determines that a fixation area formed by the one or more fixation points is a high-frequency fixation area of the human eye relative to the screen; the method has the advantages that the corresponding area is determined to be the high-frequency watching area according to the single watching duration, the more the single watching duration is, the higher the attention degree and the demand degree of the user are, the interest points of the user can be found quickly and effectively, the more efficient and accurate identification of the demand information of the user is facilitated, the preparation for the follow-up schedule generation is made, and the accuracy and the efficiency of the schedule generation are improved.
In one possible example, the electronic device determines schedule generation inquiry information to be displayed according to the high-frequency gazing area, and the method includes the following steps: the electronic equipment identifies the content information of the high-frequency watching area and extracts keywords in the content information; the electronic equipment determines the type of the keyword according to the extracted keyword; and the electronic equipment generates schedule generation inquiry information to be displayed according to the type of the keyword.
The content information comprises character information, picture information and/or voice information.
Wherein the extracting of the keywords in the content information comprises extracting at least one important feature of the content information as a keyword; when a plurality of keywords are extracted, determining the keywords with higher scores as first keywords according to a keyword priority scoring model.
In specific implementation, the electronic device identifies that the content information of the high-frequency watching area is a propaganda picture of an X movie, extracts keywords 'X movie' and 'Y time showing' in the content information, determines that the type of the keywords is an entertainment keyword according to the extracted keywords, and generates schedule generation inquiry information for 'whether to prompt a user to purchase movie tickets at Y time'.
In this example, the electronic device identifies content information of the high-frequency watching area, extracts keywords in the content information, determines types of the keywords according to the extracted keywords, and generates schedule to be displayed according to the types of the keywords to generate inquiry information; the method and the device are beneficial to generating schedule generation inquiry information with pertinence aiming at different keywords of different content information, better serve users, and refine schedule generation contents corresponding to different keyword types, so that the generated schedule contents are more pertinence, and the method and the device are beneficial to improving the efficiency and the accuracy of schedule generation.
In one possible example, the electronic device generates schedule generation inquiry information to be displayed according to the keyword type, and the method includes: if the electronic equipment determines that the keyword type is a medicine keyword, generating a medicine taking schedule according to the medicine keyword, and generating a medicine taking prompt schedule to be displayed according to the medicine taking schedule to generate inquiry information; if the electronic equipment determines that the keyword type is a weather keyword, generating a trip schedule according to the weather keyword, and generating a trip prompt schedule to be displayed according to the trip schedule to generate inquiry information; and if the electronic equipment determines that the keyword type is a social contact keyword, generating a social schedule according to the social contact keyword, and generating a to-be-displayed social prompt schedule according to the social schedule to generate inquiry information.
Wherein the keyword types further comprise entertainment keywords, diet keywords and training keywords.
The schedule generation inquiry information comprises modifiable schedule content, and a user can actively modify the schedule content according to self needs.
In the concrete implementation, the keywords ' medicine name ', ' medicine shopping record ' and ' disease record ' are extracted, the electronic equipment determines that the type of the keyword is a medicine keyword, a medicine taking schedule ' taking three Y medicines at X time, particularly reminding the user of taking the medicine without empty stomach ', and a medicine taking prompt ' whether the medicine taking prompt schedule needs to be generated or not is generated according to the medicine keyword, and the schedule content is ' taking three Y medicines at X time, particularly reminding the user of taking the medicine without empty stomach '.
In the concrete implementation, keywords "X month Y day" and "rainy day" are extracted, the electronic device determines that the keyword type is a weather keyword, and generates a trip schedule "please carry rain gear before going out when X month Y day Z, suggest to reduce trip time" according to the weather keyword, and generates a trip prompt "whether it is necessary to generate a trip prompt schedule, please carry rain gear before going out when the schedule content is 'X month Y day Z, suggest to reduce the query information of trip time'.
In the concrete implementation, keywords of Mr. X, Mr. Back and Y are extracted, the electronic equipment determines that the type of the keywords is the social keywords, then a social schedule of Mr. A time for getting back to the X is generated according to the social keywords, the content of getting back to the Y relates to the Y, whether the social prompt needs to be generated or not is generated, the schedule content is inquiry information of the Mr. A time for getting back to the X, the content of getting back to the Y relates to the Y', the user can modify the time A to be the time B according to the self needs, and the schedule content of adding the Mr. X is a manager of the M company.
In this example, the electronic device generates schedule generation inquiry information to be displayed according to the keyword type, and generates different and targeted schedule generation inquiry information for different keyword types, which is beneficial to improving the content accuracy of schedule generation, and generates diversified schedule information to meet the schedule generation requirements of users in more scenes, thereby optimizing the existing schedule generation method, being beneficial to improving the schedule generation experience of users, and helping users to process schedule arrangement in time.
In one possible example, after the electronic device performs a schedule generation operation according to a control operation for the inquiry window, the method includes: and the electronic equipment carries out schedule prompt according to the generated schedule information.
Wherein the control operation for the inquiry window comprises accepting a generation schedule and refusing the generation schedule.
After the schedule generation operation executed according to the control operation of the inquiry window comprises that a user selects to refuse to generate a schedule, the electronic equipment stops the schedule generation, continues to detect a high-frequency watching area of the human eyes relative to the screen, determines schedule generation inquiry information to be displayed again within a certain time, detects the schedule generation inquiry information, determines that the schedule generation inquiry information is repeated with the schedule generation inquiry information selected by the user to refuse to generate the schedule, and does not pop up the inquiry window.
The schedule prompting comprises displaying schedule information on the screen and/or the electronic equipment sends out a sound prompt.
In the specific implementation, the electronic equipment receives the control operation of receiving the schedule generation, generates schedule information of 'X time taking Y medicines three-piece, particularly reminding to take without empty stomach', displays 'X time taking Y medicines three-piece, particularly reminding to take without empty stomach' on the screen, and sends out alarm clock sound to carry out schedule reminding.
Therefore, in this example, the electronic device executes the schedule generation operation according to the control operation for the inquiry window, and performs schedule prompt on the user in the corresponding time period, so as to effectively avoid the situation that the user forgets to browse the schedule related to the content after browsing and misses the schedule, help the user to timely process the schedule, optimize the existing schedule generation method, and improve the use experience of the user in the schedule generation aspect.
Referring to fig. 2, fig. 2 is a schematic flowchart of a schedule generation method based on an eye tracking technique according to an embodiment of the present application, and is applied to an electronic device; as shown in the figure, the schedule generation method based on the eyeball tracking technology includes:
s201, when the electronic equipment detects that a screen is in an unlocking state, eyeball tracking information is collected;
s202, the electronic equipment determines at least one fixation point of the human eyes relative to the screen according to the eyeball tracking information;
s203, the electronic equipment acquires the gazing information of each gazing point in the at least one gazing point;
s204, the electronic equipment determines and detects a high-frequency gazing area of the human eyes relative to the screen according to the gazing information of each gazing point;
s205, the electronic equipment determines a schedule to be displayed according to the high-frequency watching area to generate inquiry information;
s206, the electronic equipment pops out a query window in the screen to display the schedule generation query information;
and S207, the electronic equipment executes schedule generation operation according to the control operation aiming at the inquiry window.
It can be seen that in the embodiment of the present application, a schedule generation method based on an eyeball tracking technology and a related product are provided, where an electronic device starts to detect a high-frequency gazing area of human eyes relative to a screen when detecting that the screen is in an unlocked state, determines schedule generation inquiry information to be displayed according to the detected high-frequency gazing area, then pops out an inquiry window in the screen to display the schedule generation inquiry information, and the electronic device executes a schedule generation operation according to a control operation for the inquiry window. Therefore, when the unlocking of the screen is detected, a high-frequency watching area focused by eyeballs of a user is determined through an eyeball tracking technology, a schedule generation inquiry window is popped up, relevant schedule information is generated according to feedback of the user aiming at the inquiry information, and schedule prompt is carried out on the user in a corresponding time period, so that the condition that the user forgets to browse the schedule related to the content after browsing and misses the schedule is effectively avoided, the schedule is favorably and timely processed by the user, the existing schedule generation method is optimized, the schedule generation is carried out based on the eyeball tracking technology, and the use experience of the user in the schedule generation aspect is favorably improved.
In addition, the electronic equipment collects eyeball tracking information, determines at least one fixation point of the human eye relative to the screen according to the eyeball tracking information, and determines and detects a high-frequency fixation area of the human eye relative to the screen according to the fixation information of each fixation point; the human eyes are detected based on the eyeball tracking technology, so that the high-frequency watching area of the screen is determined and detected more efficiently and accurately, an effective and accurate detection area is provided, a certificate is provided for subsequent schedule generation, the subsequent schedule generation prompt content is optimized, and the use experience of a user is improved.
Referring to fig. 3, fig. 3 is a schematic flowchart of a schedule generation method based on an eye tracking technique according to an embodiment of the present application, and is applied to an electronic device; as shown in the figure, the schedule generation method based on the eyeball tracking technology includes:
s301, when the electronic equipment detects that a screen is in an unlocking state, eyeball tracking information is collected;
s302, the electronic equipment determines at least one fixation point of the human eyes relative to the screen according to the eyeball tracking information;
s303, the electronic equipment acquires the gazing information of each gazing point in the at least one gazing point;
s304, the electronic equipment determines and detects a high-frequency gazing area of the human eyes relative to the screen according to the gazing information of each gazing point;
s305, the electronic equipment identifies content information of the high-frequency watching area and extracts keywords in the content information;
s306, the electronic equipment determines the type of the keyword according to the extracted keyword;
and S307, the electronic equipment generates schedule generation inquiry information to be displayed according to the type of the keyword.
S308, the electronic equipment pops out a query window in the screen to display the schedule generation query information;
s309, the electronic equipment executes schedule generation operation according to the control operation aiming at the inquiry window.
It can be seen that in the embodiment of the present application, a schedule generation method based on an eyeball tracking technology and a related product are provided, where an electronic device starts to detect a high-frequency gazing area of human eyes relative to a screen when detecting that the screen is in an unlocked state, determines schedule generation inquiry information to be displayed according to the detected high-frequency gazing area, then pops out an inquiry window in the screen to display the schedule generation inquiry information, and the electronic device executes a schedule generation operation according to a control operation for the inquiry window. Therefore, when the unlocking of the screen is detected, a high-frequency watching area focused by eyeballs of a user is determined through an eyeball tracking technology, a schedule generation inquiry window is popped up, relevant schedule information is generated according to feedback of the user aiming at the inquiry information, and schedule prompt is carried out on the user in a corresponding time period, so that the condition that the user forgets to browse the schedule related to the content after browsing and misses the schedule is effectively avoided, the schedule is favorably and timely processed by the user, the existing schedule generation method is optimized, the schedule generation is carried out based on the eyeball tracking technology, and the use experience of the user in the schedule generation aspect is favorably improved.
In addition, the electronic equipment identifies the content information of the high-frequency watching area, extracts keywords in the content information, determines the types of the keywords according to the extracted keywords, and generates a schedule to be displayed according to the types of the keywords to generate inquiry information; the method and the device are beneficial to generating schedule generation inquiry information with pertinence aiming at different keywords of different content information, better serve users, and refine schedule generation contents corresponding to different keyword types, so that the generated schedule contents are more pertinence, and the method and the device are beneficial to improving the efficiency and the accuracy of schedule generation.
Consistent with the embodiments shown in fig. 1A, fig. 2, and fig. 3, please refer to fig. 4, and fig. 4 is a schematic structural diagram of an electronic device 400 provided in an embodiment of the present application, as shown in the figure, the electronic device 400 includes an application processor 410, a memory 420, a communication interface 430, and one or more programs 421, where the one or more programs 421 are stored in the memory 420 and configured to be executed by the application processor 410, and the one or more programs 421 include instructions for performing the following steps;
detecting a high-frequency watching area of human eyes relative to a screen when the screen is detected to be in an unlocked state;
determining a schedule to be displayed according to the high-frequency watching area to generate inquiry information;
popping up a query window in the screen to display the schedule generation query information;
and executing schedule generation operation according to the control operation aiming at the inquiry window.
It can be seen that in the embodiment of the present application, a schedule generation method based on an eyeball tracking technology and a related product are provided, where an electronic device starts to detect a high-frequency gazing area of human eyes relative to a screen when detecting that the screen is in an unlocked state, determines schedule generation inquiry information to be displayed according to the detected high-frequency gazing area, then pops out an inquiry window in the screen to display the schedule generation inquiry information, and the electronic device executes a schedule generation operation according to a control operation for the inquiry window. Therefore, when the unlocking of the screen is detected, a high-frequency watching area focused by eyeballs of a user is determined through an eyeball tracking technology, a schedule generation inquiry window is popped up, relevant schedule information is generated according to feedback of the user aiming at the inquiry information, and schedule prompt is carried out on the user in a corresponding time period, so that the condition that the user forgets to browse the schedule related to the content after browsing and misses the schedule is effectively avoided, the schedule is favorably and timely processed by the user, the existing schedule generation method is optimized, the schedule generation is carried out based on the eyeball tracking technology, and the use experience of the user in the schedule generation aspect is favorably improved.
In one possible example, the detecting a high frequency gaze region of a human eye relative to the screen, the instructions in the program are specifically for performing the following: collecting eyeball tracking information; determining at least one point of regard of the human eye relative to the screen from the eye tracking information; obtaining gazing information of each gazing point in the at least one gazing point; and determining and detecting a high-frequency gazing area of the human eyes relative to the screen according to the gazing information of each gazing point.
In one possible example, the gaze information includes a number of gazes for the each gaze point within a first time threshold; determining and detecting a high-frequency gazing area of the human eye relative to the screen according to the gazing information, wherein the instructions in the program are specifically used for executing the following operations: screening one or more fixation points with fixation times larger than a first time threshold value from the at least one fixation point; and determining a gazing area formed by the one or more gazing points as a high-frequency gazing area of the human eye relative to the screen.
In one possible example, the gaze information includes a single gaze duration; determining and detecting a high-frequency gazing area of the human eye relative to the screen according to the gazing information, wherein the instructions in the program are specifically used for executing the following operations: screening one or more fixation points with a primary fixation time length larger than a first time threshold from the at least one fixation point; and determining a gazing area formed by the one or more gazing points as a high-frequency gazing area of the human eye relative to the screen.
In one possible example, the schedule to be displayed is determined according to the high-frequency gazing region, and query information is generated, and the instructions in the program are specifically configured to perform the following operations: identifying content information of the high-frequency watching area, and extracting keywords in the content information; determining the keyword type according to the extracted keywords; and generating the schedule to be displayed according to the type of the keyword to generate inquiry information.
In a possible example, the generating of the schedule generation query information to be displayed according to the keyword type includes: if the keyword type is determined to be a medicine keyword, generating a medicine taking schedule according to the medicine keyword, and generating a medicine taking prompt schedule to be displayed according to the medicine taking schedule to generate inquiry information; if the keyword type is determined to be a weather keyword, generating a trip schedule according to the weather keyword, and generating a trip prompt schedule to be displayed according to the trip schedule to generate inquiry information; and if the keyword type is determined to be a social contact keyword, generating a social schedule according to the social contact keyword, and generating a to-be-displayed social prompt schedule according to the social schedule to generate inquiry information.
In a possible example, after the schedule generating operation is executed according to the control operation for the query window, the instructions in the program of the method are specifically configured to perform the following operations: and prompting the schedule according to the generated schedule information.
The above description has introduced the solution of the embodiment of the present application mainly from the perspective of the method-side implementation process. It is understood that the electronic device comprises corresponding hardware structures and/or software modules for performing the respective functions in order to realize the above-mentioned functions. Those of skill in the art will readily appreciate that the present application is capable of hardware or a combination of hardware and computer software implementing the various illustrative elements and algorithm steps described in connection with the embodiments provided herein. Whether a function is performed as hardware or computer software drives hardware depends upon the particular application and design constraints imposed on the solution. Skilled artisans may implement the described functionality in varying ways for each particular application, but such implementation decisions should not be interpreted as causing a departure from the scope of the present application.
In the embodiment of the present application, the electronic device may be divided into the functional units according to the method example, for example, each functional unit may be divided corresponding to each function, or two or more functions may be integrated into one processing unit. The integrated unit can be realized in a form of hardware, and can also be realized in a form of a software functional unit. It should be noted that the division of the unit in the embodiment of the present application is schematic, and is only a logic function division, and there may be another division manner in actual implementation.
Fig. 5 is a block diagram of functional units of a schedule generation apparatus 500 based on eye tracking technology according to an embodiment of the present application. The schedule generating apparatus 500 based on eyeball tracking technology is applied to an electronic device, and comprises a processing unit 501 and a communication unit 502, wherein,
the processing unit 501 is configured to detect, by the eyeball tracking module, a high-frequency gazing area of the human eye relative to the screen when the screen is detected to be in an unlocked state; the high-frequency watching area is used for determining a schedule to be displayed according to the high-frequency watching area to generate inquiry information; and a query window pops up in the screen to display the schedule generation query information; and executing schedule generation operation according to the control operation aiming at the inquiry window.
It can be seen that in the embodiment of the present application, a schedule generation method based on an eyeball tracking technology and a related product are provided, where an electronic device starts to detect a high-frequency gazing area of human eyes relative to a screen when detecting that the screen is in an unlocked state, determines schedule generation inquiry information to be displayed according to the detected high-frequency gazing area, then pops out an inquiry window in the screen to display the schedule generation inquiry information, and the electronic device executes a schedule generation operation according to a control operation for the inquiry window. Therefore, when the unlocking of the screen is detected, a high-frequency watching area focused by eyeballs of a user is determined through an eyeball tracking technology, a schedule generation inquiry window is popped up, relevant schedule information is generated according to feedback of the user aiming at the inquiry information, and schedule prompt is carried out on the user in a corresponding time period, so that the condition that the user forgets to browse the schedule related to the content after browsing and misses the schedule is effectively avoided, the schedule is favorably and timely processed by the user, the existing schedule generation method is optimized, the schedule generation is carried out based on the eyeball tracking technology, and the use experience of the user in the schedule generation aspect is favorably improved.
In one possible example, the processing unit 501 is specifically configured to detect a high-frequency gaze region of a human eye relative to the screen: collecting eyeball tracking information; determining at least one point of regard of the human eye relative to the screen from the eye tracking information; obtaining gazing information of each gazing point in the at least one gazing point; and determining and detecting a high-frequency gazing area of the human eyes relative to the screen according to the gazing information of each gazing point.
In one possible example, the gaze information includes a number of gazes for the each gaze point within a first time threshold; the determining and detecting a high-frequency gazing area of the human eye relative to the screen according to the gazing information, where the processing unit 501 is specifically configured to: screening one or more fixation points with fixation times larger than a first time threshold value from the at least one fixation point; and determining a gazing area formed by the one or more gazing points as a high-frequency gazing area of the human eye relative to the screen.
In one possible example, the gaze information includes a single gaze duration; the determining and detecting a high-frequency gazing area of the human eye relative to the screen according to the gazing information, where the processing unit 501 is specifically configured to: screening one or more fixation points with a primary fixation time length larger than a first time threshold from the at least one fixation point; and determining a gazing area formed by the one or more gazing points as a high-frequency gazing area of the human eye relative to the screen.
In a possible example, the processing unit 501 is specifically configured to determine schedule generation inquiry information to be displayed according to the high-frequency watching region, and to: identifying content information of the high-frequency watching area, and extracting keywords in the content information; determining the keyword type according to the extracted keywords; and generating the schedule to be displayed according to the type of the keyword to generate inquiry information.
In a possible example, the processing unit 501 is specifically configured to generate schedule generation query information to be displayed according to the keyword type, and: if the keyword type is determined to be a medicine keyword, generating a medicine taking schedule according to the medicine keyword, and generating a medicine taking prompt schedule to be displayed according to the medicine taking schedule to generate inquiry information; if the keyword type is determined to be a weather keyword, generating a trip schedule according to the weather keyword, and generating a trip prompt schedule to be displayed according to the trip schedule to generate inquiry information; and if the keyword type is determined to be a social contact keyword, generating a social schedule according to the social contact keyword, and generating a to-be-displayed social prompt schedule according to the social schedule to generate inquiry information.
In a possible example, after the schedule generating operation is executed according to the control operation for the inquiry window, the processing unit 501 of the method is specifically configured to: and prompting the schedule according to the generated schedule information.
Embodiments of the present application also provide a computer storage medium, where the computer storage medium stores a computer program for electronic data exchange, the computer program enabling a computer to execute part or all of the steps of any one of the methods described in the above method embodiments, and the computer includes an electronic device.
Embodiments of the present application also provide a computer program product comprising a non-transitory computer readable storage medium storing a computer program operable to cause a computer to perform some or all of the steps of any of the methods as described in the above method embodiments. The computer program product may be a software installation package, the computer comprising an electronic device.
It should be noted that, for simplicity of description, the above-mentioned method embodiments are described as a series of acts or combination of acts, but those skilled in the art will recognize that the present application is not limited by the order of acts described, as some steps may occur in other orders or concurrently depending on the application. Further, those skilled in the art should also appreciate that the embodiments described in the specification are preferred embodiments and that the acts and modules referred to are not necessarily required in this application.
In the foregoing embodiments, the descriptions of the respective embodiments have respective emphasis, and for parts that are not described in detail in a certain embodiment, reference may be made to related descriptions of other embodiments.
In the embodiments provided in the present application, it should be understood that the disclosed apparatus may be implemented in other manners. For example, the above-described embodiments of the apparatus are merely illustrative, and for example, the above-described division of the units is only one type of division of logical functions, and other divisions may be realized in practice, for example, a plurality of units or components may be combined or integrated into another system, or some features may be omitted, or not executed. In addition, the shown or discussed mutual coupling or direct coupling or communication connection may be an indirect coupling or communication connection of some interfaces, devices or units, and may be an electric or other form.
The units described as separate parts may or may not be physically separate, and parts displayed as units may or may not be physical units, may be located in one place, or may be distributed on a plurality of network units. Some or all of the units can be selected according to actual needs to achieve the purpose of the solution of the embodiment.
In addition, functional units in the embodiments of the present application may be integrated into one processing unit, or each unit may exist alone physically, or two or more units are integrated into one unit. The integrated unit can be realized in a form of hardware, and can also be realized in a form of a software functional unit.
The integrated unit may be stored in a computer readable memory if it is implemented in the form of a software functional unit and sold or used as a stand-alone product. Based on such understanding, the technical solution of the present application may be substantially implemented or a part of or all or part of the technical solution contributing to the prior art may be embodied in the form of a software product stored in a memory, and including several instructions for causing a computer device (which may be a personal computer, a server, or a network device) to execute all or part of the steps of the above-mentioned method of the embodiments of the present application. And the aforementioned memory comprises: a U-disk, a Read-Only Memory (ROM), a Random Access Memory (RAM), a removable hard disk, a magnetic or optical disk, and other various media capable of storing program codes.
Those skilled in the art will appreciate that all or part of the steps in the methods of the above embodiments may be implemented by associated hardware instructed by a program, which may be stored in a computer-readable memory, which may include: flash Memory disks, Read-Only memories (ROMs), Random Access Memories (RAMs), magnetic or optical disks, and the like.
The foregoing detailed description of the embodiments of the present application has been presented to illustrate the principles and implementations of the present application, and the above description of the embodiments is only provided to help understand the method and the core concept of the present application; meanwhile, for a person skilled in the art, according to the idea of the present application, there may be variations in the specific embodiments and the application scope, and in summary, the content of the present specification should not be construed as a limitation to the present application.

Claims (9)

1. A schedule generation method based on an eyeball tracking technology is characterized by being applied to electronic equipment; the method comprises the following steps:
detecting a high-frequency watching area of human eyes relative to a screen when the screen is detected to be in an unlocked state;
determining schedule generation inquiry information to be displayed according to the high-frequency watching area, wherein the schedule generation inquiry information to be displayed comprises content information for identifying the high-frequency watching area, extracting keywords in the content information, determining the type of the keywords according to the extracted keywords, and generating the schedule generation inquiry information to be displayed according to the type of the keywords;
popping up a query window in the screen to display the schedule generation query information;
and executing schedule generation operation according to the control operation aiming at the inquiry window.
2. The method of claim 1, wherein said detecting a high frequency gaze region of a human eye relative to said screen comprises:
collecting eyeball tracking information;
determining at least one point of regard of the human eye relative to the screen from the eye tracking information;
obtaining gazing information of each gazing point in the at least one gazing point;
and determining and detecting a high-frequency watching area of the human eyes relative to the screen according to the watching information.
3. The method of claim 2, wherein the gaze information comprises a number of gazes for the each gaze point within a first time threshold; the determining and detecting a high-frequency watching region of the human eye relative to the screen according to the watching information comprises the following steps:
screening one or more fixation points with fixation times larger than a first time threshold value from the at least one fixation point;
and determining a gazing area formed by the one or more gazing points as a high-frequency gazing area of the human eye relative to the screen.
4. The method of claim 2, wherein the gaze information comprises a single gaze duration; the determining and detecting a high-frequency watching region of the human eye relative to the screen according to the watching information comprises the following steps:
screening one or more fixation points with a primary fixation time length larger than a first time threshold from the at least one fixation point;
and determining a gazing area formed by the one or more gazing points as a high-frequency gazing area of the human eye relative to the screen.
5. The method according to claim 1, wherein the generating of the schedule generation query information to be displayed according to the keyword type includes:
if the keyword type is determined to be a medicine keyword, generating a medicine taking schedule according to the medicine keyword, and generating a medicine taking prompt schedule to be displayed according to the medicine taking schedule to generate inquiry information;
if the keyword type is determined to be a weather keyword, generating a trip schedule according to the weather keyword, and generating a trip prompt schedule to be displayed according to the trip schedule to generate inquiry information;
and if the keyword type is determined to be a social contact keyword, generating a social schedule according to the social contact keyword, and generating a to-be-displayed social prompt schedule according to the social schedule to generate inquiry information.
6. The method according to any one of claims 1 to 5, wherein after performing a schedule generation operation according to a control operation for the query window, the method comprises:
and prompting the schedule according to the generated schedule information.
7. A schedule generation device based on an eyeball tracking technology is characterized by being applied to electronic equipment; the schedule generation device based on the eyeball tracking technology comprises a processing unit and a communication unit, wherein,
the processing unit is used for detecting a high-frequency gazing area of human eyes relative to the screen through the eyeball tracking module when the screen is detected to be in an unlocked state; the system comprises a high-frequency watching area, a schedule generation inquiry unit and a display unit, wherein the high-frequency watching area is used for displaying schedule generation inquiry information; and a query window pops up in the screen to display the schedule generation query information; and executing schedule generation operation according to the control operation aiming at the inquiry window.
8. An electronic device comprising a processor, a memory, a communication interface, and one or more programs stored in the memory and configured to be executed by the processor, the programs comprising instructions for performing the steps in the method of any of claims 1-6.
9. A computer-readable storage medium, characterized in that a computer program for electronic data exchange is stored, wherein the computer program causes a computer to perform the method according to any one of claims 1-6.
CN201910538691.3A 2019-06-20 2019-06-20 Schedule generation method based on eyeball tracking technology and related product Active CN110262663B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201910538691.3A CN110262663B (en) 2019-06-20 2019-06-20 Schedule generation method based on eyeball tracking technology and related product

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201910538691.3A CN110262663B (en) 2019-06-20 2019-06-20 Schedule generation method based on eyeball tracking technology and related product

Publications (2)

Publication Number Publication Date
CN110262663A CN110262663A (en) 2019-09-20
CN110262663B true CN110262663B (en) 2021-10-19

Family

ID=67919905

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201910538691.3A Active CN110262663B (en) 2019-06-20 2019-06-20 Schedule generation method based on eyeball tracking technology and related product

Country Status (1)

Country Link
CN (1) CN110262663B (en)

Families Citing this family (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN110825226A (en) * 2019-10-30 2020-02-21 维沃移动通信有限公司 Message viewing method and terminal
CN110968192A (en) * 2019-11-25 2020-04-07 中国银行股份有限公司 Transaction navigation method and device based on eyeball tracking

Citations (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102439957A (en) * 2011-10-12 2012-05-02 华为终端有限公司 Schedule generating method and communication terminal thereof
CN102830903A (en) * 2012-06-29 2012-12-19 鸿富锦精密工业(深圳)有限公司 Electronic equipment and memorandum adding method of electronic equipment
CN103914141A (en) * 2013-01-07 2014-07-09 索尼公司 Eye tracking user interface
CN104216599A (en) * 2013-06-05 2014-12-17 北京壹人壹本信息科技有限公司 Method and device for reminding event recorded in note
CN105225095A (en) * 2015-09-18 2016-01-06 宇龙计算机通信科技(深圳)有限公司 A kind of generation method of calendar prompting and device
CN105916026A (en) * 2016-04-18 2016-08-31 乐视控股(北京)有限公司 Follow behavior processing method and device
CN106469365A (en) * 2016-09-22 2017-03-01 北京小米移动软件有限公司 Agenda managing method and device
CN107660291A (en) * 2015-06-06 2018-02-02 苹果公司 System and method for generating and providing intelligent departure time prompting

Family Cites Families (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP5945417B2 (en) * 2012-01-06 2016-07-05 京セラ株式会社 Electronics
US10164484B2 (en) * 2015-06-08 2018-12-25 Ossia Inc. Techniques for leveraging existing components of a device for wireless power transfer functionality

Patent Citations (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102439957A (en) * 2011-10-12 2012-05-02 华为终端有限公司 Schedule generating method and communication terminal thereof
CN102830903A (en) * 2012-06-29 2012-12-19 鸿富锦精密工业(深圳)有限公司 Electronic equipment and memorandum adding method of electronic equipment
CN103914141A (en) * 2013-01-07 2014-07-09 索尼公司 Eye tracking user interface
CN104216599A (en) * 2013-06-05 2014-12-17 北京壹人壹本信息科技有限公司 Method and device for reminding event recorded in note
CN107660291A (en) * 2015-06-06 2018-02-02 苹果公司 System and method for generating and providing intelligent departure time prompting
CN105225095A (en) * 2015-09-18 2016-01-06 宇龙计算机通信科技(深圳)有限公司 A kind of generation method of calendar prompting and device
CN105916026A (en) * 2016-04-18 2016-08-31 乐视控股(北京)有限公司 Follow behavior processing method and device
CN106469365A (en) * 2016-09-22 2017-03-01 北京小米移动软件有限公司 Agenda managing method and device

Also Published As

Publication number Publication date
CN110262663A (en) 2019-09-20

Similar Documents

Publication Publication Date Title
CN110209952B (en) Information recommendation method, device, equipment and storage medium
CN106462242B (en) Use the user interface control of eye tracking
CN103703438B (en) Based on the content indicator watched attentively
CN103760968B (en) Method and device for selecting display contents of digital signage
CN111142673B (en) Scene switching method and head-mounted electronic equipment
US20150213123A1 (en) Method and system of scoring documents based on attributes obtained from a digital document by eye-tracking data analysis
WO2015047775A1 (en) Camera based safety mechanisms for users of head mounted displays
CN104838336A (en) Data and user interaction based on device proximity
WO2018127782A1 (en) Wearable augmented reality eyeglass communication device including mobile phone and mobile computing via virtual touch screen gesture control and neuron command
JP7231638B2 (en) Image-based information acquisition method and apparatus
KR20190030140A (en) Method for eye-tracking and user terminal for executing the same
CN108958577B (en) Window operation method and device based on wearable device, wearable device and medium
CN110262663B (en) Schedule generation method based on eyeball tracking technology and related product
US20130229342A1 (en) Information providing system, information providing method, information processing apparatus, method of controlling the same, and control program
CN111428522B (en) Translation corpus generation method, device, computer equipment and storage medium
EP2779087A1 (en) Gaze position estimation system, control method for gaze position estimation system, gaze position estimation device, control method for gaze position estimation device, program, and information storage medium
CN114302160B (en) Information display method, device, computer equipment and medium
CN113556603B (en) Method and device for adjusting video playing effect and electronic equipment
KR20190067433A (en) Method for providing text-reading based reward advertisement service and user terminal for executing the same
CN112015277B (en) Information display method and device and electronic equipment
CN117636767A (en) Image display method, system, terminal and storage medium of high beam imaging learning machine
JP2019212039A (en) Information processing device, information processing method, program, and information processing system
JP6318289B1 (en) Related information display system
CN111901518B (en) Display method and device and electronic equipment
CN114077465A (en) UI (user interface) rendering method and device, electronic equipment and storage medium

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant