CN113093906A - Method for determining and adjusting proper gaze triggering time in user gaze interaction - Google Patents

Method for determining and adjusting proper gaze triggering time in user gaze interaction Download PDF

Info

Publication number
CN113093906A
CN113093906A CN202110355471.4A CN202110355471A CN113093906A CN 113093906 A CN113093906 A CN 113093906A CN 202110355471 A CN202110355471 A CN 202110355471A CN 113093906 A CN113093906 A CN 113093906A
Authority
CN
China
Prior art keywords
gaze
trigger time
user
lowerlimit
reaction
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN202110355471.4A
Other languages
Chinese (zh)
Other versions
CN113093906B (en
Inventor
田雨
张绍尧
陈云霏
郭俊鹏
廖广姗
江京
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
63919 Troops of PLA
Original Assignee
63919 Troops of PLA
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 63919 Troops of PLA filed Critical 63919 Troops of PLA
Priority to CN202110355471.4A priority Critical patent/CN113093906B/en
Publication of CN113093906A publication Critical patent/CN113093906A/en
Application granted granted Critical
Publication of CN113093906B publication Critical patent/CN113093906B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/011—Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
    • G06F3/013—Eye tracking input arrangements
    • Y—GENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
    • Y02—TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
    • Y02D—CLIMATE CHANGE MITIGATION TECHNOLOGIES IN INFORMATION AND COMMUNICATION TECHNOLOGIES [ICT], I.E. INFORMATION AND COMMUNICATION TECHNOLOGIES AIMING AT THE REDUCTION OF THEIR OWN ENERGY USE
    • Y02D10/00—Energy efficient computing, e.g. low power processors, power management or thermal management

Abstract

The invention provides a method for determining and adjusting proper gaze triggering time in user gaze interaction, wherein a gaze acquisition device acquires the position of a user's gaze on a screen of a display system, the user executes a recognition reaction task by controlling the stay and movement of the gaze, a control system records stimulus presentation information in each trial and acquires user reaction information, parameters such as gaze triggering time and the like are adjusted or kept in the next trial, and when the control system detects that the historical rising times of the gaze triggering time and the historical falling times of the gaze triggering time reach set thresholds, the recognition reaction task is terminated, and a value interval suitable for the gaze triggering time is obtained. The invention aims to solve the practical problems that personalized consideration is lacked when the gaze triggering time is set in the prior art, and the like, and the gaze triggering time is initially configured and dynamically adjusted according to the behavior performance of a user, so that the experience and efficiency of eye movement interaction are improved.

Description

Method for determining and adjusting proper gaze triggering time in user gaze interaction
Technical Field
The invention relates to the technical field of electric digital data processing, in particular to a method for determining and adjusting proper gaze triggering time in user sight interaction.
Background
Vision is one of the main sensory pathways through which a person obtains external information. In recent years, with the development of the sight tracking technology, the real-time gaze position, eye jump or smooth tracking activity of a person can be identified and recorded by means of hardware such as an eye tracker or a common camera and based on a computer algorithm. The sight tracking technology is widely applied to the fields of product usability research, psychological and cognitive science research and man-machine interaction. In the field of human-computer interaction, a sight-controlled cursor is used to replace the function of a traditional physical mouse in various application scenarios, for example, after a Tobii specific eye tracker is connected, a computer support person installed with a Windows 10 system assists in controlling the movement of a desktop cursor through sight, i.e., the desktop cursor is shifted to a position where the person looks at when a specific condition is met. In the large-scale cursor transfer, compared with the cursor control of the traditional physical mouse, the cursor control mode of adding the sight control is more time-saving and labor-saving. In addition to identifying a viewpoint position for cursor movement, another common gaze interaction paradigm is to trigger a key click operation by identifying the behavior of a human eye gazing at the key. This interactive style of gaze-triggered clicking has its clear advantages: only need use this organ of eyes, liberated both hands, need not to utilize other peripheral hardware such as mouse, the interaction process is directly perceived etc. is applicable to the condition that people's both hands are occupied by other tasks, also provides the mode of exchanging and interacting with the external world for the physically disabled person.
Although there are many advantages to the interactive paradigm of gaze-triggered clicks, it also faces the problem of susceptibility to false triggering. In this interactive mode, when the human eye gazes at a key for more than a set time threshold (hereinafter referred to as the gaze trigger time, e.g., 0.6s), it is considered to be a single click on the key. Sometimes, the time of the sight line staying on the key exceeds the staring trigger time just by observing and distinguishing the content on the key, and the intention of clicking the button is not made, so that the condition of false triggering occurs. The false trigger probability can be reduced by increasing the gaze trigger time, but results in longer task completion time and higher visual fatigue. It is generally believed that the principle of a reasonable choice of gaze trigger time is to set a gaze trigger time as short as possible while ensuring a low false trigger probability. In conventional research and eye movement interactive products, a fixed gaze trigger time is often set empirically, and the set fixed gaze trigger time is used by any user. However, suitable gaze trigger times for different individuals are not exactly the same, e.g. older people tend to require longer gaze trigger times than younger people due to the relatively longer discernment response; the gaze trigger times required may vary in different states even for the same individual, as often are shorter where the task and gaze interaction modalities are more skilled. There is still a lack of related methods and systems for personalized, fast and efficient determination and adjustment of appropriate gaze trigger times in user gaze interaction.
Under the background, a scientific and effective method for determining and adjusting the appropriate gaze triggering time in the user gaze interaction is provided, and the method has important values for improving the gaze interaction efficiency and the user experience and has practical significance for improving the applicability of the gaze interaction in the vast population.
Disclosure of Invention
The invention aims to solve the practical problems that personalized consideration is lacked when the gaze triggering time is set in the prior art, and the like, and provides a method for determining and adjusting the proper gaze triggering time in the user sight interaction.
The invention provides a method for determining and adjusting proper gazing triggering time in user sight line interaction, which comprises the following steps:
s1, initialization setting: setting the gaze trigger time DT initially in the control system, the minimum allowable value DT of the gaze trigger timeLowerLimitGaze trigger time threshold upturn step size TUpStepGaze trigger time thresholdDown-regulating the step size TDownStepA task termination threshold value P, a fixed parameter M, a variable parameter N and a false click influence decay coefficient K, wherein the variable parameter N is used for triggering and adjusting the minimum allowable value DT of the gaze trigger timeLowerLimitThe variable parameter N is initialized to be a fixed parameter M, and the false attack influence decay coefficient K is used for adjusting the variable parameter N;
s2, executing a distinguishing reaction task: the gaze acquisition device acquires the position of the user's gaze on the screen of the display system, the user executes a gaze-triggered recognition reaction task by controlling the stay and movement of the gaze, the control system feeds back the gaze-triggered behavior, and the control system records the stimulus presentation information in the current recognition reaction trial, acquires the user reaction information and acquires the reaction type of the current recognition reaction trial;
s3, parameter adjustment: the control system determines the minimum allowable value DT of the gaze trigger time according to the type of reaction and the current number of recognition reactionsLowerLimitVariable parameter N and gaze trigger time DT adjustment and setting of gaze trigger time minimum allowed value DT for the next trialLowerLimitVariable parameter N and gaze trigger time DT;
when the control system detects that the historical rising times of the gaze triggering time DT are greater than or equal to a task termination threshold value P and the historical falling times of the gaze triggering time DT are greater than or equal to the task termination threshold value P, terminating and distinguishing the reaction task; otherwise, return to step S2;
s4, distinguishing the termination of the reaction task: and (4) identifying the termination of the reaction task, wherein an interval defined by the two gaze trigger times DT which change last before the termination is a value interval suitable for the gaze trigger time.
A method of determining and adjusting an appropriate gaze trigger time in a user gaze interaction as described herein preferably,
step S2 includes the following steps:
s21, enabling a first pattern to appear at a random position in the peripheral area of the screen;
s22, after the sight line acquisition device detects that the sight line of the user moves to the first pattern and stays for a gaze trigger time DT, the control system controls the first pattern to disappear and expose the second pattern, and meanwhile, the first pattern appears in the center of the screen;
s23, judging the second pattern by the user, moving the sight line, returning to the first pattern, stopping until reaching the fixation triggering time DT, allowing the first pattern and the second pattern to disappear simultaneously, and identifying that the reaction trial is finished;
s24, recording stimulation presenting information in each identification reaction trial, collecting user reaction information and obtaining a reaction type by the control system;
the reaction types include correct hit, false hit, correct reject, and false reject.
A method of determining and adjusting an appropriate gaze trigger time in a user gaze interaction as described herein preferably,
step S2 includes the following steps:
s21, a circle appears at the random position of the peripheral area of the screen;
s22, after the sight line acquisition device detects that the sight line of the user moves to the circle and stays for a gaze trigger time DT, the circle disappears and exposes a square containing the number, and the circle appears in the center of the screen;
s23, judging the odd-even number of the numbers, moving the sight line, stopping the circle until the gaze trigger time DT is reached, allowing the circle and the square containing the numbers to disappear simultaneously, and judging that the reaction trial is finished;
and S24, recording the stimulus presentation information in each identification reaction trial by the control system, collecting the user response information and obtaining the response type.
A method of determining and adjusting an appropriate gaze trigger time in a user gaze interaction as described herein preferably,
the reaction type in step S24 is:
correct hit: the number is even, the user gazes the number to exceed the current trial gazing triggering time DT and selects the square block, then returns to the circle to stay for the gazing triggering time DT, and the circle and the square block containing the number disappear at the same time;
error hit: the number is odd, the user gazes the number to exceed the current trial gazing triggering time DT and selects the square block, then returns to the circle to stay for the gazing triggering time DT, and the circle and the square block containing the number disappear at the same time;
and (4) correct rejection: if the number is odd, the user returns to the circle to stop for the gaze trigger time DT without selecting the square block, and the circle and the square block containing the number disappear at the same time;
error rejection: the number is even, the user returns to the circle without selecting the square to stay for the gaze trigger time DT, and the circle and the square containing the number disappear at the same time.
A method of determining and adjusting an appropriate gaze trigger time in a user gaze interaction as described herein preferably,
when the square is selected in step S23, the edge of the square appears as a white box as visual feedback.
The method for determining and adjusting the proper gaze trigger time in the user gaze interaction of the present invention preferably comprises the step of determining the minimum allowable gaze trigger time DT of the next trial at step S3LowerLimitAnd the method for adjusting the gaze trigger time DT of the next trial comprises the following steps:
when the current reaction type is correct hit or error rejection, the minimum allowable value DT of the gaze trigger time of the next trialLowerLimitAnd the gaze trigger time DT for the next trial is kept constant;
when the current reaction type is a fault hit, the minimum allowable value DT of the gaze trigger time of the next trial is determinedLowerLimitPerforming up-regulation, and simultaneously performing up-regulation on the gaze triggering time DT of the next trial;
current reaction type is correct rejection and minimum allowable value DT at current gaze trigger timeLowerLimitWhen the accumulated correct rejection times reach N times under the value, the minimum allowable value DT of the staring trigger time is determinedLowerLimitCarrying out down regulation; then, DT-T is judgedDownStep≥DTLowerLimitAnd if so, adjusting DT downwards.
A method of determining and adjusting an appropriate gaze trigger time in a user gaze interaction as described herein preferably,
in step S3Minimum allowable gaze trigger time DT for the next trialLowerLimitThe up-regulation method comprises the following steps:
judgment (DT-DT)LowerLimit)≥3×TUpStepWhether or not:
if true, DTLowerLimit＝DTLowerLimit+3×TUpStep；
If not, DTLowerLimit＝DT+(TUpStep+TDownStep)/2；
The up-regulation method of the gaze trigger time DT of the next trial is as follows: DT + TUpStep；
Minimum allowable gaze trigger time DT for next trialLowerLimitThe down-regulation method comprises the following steps:
DTLowerLimit＝DTLowerLimit-TDownStep(ii) a If DTLowerLimitIs negative, let DTLowerLimitReset to 0;
the method for adjusting down the gaze trigger time DT of the next trial comprises the following steps: DT-TDownStep。
A method of determining and adjusting an appropriate gaze trigger time in a user gaze interaction as described herein preferably,
the method for adjusting N in step S3 includes: gaze trigger time minimum allowed value DTLowerLimitRecalculating N when adjusting up or down;
the formula for calculating N is:
N＝M(SOE+1)，
Figure BDA0003003584650000051
wherein, the fixed parameter M is the minimum allowable value DT for triggering and adjusting the gaze triggering timeLowerLimitThe minimum number of correct rejections required;
the SOE is the sum of the influences of all previous error hits on the current identification reaction times;
e is 2.7183, and K is a false impact influence decay coefficient;
dito try the distanceThe trial distance represents the number of trials in the ith error hit from the current discrimination response trial interval.
The method for determining and adjusting the proper gaze trigger time in the user gaze interaction is used as a preferred mode, and the gaze trigger time threshold value is adjusted up by the step amount TUpStepGaze trigger time threshold Down step amount TDownStepThe task termination threshold value P, the fixed parameter M and the false click influence decay coefficient K are all fixed parameters.
The invention relates to a method for determining and adjusting proper gaze trigger time in user sight line interaction, which is a preferable mode, TUpStep＝0.1s，TDownStep0.05s, 3, 0.15, 1s, DT for DT initialization, DTLowerLimitInitialization is 0 and N is initialized to 3.
By the algorithm, the dynamic adjustment of the gaze triggering time is realized, and the following adjustment effects can be achieved:
if the initially set gaze trigger time is too short for the user, a miss hit is likely to occur in the task causing the gaze trigger time to rise relatively quickly and eventually fluctuate within a small range of relatively reasonable stability.
If the initially set gaze trigger time is too long for the user, the gaze trigger time will gradually decrease after multiple proper rejections in the task and eventually fluctuate within a small range of relatively reasonable stability.
The invention has the following advantages:
(1) the method can be used for quickly and effectively determining the proper gazing triggering time in the user sight line interaction, the user only needs to complete a simple recognition reaction task through the sight line interaction, the system adaptively adjusts the gazing triggering time according to the recognition reaction data of the user, and the proper gazing triggering time of the user can be determined within one to three minutes generally;
(2) the method can be used for dynamically adjusting the gaze triggering time in the user sight line interaction, and for the gaze triggering type interaction tasks, even if the initial gaze triggering time is not completely set reasonably, or the previous proper initial setting is not proper at present due to the change of personnel state, the gaze triggering time can be readjusted to the proper level in the tasks through the method;
(3) the method overcomes the defects of lack of personalized consideration and lack of a dynamic adjustment method when the gaze triggering time is set in the prior art, has application and popularization values in various gaze interaction tasks, and can effectively improve the efficiency of gaze interaction operations and user experience.
Drawings
FIG. 1 is a flow chart of a method of determining and adjusting an appropriate gaze trigger time in a user gaze interaction;
FIG. 2 is a flowchart of step S2 of embodiment 2 of a method for determining and adjusting an appropriate gaze trigger time in a user gaze interaction;
fig. 3 is a flowchart of a method embodiment 3-embodiment 7 step S2 of determining and adjusting an appropriate gaze trigger time in a user gaze interaction;
FIG. 4 is a schematic diagram of a method embodiment 3-embodiment 7 for determining and adjusting an appropriate gaze trigger time in a user gaze interaction to identify the state of an interface display at the beginning of a trial of a reaction task;
FIG. 5 is a schematic illustration of a method embodiment 3-embodiment 7 of determining and adjusting an appropriate gaze trigger time in a user gaze interaction to discern a digital discernment reaction to a task at a time when it has not yet been selected;
FIG. 6 is a schematic diagram of a method embodiment 3-embodiment 7 of determining and adjusting an appropriate gaze-trigger time in a user gaze interaction, recognizing that a trial digit of a reaction task is gaze-triggered and the type of reaction is a correct hit;
fig. 7 is a schematic diagram of a method of determining and adjusting an appropriate gaze-trigger time in a user gaze interaction, example 3-example 7, recognizing when a trial number of a reaction task is gaze-triggered and the type of reaction is a false hit.
Detailed Description
The technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the drawings in the embodiments of the present invention, and it is obvious that the described embodiments are only a part of the embodiments of the present invention, and not all of the embodiments.
Example 1
As shown in fig. 1, a method of determining and adjusting an appropriate gaze trigger time in a user gaze interaction, comprising the steps of:
s1, initialization setting: setting the gaze trigger time DT initially in the control system, the minimum allowable value DT of the gaze trigger timeLowerLimitGaze trigger time threshold upturn step size TUpStepGaze trigger time threshold Down step amount TDownStepA task termination threshold value P, a fixed parameter M, a variable parameter N and a false click influence decay coefficient K, wherein the variable parameter N is used for triggering and adjusting the minimum allowable value DT of the gaze trigger timeLowerLimitThe variable parameter N is initialized to be a fixed parameter M, and the false attack influence decay coefficient K is used for adjusting the variable parameter N;
s2, executing a distinguishing reaction task: the gaze acquisition device acquires the position of the user's gaze on the screen of the display system, the user executes a gaze-triggered recognition reaction task by controlling the stay and movement of the gaze, the control system feeds back the gaze-triggered behavior, and the control system records the stimulus presentation information in the current recognition reaction trial, acquires the user reaction information and acquires the reaction type of the current recognition reaction trial;
s3, parameter adjustment: the control system determines the minimum allowable value DT of the gaze trigger time according to the type of reaction and the current number of recognition reactionsLowerLimitVariable parameter N and gaze trigger time DT adjustment and setting of gaze trigger time minimum allowed value DT for the next trialLowerLimitVariable parameter N and gaze trigger time DT;
when the control system detects that the historical rising times of the gaze triggering time DT are greater than or equal to a task termination threshold value P and the historical falling times of the gaze triggering time DT are greater than or equal to the task termination threshold value P, terminating and distinguishing the reaction task; otherwise, return to step S2;
s4, distinguishing the termination of the reaction task: and (4) identifying the termination of the reaction task, wherein an interval defined by the two gaze trigger times DT which change last before the termination is a value interval suitable for the gaze trigger time.
Example 2
As shown in fig. 1, a method of determining and adjusting an appropriate gaze trigger time in a user gaze interaction, comprising the steps of:
s1, initialization setting: setting the gaze trigger time DT initially in the control system, the minimum allowable value DT of the gaze trigger timeLowerLimitGaze trigger time threshold upturn step size TUpStepGaze trigger time threshold Down step amount TDownStepA task termination threshold value P, a fixed parameter M, a variable parameter N and a false click influence decay coefficient K, wherein the variable parameter N is used for triggering and adjusting the minimum allowable value DT of the gaze trigger timeLowerLimitThe variable parameter N is initialized to be a fixed parameter M, and the false attack influence decay coefficient K is used for adjusting the variable parameter N;
s2, executing a distinguishing reaction task: the gaze acquisition device acquires the position of the user's gaze on the screen of the display system, the user executes a gaze-triggered recognition reaction task by controlling the stay and movement of the gaze, the control system feeds back the gaze-triggered behavior, and the control system records the stimulus presentation information in the current recognition reaction trial, acquires the user reaction information and acquires the reaction type of the current recognition reaction trial;
as shown in fig. 2, S21, a first pattern appears at random positions in the peripheral area of the screen;
s22, after the sight line acquisition device detects that the sight line of the user moves to the first pattern and stays for a gaze trigger time DT, the control system controls the first pattern to disappear and expose the second pattern, and meanwhile, the first pattern appears in the center of the screen;
s23, judging the second pattern by the user, moving the sight line, returning to the first pattern, stopping until reaching the fixation triggering time DT, allowing the first pattern and the second pattern to disappear simultaneously, and identifying that the reaction trial is finished;
s24, recording stimulation presenting information in each identification reaction trial, collecting user reaction information and obtaining a reaction type by the control system;
the reaction types comprise correct hit, wrong hit, correct rejection and wrong rejection;
s3, ginsengNumber adjustment: the control system determines the minimum allowable value DT of the gaze trigger time according to the type of reaction and the current number of recognition reactionsLowerLimitVariable parameter N and gaze trigger time DT adjustment and setting of gaze trigger time minimum allowed value DT for the next trialLowerLimitVariable parameter N and gaze trigger time DT;
when the control system detects that the historical rising times of the gaze triggering time DT are greater than or equal to a task termination threshold value P and the historical falling times of the gaze triggering time DT are greater than or equal to the task termination threshold value P, terminating and distinguishing the reaction task; otherwise, return to step S2;
s4, distinguishing the termination of the reaction task: and (4) identifying the termination of the reaction task, wherein an interval defined by the two gaze trigger times DT which change last before the termination is a value interval suitable for the gaze trigger time.
Example 3
As shown in fig. 1, a method of determining and adjusting an appropriate gaze trigger time in a user gaze interaction, comprising the steps of:
s1, initialization setting: setting the gaze trigger time DT initially in the control system, the minimum allowable value DT of the gaze trigger timeLowerLimitGaze trigger time threshold upturn step size TUpStepGaze trigger time threshold Down step amount TDownStepA task termination threshold value P, a fixed parameter M, a variable parameter N and a false click influence decay coefficient K, wherein the variable parameter N is used for triggering and adjusting the minimum allowable value DT of the gaze trigger timeLowerLimitThe variable parameter N is initialized to be a fixed parameter M, and the false attack influence decay coefficient K is used for adjusting the variable parameter N;
s2, executing a distinguishing reaction task: the gaze acquisition device acquires the position of the user's gaze on the screen of the display system, the user executes a gaze-triggered recognition reaction task by controlling the stay and movement of the gaze, the control system feeds back the gaze-triggered behavior, and the control system records the stimulus presentation information in the current recognition reaction trial, acquires the user reaction information and acquires the reaction type of the current recognition reaction trial;
as shown in fig. 3-7, S21 shows a circle in the peripheral area of the screen at random;
s22, after the sight line acquisition device detects that the sight line of the user moves to the circle and stays for a gaze trigger time DT, the circle disappears and exposes a square containing the number, and the circle appears in the center of the screen;
s23, judging the odd-even number of the numbers, moving the sight line, stopping the circle until the gaze trigger time DT is reached, allowing the circle and the square containing the numbers to disappear simultaneously, and judging that the reaction trial is finished;
when the square block is selected in the step S23, a white frame appears at the edge of the square block to serve as visual feedback;
s24, recording stimulation presenting information in each identification reaction trial, collecting user reaction information and obtaining a reaction type by the control system;
correct hit: the number is even, the user gazes the number to exceed the current trial gazing triggering time DT and selects the square block, then returns to the circle to stay for the gazing triggering time DT, and the circle and the square block containing the number disappear at the same time;
error hit: the number is odd, the user gazes the number to exceed the current trial gazing triggering time DT and selects the square block, then returns to the circle to stay for the gazing triggering time DT, and the circle and the square block containing the number disappear at the same time;
and (4) correct rejection: if the number is odd, the user returns to the circle to stop for the gaze trigger time DT without selecting the square block, and the circle and the square block containing the number disappear at the same time;
error rejection: if the number is an even number, the user returns to the circle to stop for the gaze trigger time DT without selecting the square block, and the circle and the square block containing the number disappear at the same time;
s3, parameter adjustment: the control system determines the minimum allowable value DT of the gaze trigger time according to the type of reaction and the current number of recognition reactionsLowerLimitVariable parameter N and gaze trigger time DT adjustment and setting of gaze trigger time minimum allowed value DT for the next trialLowerLimitVariable parameter N and gaze trigger time DT;
when the control system detects that the historical rising times of the gaze triggering time DT are greater than or equal to a task termination threshold value P and the historical falling times of the gaze triggering time DT are greater than or equal to the task termination threshold value P, terminating and distinguishing the reaction task; otherwise, return to step S2;
minimum allowable gaze trigger time DT for next trialLowerLimitAnd the method for adjusting the gaze trigger time DT of the next trial comprises the following steps:
when the current reaction type is correct hit or error rejection, the minimum allowable value DT of the gaze trigger time of the next trialLowerLimitAnd the gaze trigger time DT for the next trial is kept constant;
when the current reaction type is a fault hit, the minimum allowable value DT of the gaze trigger time of the next trial is determinedLowerLimitPerforming up-regulation, and simultaneously performing up-regulation on the gaze triggering time DT of the next trial;
current reaction type is correct rejection and minimum allowable value DT at current gaze trigger timeLowerLimitWhen the accumulated correct rejection times reach N times under the value, the minimum allowable value DT of the staring trigger time is determinedLowerLimitCarrying out down regulation; then, DT-T is judgedDownStep≥DTLowerLimitIf yes, adjusting DT downwards;
minimum allowable gaze trigger time DT for next trialLowerLimitThe up-regulation method comprises the following steps:
judgment (DT-DT)LowerLimit)≥3×TUpStepWhether or not:
if true, DTLowerLimit＝DTLowerLimit+3×TUpStep；
If not, DTLowerLimit＝DT+(TUpStep+TDownStep)/2；
The up-regulation method of the gaze trigger time DT of the next trial is as follows: DT + TUpStep；
Minimum allowable gaze trigger time DT for next trialLowerLimitThe down-regulation method comprises the following steps:
DTLowerLimit＝DTLowerLimit-TDownStep(ii) a If DTLowerLimitIs negative, let DTLowerLimitReset to 0;
the method for adjusting down the gaze trigger time DT of the next trial comprises the following steps: DT-TDownStep；
The adjusting method of N is as follows: gaze trigger time minimum allowed value DTLowerLimitRecalculating N when adjusting up or down;
the formula for calculating N is:
N＝M(SOE+1)，
Figure BDA0003003584650000121
wherein, the fixed parameter M is the minimum allowable value DT for triggering and adjusting the gaze triggering timeLowerLimitThe minimum number of correct rejections required;
the SOE is the sum of the influences of all previous error hits on the current identification reaction times;
e is 2.7183, and K is a false impact influence decay coefficient;
dithe trial distance represents the trial frequency of the current identification reaction trial interval in the ith error hit distance;
s4, distinguishing the termination of the reaction task: and (4) identifying the termination of the reaction task, wherein an interval defined by the two gaze trigger times DT which change last before the termination is a value interval suitable for the gaze trigger time.
Example 4
As shown in fig. 1, a method of determining and adjusting an appropriate gaze trigger time in a user gaze interaction, comprising the steps of:
s1, initialization setting: setting the gaze trigger time DT initially in the control system, the minimum allowable value DT of the gaze trigger timeLowerLimitGaze trigger time threshold upturn step size TUpStepGaze trigger time threshold Down step amount TDownStepA task termination threshold value P, a fixed parameter M, a variable parameter N and a false click influence decay coefficient K, wherein the variable parameter N is used for triggering and adjusting the minimum allowable value DT of the gaze trigger timeLowerLimitThe variable parameter N is initialized to be a fixed parameter M, and the false attack influence decay coefficient K is used for adjusting the variable parameter N;
s2, executing a distinguishing reaction task: the gaze acquisition device acquires the position of the user's gaze on the screen of the display system, the user executes a gaze-triggered recognition reaction task by controlling the stay and movement of the gaze, the control system feeds back the gaze-triggered behavior, and the control system records the stimulus presentation information in the current recognition reaction trial, acquires the user reaction information and acquires the reaction type of the current recognition reaction trial;
as shown in fig. 3-7, S21 shows a circle in the peripheral area of the screen at random;
s22, after the sight line acquisition device detects that the sight line of the user moves to the circle and stays for a gaze trigger time DT, the circle disappears and exposes a square containing the number, and the circle appears in the center of the screen;
s23, judging the odd-even number of the numbers, moving the sight line, stopping the circle until the gaze trigger time DT is reached, allowing the circle and the square containing the numbers to disappear simultaneously, and judging that the reaction trial is finished;
when the square block is selected in the step S23, a white frame appears at the edge of the square block to serve as visual feedback;
s24, recording stimulation presenting information in each identification reaction trial, collecting user reaction information and obtaining a reaction type by the control system;
correct hit: the number is even, the user gazes the number to exceed the current trial gazing triggering time DT and selects the square block, then returns to the circle to stay for the gazing triggering time DT, and the circle and the square block containing the number disappear at the same time;
error hit: the number is odd, the user gazes the number to exceed the current trial gazing triggering time DT and selects the square block, then returns to the circle to stay for the gazing triggering time DT, and the circle and the square block containing the number disappear at the same time;
and (4) correct rejection: if the number is odd, the user returns to the circle to stop for the gaze trigger time DT without selecting the square block, and the circle and the square block containing the number disappear at the same time;
error rejection: if the number is an even number, the user returns to the circle to stop for the gaze trigger time DT without selecting the square block, and the circle and the square block containing the number disappear at the same time;
s3, parameter adjustment: the control system determines the minimum allowable value DT of the gaze trigger time according to the type of reaction and the current number of recognition reactionsLowerLimitVariable parameter N and gaze trigger time DT adjustment and setting of gaze trigger time minimum allowed value DT for the next trialLowerLimitVariable parameter N and gaze trigger time DT;
when the control system detects that the historical rising times of the gaze triggering time DT are greater than or equal to a task termination threshold value P and the historical falling times of the gaze triggering time DT are greater than or equal to the task termination threshold value P, terminating and distinguishing the reaction task; otherwise, return to step S2;
minimum allowable gaze trigger time DT for next trialLowerLimitAnd the method for adjusting the gaze trigger time DT of the next trial comprises the following steps:
when the current reaction type is correct hit or error rejection, the minimum allowable value DT of the gaze trigger time of the next trialLowerLimitAnd the gaze trigger time DT for the next trial is kept constant;
when the current reaction type is a fault hit, the minimum allowable value DT of the gaze trigger time of the next trial is determinedLowerLimitPerforming up-regulation, and simultaneously performing up-regulation on the gaze triggering time DT of the next trial;
current reaction type is correct rejection and minimum allowable value DT at current gaze trigger timeLowerLimitWhen the accumulated correct rejection times reach N times under the value, the minimum allowable value DT of the staring trigger time is determinedLowerLimitCarrying out down regulation; then, DT-T is judgedDownStep≥DTLowerLimitIf yes, adjusting DT downwards;
minimum allowable gaze trigger time DT for next trialLowerLimitThe up-regulation method comprises the following steps:
judgment (DT-DT)LowerLimit)≥3×TUpStepWhether or not:
if true, DTLowerLimit＝DTLowerLimit+3×TUpStep；
If not, DTLowerLimit＝DT+(TUpStep+TDownStep)/2；
The up-regulation method of the gaze trigger time DT of the next trial is as follows: DT + TUpStep；
Minimum allowable gaze trigger time DT for next trialLowerLimitThe down-regulation method comprises the following steps:
DTLowerLimit＝DTLowerLimit-TDownStep(ii) a If DTLowerLimitIs negative, let DTLowerLimitReset to 0;
the method for adjusting down the gaze trigger time DT of the next trial comprises the following steps: DT-TDownStep；
The adjusting method of N is as follows: gaze trigger time minimum allowed value DTLowerLimitRecalculating N when adjusting up or down;
the formula for calculating N is:
N＝M(SOE+1)，
Figure BDA0003003584650000141
wherein, the fixed parameter M is the minimum allowable value DT for triggering and adjusting the gaze triggering timeLowerLimitThe minimum number of correct rejections required;
the SOE is the sum of the influences of all previous error hits on the current identification reaction times;
e is 2.7183, and K is a false impact influence decay coefficient;
dithe trial distance represents the trial frequency of the current identification reaction trial interval in the ith error hit distance;
s4, distinguishing the termination of the reaction task: recognizing that the reaction task is terminated, wherein an interval defined by two gaze trigger times DT which change last before termination is a value interval suitable for the gaze trigger time;
gaze trigger time threshold upshifting by step amount TUpStepGaze trigger time threshold Down step amount TDownStepThe task termination threshold P, the fixed parameter M and the false click influence decay coefficient K are all fixed parameters,
for example: t isUpStep＝0.1s，TDownStep0.05s, 3, 0.15, 1s, DT for DT initialization, DTLowerLimitInitialization is 0 and N is initialized to 3.
Example 5
As shown in fig. 1, a method of determining and adjusting an appropriate gaze trigger time in a user gaze interaction, comprising the steps of:
s1, setting a gaze trigger time DT (initialized to 0.3S and dynamically adjustable in task) and a minimum allowable value DT of the gaze trigger timeLowerLimit(initialized to 0, dynamically adjustable in task), gaze trigger time threshold Up step TUpStep(fixed parameters, e.g. 0.1s), gaze trigger time threshold Down step amount TDownStep(fixed parameters, e.g., 0.05s), task termination threshold P (fixed parameters, e.g., 3), fixed parameters M (fixed parameters, e.g., 2), variable parameters N (initialized to M, dynamically adjustable in task), and false hit impact decay coefficient K (fixed parameters, e.g., 0.15).
As shown in fig. 3 to 7, the position of the user' S sight line on the screen is acquired S2, the user performs a recognition reaction task by controlling the stay and movement of the sight line, records stimulus presentation information in each trial, and collects user reaction information. The recognition reaction task is a computerized software test, in a recognition reaction trial, a circle appears at a random position in the peripheral area of the screen (as shown in fig. 4), the peripheral circle disappears after the sight line moves to the circle, a square containing the number is exposed, and a circle appears in the center of the screen (as shown in fig. 5), so that the user is required to judge the parity of the number. If the number is even, the user is required to stare at the digitally selected square, when the square is selected, a white box appears at the edge of the square to serve as visual feedback (as shown in FIGS. 6 and 7), and the user returns to the central circle after selecting the square; if it is odd, the user is asked to avoid selecting the square (which would be marked as a false hit if the square was selected) and to return to the center circle. Whether or not the square is selected, the line of sight returns to the center circle to stay DT and then proceeds to the next trial.
The control system records stimulation presentation information in each identification reaction trial, collects user reaction information and obtains a reaction type;
correct hit: the number is even, the user gazes the number to exceed the current trial gazing triggering time DT and selects the square block, then returns to the circle to stay for the gazing triggering time DT, and the circle and the square block containing the number disappear at the same time;
error hit: the number is odd, the user gazes the number to exceed the current trial gazing triggering time DT and selects the square block, then returns to the circle to stay for the gazing triggering time DT, and the circle and the square block containing the number disappear at the same time;
and (4) correct rejection: if the number is odd, the user returns to the circle to stop for the gaze trigger time DT without selecting the square block, and the circle and the square block containing the number disappear at the same time;
error rejection: if the number is an even number, the user returns to the circle to stop for the gaze trigger time DT without selecting the square block, and the circle and the square block containing the number disappear at the same time;
s3, the control system according to the reaction type of the current trial and the preceding trial, the minimum allowable value DT of the gaze trigger time of the current trialLowerLimitVariable parameter N and gaze trigger time DT adjustment and setting of gaze trigger time minimum allowed value DT for the next trialLowerLimitVariable parameter N and gaze trigger time DT; the adjustment rules are as follows:
(1) if the current trial time is a fault hit, the DT is testedLowerLimitThe method for adjusting the position of the mobile terminal comprises the following steps: judgment (DT-DT)LowerLimit)≥3×TUpStepWhether or not: if true, then DT is appliedLowerLimitAdjusted to DTLowerLimit+3×TUpStep(ii) a If not, DT is treatedLowerLimitAdjusted to DT + (T)UpStep+TDownStep)/2. If the current trial time is the error hit, the DT is adjusted up, and the adjustment method is that DT + TUpStep。
(2) If the current trial is a correct rejection and is currently DTLowerLimitWhen the accumulated correct rejection times reaches N times under the value taking, the DT is processedLowerLimitDown-regulation is carried out, DTLowerLimit＝DTLowerLimit-TDownStep(ii) a If DTLowerLimitIs negative, let DTLowerLimitReset to 0;
then, DT-T is judgedDownStep≥DTLowerLimitIf the DT is satisfied, the DT is adjusted downwards, and the method for adjusting downwards is that DT is equal to DT-TDownStep。
(3) Each time of DTLowerLimitWhen the signal is adjusted up or down, that is, when the conditions in (1) and (2) are present, N is updated according to the following algorithm:
n ═ M × (SOE +1), where M is a fixed parameter (e.g., 2); SOE is a short hand for Sum of Error, and represents the Sum of the effects of all previous Error hit scenarios on:
Figure BDA0003003584650000171
k is a fixed parameter (e.g., 0.15); diRepresents the number of times of the i-th miss (trial distance) from the current trial interval, and if the current trial miss hits, the trial distance d of the missi0, which contributes 1 in the SOE; if a miss hit was previously made, the miss hit is tried to d of the current triali≧ 1, the contribution in the SOE is a value between 0 and 1, the longer the miss hit is from the current trial, diThe larger the contribution to SOE. According to this algorithm, the minimum value of N is M; after only one error hit occurs currently, N is updated to 2M; when the current miss hit occurs and other miss hits are found before, the value of N is greater than 2M. After a miss, if the N consecutive occurrences of an odd number are correctly rejected, then the value of N is typically adjusted downward (possibly to a minimum value M and held constant).
By the algorithm, the dynamic adjustment of the gaze triggering time is realized, and the following adjustment effects can be achieved:
if the initially set gaze trigger time is too short for the user, a miss hit is likely to occur in the task causing the gaze trigger time to rise relatively quickly and eventually fluctuate within a small range of relatively reasonable stability.
If the initially set gaze trigger time is too long for the user, the gaze trigger time will gradually decrease after multiple proper rejections in the task and eventually fluctuate within a small range of relatively reasonable stability.
And S4, if the rising times historically experienced by the gaze trigger time are detected to be more than or equal to 3, and the falling times historically experienced by DT are detected to be more than or equal to 3, terminating the discrimination reaction task, and determining the interval of the two gaze trigger times which are changed last before the task is terminated as the proper gaze trigger time value interval.
The sight line acquisition device and the display system transmit data through a USB.
Example 6
As shown in fig. 1-7, a method of determining and adjusting an appropriate gaze trigger time in a user gaze interaction initially sets: t isUpStep＝0.1s，TDownStep0.05s, 3, 2, 0.15, 0.3s, DTLowerLimitThe initialization is 0, the N initialization is 2, and the implementation is as follows:
Figure BDA0003003584650000181
Figure BDA0003003584650000191
Figure BDA0003003584650000201
after the 32 th trial, the historical rising times of DT are more than or equal to 3, and the historical falling times of DT are more than or equal to 3, so that the task termination condition is met, the value interval of the suitable fixation trigger time DT is [0.45, 0.5] s, wherein the initial fixation trigger time can be set as the upper limit of the interval under the condition of pursuing accuracy, and is 0.5s in the above example; in the case of pursuit of speed, the initial gaze trigger time may be set to the lower limit of the interval, 0.45s in the above example.
Example 7
As shown in FIGS. 1-7, a method of determining and adjusting user gaze interactionThe method for optimizing the gaze trigger time comprises the following steps of: t isUpStep＝0.1s，TDownStep0.05s, 3, 0.15, 1s, DT for DT initialization, DTLowerLimitThe initialization is 0, the N initialization is 3, and the implementation is as follows:
Figure BDA0003003584650000202
Figure BDA0003003584650000211
Figure BDA0003003584650000221
Figure BDA0003003584650000231
Figure BDA0003003584650000241
after the 64 th trial, the historical rising times of DT are more than or equal to 3, the historical falling times of DT are more than or equal to 3, the task termination condition is met, the value interval of the suitable fixation trigger time DT is [0.45, 0.55] s, wherein, under the condition of pursuing accuracy, the initial fixation trigger time can be set as the upper limit of the interval, which is 0.55s in the above example; in the case of pursuit of speed, the initial gaze trigger time may be set to the lower limit of the interval, 0.45s in the above example.
The above description is only for the preferred embodiment of the present invention, but the scope of the present invention is not limited thereto, and any person skilled in the art should be considered to be within the technical scope of the present invention, and the technical solutions and the inventive concepts thereof according to the present invention should be equivalent or changed within the scope of the present invention.

Claims (10)

1. A method of determining and adjusting an appropriate gaze trigger time in a user gaze interaction, characterized by: the method comprises the following steps:
s1, initialization setting: setting the gaze trigger time DT initially in the control system, the minimum allowable value DT of the gaze trigger timeLowerLimitGaze trigger time threshold upturn step size TUpStepGaze trigger time threshold Down step amount TDownStepA task termination threshold P, a fixed parameter M, a variable parameter N for triggering an adjustment of the gaze trigger time minimum allowed value DT, and a false click impact decay coefficient KLowerLimitThe variable parameter N is initialized to the fixed parameter M, and the false hit influence regression coefficient K is used to adjust the variable parameter N;
s2, executing a distinguishing reaction task: the gaze acquisition device acquires the position of a user's gaze on a display system screen, the user executes a gaze-triggered recognition reaction task by controlling the stay and movement of the gaze, the control system feeds back the gaze-triggered behavior, and the control system records stimulus presentation information in the current recognition reaction trial, acquires user reaction information and acquires the reaction type of the current recognition reaction trial;
s3, parameter adjustment: the control system determines the minimum allowable value DT of the gaze trigger time according to the type of reaction and the current number of recognition reactionsLowerLimitAdjusting the variable parameter N and the gaze trigger time DT and setting the minimum allowable value DT of the gaze trigger time for the next trialLowerLimitThe variable parameter N and the gaze trigger time DT;
when the control system detects that the historical rising times of the gaze trigger time DT are greater than or equal to the task termination threshold value P and the historical falling times of the gaze trigger time DT are greater than or equal to the task termination threshold value P, terminating the discrimination reaction task; otherwise, return to step S2;
s4, distinguishing the termination of the reaction task: and identifying the termination of the reaction task, wherein an interval defined by the two gaze trigger times DT which change last before the termination is a value interval suitable for the gaze trigger time.
2. The method of determining and adjusting an appropriate gaze-trigger time in a user gaze interaction of claim 1, wherein:
step S2 includes the following steps:
s21, randomly positioning a first pattern in the peripheral area of the screen;
s22, after the sight line acquisition device detects that the sight line of the user moves to the first pattern and stays for the gaze trigger time DT, the control system controls the first pattern to disappear and expose the second pattern, and meanwhile the first pattern appears in the center of the screen;
s23, judging the second pattern by the user, moving the line of sight, returning to the first pattern, stopping for the gaze trigger time DT, allowing the first pattern and the second pattern to disappear simultaneously, and identifying that the reaction trial is finished;
s24, the control system records the stimulation presenting information in each distinguishing reaction trial, collects the user reaction information and obtains the reaction type;
the reaction types include correct hit, false hit, correct reject, and false reject.
3. The method of determining and adjusting an appropriate gaze-trigger time in a user gaze interaction of claim 2, wherein:
step S2 includes the following steps:
s21, a circle appears at the random position of the peripheral area of the screen;
s22, after the sight line acquisition device detects that the sight line of the user moves to the circle and stays for the gaze trigger time DT, the circle disappears and exposes a square block containing numbers, and meanwhile, the circle appears in the center of the screen;
s23, the user judges the odd-even number of the numbers, moves the sight line, then returns to the circle to stay for the gaze trigger time DT, the circle and the square containing the numbers disappear at the same time, and the distinguishing reaction is finished;
and S24, the control system records the stimulus presentation information in each distinguishing reaction trial, collects the user response information and obtains the response type.
4. A method of determining and adjusting an appropriate gaze trigger time in a user gaze interaction according to claim 3, characterized by: the reaction type in step S24 is:
correct hit: the number is an even number, the user gazes at the number, the number exceeds the gazing trigger time DT of the current trial, the user returns to the circle to stay for the gazing trigger time DT after gazing trigger time DT of the current trial, and the circle and the square containing the number disappear at the same time;
error hit: the number is an odd number, the user gazes at the number, the number exceeds the gazing trigger time DT of the current trial, the user returns to the circle to stay for the gazing trigger time DT after gazing at the number for the square, and the circle and the square containing the number disappear at the same time;
and (4) correct rejection: the number is odd, the user returns to the circle without selecting the square block to stay for the gaze trigger time DT, and the circle and the square block containing the number disappear at the same time;
error rejection: the number is even, the user returns to the circle without checking the square to stay for the gaze trigger time DT, the circle and the square containing the number disappear at the same time.
5. The method of determining and adjusting an appropriate gaze-trigger time in a user gaze interaction of claim 4, wherein:
when the square block is selected in step S23, a white box appears on the edge of the square block as visual feedback.
6. The method of determining and adjusting an appropriate gaze trigger time in a user gaze interaction of claim 2, comprisingIs characterized in that: the gaze trigger time minimum allowed value DT of the next trial in step S3LowerLimitAnd the method for adjusting the gaze trigger time DT for the next trial comprises the following steps:
when the current reaction type is correct hit or error rejection, the minimum allowable value DT of the gaze trigger time of the next trialLowerLimitAnd the gaze trigger time DT of the next trial remains unchanged;
when the current reaction type is a false hit, the minimum allowable value DT of the gaze trigger time of the next trial is determinedLowerLimitPerforming up-regulation, and simultaneously performing up-regulation on the gaze trigger time DT of the next trial;
the current reaction type is correct rejection and the minimum allowable value DT is at the current gaze trigger timeLowerLimitWhen the accumulated correct rejection times reach N times under the value, the minimum allowable value DT of the staring trigger time is determinedLowerLimitCarrying out down regulation; then, DT-T is judgedDownStep≥DTLowerLimitAnd if so, adjusting DT downwards.
7. The method of determining and adjusting an appropriate gaze-trigger time in a user gaze interaction of claim 6, wherein:
in step S3, the gaze trigger time minimum allowable value DT for the next trialLowerLimitThe up-regulation method comprises the following steps:
judgment (DT-DT)LowerLimit)≥3×TUpStepWhether or not:
if true, DTLowerLimit＝DTLowerLimit+3×TUpStep；
If not, DTLowerLimit＝DT+(TUpStep+TDownStep)/2；
The up-regulation method of the gaze trigger time DT of the next trial is: DT + TUpStep；
The gaze trigger time minimum allowed value DT for the next trialLowerLimitThe down-regulation method comprises the following steps:
DTLowerLimit＝DTLowerLimit-TDownStep(ii) a If DTLowerLimitIs negative, let DTLowerLimitReset to 0;
the gaze trigger time DT down-regulation method for the next trial comprises: DT-TDownStep。
8. The method of determining and adjusting an appropriate gaze-trigger time in a user gaze interaction of claim 2, wherein:
the method for adjusting N in step S3 includes: said gaze trigger time minimum allowed value DTLowerLimitRecalculating N when adjusting up or down;
the formula for calculating N is:
N＝M(SOE+1)，
Figure FDA0003003584640000041
wherein the fixed parameter M is used for triggering and adjusting the minimum allowable value DT of the gaze trigger timeLowerLimitThe minimum number of correct rejections required;
the SOE is the sum of the influences of all previous error hits on the current identification reaction times;
e is 2.7183, and K is the false impact influence decay coefficient;
diand the trial distance represents the trial frequency of the ith error hit to the current identification reaction trial interval.
9. The method of determining and adjusting an appropriate gaze-trigger time in a user gaze interaction of claim 1, wherein: the gaze trigger time threshold is adjusted up by a step amount TUpStepThe gaze trigger time threshold is adjusted by a step amount TDownStepThe task termination threshold value P, the fixed parameter M and the false click influence regression coefficient K are all fixed parameters.
10. The method of claim 9A method of determining and adjusting an appropriate gaze trigger time in a user gaze interaction, characterized by: t isUpStep＝0.1s，TDownStep0.05s, 3, 0.15, 1s, DT for DT initialization, DTLowerLimitInitialization is 0 and N is initialized to 3.
CN202110355471.4A 2021-04-01 2021-04-01 Method for determining and adjusting proper staring trigger time in user sight interaction Active CN113093906B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202110355471.4A CN113093906B (en) 2021-04-01 2021-04-01 Method for determining and adjusting proper staring trigger time in user sight interaction

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202110355471.4A CN113093906B (en) 2021-04-01 2021-04-01 Method for determining and adjusting proper staring trigger time in user sight interaction

Publications (2)

Publication Number Publication Date
CN113093906A true CN113093906A (en) 2021-07-09
CN113093906B CN113093906B (en) 2023-08-01

Family

ID=76672554

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202110355471.4A Active CN113093906B (en) 2021-04-01 2021-04-01 Method for determining and adjusting proper staring trigger time in user sight interaction

Country Status (1)

Country Link
CN (1) CN113093906B (en)

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20160193104A1 (en) * 2013-08-22 2016-07-07 Beijing Zhigu Rui Tuo Tech Co., Ltd Eyesight-protection imaging apparatus and eyesight-protection imaging method
US20190033964A1 (en) * 2017-07-26 2019-01-31 Microsoft Technology Licensing, Llc Controlling a computer using eyegaze and dwell
US20190212815A1 (en) * 2018-01-10 2019-07-11 Samsung Electronics Co., Ltd. Method and apparatus to determine trigger intent of user
CN110007766A (en) * 2019-04-15 2019-07-12 中国航天员科研训练中心 A kind of display of sight cursor and control method and system
CN111580674A (en) * 2020-05-20 2020-08-25 北京师范大学珠海分校 Eye-controlled mouse implementation method and keyboard input implementation method by recognizing eye movement track

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20160193104A1 (en) * 2013-08-22 2016-07-07 Beijing Zhigu Rui Tuo Tech Co., Ltd Eyesight-protection imaging apparatus and eyesight-protection imaging method
US20190033964A1 (en) * 2017-07-26 2019-01-31 Microsoft Technology Licensing, Llc Controlling a computer using eyegaze and dwell
US20190212815A1 (en) * 2018-01-10 2019-07-11 Samsung Electronics Co., Ltd. Method and apparatus to determine trigger intent of user
CN110007766A (en) * 2019-04-15 2019-07-12 中国航天员科研训练中心 A kind of display of sight cursor and control method and system
CN111580674A (en) * 2020-05-20 2020-08-25 北京师范大学珠海分校 Eye-controlled mouse implementation method and keyboard input implementation method by recognizing eye movement track

Also Published As

Publication number Publication date
CN113093906B (en) 2023-08-01

Similar Documents

Publication Publication Date Title
WO2016112690A1 (en) Eye movement data based online user state recognition method and device
CN114898832A (en) Rehabilitation training remote control system, method, device, equipment and medium
US11226686B2 (en) Interactive user gesture inputs
CN110136714A (en) Natural interaction sound control method and device
DE102014019600B4 (en) Switching method and electronic device
CN109431445A (en) A kind of vision monitoring method, apparatus, terminal device and storage medium
CN115890655A (en) Head posture and electro-oculogram-based mechanical arm control method, device and medium
KR101986241B1 (en) User identification apparatus based on multi-modal using bio-signal and method thereof
CN108491792B (en) Office scene human-computer interaction behavior recognition method based on electro-oculogram signals
CN106681509A (en) Interface operating method and system
CN113093906A (en) Method for determining and adjusting proper gaze triggering time in user gaze interaction
US11921922B2 (en) Neural menu navigator and navigation methods
Isachenko et al. The pursuing gaze beats mouse in non-pop-out target selection
CN107390873B (en) Multi-scale cursor positioning method based on electroencephalogram control
EP3559846B1 (en) Method and system for the behavior-based authentication of a user
US10646141B2 (en) Method and device for determining head movement
Dal Seno et al. On-line detection of p300 and error potentials in a BCI speller
US20230325059A1 (en) Method for processing data to adjust data inputting speed in human-computer interface system controlled by eye gaze and electroencephalography data
CN116612575B (en) Intelligent toilet occupancy monitoring system and method based on image processing
US20240056452A1 (en) Extended reality access control
CN112162595B (en) Vertical arm rotation identification method and wearable terminal
CN117348771A (en) Mixed brain-computer interface cursor control system for motor imagery and eyeball tracking
Jin et al. An implementation of multimodal gaze direction recognition system using image and EOG
礒本俊弥 et al. Study on Eye-Behavior-Based Intent Detection for Dwell Selection
Liu et al. Comparsion of methods for a motor imagery-based two-state self-paced brain-computer interface

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant