TW201947361A - Terminal control method and, apparatus, and terminal - Google Patents

Abstract

The application discloses a terminal control method and apparatus, and a terminal. The method includes the steps of acquiring a gaze point information for the terminal; acquiring a first touch instruction generated by performing touch operation on a touch device; determining a control instruction for the terminal according to the gaze point information and the first touch instruction; and controlling the terminal to execute operation corresponding to the control instruction. According to the terminal control method and apparatus, the technical problem that a deterministic instruction cannot be generated accurately according to the gaze point information is solved.

Description

Control method and device of terminal and terminal

The present invention relates to the field of computers, and in particular, to a method, device and terminal for controlling a terminal.

In recent years, the ways of human-computer interaction have gradually diversified. Multi-channel interaction adopts new interactive channels, devices, and interaction technologies such as sight, voice, and gestures, so that users can use multiple channels to conduct human-computer conversation in a natural, parallel, and collaborative manner. By capturing accurate and inaccurate inputs from multiple channels to capture user interaction intents, it improves the naturalness and efficiency of human-computer interaction. In multi-channel human-computer interaction, the nature of interaction, the efficiency of interaction, and the compatibility with traditional interfaces are particularly important.

Eye tracking technology uses eye movement measurement equipment to capture the user's eye image in milliseconds, and analyzes the relative positions of features such as the contour of the pupil, the contour of the iris, the center of the pupil, the center of the iris, and the reflection point of the external light source on the cornea to estimate the direction of the line of sight Or look down. At present, eye movement analysis technology is widely used in new types of human-computer interaction (typing with eyes, playing games), medical diagnosis, user experience research, psychological and cognitive research, and educational assistance.

Some current models of Apple phones, Huawei phones, and Samsung have eye tracking functions, which can implement applications such as eye movement unlocking, hibernation when there is no eye movement, and page turning with eye movement. There are also communication aids that use visual input to help people with disabilities communicate with the outside world.

However, in the actual application process, since gaze is not a deterministic instruction, it is easy for the computer to distinguish whether the user's line of sight is to be operated or only to observe the target. This is the Midas contact problem.

In addition, the eye tracker has inherent inaccuracies and cannot guarantee that the calculated fixation point is 100% coincident with the actual fixation point. Especially in scenes with complicated usage environments such as mobile phones and PADs, the eye fixation device's estimation of fixation points is not easy to prepare. , Resulting in poor user experience. In the conventional method, the gaze duration threshold method is adopted, which is relatively inefficient and easy to misuse.

Aiming at the above-mentioned problem that the deterministic instruction cannot be accurately generated based on the gaze point information, no effective solution has been proposed at present.

In view of this, our inventors are concentrating on further research and proceeding with research and development and improvement, with a better design to solve the above problems, and the invention came out after continuous testing and modification.

Embodiments of the present invention provide a control method, device, and terminal of a terminal, so as to at least solve a technical problem that a deterministic instruction cannot be accurately generated based on gaze point information.

According to an aspect of an embodiment of the present invention, a method for controlling a terminal is provided, which includes: obtaining gaze point information for a terminal; obtaining a first touch instruction generated by performing a touch operation on a touch device; and according to the gaze point information and the The first touch instruction determines a control instruction for the terminal; and controls the terminal to perform an operation corresponding to the control instruction.

Further, before determining a control instruction for the terminal according to the fixation point information and the touch operation instruction, the method further includes: calibrating the fixation point information.

Further, calibrating the fixation point information includes: determining an initial position of the fixation point corresponding to the target object; adjusting a position of the pointer so that the pointer coincides with the target object, and adjusting the adjusted pointer The position of the object is used as the gaze point information after calibration, wherein the indicator is used to indicate the position of the gaze point.

Further, adjusting the position of the pointer includes: acquiring a second touch instruction generated by performing a touch operation on the touch device; and adjusting the position of the pointer according to the second touch instruction.

According to another aspect of the embodiments of the present invention, a storage medium is also provided, where the storage medium includes a stored program, wherein when the program runs, the device where the storage medium is located is controlled to execute the terminal control method described above. .

According to another aspect of the embodiments of the present invention, there is also provided a processor for running a program, wherein when the program runs, the method for controlling a terminal described above is executed.

According to another aspect of the embodiments of the present invention, a control device for a terminal is further provided, including: a first obtaining unit for obtaining gaze point information for the terminal; a second obtaining unit for obtaining a touch operation on a touch device The generated first touch instruction; a determining unit configured to determine a control instruction for the terminal according to the fixation point information and the first touch instruction; a control unit configured to control the terminal to execute the control instruction Corresponding operation.

Further, the apparatus further includes: a calibration unit configured to calibrate the fixation point information before determining a control instruction for the terminal according to the fixation point information and the touch operation instruction.

Further, the calibration unit includes: a determining module for determining an initial position of a fixation point corresponding to a target object; an adjustment module for adjusting a position of a pointer so that the pointer coincides with the target, The adjusted position of the pointer is used as the gaze point information after calibration, where the pointer is used to indicate the position of the gaze point.

Further, the adjustment module includes: an acquisition module for acquiring a second touch instruction generated by a touch operation on the touch device; and an adjustment submodule for adjusting the position of the pointer according to the second touch instruction.

According to another aspect of the embodiments of the present invention, a terminal is further provided, including: an eye movement following device for acquiring gaze point information for the terminal; and a touch device for acquiring a first generated by a touch operation on the touch device. A touch instruction; a processor, configured to determine a control instruction for the terminal according to the gaze point information and the first touch instruction, and control the terminal to perform an operation corresponding to the control instruction.

Further, the eye movement following device is detachably provided on the terminal; or the eye movement following device is fixedly installed on the terminal.

Further, the touch device is fixedly installed on the terminal.

Further, the touch device includes a touch screen of the terminal; and / or the touch device includes a touch pad provided on a rear surface of the terminal.

In the embodiment of the present invention, the user's gaze point information for the terminal and the first touch instruction generated by the user's touch operation on the touch device are acquired, and the control instruction issued by the user to the terminal is determined according to the gaze point information and the first touch instruction. To enable the terminal to perform the operation corresponding to the control instruction and complete the instruction issued by the user, achieving the technical effect of accurately generating the deterministic instruction based on the user's gaze point information, thereby solving the inability to accurately generate the deterministic instruction based on the gaze point information. technical problem.

Regarding the technical means of our inventors, several preferred embodiments are described in detail below in conjunction with the drawings, for the purpose of understanding and agreeing with the present invention.

In order to enable those with ordinary knowledge in the technical field to better understand the solution of the present invention, the technical solution in the embodiment of the present invention will be clearly and completely described below with reference to the accompanying drawings in the embodiments of the present invention. The described embodiments are only a part of embodiments of the present invention, but not all the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by persons with ordinary knowledge in the technical field to which the present invention belongs without making progressive labor should fall within the protection scope of the present invention.

It should be noted that the terms “first” and “second” in the scope of the specification and patent application of the present invention and the above-mentioned drawings are used to distinguish similar objects, and are not necessarily used to describe a specific order or sequence. It should be understood that the data so used may be interchanged where appropriate so that the embodiments of the invention described herein can be implemented in an order other than those illustrated or described herein. Furthermore, the terms "including" and "having" and any of their variations are intended to cover non-exclusive inclusions, for example, a process, method, system, product, or device that includes a series of steps or units need not be limited to those explicitly listed Those steps or units may instead include other steps or units not explicitly listed or inherent to these processes, methods, products or equipment.

According to an embodiment of the present invention, an embodiment of a method for controlling a terminal is provided. It should be noted that the steps shown in the flowchart of the accompanying drawings can be executed in a computer system such as a set of computer-executable instructions. The logical order is shown in the flowchart, but in some cases, the steps shown or described may be performed in a different order than here.

FIG. 1 is a flowchart of a method for controlling a terminal according to an embodiment of the present invention. As shown in FIG. 1, the method includes the following steps:

Step S102: Obtain gaze point information for the terminal;

Step S104, acquiring a first touch instruction generated by performing a touch operation on the touch device;

Step S106, determining a control instruction for the terminal according to the gaze point information and the first touch instruction;

Step S108: The control terminal performs an operation corresponding to the control instruction.

Through the above steps, the user's gaze point information for the terminal and the first touch instruction generated by the user's touch operation on the touch device are obtained, and then the control instruction issued by the user to the terminal is determined according to the gaze point information and the first touch instruction, so that The terminal can perform operations corresponding to the control instructions, complete the instructions issued by the user, and achieve the technical effect of accurately generating deterministic instructions based on the user's fixation point information, thereby solving the technical problem of being unable to accurately generate deterministic instructions based on the fixation point information. .

In the solution provided in the above step S102, the gaze point information may be the position information of the user's gaze collected through the eye movement following device when the user is looking at the terminal.

It should be noted that the eye tracking device includes an infrared device, a camera, and a processor.

It should be noted that terminals include: mobile phones, tablet computers (PAD), and laptop computers.

Optionally, the eye movement following device determines a user's gaze point on the terminal by collecting an image of the user's eyeball.

In the solution provided in the above step S104, the touch device may be set on the terminal, such as a touch screen or a touch pad fixed on the terminal, and the user produces a touch instruction by touching the touch device.

Optionally, in the case of acquiring the first touch instruction, determining the fixation point information at the current time as the instruction information, and determining the control instruction according to the first touch instruction and the instruction information.

In the solution provided in the above step S106, the control instruction is used to control a terminal instruction, and the control instruction is determined by the fixation point information and the first touch instruction together.

Optionally, the gaze point information, the mapping relationship between the first touch instruction and the control instruction may be stored in a storage device (such as a cache area or a database) in advance.

Optionally, the first touch instruction may be generated by touching the touch device, pressing on the touch device, and sliding on the touch device.

In the solution provided in the above step S108, after acquiring the control instruction, the terminal may perform an operation corresponding to the control instruction in response to the control instruction.

According to the above embodiment of the present invention, by using the gaze point information and the first touch instruction, the first touch instruction can be used as a confirmation signal of the gaze point information, so that a definitive instruction can be accurately generated according to the gaze point, and the user's operation can be accurately confirmed. mobile.

In addition, due to the manner in which the touch device generates an instruction, when the first touch instruction generated by the touch device is used as the gaze point information confirmation signal, the shaking of the terminal caused by the generation of the confirmation signal can be avoided, thereby avoiding the shaking of the gaze point. To get accurate gaze point information.

As an optional embodiment, before determining the control instruction for the terminal according to the fixation point information and the touch operation instruction, this embodiment may further include: calibrating the fixation point information.

In order to obtain accurate fixation point information, the fixation point information may be calibrated first to obtain accurate fixation point information.

Optionally, calibrating the fixation point information may be implemented by calibrating the position of the fixation point.

As an optional example, the gaze point of the terminal may be collected by the eye tracking device, and then the gaze information may be calibrated by calibrating the position of the gaze point.

In an optional embodiment, calibrating the fixation point information includes: determining an initial position of the fixation point corresponding to the target; adjusting the position of the pointer so that the pointer coincides with the target; and adjusting the position of the adjusted pointer The position is used as the gaze point information after calibration, and the pointer is used to indicate the position of the gaze point.

According to the above embodiment of the present invention, in the process of calibrating the fixation point information, the terminal displays a target object, and determines the fixation point calculated by the terminal when the user fixes the target object, and positions the fixation point. As the initial position, and the position of the fixation point is indicated by a pointer, and then the position of the fixation point is made to coincide with the target by adjusting the position of the pointer, so that the current indication position can be used as the fixation point position to obtain the calibrated attention. The viewpoint information realizes the calibration of the fixation point information.

Alternatively, the yes indicator may be a calibration point for calibration, such as a black point.

It should be noted that the gaze point can be displayed on the terminal in the form of an indicator during the calibration process, and the gaze point can be hidden in the case other than calibration.

Optionally, the pointer may be a cursor for indicating the position where the point is located.

In an optional embodiment, adjusting the position of the pointer includes: acquiring a second touch instruction generated by performing a touch operation on the touch device; and adjusting the position of the pointer according to the second touch instruction.

With the above embodiments of the present invention, in the process of adjusting the pointer, a second touch instruction generated by the touch device can be acquired, and the pointer is controlled to move according to the second touch instruction to adjust the position of the pointer.

It should be noted that the second touch instruction may be generated by touching the touch device, pressing on the touch device, and sliding on the touch device.

Optionally, the second touch instruction is a touch instruction generated by the touch device during calibration of the gaze point information.

Optionally, in the process of calibrating the gaze point information, the touch instruction generated by the touch device is a second touch instruction.

According to yet another embodiment of the present invention, a storage medium is further provided. The storage medium includes a stored program, and the method of any one of the foregoing is executed when the program is run.

According to still another embodiment of the present invention, a processor is further provided. The processor is configured to run a program, and the method executes any of the foregoing methods when the program is run.

According to the embodiment of the present invention, an embodiment of a control device for a terminal is also provided. It should be noted that the control device of the terminal may be used to execute the control method of the terminal in the embodiment of the present invention. The control method may be executed in a control device of the terminal.

FIG. 2 is a schematic diagram of a control device for a terminal according to an embodiment of the present invention. As shown in FIG. 2, the device includes: a first obtaining unit 21 for obtaining gaze point information for the terminal; and a second obtaining unit 23 for For obtaining a first touch instruction generated by performing a touch operation on a touch device; a determining unit 25 for determining a control instruction for the terminal according to the gaze point information and the first touch instruction; a control unit 27 for controlling the terminal to execute and control the instruction Corresponding operation.

It should be noted that the first obtaining unit 21 in this embodiment may be used to execute step S102 in the embodiment of the present invention, and the second obtaining unit 23 in this embodiment may be used to execute step S104 in the embodiment of the present invention. The sending unit 76 of the determining unit 25 in this embodiment may be used to execute step S106 in the embodiment of the present invention, and the control unit 27 in this embodiment may be used to execute step S108 in the embodiment of the present invention. The examples and application scenarios implemented by the foregoing modules are the same as the corresponding steps, but are not limited to the content disclosed in the foregoing embodiments.

According to the above embodiments of the present invention, the user's gaze point information for the terminal and the first touch instruction generated by the user's touch operation on the touch device are acquired, and then the control issued by the user to the terminal is determined according to the gaze point information and the first touch instruction. Instructions to enable the terminal to perform operations corresponding to control instructions and complete the instructions issued by the user, achieving the technical effect of accurately generating deterministic instructions based on the user's gaze point information, thereby solving the inability to accurately generate deterministic instructions based on the gaze point information Technical issues.

As an optional embodiment, this embodiment may further include: a calibration unit, configured to calibrate the fixation point information before determining the control instruction for the terminal according to the fixation point information and the touch operation instruction.

As an optional embodiment, the calibration unit includes: a determining module for determining an initial position of a fixation point corresponding to the target; an adjustment module for adjusting the position of the pointer so that the pointer coincides with the target, and The position of the adjusted pointer is used as the gaze point information after calibration, where the pointer is used to indicate the position of the gaze point.

As an optional embodiment, the adjustment module includes: an acquisition module for acquiring a second touch instruction generated by performing a touch operation on the touch device; and an adjustment submodule for adjusting a position of the pointer according to the second touch instruction.

FIG. 3 is a schematic diagram of a terminal according to an embodiment of the present invention. As shown in FIG. 3, the terminal includes: an eye tracking device 31 for acquiring gaze point information for the terminal; and a touch device 33 for acquiring a touch device A first touch instruction generated by performing a touch operation; the processor 35 is configured to determine a control instruction for the terminal according to the gaze point information and the first touch instruction, and control the terminal to perform an operation corresponding to the control instruction.

According to the above embodiment of the present invention, the user's gaze point information for the terminal is obtained through the eye tracking device, and the first touch instruction generated by the user's touch operation on the touch device, and the user's The control instructions issued by the terminal enable the terminal to perform the operations corresponding to the control instructions and complete the instructions issued by the user. This achieves the technical effect of generating deterministic instructions accurately based on the user's gaze point information, thereby solving the inability to accurately determine the gaze point. Technical issues of information generating deterministic instructions.

It needs to be said that the terminal is a terminal controlled in the foregoing terminal control method.

Optionally, the eye movement following device is located on the same side of the terminal as the screen.

Optionally, the eye movement following device may be positioned in front of the terminal.

As an optional embodiment, the eye movement following device is detachably disposed on the terminal; or the eye movement following device is fixedly installed on the terminal.

As an optional embodiment, the touch device is fixedly mounted on the terminal.

As an optional embodiment, the touch device includes a touch screen of the terminal; and / or the touch device includes a touch pad provided on the back of the terminal.

It should be noted that the back of the terminal is a different surface of the terminal from the touch screen, for example, a surface opposite to the touch screen.

Optionally, when the touch device is a touch screen of a terminal, a touch instruction generated by touching the screen may be used as the first touch instruction.

The present invention also provides a preferred embodiment, which provides a system and method for correcting a gaze point by using a touch device.

The invention adopts the touch of a touch device as a confirmation signal for operating a fixation target, and uses the displacement on the touch device as a correction signal for a calculated fixation point, so as to ensure that the collection of sight data and the sight input achieve a good use effect.

It should be said that the correction signal is a second touch signal generated by operating the touch device during the calibration process.

In the present invention, a touch device can be integrated into a target device (terminal), for example, a mobile phone, a PAD, or a notebook, thereby eliminating the need to separately set a touch pad, simplifying design complexity, and reducing the possibility of the touch pad being lost.

The present invention adopts the method of touching the touch device without causing displacement or vibration of the device (terminal), and does not affect the use of the eye tracking device.

The invention adopts the touch displacement method to adjust and calculate the gaze point, and the method is intuitive, which can further ensure the accuracy of the gaze tracking.

In the following embodiments, a mobile phone is used as a terminal for illustration.

For example, you can add eye tracking and touch devices to your phone.

Optionally, a touchpad can be added on the back of the phone.

Optionally, an eye tracking device can be added on the front of the mobile phone.

FIG. 4 (a) is a first schematic diagram of a terminal setting a fixed eye tracking device according to an embodiment of the present invention. As shown in FIG. 4 (a), a built-in method is used to add an eye tracking device, and fix the eye tracking device to Below the phone screen.

Optionally, the eye movement following device includes an infrared lamp, a motherboard, and a camera.

Optionally, the camera of the eye tracking device may be a front camera of a mobile phone.

FIG. 4 (b) is a second schematic diagram of a terminal setting fixed eye tracking device according to an embodiment of the present invention. As shown in FIG. 4 (b), a touchpad is added by using a built-in method, and the touchpad is arranged on the back of the mobile phone.

FIG. 5 (a) is a first schematic diagram of a terminal provided with a detachable eye-tracking device according to an embodiment of the present invention. As shown in FIG. 5 (a), an external method is used to add an eye-movement detection device to track the device. With the phone screen below.

Optionally, the eye movement detection device may be connected to the mobile phone through a charging interface of the mobile phone.

Fig. 5 (b) is a second schematic diagram of a terminal with a detachable eye-tracking device according to an embodiment of the present invention. As shown in Fig. 5 (b), a touchpad is added using a built-in method, and the touchpad is arranged on the back of the mobile phone. .

Optionally, the eye tracking mode can be turned on through a shortcut key or in a mobile phone setting interface.

Optionally, in order to ensure the accuracy of the gaze points collected by the mobile phone, the gaze points need to be calibrated before the eye tracking mode is activated.

It should be noted that before using the eye tracking mode, a number of eye feature images need to be collected, and then the gaze point is calculated based on the eye feature images.

For example, several eye feature images of the user may be collected, and then the user's gaze point may be calculated according to the eye feature patterns.

Optionally, before using the eye tracking mode, the user is required to cooperate to watch some mobile phone screens or target gaze points on the mobile phone. This process is also called calibration.

Optionally, the calibration process can be performed by the following steps:

1) While the user is looking at the target, a gaze point indicator appears on the mobile phone screen, and the indicator may be a cursor.

2) The user checks the deviation between the gaze point indicator and the gaze target.

3) If there is no deviation, continue to use the gaze point as an indicator to operate the mobile phone.

4) If there is deviation, switch to correction mode.

Optionally, in the modification mode, the cursor can be moved to the target object through the touchpad behind the mobile phone to make the two overlap.

5) After moving the cursor so that the cursor overlaps the target, the fixation point recognition algorithm adjusts the calculation coefficient according to the user's correction result.

6) The user can repeat the process 2 until the calculated fixation point and the user's actual fixation point reach a satisfactory accuracy.

The following are examples of practical applications of the solutions provided by the present invention.

It should be noted that the technical solution provided by the present invention may include, but is not limited to, the following examples.

Optionally, the user may generate an "open instruction" by watching.

For example, it can be used to watch the icon of the target application in the interactive interface of the mobile phone, and after the cursor (can be hidden) appears on the target icon, tap the touch device to control the target application to open.

Optionally, the user may generate a "page turning instruction" by watching.

For example, when reading an e-book on a mobile phone, look at the bottom right corner of the "Book", and gently swipe your finger from right to left on the touch device to page backwards; look at the bottom left corner of the "Book", and your finger lightly on the touch device Gently swipe from left to right to page forward.

For another example, when reading an e-book or webpage on a mobile phone, a finger is pressed on the touch device, and the user looks from the lower right corner of the "book" and moves to the left to complete the page backward movement; the user looks from the lower left corner of the "book" , And move to the right to complete the page forward action.

Optionally, the user may generate a “drag instruction” by watching.

For example, when a user looks at an icon on the interactive interface of the mobile phone, while the finger is pressed on the touch device and moves toward the target direction, the corresponding icon moves to the target position with the finger.

For example, a user looks at an icon on a mobile phone interaction interface while pressing a finger on a touch device, and then the user's gaze (gaze point) moves to the target direction, and the corresponding icon follows the user's gaze (gaze point) to the target position.

Where is the technology provided by the present invention? By combining the touch device with the eye tracking technology, correction or operation of the calculated gaze point is achieved to achieve the effect of accurately using the line of sight for human-computer interaction, and the precise operation of the electronic device is achieved.

The sequence numbers of the foregoing embodiments of the present invention are only for description, and do not represent the superiority or inferiority of the embodiments.

In the above embodiments of the present invention, the description of each embodiment has its own emphasis. For a part that is not described in detail in an embodiment, reference may be made to the description of other embodiments.

In the several embodiments provided by the present invention, it should be understood that the disclosed technical content may be implemented in other ways. The device embodiments described above are merely schematic. For example, the division of the unit may be a logical function division. In actual implementation, there may be another division manner. For example, multiple units or components may be combined or integrated. To another system, or some features can be ignored or not implemented. In addition, the displayed or discussed mutual coupling or direct coupling or communication connection may be indirect coupling or communication connection through some interfaces, units or modules, and may be electrical or other forms.

The units described as separate components may or may not be physically separated, and the components displayed as units may or may not be physical units, that is, may be located in one place, or may be distributed on multiple units. Some or all of the units may be selected according to actual needs to achieve the objective of the solution of this embodiment.

In addition, each functional unit in each embodiment of the present invention may be integrated into one processing unit, or each unit may exist separately physically, or two or more units may be integrated into one unit. The above integrated unit may be implemented in the form of hardware or in the form of software functional unit.

When the integrated unit is implemented in the form of a software functional unit and sold or used as an independent product, it may be stored in a computer-readable storage medium. Based on this understanding, the technical solution of the present invention essentially or part that contributes to the existing technology or all or part of the technical solution can be embodied in the form of a software product, which is stored in a storage medium Several instructions are included to cause a computer device (which may be a personal computer, a server, or a network device, etc.) to perform all or part of the steps of the method described in various embodiments of the present invention. The foregoing storage medium includes: a U disk, a read-only memory (ROM, Read-Only Memory), a random access memory (RAM, Random Access Memory), a mobile hard disk, a magnetic disk, or an optical disk, and other media that can store program codes.

The above is only a preferred embodiment of the present invention. It should be noted that for those who have ordinary knowledge in the technical field to which the present invention pertains, without departing from the principles of the present invention, several improvements and retouches can be made. And retouching should also be regarded as the protection scope of the present invention.

In summary, the technical means disclosed in the present invention can effectively solve problems such as knowledge, and achieve the intended purpose and effect. It has not been published in publications before application, has not been publicly used, and has long-term progress. The invention referred to in the Patent Law is correct, and he filed an application in accordance with the law. He earnestly hopes that Jun will give him a detailed review and grant a patent for the invention.

However, the above are only a few preferred embodiments of the present invention. When the scope of implementation of the present invention cannot be limited in this way, that is, equivalent changes and modifications made according to the scope of the patent application and the content of the invention specification of the present invention are It should still fall within the scope of the invention patent.

〔this invention〕

21‧‧‧First acquisition unit

23‧‧‧Second Acquisition Unit

25‧‧‧ Confirmation unit

27‧‧‧Control unit

31‧‧‧Eye tracking device

33‧‧‧Touch Device

35‧‧‧ processor

S102-S108‧‧‧step

FIG. 1 is a flowchart of a method for controlling a terminal according to an embodiment of the present invention.

FIG. 2 is a schematic diagram of a control device for a terminal according to an embodiment of the present invention.

FIG. 3 is a schematic diagram of a terminal according to an embodiment of the present invention.

FIG. 4 (a) is a first schematic diagram of a terminal setting a fixed eye movement following device according to an embodiment of the present invention.

FIG. 4 (b) is a second schematic diagram of a terminal setting a fixed eye movement following device according to an embodiment of the present invention.

FIG. 5 (a) is a first schematic view of a terminal provided with a detachable eye tracking device according to an embodiment of the present invention.

5 (b) is a second schematic diagram of a terminal provided with a detachable eye tracking device according to an embodiment of the present invention.

Claims (14)

A method for controlling a terminal, comprising: Obtaining gaze point information for a terminal; Acquiring a first touch instruction generated by performing a touch operation on a touch device; Determining a control instruction for the terminal according to the gaze point information and the first touch instruction; Controlling the terminal to perform an operation corresponding to the control instruction. The method according to item 1 of the scope of patent application, wherein before determining a control instruction for the terminal according to the gaze point information and the touch operation instruction, the method further includes: The gaze point information is calibrated. The method according to item 2 of the scope of patent application, wherein calibrating the fixation point information includes: Determine the initial position of the fixation point corresponding to the target; Adjusting the position of the pointer so that the pointer coincides with the target, and using the adjusted position of the pointer as the calibration gaze point information, wherein the pointer is used to indicate the gaze point location. The method of claim 3, wherein adjusting the position of the indicator includes: Acquiring a second touch instruction generated by performing a touch operation on the touch device; Adjusting the position of the pointer according to the second touch instruction. A control device for a terminal, comprising: A first acquiring unit, configured to acquire gaze point information for a terminal; A second obtaining unit, configured to obtain a first touch instruction generated by performing a touch operation on the touch device; A determining unit, configured to determine a control instruction for the terminal according to the gaze point information and the first touch instruction; A control unit, configured to control the terminal to perform an operation corresponding to the control instruction. The device according to item 5 of the scope of patent application, wherein the device further comprises: A calibration unit is configured to calibrate the fixation point information before determining a control instruction for the terminal according to the fixation point information and the touch operation instruction. The device according to item 6 of the scope of patent application, wherein the calibration unit includes: A determining module for determining an initial position of a fixation point corresponding to a target object; An adjustment module, configured to adjust the position of the pointer so that the pointer coincides with the target, and use the adjusted position of the pointer as the calibration gaze point information, wherein Indicates where the gaze point is. The device according to item 7 of the scope of patent application, wherein the adjustment module includes: An acquisition module, configured to acquire a second touch instruction generated by performing a touch operation on the touch device; An adjustment sub-module is configured to adjust a position of the pointer according to the second touch instruction. A terminal, comprising: Eye-tracking device for acquiring gaze point information for a terminal; A touch device, configured to obtain a first touch instruction generated by performing a touch operation on the touch device; A processor, configured to determine a control instruction for the terminal according to the gaze point information and the first touch instruction, and control the terminal to perform an operation corresponding to the control instruction. The terminal as described in item 9 of the scope of patent application, wherein: The eye movement following device is detachably provided on the terminal; or The eye movement following device is fixedly installed on the terminal. The terminal according to item 9 of the scope of patent application, wherein the touch device is fixedly installed on the terminal. The terminal according to item 11 of the scope of patent application, wherein: The touch device includes a touch screen of the terminal; and / or The touch device includes a touch pad provided on the back of the terminal. A storage medium, characterized in that the storage medium includes a stored program, wherein the program executes the terminal control method according to any one of claims 1 to 4 of the scope of patent application. A processor is characterized in that the processor is used to run a program, and when the program runs, the method for controlling a terminal according to any one of claims 1 to 4 of the scope of patent application is executed.