TWI783604B - Reading interface design method based on hand-eye tracking - Google Patents

Abstract

The present invention relates to a reading interface design method for hand-eye movement tracking. It mainly uses the eye tracking device to record the eye movement during reading when the subject uses the reading device, and uses the interface operation recording device to monitor the subject. The operation action of the reading interface, the part of the operation action is subdivided by the mouse operation monitoring part, the keyboard operation monitoring part, and the text ratio monitoring part, and after reading, the visual fatigue detection device is used to judge the degree of visual fatigue of the subject , and carry out regression analysis on it, and use the perception survey unit to record the subjective perception of the subjects, and finally integrate the monitoring data. This is used to analyze the number and time of use of the reading interface and operation actions, and conduct regression analysis with the subjective visual fatigue of the subjects, so as to understand the correlation between the experimental variables, so as to assist users in designing a more suitable interface for reading.

Description

Reading interface design method based on hand-eye tracking

The present invention provides a reading interface design method for hand-eye movement tracking, especially a method that can help to study the frequency and habits of ordinary people using different reading interfaces and control devices, and assist users in developing reading that can improve control convenience and reduce visual fatigue The reading interface design method of the hand-eye movement tracking of the interface.

By the way, the popularization of the Internet has led to a new type of information source, such as e-books, major websites, e-newsletters, etc., and even the popular Facebook, Instagram, LINE, Blog, etc., so that people can quickly obtain information and provide more information. Interaction, and therefore the time spent staring at the screen is greatly increased. If you do not get proper rest, it is easy to cause symptoms caused by visual burden such as sore eyes, blurred flickering, etc. In addition, staring at the screen will reduce the number of blinks and accelerate the evaporation of tears. And exacerbate the problem of eye fatigue.

Under long-term use, the applicability of the reading interface and operating device (BIOC) used to read information on the Internet is very important. The so-called BIOC means that when people use computers to read information, they use Software and hardware tools used to operate, select, search, or control information, such as left and right mouse buttons, mouse wheel, window scroll, keyboard arrow keys, etc., and in different reading interfaces, different control device design factors (Scroll and scroll wheel, jumping range, zoom ratio, etc.), when the interface user performs graphic information reading and searching operations, both visual performance and fatigue may be affected.

Therefore, how to solve the above-mentioned conventional problems and deficiencies is the direction that the inventor of the present invention and related manufacturers engaged in this industry want to research and improve urgently.

Therefore, in view of the above-mentioned deficiency, the inventor of the present invention collects relevant information, evaluates and considers in many ways, and uses years of experience accumulated in this industry, through continuous trial and modification, to design this kind of product that can help ordinary people to understand The frequency and habit of using different reading interfaces and control devices, and the invention patent of the reading interface design method that assists users in developing a reading interface that can improve the convenience of operation and reduce visual fatigue by tracking hand-eye movements.

The main purpose of the present invention is to: monitor the subject's eyeball movements and hand movements during the reading process, and evaluate the subject's visual fatigue and subjective impressions, so as to statistically analyze the reading habits of ordinary people, and then provide improved control convenience , The design direction of the reading interface that reduces visual fatigue.

In order to achieve the above object, the main structure of the present invention includes: a reading device, an eyeball tracking device, an interface operation recording device, a mouse operation monitoring part, a keyboard operation monitoring part, a character ratio monitoring part, and a visual fatigue detection device , a perception survey unit, and a regression analysis module; with the above structure, a reading device is provided for the subject to read and display information in the reading interface, and during the reading process of the subject, the eye tracking device is used to record the reading The eye movement situation at the time, and use the interface operation recording device to monitor the subject's operation action on the reading interface, and the monitoring of the operation action is further subdivided by the mouse operation monitoring part to monitor the subject's mouse operation action, by The keyboard operation monitoring part monitors the subject's keyboard operation action, and the text ratio monitoring part monitors the proportion of the subject's adjusted text to the page, and after the subject finishes reading, the visual fatigue detection device is used to judge the subject's The degree of visual fatigue of the test subject, and use the regression analysis module to analyze the degree of visual fatigue, and use the perception survey unit to record the subjective perception of the subject, and finally analyze the monitoring data to understand the relationship between the variables Relevance, as the basis for improving the reading interface, to assist users in designing an interface that is more suitable for reading.

With the above-mentioned technology, it is possible to make a breakthrough on the problem of aggravating eye fatigue existing in the conventional reading interface, and achieve the practical progress of the above-mentioned advantages.

1, 1a: reading device

11: Reading interface

111, 111a: display information

12a: Context Database

13a: Task release module

2, 2a: Eye tracking device

21a: Jaw support

22a: Photographic device

3.3a: interface operation recording device

31:Mouse operation monitoring department

32: Keyboard operation monitoring department

33: Text Ratio Monitoring Department

4: Visual fatigue detection device

51: Perception survey unit

52a: Pre-Survey Questionnaire

6: Regression analysis module

The first figure is a flow chart of the steps of the preferred embodiment of the present invention.

The second figure is a flow chart of the visual processing of webpage reading.

The third figure is the implementation schematic diagram (1) of the preferred embodiment of the present invention.

The fourth figure is the implementation schematic diagram (2) of the preferred embodiment of the present invention.

The fifth figure is a schematic diagram of the regression analysis of the preferred embodiment of the present invention.

Figure 6 is an implementation schematic diagram of yet another preferred embodiment of the present invention.

In order to achieve the above-mentioned purpose and effect, the technical means and structure adopted by the present invention are hereby illustrated in detail with respect to the preferred embodiments of the present invention. Its features and functions are as follows, so that it can be fully understood.

Please refer to shown in the first figure to the fifth figure, which is a flow chart of the steps of the preferred embodiment of the present invention to a schematic diagram of regression analysis. From the figure, it can be clearly seen that the main steps of the present invention include: (a) providing a reading device 1. For the subject to read a display information 111 in a reading interface 11, the reading device 1 has a task release module 13 to guide the subject to perform the specified operation behavior; (b) in the subject During the reading process of the subject, use the eye tracking device 2 to record the eye movement during reading; (c) during the reading process of the subject, use an interface operation recording device 3 to monitor the subject's operation of the reading interface 11 (d) use the mouse operation monitoring part 31 of the interface operation recording device 3 to monitor the subject's mouse operation action; (e) use the keyboard operation monitoring part 32 of the interface operation recording device 3 to monitor the subject's mouse operation The subject's keyboard operation action; (f) utilize the text ratio monitoring section 33 of the interface operation recording device 3 to monitor the proportion of the subject's adjusted text to the page; (g) after the subject finishes reading, Use a visual fatigue detection device 4 to judge the degree of visual fatigue of the subject, and use a regression analysis module 6 to analyze the degree of visual fatigue; (h) after the subject finishes reading, use a perception survey unit 51 Record the subject's subjective perception; and (i) integrate the eye movement situation, the operation action, the degree of visual fatigue, and the subjective perception as a design reference for the user.

Through the above description, the structure of this technology can already be understood, and according to the corresponding cooperation of this structure, it can also help to study the frequency and habits of ordinary people using different reading interfaces 11 and control devices, so as to assist users in developing and improving control Convenience, reading interface that reduces visual fatigue 11 As can be clearly seen from the figure, the reading device 1 is an example of a computer screen, the reading interface 11 is an example of a web browser, the display information 111 is an example of text information on a web page, and the task release module 13 is an example that can generate text The software of the window, the task distribution module 13 is represented by the dotted frame in the computer in the figure, the eye tracking device 2 is taken as an example by Tobii Eye Tracker 4C, and the interface operation recording device 3 uses the software of SR Research Experiment Builder, as shown in the figure Represented by the dotted line frame in the computer, the visual fatigue detection device 4 is a tool for comprehensively judging the degree of visual fatigue with reference to the eye movement data such as the angle of sight and focus status measured by the eye tracking device 2, and in conjunction with the detection of head movement and the number of blinks. In this embodiment, it is implemented with the lens on the computer, and the perception survey unit 51 is a questionnaire survey form or software or equipment that can provide a survey function.

As shown in the second figure, firstly, the four main visual processing methods that the eyes will produce on the text in the process of reading the webpage will be explained firstly: (1) fixations or gazes: that is, the visual stop occurs when reading the article (2) saccades: short, rapid jumps between different gaze points; (3) return sweep: after reading each line At the end, the action of moving the gaze back to the starting point of the next line; (4) Regression: In order to clarify incomplete information, sometimes the reader must move his gaze back to the front, and this kind of gaze has been read before. The saccade action of word movement is regression. In the process of web page reading, the above four actions are all related to manual response, and since the reading area is larger than that of written materials, it is necessary to increase the number of regression and the movement of the central fovea of the eyeballs. Among them, the same For the content of reading, because the number of page scrolling is more frequent than that of text information, it is necessary to increase the actions of finger scrolling the page or operating the scroll wheel, thereby increasing visual fatigue and mental load.

As shown in the third figure, in actual operation, in order to reduce unnecessary variation factors, the present invention first sets the reading device 1 at a fixed position, so that the distance and angle of each subject watching the screen are as completely as possible, so that The difference in environmental conditions of each subject is minimized when reading, and the part where the difference is minimized also includes the reading interface 11 and display information 111. The part that displays information 111 provides different task test methods through the task release module 13, so that each subject can The tester reads the display information 111 for the same purpose, so as to collect more parameters for the user's reference. For example, each subject can randomly perform different tasks multiple times. For example, if the task of selecting a shopping website is selected, the subject will be told to read the shopping website and search for the specified product, and the subject is required to complete it within a specified time The selected task. Then, in the experiment, the eye tracking device 2 is used to record the reading content and the subject's eye movement during reading, and the eye tracking device 2 can completely record the movement of the eye reading.

As shown in Figures 4 and 5, in order to further understand the frequency and time of using various control devices when the subjects use the reading device 1 to read the displayed information 111, as well as the inconvenience and problems encountered during the reading process, Therefore, the present invention uses the interface operation recording device 3 to monitor the subject's operation actions on the reading interface 11, including using the mouse operation monitoring part 31 to monitor the subject's mouse operation actions, and utilizing the keyboard operation monitoring The part 32 monitors the subject's keyboard operation actions. When the subject reads the display information 111, the two can monitor the type, frequency and time of the reading interface 11 and the control device used by the subject. The reading interface 11 and the control device include : mouse wheel, left and right mouse buttons, window scroll, keyboard direction keys, keyboard page change keys, etc., and because in different types of display information 111, the proportion of text to the page is different, such as the text ratio of web news is greater than The text ratio of the shopping website, that is, there are more text layouts in the web news page, but the shopping website does not, so the present invention uses the text ratio monitoring part 33 to monitor the proportion of the subject's adjusted text to the page, The text ratio monitoring unit 33 uses a "data-ink ratio" method to estimate the ratio of the text in the text message to the page.

After the experiment, utilize the visual fatigue detection device 4 to objectively judge the degree of visual fatigue of the subject, and utilize the regression analysis module 6 to carry out linear regression analysis on the degree of visual fatigue to produce a Likert scale (Likert scale) In addition, the visual fatigue analysis results of the visual fatigue analysis will provide the subjects with a perception survey unit 51 to conduct a questionnaire survey on the subjects during the reading process just now, so as to dig out and confirm the manipulation situation in each reading stage, and understand the manipulation during the reading process. Devices, screen jitters, and webpage rendering conditions, etc., have subjective effects on vision. Finally, the various monitoring data are integrated and analyzed. The present invention uses IBM SPSS software and SFI Minitab software as analysis tools. In the narrative statistics of research data, the number of times is used to analyze the population background variables of the test subjects. Secondly, for Different types of text messages, usage times and time of the reading interface 11 and the control device were analyzed by single-factor independent analysis of variance (Analysis of Variance, ANOVA). Regression analysis was carried out on the subjective visual fatigue of the test subjects to understand the correlation between the experimental variables, so as to provide relevant data to the developers of the reading interface 11 to assist them in developing a reading interface that can improve the convenience of operation and reduce visual fatigue 11.

Please refer to the sixth figure at the same time, which is an implementation schematic diagram of another preferred embodiment of the present invention. It can be clearly seen from the figure that this embodiment is similar to the above-mentioned embodiment, and only the eye tracking device 2a A lower jaw support 21a is used together, and a photographic device 22a is provided on one side of the eye tracking device 2a. Let the three-dimensional position of the eyeballs of the subjects be fixed during the reading process, only The moving eyes can be used for reading, so as to enhance the eye track recognition effect of the eye tracking device 2a, thereby increasing the reference value of the recognition results, and the photographic device 22a can cooperate with the eye tracking device 2a or the interface operation recording device 3a, so that the user can Accurately grasp the subject's reading actions (including operating actions), and have a situation database 12a that provides multiple information reading situations in the reading device 1a. In this embodiment, the situation database 12a is a cloud database or a computer One of the hard disks, and the situation database 12a is represented by a dotted frame in the computer in the diagram, and the reading situation is one of Internet news, shopping websites, personal blogs, Word files, or PDF files Or, by using different situations and collaborating with different tasks of the task release module 13a, each subject can read the display information 111a for the same purpose, so as to collect more parameters for the user's reference. For example, each subject can randomly perform different tasks multiple times. For example, if the task of selecting a shopping website is selected, the subject will be told to read the shopping website and search for the specified product, and the subject is required to complete it within a specified time The selected task. Furthermore, the perception survey unit can generate a pre-existing questionnaire 52a for users to collect a large number of research samples through observation and questionnaire distribution, and to initially explore and display information 111a based on the questionnaire data filled by the subjects. The influencing factors of the operator's operation mode and visual comfort further provide more reference elements for the final analysis.

However, the above description is only a preferred embodiment of the present invention, and does not limit the patent scope of the present invention. Therefore, all simple modifications and equivalent structural changes made by using the description and drawings of the present invention should be treated in the same way. Included in the scope of the patent of the present invention, it is jointly stated.

To sum up, the reading interface design method of hand-eye movement tracking of the present invention can really achieve its effect and purpose when used. Therefore, the present invention is an invention with excellent practicability and meets the requirements of the invention patent application. The application is filed in accordance with the law, and I hope that the review committee will approve the invention as soon as possible to protect the hard work of the inventor. If the review committee has any doubts, please feel free to send a letter to instruct. The inventor will do his best to cooperate, and I really appreciate it.

1: Reading device

11: Reading interface

111: Display information

2: Eye tracking device

3: Interface operation recording device

31:Mouse operation monitoring department

32: Keyboard operation monitoring department

33: Text Ratio Monitoring Department

4: Visual fatigue detection device

51: Perception survey unit

6: Regression analysis module

Claims (6)

A reading interface design method for hand-eye movement tracking, the main steps of which include: (a) providing a reading device for subjects to read a displayed information in a reading interface, the reading device has a task release module to guide The subject performs the specified operation behavior; (b) during the reading process of the subject, use the eye tracking device to record the eye movement during reading; (c) during the reading process of the subject, use an interface The operation recording device monitors the subject's operation actions on the reading interface; (d) uses the mouse operation monitoring part of the interface operation recording device to monitor the subject's mouse operation actions; (e) uses the interface to operate The keyboard operation monitoring part of the recording device monitors the subject's keyboard operation; (f) uses the interface to operate the text ratio monitoring part of the recording device to monitor the proportion of the subject's adjusted text to the page; (g) After the subject finished reading, use a visual fatigue detection device to judge the degree of visual fatigue of the subject, and use a regression analysis module to analyze the degree of visual fatigue; (h) after the subject finished reading, Using a perception survey unit to record the subject's subjective perception; and (i) integrating the eye movement, the operation action, the degree of visual fatigue, and the subjective perception as a design reference for the user. The reading interface design method for hand-eye movement tracking as described in item 1 of the patent application, wherein the reading device has a context database to provide multiple information reading contexts. The reading interface design method for hand-eye movement tracking described in item 2 of the scope of the patent application, wherein the reading situation is one of online news, shopping websites, personal blogs, Word documents, or PDF documents. The reading interface design method for hand-eye movement tracking described in item 1 of the scope of the patent application, wherein the eye tracking device is used in conjunction with a lower jaw support to enhance the recognition effect of the eye track. The reading interface design method for hand-eye movement tracking described in item 1 of the scope of patent application, which One side of the eye tracking device is provided with a camera device. The reading interface design method for hand-eye movement tracking as described in item 1 of the patent application, wherein the perception survey unit is used to generate a questionnaire beforehand.

Images