TW396032B - Method for applying an eye vision test and evaluating an eyeball exercise - Google Patents

Abstract

This is a method for applying an eye vision test and evaluating an eyeball exercise including declaring variables, capturing eye images, configuring boundary, processing a fixed point display by binary calculation, capturing the central position of a pupil, and analyzing results. By measuring an eye vision position and its flexibility, the data of the eye exercise can be quantified and used to analyze the user's eyeball behavior. Furthermore, the data can be used to increase the flexibility and resolution of the devices and prevent errors and misjudgments to attain the expected effect. In addition, as to the clinical practice for the eyeball exercise, it obtains solid data of the eyeball exercise and improves the accuracy when judging the results.

Description

V. Description of the Invention (1) Technical Field] The present invention is an estimation method. [Previously, viewers were eager for the whole study and mind to gradually learn about the popularity of the reward. The principle of measurable pupil tracing and the range of activity, and then the voltage signal measurement, capacity. And magnetism forms magnetism, especially the technology] in human life. The existing equipment is expected to be able to obtain the system architecture. The topic of real-time detection in the eyeballs can be classified into three types of systems, the piezoelectric direction. This type of piezo number is used to deal with perspiration. To improve the use of a kind of eye sight detection and eye movement evaluation that can specifically evaluate the user ’s eye behavior, various high-tech virtual reality systems and head matching displays have also been developed. At present, head matching It is a reference for the improvement of the user's eye movement behavior, and these materials are also science, communication, and media arts. Measurement of dynamic behavior, it is common to detect eye movements with the eye. At present, the design of piezoelectric pupil tracking system, optical chasing home appliances, or other viewer systems is used to study ophthalmic medicine. ... and other experts and scholars ball tracking system, pupil tracking system uses pupil detection system and magnetic field pupil tracking system to detect changes in eye pressure by using changes in intraocular pressure. The main method is to use piezoelectric materials attached to the periocular sensor to detect intraocular pressure. Converted into electrical signals, and interpret the resulting theory. However, the piezoelectric pupil tracking system affects the interpretation of the signal due to other factors such as current sense. The system is similar to the piezoelectric pupil tracking system *. It judges the eye movement around the eyeball. Compared to the piezoelectric pupillary system

Page 4 V. Description of the invention (2) System, the optical pupil tracking system has greater flexibility ^ Images can be divided into point, line, and matrix, etc. ° Optical pupil tracking system takes faster, but for eye movement Amplitude over mode. Although the scanning speed of the dot type is the case, as for the matrix type, it is easy to judge the change of the eyeball size when it is judged directly at the time of delivery. X 'fixed coordinates' and simultaneous optical pupil tracking system uses a device, a pinhole CCD (charge-coupled device), and a commercially available head-mounted display as its hardware part. First of all, the personal light, and personal computer are assembled on the screen of the head-mounted display, so when the screen on my brain screen is converted to 'the image on the screen is two, we put on a head-mounted display. . And a pinhole CCD is set on the head with a solid lens on the computer screen, and the light makes the captured eyeball image ^ 'below the owner's device' to adjust the focal eyeball image for analysis. When the eyeball scene is clear in February, we first freeze the eyeball image after only capturing the card. The second stage is transmitted from the pinhole CCD to the movie to analyze and determine the eyeball's current attention. Some image analysis algorithms are seen. The coordinates of the coordinates, via the RS232 communication protocol, are then 'analyzed in the personal computer analyzed and driven to perform a command ~ the coordinates are transmitted to the application of the viewing state camera' to control the eye f obtained from photography. Through the analysis of CCD fixed image processing card and computer program ^, the two-dimensional linear image signal passes through the point to determine the position of the eyeball, and converts the eyeball Note 2 = the angle of the center of the eyeball image, and then the eye movement information is equal to 2 = the vertical angle And horizontal brain screen provides eye tracking data. ', I processing, finally can be used in electricity. However, the existing pupil position is' °, but most of its devices are lacking =, can analyze the user's eyeball line, lack of flexibility and low resolution, especially different.

Page 5 V. Description of the invention (3) The inconvenience of moving the eyeballs between the two users is to look at the same point in various viewing, viewing errors, or even completely differently, to visually inspect the patient's vestibular vision. Check the patient's eyes Cover test (Orthophoria), but there are no judgments, so the judgment [& and efficacy] The position of the main eye sight detection and the eye sight of the present invention are clearly specified, and the data is used to improve the application. The power of judgment is wrong. Another aspect of the present invention is to get the eyeball tour when browsing the eyeballs. ^ ------------ Habits: different or each person's crotch is large, there will be different eyeballs Π angles are different. When viewing the equipment, it may be caused by the use of the red ice field, and the product is too large, which will result in the judgment ... and the use of the law will not achieve the expected results. In terms of the previous clinical and practical aspects of the medical method + condition, compared to the inner county, the ophthalmologist can judge the state of exercise, and the household method is based on the naked eye 1 «τ wOphthalmology is also over | Method ― to check /, whether the patient / eye is in the right position of the eyeball & get i ^ μ The method of measuring eye squint is to obtain specific data ', and the result is easy to be unobjective and inaccurate. ^. !! The test = 'is to solve the above problems by using evaluation and eye movement methods, and measuring the degree of flexibility of the line to signify eye movement :; analyze the user's eyeball behavior with / knife, and then use the flexibility of the obtained equipment = The resolution 1 can avoid errors and the second purpose is to determine the user's ability to operate the pupil tracker. The second purpose is to provide an eye examination as a study of ophthalmology and psychology.

V. Description of the invention (4) The reference for learning, communication and media art is 4K, and judge whether the user is abnormal in the non-autonomic nerve. [Technical content] A method of eyeball detection and eye movement evaluation. The method of eyeball and eyeball detection and evaluation includes:-The method of eyeball detection and evaluation is used for the calibration of a pupil tracker. It locates the coordinates of the positioning points formed by the user ’s eyesight on the top, bottom, left, right, and middle of the pupil tracker screen, and uses a — — the reference value set in the pupil tracker The ideal value is determined by the user. The ratio of the reference coordinate distance between the correction reference point and the ideal value of the fixation point f-is a first use evaluation parameter; when the user looks at the screen, the five correction reference points are all The ratio of the ideal variance value to the mean square error value obtained from the analysis of the eye coordinates is a second use evaluation parameter; the product of the first use evaluation parameter and the second use evaluation parameter is used to obtain a use evaluation parameter;

Use the value of the evaluation parameter to determine whether the user is capable of operating pupil tracking I

Or the calibration result is good. If the value of the evaluation parameter is greater than an I setting value, it indicates that the initial calibration result is good. If the value of the evaluation parameter is less than the setting value, it indicates that the initial, calibration loss It or The user may not be able to operate the pupil tracker; and-an eye movement assessment method for eye sight detection, the eye sight ¢) _ the detected eye movement assessment method is used for the eye sight detection process of the pupil tracker, which Most of the positioning point coordinates formed by the user's gaze through the pupil tracker screen along a circular movement. The user's eyeball is used to correct the internal angle of the reference coordinates and the ratio of the internal angle of the positioning point coordinates to calculate the virtual use-—

The description of the five inventions on page 7 评估 The evaluation parameters of leisure ball movement, the eyeball flexibility of t; In addition, the root mean square of the difference is calculated and counted, the user's eyeball movement, the user's eyeball movement is flexible, and can be stored in The circular motion of the bright motion evaluation parameter is smaller than the setting of the non-autonomic nerve problem. The degree of user's eye movement evaluation assists the concentration of the auxiliary parameter. When the user's eye value is displayed, the above and other embodiments of the present invention are displayed by the user. The detailed description is in accordance with the drawings. Of course, the present invention is different in some aspects, but the selected implementation descriptions are shown in the drawings. [Simplified illustration of the diagrams] The analysis of the eye movement evaluation parameters is used by the user's eye center When a user ’s eyeball motion assessment auxiliary evaluation parameter is stopped near a set value, it means that it catches up with the highlights of the rotation movement on the circle, and the point jump speed is slow. When the eyeball value of the user is in the user ’s health, In the situation, further inspection is needed; and from this number, the user can get small auxiliary parameters for eye movement test ball movement evaluation. A set exercise test quite focused. Purpose and advantages, it is not difficult to obtain in-depth understanding from the following selected applications. Examples are allowed on the 'or other' arrangements, which will be detailed in this specification. Hereinbelow, the present invention will be described in detail with reference to a preferred embodiment in conjunction with the drawings: Fig. 1... The present invention is a type measurement-the decoration of the Italian grace / Fig. 2 is the hair ... etc. 3-is a also Shaya Yi_Cheng. Yan (4 pictures, free also a note of Thai attention-vision-straight picture 5 ... Department. The present invention uses Pingchun n Wuding scattered m picture one

V. Explanation of the invention (6) Figure 6A is the eyeball image of the first positioning point of the present invention using the evaluation method for rabbits. Two of the anchor points. ---------. &Quot; ~ 'No. 6 ς—month- ^ use, test · .—— first three. House of the dragon ^: 遽: image No. 6 Figure D shows the user's gaze detection using the cobalt-evaluation method of the present invention (No. 酉 _ 定 1 ^ 点 _ ^ _ || ^ 11_ image V. No. θ B: Figure shows the use of the present invention to evaluate one party's-attention-looking ^ The 7th eye of the test is also invented-the eyeball ^ ~ dysentery-dry ~ t? L j_ f detected by the t method straight-fuck-Jue 8th diagram-the invention-the eye-one point i 9 .Picture ........ Piming's eye movement detection method in the pupil —..............- ........-- —--------— ~ ^ _. · Heart coordinates [Illustration of drawing number] Computer (2 2) Memory (2 2 2) Input device (2 2 4 Frame (2 4)) Screen (2 1 ) Central unit (221) Data storage device (2 2 3) 0 Image projection device (2 3) CCD image detector (2 5) (A1) Variable declaration (A2) Capture eye image (A3) boundary setting

5. Explanation of the invention (7) (A4) Binarization processing (A5) Anchor point display (A6) Extraction of pupil center position (A7) Results analysis (1)-Anchor points NO, Nl, N2, N3 , M4 correction reference points NO ', ΝΓ, N2', N3 ', N4' (two) angles Al, A2, A3 —A22 positioning points Ql, Q2, Q3 ... Q22 ψ correction reference point coordinates Ql ', Q2', Q3 '... Q22' '[Detailed description of the embodiment] Please refer to Figs. 1 to 9, which show the structure of the embodiment of the invention selected for the purpose of illustration. Limitations of this structure. The present invention is a method for detecting the sight of the eyeball and a method for evaluating the movement of the eyeball. The device may be a telemetry type < REMOTE) shown in FIG. 1, which includes: a display screen for outputting an image (2 1) A computer (2 2), which can execute a software for eye tracking and pupil zoom detection, which includes at least a central unit (2 2 1), a memory (2 2 2), and a data storage device (223); An allegation command input device (2 2 4), an image input interface element (not shown) and an image output interface element (not shown);

V. Description of the invention (8) An image projection device (2 3), which is connected to the image output interface element of the computer (2 2), so as to convert the image signal transmitted from the computer (2 2) into an optical image and project it To the screen (2 1); a CCD (charge coupled device) image detector (2 5) and mounting accessories, which in this embodiment is a CCD camera; a DSP (digital signal processing) chip module (figure (Not shown in the figure) and the video line curtain setting. In addition, (HMD) > (21) Use the oblique angle formed on the head to rationalize the card and the present invention A1) Variable A2) Capture the user's attention to A3 ) The boundary can fall on the search A4) binary value to obtain the A5) positioning number so that the (surface (physical) device can be installed as the head shown in Figure 2 with the CCD image of the head configuration The detector (2 5) and the display screen are arranged in a frame (2 4), which is near the eyes of the fixer; the CCD image detector (2 5) is used to configure the display screen (2 1 ), And capture the day and night face of the eyeballs at close to 4 5; capture the image of the human eye and use the image to the computer The composition microprocessor analyzes it. It includes the following steps: Announce; © Eye image: Use this CCD image detector (2 5) to capture the screen (2 1), and capture the image of the user's pupil; Setting: Set Image search boundary (2 6), make pupils search for the day (2 6) within the boundary; chemical processing: analyze the image to make the X and Y values binarize the center point of the hole; point display: on this screen (2 6) Points displayed for analysis;

Page 11 V. Description of the invention (9) (A6) Extracting and extracting the dir · borrow the ccd image detector (2 5) point coordinates; the point of the image to get most of the correction reference. (A 7) analysis of results : The coordinates of the correction reference point obtained by the analysis of the upper and the lower two types are shown in the following screen f ^ = a sphere. When the line of sight moves from left to right, note the calculated three levels between the center of the pupil and the lower part of the furnace. In a straight line, the red point of the center point of the hole = Yoshihisa as shown in Figure 4. 'In the image, the pupils must take a trace of Asia and Africa on a straight line and have an arc shape. Therefore, I am ... The coordinate conversion method to overcome the factor 1 I as shown in Figures 5 to 7 is the detection of the position of the eyeball sight line of the present invention. In this embodiment, the positioning points, The coordinates of the first to fifth positioning points No., Nl, M, and the n-positions N 0 to N 4 displayed on the screen on the top, right, middle, left, and bottom sides of the screen are (χι γ 〇), (χ2, γι), (χι, γι), (X Ο, Υ1), (χ1, γ 2), the initial calibration step is started Before, users can choose to use automatic correction. The yellow crosses of these anchor points will appear on the screen in order (XI, YO), (XO, Y1), (XI, Yl), (X2, Y1), ( XI, Y2) and other five positions, the user must continue to look at the z-word and follow it. After calculating the center position of the user's eyeball 20 times, among them, taking into account the user's reaction time, the 20 eyeballs The first five coordinates in the center coordinates will not be used, and the remaining fifteen eyeball center coordinates will be analyzed, and the median value of each positioning point will be used to obtain the best positioning point.

V. Explanation of the invention (10) The coordinates are advanced to avoid errors caused when the user looks at the positioning points N 0 ~ N 4 when the line of sight drifts. Due to the extremely fast image processing speed, the average time required for one correction is only ten seconds. If the user selects manual correction, when the cross appears at the coordinates of the positioning points N 0 ~ N 4 respectively, the user must look at the positioning points N 0 ~

N4 'Then press the ejlter key of the computer to make the positioning points N0 ~ N4 displayed in order, after the user looks at the positioning points N0 ~ N4 in order,' My milk can get five eyeball images, such as As shown in Figs. 6A to 6E, the correction reference points N0 ', NΓ, N2, N3', N4 '' of the pupil center as shown in Fig. 7 are obtained, and the distances between them are 102 ', L12 ', L32', L42, to express, after completing the calibration step, we will get the calibration reference point coordinates N0 '~ N4' ', whose coordinate values are (N0,00), (N1,01), (N2, 02), (N3, 03), (N4, 04). Based on the distribution of the five calibration reference points NO '~ N4', we can define the use of the evaluation parameter K to analyze the user's calibration results; meaning whether we can use the coordinates of the five calibration reference points NO '~ N4' to analyze User's on-screen gaze point; use evaluation parameters K 二 Klx K2

The calculation method of the first use evaluation parameter K1 is that L02 ', L12', L32 ', and L42' represent the distances between the calibration reference points; L02, L12, L32, and L42 represent the average ideal values of these calibration reference points; where, ,,, Are the ideal values obtained from the experimental average,

(11) 33555537 The second calculation method for using the evaluation parameter K2 is as follows, when the ball coordinates and,,,, are the user's gaze, and other positioning points are analyzed, 10 points of data are obtained in the analysis of eye seconds). The mean square error values of,,, are ideal values obtained by experimental averaging. 34243 With the average ideality between the positioning points such as the pupil base of the user, we operate the pupil tracker according to the use of the evaluation force, or the size of the head and eyes are different, and the differences are mostly between 0.7 and 0.9. 5. If the evaluation parameter K is good, we can fix the point according to this screen. If the calibration fails or the user may return to the initial step, the binarization threshold or the configuration can be used to continue using the system. (2) As shown in Fig. 8, the distance between the target calibration reference point and the gaze analysis user's line of sight. The value of the parameter K is used to determine whether the user is able to correct the result of the correction. 'Because everyone's and the angle of the head-mounted display will have a value of K. According to experience, between the K values, we set the K value to 0. A value greater than 0.5 indicates that the five calibration reference points of the initial calibration continue to analyze the value of the user's estimated parameter K is less than 0. 5, it means that there is no ability to operate the pupil tracker initially. At this time, _ the user must readjust the search boundary, the image, wear the monitor, and then recalibrate it again. This is the eye movement evaluation method of the present invention.

Page 14 V. Description of the invention (12) It is the detection of the flexibility of the eyeball sight. In this embodiment, 2.2 positioning points are taken, and the positioning points Q1, Q2, Q3 ... Q22 are on the screen (2 1). The displayed circular trajectory moves, and its line of sight is recorded, as shown in FIG. 9, and the corrected reference point coordinates Ql, Q2, Q3,... Of the fixation points Q1, Q2, Q3 ... Q22 are obtained. . Q22 ,. Therefore, the angles Al, A2, A3, ..., A22 of the stopping points of the center of the user's eyeball can be obtained, so that A1 = ZQ1, Q2 ’Q3’ A2 = ZQ2, Q3, Q4,

A3 = ZQ3 ’Q4’ Q5 ’W A22 = ZQ22, Q1, Q2, and the user ’s eye movement evaluation parameter U1 N is obtained by subtracting two times the number of bright point jumps of the rotary motion on the circumference. Where:: is the average value of the included angles of the stopping points in the center of the user's eyeball. Θ Denominator part: It is the number of positioning points that rotate on the circle minus 2 times 7Γ, which is the sum of the internal angles of the polygon. The numerator part is the polygon_internal angle sum enclosed by the measured calibration reference points.

Page 15 V. Description of Invention (13)

When the user's eyeball ▲ indicates that the user's eyes are broken * Le evaluation parameter ϋ 1 is close to the set value 1, click. I Ju ’can catch up with the rotating motion on the circle. This is based on the user's internal angle sum ratio analysis. The internal angle sum of the positive reference coordinates and the positioning base mark. When the user's eyeball movement = f's eyeball flexibility. The eye movement of the user is flexible. When the s-estimation parameter u 1 is close to 1, it means that when the rotation on the circle is used, the highlight of the rotation movement on the circumference is used. A circle around every second), and the speed of each bright spot is slow (for example, every time the value of 0.5 is' user f, the eye movement evaluation parameter U1 is less than the setting problem, you need to do further = ^ non-discipline in health conditions Another definition of the neurological aspect of the user's eyesight, the auxiliary parameter U2 for the evaluation of the movement of the second movement U2, the user's eye movement evaluation auxiliary table for each stop motion experiment (set the detection of the eye and the effect of the solution period, the results point angle The root mean square of the difference. This is the degree of the center of the user's eyeball. When the user's eyeball is transported :; The degree of flexibility of the line is further borrowed from the data used to raise steam ::: use: degree 'and can avoid errors and judgment errors. The J-ball track detection system of the J device is placed in each junior; Liu: The device that has achieved a preview of various virtual reality technology and viewing equipment, so the value of the evaluation parameter K is greater than 0.5, the main: the test basis. J represents the initial correction

V. Description of the invention (14) --- = If the value of Ilf is less than ° .5, it means the initial correction ... J user has the power to operate the position tracker, and the second time loses 0.5. When the user The ball can be exercised flexibly. The evaluation parameter U1 is less than the question. Furthermore, the evaluation assists the table to construct a number of exercises. The auto-neural autonomic nerve question ball exercise experiment is quite focused [0 · 2, which shows the data on the eye of the thrower, and可 ΪI: t2 ί 查, # to the specifics of eye movements is the study of ophthalmology, heart and time table, as an important reference basis. Science, Communication and Media Arts Of course, the present invention still has the above-mentioned points, and it should be noted that, for example, these sites are not limited to the behavior of eyeballs. Isochronous sites can be displayed randomly and randomly, and then analyzed. In summary, Tailu 0Η has a flexible degree of inspection and body two f = eyeball position and eyeball user's eyeball line. The data is clear and concrete, the flexibility of separation and analysis of the product, and the data served by s are used to improve the personal eye movements of users who are different in application dressing or different from K people: The angle of the head-mounted display :: The size of the eye, the size of the eyeball, the size of the eyeball, and the mismatch are different, so as to achieve the error caused by the pre-second difference to avoid misjudgment. It can be buried in clinical practice. In addition, as to the condition of the eye movements, it is possible to increase the determination of the JJJ Ming to obtain specific data of the eye movements, limiting the invention? ：: 2 is not used to explain the present invention, and is not used to change the numerical value or replace the equivalent element ;:

Page 17 V. Description of the invention (15) belongs to the scope of the present invention. From the above detailed description, those skilled in the art can understand that the present invention can indeed achieve the aforementioned purpose, and it has indeed complied with the provisions of the Patent Law, and filed a patent application. Attachment 1: This is a reference diagram of the present invention for detecting pupil shadow on a computer screen.

Q

Page 18

Claims (1)

Sixth, the scope of patent application ---- 1 kind of eyeball gaze detection use evaluation method, the eyeball .. sight-line of sight. The test 'use evaluation method is used for the correction process of a pupil tracker, by using The positioning points of the pupil sight line at the top, bottom 1, gray side, right side, and middle of the screen of the pupil tracker-coordinates ~ ^ The reference value set in a differential chaser is an ideal value, and Use the ^ dark hole I standard calibration reference point spacing m bits hhm acres as a first use evaluation parameter; and use the test to look at the screen five old points late, all X ^ Μ ^ .ΑΜΛΜ ^ Α Jungu Carcass The second is to use the evaluation parameter i :: the first farmer is the evaluation parameter and the second evaluation product is the product of the second evaluation parameter to obtain an IJ evaluation gas parameter; and to judge the user ^ no friend according to the use evaluation # 参 # various values -Capability operation, belongs to pupil tracker. Gongyi thuihui winter province-Fan _ 之-head surname 1 make a comment — estimate, its #__ 声 __ ^ (rA LL variable I announced; (Α2) capture eye images. Borrow-an image detector Capture the scene with the user, and capture the image of J-H Kang Kong; ~ a c edge m is set to find the edge u ·, D (Α · 4) two-value-I processing-: sub-invitation JSj & AilAX -— .. 1_ 后 __ 之 ._ 士 _ 羞 一 也 处-琪, in order to _ take pupils, east-heart. -¾? (Α'5): ^ i ^ most of them "^ ^ (A 6), capture the pupil ten hearts ~ ^ A% of these positioning-point shadow remote 1L most of the correction reference m; Analysis of the scope of patent application (A 7): Analysis of the correction and reference square coordinates obtained from Shuzheng No. 4 of the barrier coordinates' By using the ideal average value of the car, the distance between the test sites and the distance between each test, etc. 3. Between the positioning points: a = analysis of the user's line of sight. The eye detection process of inspection is based on the theory that the injury is formed by the movement of the Yu-Zhou-Wen-Zhou movement ^^ The screen of a pupil along a round seat & a ^ number point coordinates, borrowed by the user Mugenyu-correction of the reference point's internal angle and the ratio of one of the coordinates of the anchor point, the M channel is calculated using the motion evaluation parameters, and the analysis of the eyeball motion evaluation parameter is selected. The eyeball motion of the person.s μ — —— — — m towel ^ ^ ^ ^ ^ ^ I :! * ^ α ^ ^ ^ I bst ^ ^ ^ 3. ΜΛ ...— assistance ^ ^ # M ^ ^ ^ " The eye movement evaluation method of the i-ball sight detection described in item 3, the steps include: (A4) 1 number: announcement "(A2) capture I eye H: borrowing the curtain, two _ capture star toe cutting-A», Hitomi JUHlj (A3) Boundary setting: Custom-fix-image-good: shame-boundary, the complex j-face of the pupil can fall within the search boundary; (A 402 posteriority: analysis of the image obtained as χ ′, γ Value --- binarization processing to find in the pupils ... hearts; (Boom 5) fixed point display = display most anchor points moving along the edge of JJLJIA with strict points; — -_ Page 20 VI. Patent application scope (A 6) Capturing the pupil's earthen core position: By using Ning image detection 1 to capture the image of the user's gaze at these anchor points, the JiL majority table is obtained; (A7) Analysis of results : Analyze the coordinates of the reference point obtained by the above analysis, and use β to analyze with [the user's correction, reference coordinates-of "and and |