TW455483B - Method and device to relieve user of terminal display from eye and body fatigue - Google Patents

Abstract

The present invention is a system formed of a CCD or CMOS camcorder installed around the video terminal display (abbreviated VDT below), and one set of programs for the training of eye exercise and hand, neck, shoulder, and waist exercise training, etc. When the VDT user's eye is fatigued to a certain degree or the usage of VDT exceeds certain period of time, this system will send out the warning message and request the user to have eye exercise. The eye exercise is performed by setting up a series of eye training patterns and texts on the screen by the system automatically, and/or the relative music or voice hint in accordance with the feedback from the picture of the user's eye movement position or closing eye for resting taken by the camcorder to indicate and check the VDT user's training condition. By this function, the present invention can request the user to relax and accommodate the focusing tension of eyes, to train the eyelash muscle for it to relax and make the eye ball do the contracting and diverging exercise, so this system can effectively reduce the VDT user's eye fatigue symptom and the tension of the eyelash muscle. In addition, the present invention also provides the demonstration movement of a simple exercise for VDT users, which includes hand, neck, shoulder, and waist movements, etc. By capturing the image of DVT users in performing exercise and comparing with the demonstration movement, the training condition of the DVT user can be indicated and checked to reduce the ache and injury of the local body. In summary, the present invention utilizes camcorder for feedback so as to objectively let VDT users to relax their local fatigue of eyes and bodies.

Description

455483 V. Description of the invention (1) Information technology is developed and industries are upgraded. Computers are widely used in various industries. Even ordinary daily life is increasing, especially the Internet population has increased significantly. In recent years, the development of computer technology in the world is obvious to all, and it is foreseeable that the working population using computers to work in the workplace will surge. Facts have proved that the use of computers provides great help in work and life, but long-term operation has gradually negatively affected people's health, such as visual fatigue, physical aches, and work pressure, and other health burdens. Work performance and productivity have also decreased. The relationship between the workstation and the work environment has attracted much attention. Computer operation is a static operation type. After any static posture is maintained for a period of time, it is easy to cause fatigue. Therefore, prolonged use may easily cause local aches and injuries to the limbs. Computer operators often complain of fatigue, soreness, numbness, and even stiffness in the hands, wrists, upper arms, shoulders, neck, and back. In severe cases, such as arthritis, tendon inflammation, and carpal symptoms, etc.d Visual problems are one of the most common concerns when operating a computer. Frequent complaints include eye fatigue, sourness, blurring, flickering, and dryness. Causes of visual problems include: long operating time without proper rest, not maintaining proper line of sight, poor screen quality on the screen, poor screen reflection caused by the working environment, and poor working posture. According to Wang Jinze's research (Min. 85, Discussion on Occupational Injuries of Computer Workers-Take Three Southern Hospitals as an Example), the operators using VDT watch an average of 6.8 hours of screen time per day, and the injuries caused by eye fatigue General symptoms and musculoskeletal problems affect the health of VDT users.

4 5 54 8; ·, 5 'Description of the invention (2) According to Weng Linzhong's research (Min 83, Ophthalmology "Computer Terminal Syndrome" Study-Vision, Diopter, Intraocular Pressure, and Adjustment Function), the VDT user's When the eyes are staring at the terminal display for a long time, the eye symptoms caused by the eyes include eye fatigue, dry eyes, blurred vision, eye pain, eyes afraid of light, and increased number of blinks. Eye relaxation is very important to reduce eye pressure. Many computer users will pause after working for a while and do other tasks that do not require a computer, but do not really relax their eyes. On the contrary, this system requires some activity. First ask the user to close their eyes and rest, because this is the best way to relieve tension in the visual system. This will give the user's external visual and ciliary muscles a rest, and it will also wet the eyes. When the user sits in front of the computer, the eyes will look at nearby objects, such as the screen, documents, keyboard, etc. In this way, the external vision muscle will bring the eyeballs inward (toward the nose). This is called convergence, and the closer the object is to the eyes The more cohesive the external optic muscle, the tighter it becomes. If, after a while, the eyes are not relaxed, the user may feel tired and uncomfortable.

When the eyeball converges, the crystal lens of the eye must ensure that the image is focused on the omentum. In this way, the ciliary muscle must be moved to change the thickness of the crystal lens to adapt to the change in object distance. This action is called adjustment (acc ◦ mm 〇dati ο η). When the object distance is smaller, the crystal lens must be thicker. After a while, these muscles will be tired. It must be properly relaxed and stretched to maintain its elasticity. D In the past, it is a method to relieve the pressure on the eyes of computer users. There is the United States The patent US5 0 5 1 9 31, as shown in the first figure, mainly uses the designed program to provide training and equipment for eye movement, fusion and focusing. These trainings

4554 83 V. Description of the invention ¢ 3) The training items are progressive and quantitatively display the results of user training. The embodiment is to provide users with non-windowed menus to select items for training. The disadvantage is whether the user is really The scoring of training and execution effects depends entirely on the subjective judgment of users, and it is difficult to have objective effects. In addition, U.S. patent U S 6 0 4 2 2 31, the program provides a multi-object motion (as s 〇 ci a t e d) image motion, as shown in the second figure. When the user 15 focuses on the midpoint between the two related images 21, he should see a unified image. Two related images with different separation degrees are required, and the user's left and right eyes are focused horizontally inward to achieve eye training exercises. The performer can also look at a vertical bar placed between the eyes and the screen 22 with the help of both eyes. Top 2 3, easy to reach focused training. The disadvantage is that the trainer ’s eyeballs have completed the training movement and cannot be known objectively, because there is no feedback. The Japanese patent J P 1 0 1 9 2 3 5 1 A is shown in the third figure. The device for providing eye-clear muscle training is mainly a black box 25, which is equipped with a transparent plate 26, for the user 15 to look at the flashing light source 27 in the black box, and use the light source to flicker to achieve the purpose of eye muscle training. This method requires a device that is not related to the computer used by the computer user. It is not easy to popularize, and it also lacks a method of giving back.

In order to improve the shortcomings of the above conventional techniques, such as lack of feedback and supervision, it is impossible to know whether the user actually performs eye rest and training activities, whether to perform eye massage, neck movement, and so on. Thus, the invention is produced. The device of the invention includes a CCD or CMO_S camera placed near the terminal display and a set of eye training programs. This device will automatically or by V D T

4 ^ 548s V. Description of the invention (4) The user manually sets the item a 5 of eye training for eye training and exercise. The S of the g is one of the g of the present invention. It provides objective feedback and supervision functions to perform eye training. The effect of gymnastics does not flow into subjective judgments, so the effect varies from person to person.-The second of g of the present invention provides a variety of training, including eye movement fusion and focus training. Close a rest, eye massage, neck movement, and other feedback comparisons. Function 0 The third purpose of the present invention records the effect of the eye training performed by computer workers and quantifies the score. The fourth of the present invention cooperates with the claimed patent request No. 881] ί 4] [42, which can automatically 5 Also set the VDT to use the working environment to optimize eye protection Placement system G This system will display a message at a predetermined time to remind the user to interrupt the existing work. Provide a few minutes for the user to close. § Rest and perform some very simple multimedia eye training exercises and simple neck and shoulders.> Waist gymnastics. 0 In summary, the main a of the present invention is to provide the status y of the eye operation of the VDT user and give objective feedback and supervision in an unobtrusive manner> In addition, it also provides a simple motion indicator for the VDT user. The comparison program can effectively reduce the symptoms of eye fatigue and the tension of the eye ciliary muscles of VDT users, and reduce local soreness and injury of the limbs. In order to clearly describe the method and device of the present invention, the inventor The illustration, figure number, and detailed description are as follows

Page 8 4554Q3 V. Description of the invention (5) Diagram: The first diagram is the conventional technique of the present invention-α The second diagram is the conventional technique of the present invention 20 The second diagram is the conventional technique of the present invention 20th The fourth figure is a diagram of a preferred device embodiment of the present invention. The fifth figure is the eye training of the present invention. &Amp; TL 5 and the program flow chart. The sixth figure is the eye training item setting window of the present invention. The seventh figure is The flowchart of the near-far-distance training program of the present invention. The eighth diagram is a flowchart of the eye-ball collection and divergence training program of the present invention. The ninth picture is the eyeball convergence and divergence training pattern of the present invention. 0 The tenth picture is the simple body demonstration and comparison procedure of the present invention. The eleventh picture is the simple body instruction and comparison illustration of the present invention. Drawing number: 11 lighting 1 3 computer host 1 5 user 2 i two related images 2 3 top of vertical rod 2 6 transparent board 3 1 start program 3 3 input image and image processing 3 5 warning 3 7 execute training items and score 1 2 CCD or CMOS # Camera 14 CRT or other type of display 1 6 Stand or connecting rod 2 2 Display 2 5 Black box 2 7 Flash measurement light source 3 2 Start the camera 3 4 Align the user 3 6 Select training program combination formula

45 ^ 483 V. Description of the invention (6) 4 1-4 7 Look at the distance training program step 5 1-5 6 Convergence divergence training program step 5 9 Scrabble game 6 0 Puzzle game 6 bu 6 6 Simple gymnastic training program step 7 1 Eyes closed 7 2 Eyes open 7 3 Head tilt 7 4 Neck extension 7 5 Neck massage 7 6 Neck rotation 7 7 Swing movement 7 8 Stretching exercise 79 Shoulder lifting exercise 8 0 Waist gymnastics 112 For the location of the camera, please refer to the fourth figure, which is the embodiment of the device of the present invention. The light 11 provides environmental lighting. The hardware equipment mainly includes a CCD or CMOS camera 12 (hereinafter referred to as a camera), and a computer host 1 3 And display 14, while V DT user 15 is directly in front of the screen. Differences in computer equipment. Digital cameras can be used for cameras 1 and 2. In order to detect the eye movement position of VDT user 15, the camera can use the bracket or link mechanism 16 to move the camera to VDT user 1 5 The eye is about 1C 1-2 5 cm, as shown in camera 11 2, the true distance is about the maximum size of the binocular image, but not beyond the image frame. The eyes of VDT user 15 can now perform a combination of closed-eye rest, focused training, and watching distant scenery according to the steps provided by the training program. Training and relaxation 0 Please refer to the fifth figure. After the eye training program is loaded into the Windows operating system, it will be registered under the operating system.

Page 10 4δ54 8 3 V. Description of the invention ¢ 7) When the machine is on, Wi i η d 0 w s will automatically execute step 31 to start the eye training and simple gymnastics teaching program of the invention. After the training program of the present invention is executed, in step 32, the program of the present invention starts the camera 12. In step 33, images of the V D T user 15 and the surrounding work environment are captured by the camera 12 and the captured images are processed appropriately to determine the outline of the V D T user 15. In step 34, the V D T user 15 is asked to move the camera 12 to 10-2 5 cm to get closer to the user's eyes. In step 36, the instructions will be executed, and the selected items are scattered 4. The selection of the hand gymnastics training item combination, please refer to the sixth picture including 1. Closed eyes and rest 2. Look far away and close 3. Convergence hair 5. Neck Gymnastics 6. Shoulder gymnastics 7. Waist gymnastics 8. Other sports refer to the main system. You can use the eyebrow or a direction that is less than a reference body to train the sphere to look at the sphere. The eyeball position of the camera is on the screen? Report the voice. Eleventh use photography hair and nose line, and also set the seventh image and music. First, the image will be taken by the water. If it is necessary to move the image, close your eyes and rest 7 1 and open your eyes 7 2 Capture the image to determine the area search between the eyes of the user. If it is found that the eye shape is that the shape of the eyeball does not exist, and the eyes are added, then the eyes can be regarded as closed, and the training of seeing near and far is to match the screen Run the rhythm, move your eyeball, look closer and farther. Look Close In step 41, a sphere image is displayed on the screen. Move it to the right side of the screen to guide the user to take the eye position. In step 42, whether the user ’s eyeball follows the sphere image will be judged by photography. Then proceed to step 4 3. The program will issue a warning sound to the screen and score; if it is, judge, set the area of this straight line. When the object looks far away, catch the ball to the right and take the machine. Move to the right or the police step.

Page 11 45 54 B 3 V. Description of the invention (8) 44. Determine whether the user's eyeball has not moved back to the screen within the preset time? If not, go to step 4 5. The program sends out warning music or warning voice, asks to remove the screen and score; if yes, go to step 4 6 and repeats the eyeball to the left of the horizontal, vertical up and down, etc. Look away. Finally, go to step 4-7. According to the eyeball position captured in the above steps, calculate the amount of movement and the time to look far away, and calculate the total score of this option. 1 For the training of eye convergence and divergence, please refer to Figures 8 and 9, according to the displacement of the eye position of the ingestion, and score it. In principle, the more consistent the displacement of the two related images, the higher the score. The two related images can be divided into two categories, one is a crossword game 59, such as LV and 0E to combine LOVE, and the other is a puzzle game 60, such as to synthesize the contour of the face with the eyes and mouth to smile. The main steps are as follows: Step 51: Display two related images along the horizontal line, and use the camera to capture the position of the user's eyeball. Step 52: The user puts the index finger of his right (or left) hand upright, and the other four fingers shrink into a ball. The vertical index finger is placed in the middle of two related images and close to the screen. The user looks for the focus point on the index finger. Step 53: The user moves the index finger at a slow speed, close to between the two eyes. If the user's two eyes are continuously focused on the index finger, the camera will judge the two related images according to the degree of divergence to convergence of the user's eyeball position. Gradually merge into an image. Step 54: The user moves the index finger at a slow speed, leaves between the eyes, and gradually gets closer to the screen. If the user continues to focus on the index finger, the camera will judge, according to the degree of convergence of the user's eyeball, to the degree of divergence. Will come together

Page 12 4 ^ 183_ V. Description of the Invention (9) An image is gradually separated into two related images. Step 55, repeat steps 53 and 54 several times, and increase the index finger movement speed one by one. Steps 56 and 6, based on the position of the eyeball taken, calculate the number of successful convergence and divergent points. The purpose and timing of simple exercise (gymnastics) is to move the bones and muscles, and to relieve the depression in the heart. It can be performed before, after and during computer work. Referring to the tenth figure, sports include gymnastics such as eyes, hands, neck, shoulders, and waist. Let your body move as much as possible, relax your body and mind, and let your eyes look into the distance. The length of the exercise and the number of events, depending on the time and condition allowed Let users set it up. Please refer to the eleventh figure. The training of simple sports is to ask the trainee to leave the seat so that the camera can take a picture of the whole body, use the binary image to find the skeleton picture, and compare it with the movement skeleton picture of the model character on the screen. Correct. Take neck, shoulder, and waist gymnastics as an example. First, go to step 61. If it is neck gymnastics, ask the user to take a seat back and make the camera take pictures of the body above the waist. For shoulder, waist and other gymnastics, use The person leaves the seat and makes the camera shoot the whole body. If the user allows the camera to capture the desired image according to the options, go to step 6 2 to display the demonstration action of the demonstration character on the screen and invite the user to do the same. Step 63: The camera captures the action of the user and binarizes the image of the user's body parts. Step 64 calculates the user's skeleton picture and compares it with the movement skeleton picture of the model person on the screen. Scoring history. Next, step 65, to see if all the selected gymnastics have been completed? Finally, go to step 6 to calculate the total score and record it.

Page 13 455483 V. Description of the Invention (11) With reference to the eleventh figure, the neck gymnastics of the present invention can be subdivided into head pitch 7, neck extension 7 4, neck massage 7 5, neck rotation 7 6; Shoulder gymnastics is divided into rotary movements 7 7 (relax arms with ease, draw a circle around the shoulders, and change hands after a few rotations), stretching exercises 7 8, shoulder lifting exercises 7 9 (lift both shoulders upward, Rest for a few seconds before lowering); waist gym 80 has three movements, as shown in the eleventh figure. In summary, the present invention can automatically provide various training and gymnastics for VDT users, and use digital camera feedback to objectively urge and evaluate the status of VDT users, which can effectively reduce the eye fatigue symptoms and eyelashes of VDT users. The tightness of the shape muscles reduces the local soreness and injury of the limbs, for which a patent application is filed.

Page 14 1 2 CCD or CMOSil camera 14 CRT or other type of display 1 6 Stand or link 2 2 Display 2 5 Black box 2 7 Flicker measurement light source 3 2 Start camera 3 4 Align with user 3 6 Select Brief description of the training project combination diagram. First picture: It is the conventional knowledge of the present invention. Second picture: It is the conventional knowledge of the present invention. Third picture: It is the conventional knowledge of the present invention. Figure: the eye of the present invention sixth: the eye of the present invention seventh: the eye of the present invention close to the eighth picture: the eye of the present invention ninth picture: the eye of the present invention tenth picture: the present Simple diagram of the invention. The eleventh figure is the simplified drawing number of the present invention. -11 The lighting 1 3 The computer host 1 5 The user 21 Two related images 2 3 The top of the vertical rod 2 6 The transparent board 3 1 The program is started 3 3 The input image and image processing 3 5 Warning 3 7 Implementation of training programs and scoring techniques. Technology two. Technology III. Device embodiment diagram. Training setup program flowchart. Training item setting window 15 See the distance training program flowchart. Flow chart of the training program for receiving and diverging. Convergent divergence training pattern. Gymnastics, demonstration and comparison program flow Easy gymnastics, demonstration and comparison drawing.

Page 15

Claims (1)

6 'Application for Patent Scope1 · A method to relieve the terminal monitor ’s use, and pass on the “one”: “Square J ’s eyes and body fatigue”, the charge near the terminal monitor (CCD) ) Or complementary metal-oxide half-field effect transistor 〇13 Including training and hands, neck, shoulders, * waist body bag When the terminal display user's eyes are more fatigued than necessary !: If the blink frequency is too high or too low, or the terminal is used When the display exceeds the setting room, this system will automatically issue a warning and ask for eye training. The execution of eye training is automatically set by the system with a series of eye training patterns, text on the screen, and / or related music or voice cues In cooperation with the camera to capture the user's eye movement position or closed-eye rest situation, as a feedback to indicate and check the training status of the terminal display user, through this function, the present invention can objectively and surely require the user to relax and adjust Focusing on the tension, training the ciliary body to 'stretch' and make the eyeball perform convergence and divergence movements, so this system can effectively reduce Symptoms of eye fatigue for users of terminal display and tightness of eye ciliary muscles; Provide demonstration exercises for users of terminal display (VDT) for simple gymnastics, including eye, hand, neck, shoulder, and waist movements, through the camera Take pictures of gymnastics performed by terminal display (VDT) users to compare with demonstration movements to indicate and check the training status of terminal display users to reduce local soreness and injuries; in summary, the invention The use of camera feedback can objectively connect users to relieve the fatigue of the eyes and body of the terminal display (VDT) user. Page 16 4554 8-VI. Scope of patent application 2. According to the method described in item (1) of the scope of patent application, the method for relieving the eyes and body of the user of the terminal display is part of the eye training. Seeing near and far, eye convergence and divergent movements, simple gymnastics such as hand, neck, shoulder, and waist exercises, and other training or sports that can help to relieve the stress of the eye, can also be monitored and compared with the help of cameras. It belongs to the patent scope of the present invention. 3. —A device to resolve the fatigue of the eyes and body of the user of the terminal display monitor 'This device includes a charge coupled device (CCD) or complementary metal-oxide-semiconductor (CMOS) camera near the terminal display, and a set of Includes eye training and hand, neck, shoulder, and waist training programs. 4. The device for relieving the eyes and body of the user of the terminal display according to item 3 of the scope of the patent application. Among them, the terminal display can be used for desktop computers, notebook computers, or other types of computers. 5. The device for relieving the fatigue of eyes and body of the user of the terminal display according to item 3 of the scope of the patent application. The terminal display may be a cathode ray tube (CRT) or a liquid crystal display (LCD). , Plasma or other types. 6. The device for relieving the fatigue of the eyes and body of the user of the terminal display according to item 3 of the scope of the patent application, wherein a charge-coupled device (CCD) or a complementary metal-oxide-semiconductor field effect transistor (CM0S) near the terminal display is used. ) The camera can be moved close to the eyes of the user of the terminal display (VDT) by the link mechanism, so that the user's eye movement can be captured, or the user can be asked to leave the seat and follow the photography 1 Remuneration 4554 8 VI. The patent application machine maintains a long distance to allow users to take simple gymnastic exercises. Page 18 111