WO2016137405A1 - A communicative system by monitoring patients' eye blinking - Google Patents

A communicative system by monitoring patients' eye blinking Download PDF

Info

Publication number
WO2016137405A1
WO2016137405A1 PCT/TH2015/000012 TH2015000012W WO2016137405A1 WO 2016137405 A1 WO2016137405 A1 WO 2016137405A1 TH 2015000012 W TH2015000012 W TH 2015000012W WO 2016137405 A1 WO2016137405 A1 WO 2016137405A1
Authority
WO
WIPO (PCT)
Prior art keywords
data
sub
main
eye
blinking
Prior art date
Application number
PCT/TH2015/000012
Other languages
French (fr)
Inventor
Piyasak BUNKHOMRAT
Original Assignee
Meditech Solution Company Limited
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Meditech Solution Company Limited filed Critical Meditech Solution Company Limited
Priority to PCT/TH2015/000012 priority Critical patent/WO2016137405A1/en
Publication of WO2016137405A1 publication Critical patent/WO2016137405A1/en

Links

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0481—Interaction techniques based on graphical user interfaces [GUI] based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance
    • G06F3/0482—Interaction with lists of selectable items, e.g. menus
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/011—Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
    • G06F3/013—Eye tracking input arrangements
    • G—PHYSICS
    • G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09B—EDUCATIONAL OR DEMONSTRATION APPLIANCES; APPLIANCES FOR TEACHING, OR COMMUNICATING WITH, THE BLIND, DEAF OR MUTE; MODELS; PLANETARIA; GLOBES; MAPS; DIAGRAMS
    • G09B21/00—Teaching, or communicating with, the blind, deaf or mute

Definitions

  • This invention involves a communicative system by monitoring patients' eye blinking.
  • a patient who has been in a severe accident, or has an illness so severe that the patient cannot communicate verbally as usual, or an elderly patient whose cognitive function is inhibited, or a patient with a deficient nervous system, or a patient who has brain impairment will have problems communicating with doctors. If information from a patient is important for a case, it will be beneficial for police officers if the patient can communicate with the police officers because actions can be taken by the police station in a timely manner.
  • the eye monitoring system with a set value for eye movement and light source with brightness exceeding the standards with blinking will send a command for the processing unit to control instead of button pressing with fingers.
  • computer devices can be controlled by having the patient look at the keyboard or symbolic images on the computer monitor. This technology is very useful for people with special requirements such as people with disabilities or paralysis who cannot use the mouse to control the computer or use their own voice. These patients will be able to use computer as a communication instrument and access information available on the internet.
  • the communicative system by monitoring patients' eye blinking is composed of easy-to- understand symbolic images such as images of a person with a headache or stomachache and statements set up to suit a patient in certain situations with certain symptoms.
  • the symbolic images and statements are categorized into groups and divided into more than one main set of data containing at least the first set of sub-data, the second set of sub-data, the third set of sub- data and the fourth set of sub-data.
  • the data identification system will point to each of the rotating data units automatically and the patient can select the data by blinking twice.
  • An additional objective is to obtain an engine combustion system oxygen efficiency enhancing device with raised electrical voltage and improved installation method for easy installation and prevention of sparks from the electric wire or conductive metal from touching the wall of the air duct due to the air pressure inside the air duct.
  • Figure 1 shows images of parts of devices and operating process of the communicative system by monitoring patients' eye blinking as follows:
  • the computer (22) contains a processing unit that is connected to the eye monitoring device (21 ) serving to receive data on eye blinking from the eye monitoring device (21) and interpreting output as a point with brightness exceeding the set standard when a blinking twice (40) occurs as a confirmation command, e.g. mouse clicking.
  • a computer monitor (20) that is connected to the computer's processing unit (23) serves to display more than one main set of data and the first set of sub-data, the second set of sub-data, the third set of sub-data and the fourth set of sub-data in order for the patient (10) to view data in the form of easy-to-understand images such as images of a person having a headache or stomachache, and statements are set to suit the patient's situation and symptoms (10).
  • the data will rotate from main data to sub-data automatically.
  • An eye monitoring device (21 ) composed of a video camera (14) connected to the computer's processing unit (23) serving to catch the eye's image (13) and send a command to the computer's processing unit (23) in order to set the value for the eye's areas (12) as a point of reference and an area with black color and display success for the point of reference setting with blinking light signals shown on the computer monitor (20), indicating that the system is ready for operation.
  • the eye monitoring device (21) sends a command to the computer's processing unit (23) in order to interpret the blinking twice (40) as a point with brightness higher than standard as a confirmation command, e.g. mouse clicking.
  • the patient (10) will be positioned in a head and eye level that are even with the eye monitoring device (21 ) serving to catch the eye's image (13). The value will then be set for the eye's areas (12) at point of reference and an area with black color.
  • the eye monitoring device (21) reads the blinking twice (40) as a point with brightness higher than standard.
  • the eye monitoring device (21) will send a command to the computer's processing unit (23) which is set to interpret a point with brightness exceeding the set standard as a confirmation command, e.g. mouse clicking.
  • the command program is set so data rotates from main data to sub-data automatically.
  • the data indication system points to a data set such as an image of a person with a headache, and the patient (10) wishes to select this data in order to communicate with the recipient of the communication (1 1), the patient (10) will blink twice.
  • Figure 2 shows the diagram for the function of more than one main set of data and the first set of sub-data, the second set of sub-data, the third set of sub-data and the fourth set of sub-data in symbolic images and statements (30) such as an image of a person with a headache or a statement saying "headache on the left side", etc.
  • the data unit is categorized into groups composed of at least the first set of main data (Al ), the second set of main data (A2), the third set of main data (A3), the fourth set of main data (A4) and the fifth set of main data (A5)
  • Each of the main data sets is composed of the first set of sub-data of the first set of main data (Bl), the first set of sub-data of the second set of main data (B2), the first set of sub-data of the third set of main data (B3), the first set of sub-data of the fourth set of main data (B4) and the first set of sub-data of the fifth set of main data (B5).
  • Each of the first set of sub-data is composed of the second set of sub-data of the first set of sub-data (CI), the second set of sub-data of the first set of sub-data (C2), the second set of sub-data of the first set of sub-data (C3), the second set of sub-data of the first set of sub-data (C4), the second set of sub-data of the first set of sub-data (C5).
  • Each of the second set of sub-data is composed of the third set of sub-data of the second set of sub-data (Dl ), the third set of sub-data of the second set of sub-data (D2), the third set of sub-data of the second set of sub-data (D3), the third set of sub-data of the second set of sub-data (D4) and the third set of sub-data of the second set of sub-data (D5).
  • Each of the third sub-data is composed of the fourth set of sub-data of the third set of sub-data (El ), the fourth set of sub-data of the third set of sub-data (E2), the fourth set of sub- data of the third set of sub-data (E3), the fourth set of sub-data of the third set of sub-data (E4) and the fourth set of sub-data of the third set of sub-data (E5).
  • the data identification system will identify the data of each rotating data unit, automatically rotating in the direction of the pointing arrow, and the patient (10) will select the first set of main data (Al ), the second set of main data (A2), the third set of main data (A3), the fourth set of main data (A4) and the fifth set of main data (A5) as the first order by blinking twice (40).
  • the patient (10) will select the first set of sub-data of the first set of main data (Bl), the first set of sub-data of the second set of main data (B2), the first set of sub-data of the third set of main data (B3), the first set of sub-data of the fourth set of main data (B4) and the first set of sub-data of the fifth set of main data (B5).
  • the patient (10) will select the first set of sub-data of the first set of main data (B l ), the first set of sub-data of the second set of main data (B2), the first set of sub-data of the third set of main data (B3), the first set of sub-data of the fourth set of main data (B4) and the first set of sub-data of the fifth set of main data (B5) as the second order by blinking twice (40) in order to access the second set of sub-data of the first set of sub-data (C 1 ), the second set of sub-data of the first set of sub-data (C2), the second set of sub-data of the first set of sub-data (C3), the second set of sub-data of the first set of sub-data (C4), the second set of sub-data of the first set of sub-data (C5).
  • the patient (10) will select the second set of sub-data of the first set of sub-data (C 1 ), the second set of sub-data of the first set of sub-data (C2), the second set of sub-data of the first set of sub-data (C3), the second set of sub-data of the first set of sub-data (C4), the second set of sub-data of the first set of sub-data (C5) as the third order by blinking twice (40) in order to access the third set of sub-data of the second set of sub-data (Dl), the third set of sub-data of the second set of sub-data (D2), the third set of sub-data of the second set of sub-data (D3), the third set of sub-data of the second set of sub-data (D4) and the third set of sub-data of the second set of sub-data (D5).
  • the patient (10) will select the third set of sub-data of the second set of sub-data (Dl ), the third set of sub-data of the second set of sub-data (D2), the third set of sub-data of the second set of sub-data (D3), the third set of sub-data of the second set of sub-data (D4) and the third set of sub-data of the second set of sub-data (D5) as the fourth order by blinking twice (40) in order to access the fourth set of sub-data of the third set of sub-data (El), the fourth set of sub-data of the third set of sub-data (E2). the fourth set of sub-data of the third set of sub-data (E3), the fourth set of sub-data of the third set of sub-data (E4) and the fourth set of sub-data of the third set of sub-data (E5).
  • Each set of the data contains data on a return command for the patient to select the return from the fourth set of sub-data of the third set of sub-data (E 1 ), the fourth set of sub-data of the third set of sub-data (E2), the fourth set of sub-data of the third set of sub-data (E3).
  • the fourth set of sub-data of the third set of sub-data (E4) and the fourth set of sub-data of the third set of sub-data (E5) back to the first set of main data (Al), the second set of main data (A2), the third set of main data (A3), the fourth set of main data (A4) and the fifth set of main data (A5).
  • Figures 3 and 4 show diagram displaying parts of device and operating process of the communicative system by monitoring patients' eye blinking in line with this invention. The operation begins as follows:
  • the data identification system will point to the first set of main data (Al ), the second set of main data (A2), the third set of main data (A3), the fourth set of main data (A4) and the fifth set of main data (A5), one by one and in an automatic rotation.
  • the patient (10) will choose the data when the data identification system is in the position of the desired data, and the data is selected by blinking twice (40). For example, when the data identification system is in the position of the first main set of data (Al), which is the part of data where the patient (10) wants to communicate with the recipient of the communication (1 1), the patient will select the first main set of data (Al ) by blinking twice (40).
  • the eye monitoring device (21 ) will read the movement at this point of reference as the point with brightness exceeding standards and it will send a command to the processing unit (23), which is set to interpret the input of a point with brightness exceeding standard as a confirmation command, e.g. mouse clicking.
  • the system will proceed to the first set of sub-data of the first main set of data (Bl) and the pattern continues until the second set of sub-data of the first set of sub-data (CI), and the pattern continues until the third set of sub-data of the second set of sub-data (Dl ), and the pattern continues until the fourth set of sub-data of the third set of sub-data (El ), etc.
  • the explanation will raise the example of accessing the first main set of data (Al), the first set of sub-data of the first main set of data (Bl), the second set of sub-data of the first set of sub-data (C I), the third set of sub-data of the second set of sub-data (Dl) and the fourth set of sub-data of the third set of sub-data (El) are only used as references.
  • the patient (10) can choose to access data as desired by blinking twice (40).
  • Each set of data contains a data on return command for the patient (10) to choose to return from the fourth set of sub-data (E) to the main set of data (A).
  • Figurel shows images of parts of devices and operating processes of the communicative system by monitoring patients' eye blinking in this invention.
  • FIG. 2 shows the diagram of the data units in symbolic images and statements (30) in this invention.
  • Figure 3 shows the system diagram displaying parts of devices and operation process of the communicative system by monitoring patients' eye blinking in this invention.
  • Figure 4 shows system diagram displaying parts of devices and operation process of the communicative system by monitoring patients' eye blinking in this invention.

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • General Engineering & Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Physics & Mathematics (AREA)
  • Human Computer Interaction (AREA)
  • Business, Economics & Management (AREA)
  • Educational Technology (AREA)
  • Educational Administration (AREA)
  • Health & Medical Sciences (AREA)
  • General Health & Medical Sciences (AREA)
  • Audiology, Speech & Language Pathology (AREA)
  • Measuring And Recording Apparatus For Diagnosis (AREA)

Abstract

The communicative system by monitoring patients' eye blinking is composed of a computer (22) with a processing unit (23) serving to interpret the blinking twice (40) as a dot with brightness higher than standard as a confirmation command, a computer monitor (20) which is connected to the processing unit (23) serving to display data, an eye monitoring device (21) composed of a video camera (14) which is connected to the processing unit (23) serving to catch the eye's image (13) in order to set value of the eye's area (12) as a point of reference. The system's special features are composed of a certain number of symbolic images and statements (30). The system will identify data on a number of images and statements (30) in an automatic rotation manner, and the patient (10) will select a unit of data by blinking twice (40) as a confirmation command for data selection.

Description

A COMMUNICATIVE SYSTEM BY MONITORING PATIENTS' EYE BLINKING Branch of Science Associated with the Invention
This invention involves a communicative system by monitoring patients' eye blinking.
Background of Relevant Arts or Science
A patient who has been in a severe accident, or has an illness so severe that the patient cannot communicate verbally as usual, or an elderly patient whose cognitive function is inhibited, or a patient with a deficient nervous system, or a patient who has brain impairment will have problems communicating with doctors. If information from a patient is important for a case, it will be beneficial for police officers if the patient can communicate with the police officers because actions can be taken by the police station in a timely manner.
In the past, communicating with a patient and eliciting patient responses required the use of stimulants such as pointing, nodding or managing with a computer mouse or joystick. However, problems persisted with understanding about how to use these devices. Furthermore, the use of body language was not very successful in accurately conveying a meaning. There is also the problem with the patient's disinterest and failure to pay attention to the instructions.
With reference to United States Patent 7391887, there have been attempts to find methods for detecting a patient's eye movement involving the use of a video camera for input data, the receipt of video data by detecting the eye's image, the detection of a patient's eyes, the location of a point of reference in the patient's eyes through brightness from the patient's eyes as the source of light, the location of point with brightness exceeding standard for the selecting of the accurate point of reference by comparing certain parts of the image that is with brightness difference from the set standard. The video camera detects the eye's image and records eye movement and light sources with brightness exceeding the set standards when blinking. The patient can look at a point he/she selects and blink. The eye monitoring system with a set value for eye movement and light source with brightness exceeding the standards with blinking will send a command for the processing unit to control instead of button pressing with fingers. Furthermore, computer devices can be controlled by having the patient look at the keyboard or symbolic images on the computer monitor. This technology is very useful for people with special requirements such as people with disabilities or paralysis who cannot use the mouse to control the computer or use their own voice. These patients will be able to use computer as a communication instrument and access information available on the internet.
In terms of usage, the distance between the patient's head and the video camera must be constant within a set distance, which makes prolonged use impossible. Thus, communicating through symbolic language in people with limited ability must be efficient in order for them to understand basic language linked with the meaning of the operating memory. Moreover, these people's previous inventions were all fraught with these limitations. Methods of accessing data were as complicated as the systems for computer programs in general. Having to look at the keyboard on a computer monitor in order to type becomes boring for patients. Furthermore, and patients' disinterest in following instructions could cause the communication to fail. Moreover, previous inventions used only single blinking that required longer time than natural blinking to avoid unintended commands. In this invention, the blinking is set for double-blinking in order to avoid unintended commands from a single blinking.
Invention Characteristics and Objectives
The communicative system by monitoring patients' eye blinking is composed of easy-to- understand symbolic images such as images of a person with a headache or stomachache and statements set up to suit a patient in certain situations with certain symptoms. The symbolic images and statements are categorized into groups and divided into more than one main set of data containing at least the first set of sub-data, the second set of sub-data, the third set of sub- data and the fourth set of sub-data. The data identification system will point to each of the rotating data units automatically and the patient can select the data by blinking twice. An additional objective is to obtain an engine combustion system oxygen efficiency enhancing device with raised electrical voltage and improved installation method for easy installation and prevention of sparks from the electric wire or conductive metal from touching the wall of the air duct due to the air pressure inside the air duct. Full Disclosure of the Invention
Figure 1 shows images of parts of devices and operating process of the communicative system by monitoring patients' eye blinking as follows:
- A computer (22) with a commanding program in symbolic images and statements (30) of more than one main set of data set and composed of at least the first set of sub-data, the second set of sub-data, the third set of sub-data and the fourth set of sub-data . The computer (22) contains a processing unit that is connected to the eye monitoring device (21 ) serving to receive data on eye blinking from the eye monitoring device (21) and interpreting output as a point with brightness exceeding the set standard when a blinking twice (40) occurs as a confirmation command, e.g. mouse clicking.
- A computer monitor (20) that is connected to the computer's processing unit (23) serves to display more than one main set of data and the first set of sub-data, the second set of sub-data, the third set of sub-data and the fourth set of sub-data in order for the patient (10) to view data in the form of easy-to-understand images such as images of a person having a headache or stomachache, and statements are set to suit the patient's situation and symptoms (10). The data will rotate from main data to sub-data automatically.
- An eye monitoring device (21 ) composed of a video camera (14) connected to the computer's processing unit (23) serving to catch the eye's image (13) and send a command to the computer's processing unit (23) in order to set the value for the eye's areas (12) as a point of reference and an area with black color and display success for the point of reference setting with blinking light signals shown on the computer monitor (20), indicating that the system is ready for operation. When a blinking twice (40) occurs, the eye monitoring device (21) sends a command to the computer's processing unit (23) in order to interpret the blinking twice (40) as a point with brightness higher than standard as a confirmation command, e.g. mouse clicking.
As it begins to work, the patient (10) will be positioned in a head and eye level that are even with the eye monitoring device (21 ) serving to catch the eye's image (13). The value will then be set for the eye's areas (12) at point of reference and an area with black color. When the patient (10) blinks twice (40), this point of reference moves and the eye monitoring device (21) reads the blinking twice (40) as a point with brightness higher than standard. The eye monitoring device (21) will send a command to the computer's processing unit (23) which is set to interpret a point with brightness exceeding the set standard as a confirmation command, e.g. mouse clicking. The command program is set so data rotates from main data to sub-data automatically. When the data indication system points to a data set such as an image of a person with a headache, and the patient (10) wishes to select this data in order to communicate with the recipient of the communication (1 1), the patient (10) will blink twice.
Figure 2 shows the diagram for the function of more than one main set of data and the first set of sub-data, the second set of sub-data, the third set of sub-data and the fourth set of sub-data in symbolic images and statements (30) such as an image of a person with a headache or a statement saying "headache on the left side", etc.
The data unit is categorized into groups composed of at least the first set of main data (Al ), the second set of main data (A2), the third set of main data (A3), the fourth set of main data (A4) and the fifth set of main data (A5)
Each of the main data sets is composed of the first set of sub-data of the first set of main data (Bl), the first set of sub-data of the second set of main data (B2), the first set of sub-data of the third set of main data (B3), the first set of sub-data of the fourth set of main data (B4) and the first set of sub-data of the fifth set of main data (B5).
Each of the first set of sub-data is composed of the second set of sub-data of the first set of sub-data (CI), the second set of sub-data of the first set of sub-data (C2), the second set of sub-data of the first set of sub-data (C3), the second set of sub-data of the first set of sub-data (C4), the second set of sub-data of the first set of sub-data (C5).
Each of the second set of sub-data is composed of the third set of sub-data of the second set of sub-data (Dl ), the third set of sub-data of the second set of sub-data (D2), the third set of sub-data of the second set of sub-data (D3), the third set of sub-data of the second set of sub- data (D4) and the third set of sub-data of the second set of sub-data (D5). Each of the third sub-data is composed of the fourth set of sub-data of the third set of sub-data (El ), the fourth set of sub-data of the third set of sub-data (E2), the fourth set of sub- data of the third set of sub-data (E3), the fourth set of sub-data of the third set of sub-data (E4) and the fourth set of sub-data of the third set of sub-data (E5).
The data identification system will identify the data of each rotating data unit, automatically rotating in the direction of the pointing arrow, and the patient (10) will select the first set of main data (Al ), the second set of main data (A2), the third set of main data (A3), the fourth set of main data (A4) and the fifth set of main data (A5) as the first order by blinking twice (40). In order to access, the patient (10) will select the first set of sub-data of the first set of main data (Bl), the first set of sub-data of the second set of main data (B2), the first set of sub-data of the third set of main data (B3), the first set of sub-data of the fourth set of main data (B4) and the first set of sub-data of the fifth set of main data (B5).
Next, the patient (10) will select the first set of sub-data of the first set of main data (B l ), the first set of sub-data of the second set of main data (B2), the first set of sub-data of the third set of main data (B3), the first set of sub-data of the fourth set of main data (B4) and the first set of sub-data of the fifth set of main data (B5) as the second order by blinking twice (40) in order to access the second set of sub-data of the first set of sub-data (C 1 ), the second set of sub-data of the first set of sub-data (C2), the second set of sub-data of the first set of sub-data (C3), the second set of sub-data of the first set of sub-data (C4), the second set of sub-data of the first set of sub-data (C5).
Then the patient (10) will select the second set of sub-data of the first set of sub-data (C 1 ), the second set of sub-data of the first set of sub-data (C2), the second set of sub-data of the first set of sub-data (C3), the second set of sub-data of the first set of sub-data (C4), the second set of sub-data of the first set of sub-data (C5) as the third order by blinking twice (40) in order to access the third set of sub-data of the second set of sub-data (Dl), the third set of sub-data of the second set of sub-data (D2), the third set of sub-data of the second set of sub-data (D3), the third set of sub-data of the second set of sub-data (D4) and the third set of sub-data of the second set of sub-data (D5). Then the patient (10) will select the third set of sub-data of the second set of sub-data (Dl ), the third set of sub-data of the second set of sub-data (D2), the third set of sub-data of the second set of sub-data (D3), the third set of sub-data of the second set of sub-data (D4) and the third set of sub-data of the second set of sub-data (D5) as the fourth order by blinking twice (40) in order to access the fourth set of sub-data of the third set of sub-data (El), the fourth set of sub-data of the third set of sub-data (E2). the fourth set of sub-data of the third set of sub-data (E3), the fourth set of sub-data of the third set of sub-data (E4) and the fourth set of sub-data of the third set of sub-data (E5).
Each set of the data contains data on a return command for the patient to select the return from the fourth set of sub-data of the third set of sub-data (E 1 ), the fourth set of sub-data of the third set of sub-data (E2), the fourth set of sub-data of the third set of sub-data (E3). the fourth set of sub-data of the third set of sub-data (E4) and the fourth set of sub-data of the third set of sub-data (E5) back to the first set of main data (Al), the second set of main data (A2), the third set of main data (A3), the fourth set of main data (A4) and the fifth set of main data (A5).
Figures 3 and 4 show diagram displaying parts of device and operating process of the communicative system by monitoring patients' eye blinking in line with this invention. The operation begins as follows:
- Connecting the computer (22) to the monitor (20) and the eye monitoring device (21 ), arranging so the eye monitoring device (21 ) catches the eye's image (13). When the eye monitoring device (21) catches the eye's image (13), a command is sent to the processing unit (23). The processing unit (23) will set this reference point as black area image. The success of the setting of reference point is shown by blinking light signal appearing on the computer monitor (20). Then the processing unit (23) will advance to the communication with symbolic images and statements (30) composed of the first set of main data (Al), the second set of main data (A2), the third set of main data (A3), the fourth set of main data (A4) and the fifth set of main data (A5). The data identification system will point to the first set of main data (Al ), the second set of main data (A2), the third set of main data (A3), the fourth set of main data (A4) and the fifth set of main data (A5), one by one and in an automatic rotation. The patient (10) will choose the data when the data identification system is in the position of the desired data, and the data is selected by blinking twice (40). For example, when the data identification system is in the position of the first main set of data (Al), which is the part of data where the patient (10) wants to communicate with the recipient of the communication (1 1), the patient will select the first main set of data (Al ) by blinking twice (40). The eye monitoring device (21 ) will read the movement at this point of reference as the point with brightness exceeding standards and it will send a command to the processing unit (23), which is set to interpret the input of a point with brightness exceeding standard as a confirmation command, e.g. mouse clicking. Next, the system will proceed to the first set of sub-data of the first main set of data (Bl) and the pattern continues until the second set of sub-data of the first set of sub-data (CI), and the pattern continues until the third set of sub-data of the second set of sub-data (Dl ), and the pattern continues until the fourth set of sub-data of the third set of sub-data (El ), etc. The explanation will raise the example of accessing the first main set of data (Al), the first set of sub-data of the first main set of data (Bl), the second set of sub-data of the first set of sub-data (C I), the third set of sub-data of the second set of sub-data (Dl) and the fourth set of sub-data of the third set of sub-data (El) are only used as references. The patient (10) can choose to access data as desired by blinking twice (40). Each set of data contains a data on return command for the patient (10) to choose to return from the fourth set of sub-data (E) to the main set of data (A).
Brief Description of Drawings
Figurel shows images of parts of devices and operating processes of the communicative system by monitoring patients' eye blinking in this invention.
Figure 2 shows the diagram of the data units in symbolic images and statements (30) in this invention.
Figure 3 shows the system diagram displaying parts of devices and operation process of the communicative system by monitoring patients' eye blinking in this invention.
Figure 4 shows system diagram displaying parts of devices and operation process of the communicative system by monitoring patients' eye blinking in this invention. Best Invention Method
As stated in the section "Full Disclosure of the Invention".

Claims

Claims
1. The communicative system by monitoring patients' eye blinking is composed of the following:
- A computer (22) with a commanding program containing symbolic images and statements (30) on more than one main set of data and composed of at least the first set of sub- data, the second set of sub-data, the third set of sub-data and the fourth set of sub-data . The computer (22) contains a processing unit that is connected to the eye monitoring device (21) serving to receive data on eye blinking from the eye monitoring device (21 ).
- A computer monitor (20) connected to the computer's processing unit (23) serving to display more than one main set of data and the first set of sub-data, the second set of sub-data, the third set of sub-data and the fourth set of sub-data.
- An eye monitoring device (21) composed of a video camera (14) connected to the computer's processing unit (23) serving to catch the eye's image (13) in order to set the eye's areas (12) as a point of reference in order to catch the blinking twice (40) to send the command to the computer's processing unit (23) in order to interpret the blinking twice (40) as a point with brightness higher than standard as a confirmation command.
Special Features
- Symbolic images and statements (30) categorized into groups composed of at least the following:
- The first set of main data (Al ), the second set of main data (A2), the third set of main data (A3), the fourth set of main data (A4) and the fifth set of main data (A5).
- The first set of sub-data of the first set of main data (Bl), the first set of sub-data of the second set of main data (B2), the first set of sub-data of the third set of main data (B3), the first set of sub-data of the fourth set of main data (B4) and the first set of sub-data of the fifth set of main data (B5). - The second set of sub-data of the first set of sub-data (CI ), the second set of sub-data of the first set of sub-data (C2), the second set of sub-data of the first set of sub-data (C3), the second set of sub-data of the first set of sub-data (C4) and the second sub data of the first set of sub-data (C5).
- The third set of sub-data of the second set of sub-data (Dl), the third set of sub-data of the second set of sub-data (D2), the third set of sub-data of the second set of sub-data (D3), the third set of sub-data of the second set of sub-data (D4) and the third set of sub-data of the second set of sub-data (D5).
- The fourth set of sub-data of the third set of sub-data (El ), the fourth set of sub-data of the third set of sub-data (E2), the fourth set of sub-data of the third set of sub-data (E3), the fourth set of sub-data of the third set of sub-data (E4) and the fourth set of sub-data of the third set of sub-data (E5).
2. The communicative system by monitoring patients' eye blinking according to the Right Claiming Clause 1 where the data identification system identifies data in an automatic rotation manner from the first set of main data (Al ), the second set of main data (A2), the third set of main data (A3), the fourth set of main data (A4) and the fifth set of main data (A5) as the first in order.
The first set of sub-data of the first set of main data (Bl ), the first set of sub-data of the second set of main data (B2), the first set of sub-data of the third set of main data (B3), the first set of sub-data of the fourth set of main data (B4) and the first set of sub-data of the fifth set of main data (B5) as the second in order.
The second set of sub-data of the first set of sub-data (CI), the second set of sub-data of the first set of sub-data (C2), the second set of sub-data of the first set of sub-data (C3), the second set of sub-data of the first set of sub-data (C4) and the second sub data of the first set of sub-data (C5) as the third in order.
The third set of sub-data of the second set of sub-data (Dl ), the third set of sub-data of the second set of sub-data (D2), the third set of sub-data of the second set of sub-data (D3), the third set of sub-data of the second set of sub-data (D4) and the third set of sub-data of the second set of sub-data (D5) as the fourth in order.
The fourth set of sub-data of the third set of sub-data (El ), the fourth set of sub-data of the third set of sub-data (E2), the fourth set of sub-data of the third set of sub-data (E3), the fourth set of sub-data of the third set of sub-data (E4) and the fourth set of sub-data of the third set of sub-data (E5) as the fi fth in order.
3. The communicative system by monitoring patients' eye blinking according to any of Claims 1-2 where a blinking twice (40) is set as a point with brightness higher than standard as a confirmation command.
4. The communicative system by monitoring patients' eye blinking according to any of Claims 1-2 where each of the data set contains data on the return command from the fourth set of sub-data of the third set of sub-data (El ), the fourth set of sub-data of the third set of sub- data (E2), the fourth set of sub-data of the third set of sub-data (E3), the fourth set of sub-data of the third set of sub-data (E4) and the fourth set of sub-data of the third set of sub-data (E5) back to the first set of main data (Al ), the second set of main data (A2), the third set of main data (A3), the fourth set of main data (A4) and the fifth set of main data (A5).
PCT/TH2015/000012 2015-02-27 2015-02-27 A communicative system by monitoring patients' eye blinking WO2016137405A1 (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
PCT/TH2015/000012 WO2016137405A1 (en) 2015-02-27 2015-02-27 A communicative system by monitoring patients' eye blinking

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
PCT/TH2015/000012 WO2016137405A1 (en) 2015-02-27 2015-02-27 A communicative system by monitoring patients' eye blinking

Publications (1)

Publication Number Publication Date
WO2016137405A1 true WO2016137405A1 (en) 2016-09-01

Family

ID=56789011

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/TH2015/000012 WO2016137405A1 (en) 2015-02-27 2015-02-27 A communicative system by monitoring patients' eye blinking

Country Status (1)

Country Link
WO (1) WO2016137405A1 (en)

Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
GB2281838A (en) * 1993-08-04 1995-03-15 Pioneer Electronic Corp Input for a virtual reality system
US20030040680A1 (en) * 2001-08-23 2003-02-27 Clear View Scientific, Llc Eye blinking bio-feedback apparatus and method
JP2006285715A (en) * 2005-04-01 2006-10-19 Konica Minolta Holdings Inc Sight line detection system
CN102377867A (en) * 2010-08-18 2012-03-14 希姆通信息技术（上海）有限公司 Realization method for displaying icon by cycling rotation
CN103324290A (en) * 2013-07-04 2013-09-25 深圳市中兴移动通信有限公司 Terminal equipment and eye control method thereof
CN103703438A (en) * 2011-04-08 2014-04-02 亚马逊技术公司 Gaze-based content display
US20140092015A1 (en) * 2012-09-29 2014-04-03 Zhaohui Xing Method and apparatus for manipulating a graphical user interface using camera

Patent Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
GB2281838A (en) * 1993-08-04 1995-03-15 Pioneer Electronic Corp Input for a virtual reality system
US20030040680A1 (en) * 2001-08-23 2003-02-27 Clear View Scientific, Llc Eye blinking bio-feedback apparatus and method
JP2006285715A (en) * 2005-04-01 2006-10-19 Konica Minolta Holdings Inc Sight line detection system
CN102377867A (en) * 2010-08-18 2012-03-14 希姆通信息技术（上海）有限公司 Realization method for displaying icon by cycling rotation
CN103703438A (en) * 2011-04-08 2014-04-02 亚马逊技术公司 Gaze-based content display
US20140092015A1 (en) * 2012-09-29 2014-04-03 Zhaohui Xing Method and apparatus for manipulating a graphical user interface using camera
CN103324290A (en) * 2013-07-04 2013-09-25 深圳市中兴移动通信有限公司 Terminal equipment and eye control method thereof

Similar Documents

Publication Publication Date Title
CN109313576B (en) Cross-device task execution
EP2631739B1 (en) Contactless gesture-based control method and apparatus
CN101441513B (en) System for performing non-contact type human-machine interaction by vision
DE102015212421B4 (en) Control method and electronic device
US20100179390A1 (en) Collaborative tabletop for centralized monitoring system
US20150212676A1 (en) Multi-Touch Gesture Sensing and Speech Activated Radiological Device and methods of use
Rozado et al. Low cost remote gaze gesture recognition in real time
US20220253146A1 (en) Combine Inputs from Different Devices to Control a Computing Device
CN104035554A (en) Method To Operate Device In Sterile Environment
KR20140107135A (en) Data processing apparatus which detects gesture operation
Mohd Noor et al. Detecting swipe errors on touchscreens using grip modulation
CN106843503B (en) A kind of display device and its control method
Niu et al. Improving accuracy of gaze‐control tools: Design recommendations for optimum position, sizes, and spacing of interactive objects
WO2022160765A1 (en) Household appliance control method, household appliance control system, and wearable device
WO2021092012A1 (en) Methods and systems for comprehensive symptom analysis
WO2016137405A1 (en) A communicative system by monitoring patients' eye blinking
Prabhakar et al. A wearable virtual touch system for IVIS in cars
KR20150024179A (en) Mobile device for providing information by automatically recognizing intention and operating method thereof
EP2811369A1 (en) Method of moving a cursor on a screen to a clickable object and a computer system and a computer program thereof
Zeng et al. GaVe: A webcam-based gaze vending interface using one-point calibration
CN110597382A (en) Nuclear power station control room multi-channel fusion man-machine interaction method and system
CN114333056A (en) Gesture control method, system, equipment and storage medium
US20230187064A1 (en) Methods and systems for comprehensive patient screening
Shewell et al. Indoor localisation through object detection within multiple environments utilising a single wearable camera
Lin et al. Study on directional eye movements in non‐frontal face images for eye‐controlled interaction

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 15883524

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 15883524

Country of ref document: EP

Kind code of ref document: A1