EP3519922A2 - Electronic and motorized wheelchair system that can be controlled with eye movements - Google Patents

Electronic and motorized wheelchair system that can be controlled with eye movements

Info

Publication number
EP3519922A2
EP3519922A2 EP17854223.9A EP17854223A EP3519922A2 EP 3519922 A2 EP3519922 A2 EP 3519922A2 EP 17854223 A EP17854223 A EP 17854223A EP 3519922 A2 EP3519922 A2 EP 3519922A2
Authority
EP
European Patent Office
Prior art keywords
electronic
motorized wheelchair
user
computer based
based system
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Withdrawn
Application number
EP17854223.9A
Other languages
German (de)
French (fr)
Inventor
Ersin KARA
Mehmet DONMEZ
Kursat Cagiltay
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Individual
Original Assignee
Individual
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Individual filed Critical Individual
Publication of EP3519922A2 publication Critical patent/EP3519922A2/en
Withdrawn legal-status Critical Current

Links

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/011—Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
    • G06F3/013—Eye tracking input arrangements

Definitions

  • the invention subject to the application is related to a system , in which commands using only eye movements, can be sent to the electronic and motorized wheelchair by means of an application located on the system screen in order to move the electronic and motorized wheelchair that is a part of a computer based system.
  • Wheelchairs are devices which enable people with temporary or permanent walking disabilities to move. I n present systems, mechanical wheelchairs that are moved by hand/arm power of the user and motorized wheelchairs having an electronic system moving with an engine are available.
  • the invention subject to the application is related to wheelchairs that move by means of engine power having an electronic system which is the second type. The movement of such wheelchairs can be performed manually using a controller, a computer with wireless connection, a tablet computer, or devices such as mobile phones.
  • the subject of the invention is related to the movement of an electronic and motorized wheelchair that is a part of a computer based system and said wheelchair is operated together with an eye movement tracking device.
  • the invention is based on moving an electronic and motorized wheelchair located in a real environment without the need for any kind of physical contact, by means of processing data related to eye movements that have been obtained when the user looks at the application on the screen of the computer based system.
  • the aim of the invention is to move an electronic wheelchair that is connected to a computer based system using only eye movements without the need to use any kind of devices such as a control lever, computer with wireless connection, tablet computer, and mobile phones that are usually necessary to use the motorized wheelchair.
  • Another aim of the invention is to enable disabled people who cannot use computer systems (mouse, keyboard and touch screen etc.) through physical contact as they cannot use their hands or arms and as a result who cannot operate an electronic and motorized wheelchair, to be able to move their wheelchairs by eye movements only.
  • Figure 1 The schematic view of the components of the electronic and motorized wheelchair movement system controlled by eye movements
  • Figure 2- A screen image from the application on the computer based system screen
  • I con enabling the electronic and motorized wheelchair to turn left at a 180 degree angle 16. Icon enabling the electronic and motorized wheelchair to turn right at a 180 degree angle
  • the subject of the application is a system that enables the usage of a wheelchair by means of only eye movements without the need for any kind of computer input devices such as keyboard, mouse and touchpad that necessitate physical contact in order to move the wheelchair with engine power having an electronic system located in a physical environment, wherein Figure 1 shows the components (parts) of the system of the invention.
  • a computer based system ( 1 ) having a screen which enables to operate the system and which comprises the computer based system screen application (4) therein, • eye movement tracking device (2) which tracks the eye movements of a user as soon as he/she looks at the screen of the computer based system which has been positioned by means of an eye movement tracking device fixing apparatus (3) ,
  • eye movement tracking device fixing apparatus (3) which can be adjusted according to the sitting position of the user in the electronic and motorized wheelchair (7) and which is used to position the eye movement tracking device (2) ,
  • a computer based system screen application (4) which enables the communication between the eye movement tracking device (2) and the electronic and motorized wheelchair (7) , which can display the user interactions simultaneously on the screen of the computer based system (1 ) screen, which can send audio and/or visual warning signals if necessary, and which can display the image received from the front and rear-view cameras (8) ,
  • lever (5) which holds the telescopic computer based system screen, whose height, angle and distance can be adjusted according to the user, and which is used to adjust the screen of the computer based system (1 ) to the eye level of the user,
  • chin and forehead resting apparatus (6) which is attached to the electronic and motorized wheelchair (7) , which is used to if necessary to stabilize the head of the user, where the user can rest his/her head-chin, which enables to maintain the distance between the eye movement tracking device (2) and the eyes of the user, which can be adjusted in height, angle and distance,
  • front and rear-view cameras (8) which receive the images from the front and the rear of the electronic and motorized wheelchair (7) and which submits said images to the computer based system screen application (4) .
  • the system subject to the application that enables to move the electronic and motorized wheelchair (7) with only eye movements, is used together with an eye movement tracking device (2) .
  • the application is based on forming a system through which procedures/interactions can be carried out by means of the computer based system screen application (4) using only the eye movements of a user and on these system outputs to be processed by the electronic and motorized wheelchair (7) .
  • the eye movement tracking device (2) can track the movement of eyes when the user looks at the screen of the computer based system screen application (4) .
  • the system regularly receives the data related to the eye movements obtained from the eye movement tracking device (2) .
  • the data obtained from the eye movements of the user captured by the eye movement tracking device (2) is processed by the computer based system screen application (4) and as a result the action carried out by the user on the screen of the computer based system ( 1 ) is determined.
  • the computer based system screen application (4) submits this data to the electronic and motorized wheelchair (7) .
  • the electronic and motorized wheelchair (7) moves in accordance with the data received.
  • the invention subject to the application is a system which enables to move an electronic and motorized wheelchair by means of eye movements, wherein Figure 2 shows a screen shot of the computer based system screen application (4) . According to Figure 2;
  • the user focuses for a predetermined period of time to the icon (9) which enables to turn the electronic and motorized wheelchair to the right, which is displayed on the computer based system screen application (4) in order to turn the electronic and motorized wheelchair (7) to the left and then the wheelchair (7) starts to move.
  • the electronic and motorized wheelchair (7) starts to turn at a predetermined speed and when the user stops focusing, the movement is stopped.
  • the user focuses on the icon (10) enabling the electronic and motorized wheelchair to turn right, which is displayed on the computer based system screen application (4) in order to turn the electronic and motorized wheelchair (7) to the right and then the wheelchair (7) starts to move.
  • the electronic and motorized wheelchair (7) starts to turn at a predetermined speed and when the user stops focusing, the movement is stopped.
  • the user focuses on the icon (1 1 ) enabling the electronic and motorized wheelchair to go straight forward, which is displayed on the computer based system screen application (4) in order to move the electronic and motorized wheelchair (7) forward and then the wheelchair (7) starts to move.
  • the electronic and motorized wheelchair (7) starts to move forward at a predetermined speed and when the user stops focusing, the movement is stopped.
  • the user focuses on the icon (12) enabling the electronic and motorized wheelchair to be reversed, which is displayed on the computer based system screen application (4) in order to reverse the electronic and motorized wheelchair (7) and then the wheelchair (7) starts to move.
  • the electronic and motorized wheelchair (7) is reversed at a predetermined speed and when the user stops focusing, the movement is stopped.
  • the user focuses for a predetermined time on the icon (13) which enables the electronic and motorized wheelchair to make a left turn at a 90 degree angle, which is located on the computer based screen application (4) in order to turn the electronic and motorized wheelchair (7) to the left at a 90 degree angle and the electronic and motorized wheelchair (7) performs the turning motion.
  • the user focuses for a predetermined time on the icon (14) which enables the electronic and motorized wheelchair to make a right turn at a 90 degree angle, which is located on the computer based screen application (4) in order to turn the electronic and motorized wheelchair (7) to the right at a 90 degree angle and the electronic and motorized wheelchair (7) performs the turning motion.
  • the user focuses for a predetermined time on the icon (15) which enables the electronic and motorized wheelchair to make a left turn at a 180 degree angle, which is located on the computer based screen application (4) in order to turn the electronic and motorized wheelchair (7) to the left at a 180 degree angle and the electronic and motorized wheelchair (7) performs the turning motion.
  • the user focuses for a predetermined time on the icon (16) which enables the electronic and motorized wheelchair to make a right turn at a 1 80 degree angle, which is located on the computer based screen application (4) in order to turn the electronic and motorized wheelchair (7) to the right at a 180 degree angle and the electronic and motorized wheelchair (7) performs the turning motion.
  • the user can capture images by means of the front and rear cameras (8) connected to the computer based system ( 1 ) during the usage of the computer based system screen application (4) and the images obtained can be submitted to the camera image display ( 17) simultaneously by said cameras.
  • the image on the screen can be a front image and/or a rear image depending on the movement type.
  • the option to capture images at the same time from both cameras can be made active/ passive using the options button (19) .
  • the user uses the emergency button ( 18) in order to stop the movement of the electronic and motorized wheelchair (7) if there is any kind of problem .
  • the user uses the option button ( 19) in order to configure all settings of the system .
  • the user can receive audio and/or visual warnings in relation to errors or warnings that may be faced in relation to completed procedures.
  • the system enables to submit commands in relation to moving an electronic and motorized wheelchair by means of an application located on the screen of the system .
  • a computer based system with eye movement tracking technology integrated enables users to move the electronic and motorized wheelchair in a desirable direction after commands from the user are received. Therefore this system can be sold with similar methods used to sell present motorized wheelchairs.

Landscapes

  • Engineering & Computer Science (AREA)
  • General Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Human Computer Interaction (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • User Interface Of Digital Computer (AREA)
  • Selective Calling Equipment (AREA)

Abstract

The invention subject to the application is related to a system, in which commands using only eye movements, can be sent to the electronic and motorized wheelchair by means of an application located on the system screen in order to move the electronic and motorized wheelchair that is a part of a computer based system.

Description

ELECTRON I C AND MOTORI ZED WHEELCHAI R SYSTEM THAT CAN BE CONTROLLED
Wl TH EYE MOVEMENTS
Technical Field of the I nvention The invention subject to the application is related to a system , in which commands using only eye movements, can be sent to the electronic and motorized wheelchair by means of an application located on the system screen in order to move the electronic and motorized wheelchair that is a part of a computer based system.
Known State of the Art ( Prior Art)
Wheelchairs are devices which enable people with temporary or permanent walking disabilities to move. I n present systems, mechanical wheelchairs that are moved by hand/arm power of the user and motorized wheelchairs having an electronic system moving with an engine are available. The invention subject to the application is related to wheelchairs that move by means of engine power having an electronic system which is the second type. The movement of such wheelchairs can be performed manually using a controller, a computer with wireless connection, a tablet computer, or devices such as mobile phones.
I n the prior art, computer based motorized wheelchairs can be moved using input devices such as a keyboard or touchpad. It is possible to use a wheelchair that moves with engine power having an electronic system by using the direction keys on the keyboard depending on the codes written beforehand or by writing various codes using the keyboard. Similarly movements defined by means of the mouse or touchpad inputs, using previously written codes can also be carried out by means of such wheelchairs. However, it is not possible for users that do not have any physical contact with such hardware to be able to use or move such wheelchairs.
For example, people who cannot use their hands or arms or who are paralyzed from the neck down are not able to use these motorized wheelchairs as they cannot physically contact with these physical input devices. Brief Description of the I nvention and its Aims
The subject of the invention is related to the movement of an electronic and motorized wheelchair that is a part of a computer based system and said wheelchair is operated together with an eye movement tracking device. The invention is based on moving an electronic and motorized wheelchair located in a real environment without the need for any kind of physical contact, by means of processing data related to eye movements that have been obtained when the user looks at the application on the screen of the computer based system.
The aim of the invention is to move an electronic wheelchair that is connected to a computer based system using only eye movements without the need to use any kind of devices such as a control lever, computer with wireless connection, tablet computer, and mobile phones that are usually necessary to use the motorized wheelchair.
Another aim of the invention is to enable disabled people who cannot use computer systems (mouse, keyboard and touch screen etc.) through physical contact as they cannot use their hands or arms and as a result who cannot operate an electronic and motorized wheelchair, to be able to move their wheelchairs by eye movements only.
Definition of the Figures Describing the I nvention
The figures that have been prepared in order to further explain the electronic and motorized wheelchair system developed by the invention that is controlled by means of eye movements are described below.
Figure 1 - The schematic view of the components of the electronic and motorized wheelchair movement system controlled by eye movements
Figure 2- A screen image from the application on the computer based system screen
Definitions of the Parts of the I nvention
The parts of the invention shown in Figure 1 and Figure 2 have been each numbered in order to further describe the electronic and motorized wheelchair system that is controlled by eye movements, developed according to the invention, and the references of each numbering has been listed below:
1 . Computer based system having a screen 2. Eye movement tracking device
3. Eye movement tracking device fixing apparatus
4. Computer based system screen application
5. Lever holding the telescopic, computer based system screen 6. Chin-forehead resting apparatus (optional)
7. Electronic and motorized wheelchair
8. Front and rear-view cameras
9. I con enabling the electronic and motorized wheelchair to turn left
10. I con enabling the electronic and motorized wheelchair to turn right 1 1 . I con enabling the electronic and motorized wheelchair to move straight ahead (forward)
12. I con enabling the electronic and motorized wheelchair to reverse (move backwards)
13. I con enabling the electronic and motorized wheelchair to turn left at a 90 degree angle
14. I con enabling the electronic and motorized wheelchair to turn right at a 90 degree angle
15. I con enabling the electronic and motorized wheelchair to turn left at a 180 degree angle 16. Icon enabling the electronic and motorized wheelchair to turn right at a 180 degree angle
17. Camera display screen
18. Emergency button
19. Options button
Detailed Description of the I nvention
The subject of the application is a system that enables the usage of a wheelchair by means of only eye movements without the need for any kind of computer input devices such as keyboard, mouse and touchpad that necessitate physical contact in order to move the wheelchair with engine power having an electronic system located in a physical environment, wherein Figure 1 shows the components (parts) of the system of the invention.
.The system according to Figure 1 comprises;
• a computer based system ( 1 ) having a screen which enables to operate the system and which comprises the computer based system screen application (4) therein, • eye movement tracking device (2) which tracks the eye movements of a user as soon as he/she looks at the screen of the computer based system which has been positioned by means of an eye movement tracking device fixing apparatus (3) ,
• eye movement tracking device fixing apparatus (3) which can be adjusted according to the sitting position of the user in the electronic and motorized wheelchair (7) and which is used to position the eye movement tracking device (2) ,
• a computer based system screen application (4) which enables the communication between the eye movement tracking device (2) and the electronic and motorized wheelchair (7) , which can display the user interactions simultaneously on the screen of the computer based system (1 ) screen, which can send audio and/or visual warning signals if necessary, and which can display the image received from the front and rear-view cameras (8) ,
• lever (5) which holds the telescopic computer based system screen, whose height, angle and distance can be adjusted according to the user, and which is used to adjust the screen of the computer based system (1 ) to the eye level of the user,
• chin and forehead resting apparatus (6) which is attached to the electronic and motorized wheelchair (7) , which is used to if necessary to stabilize the head of the user, where the user can rest his/her head-chin, which enables to maintain the distance between the eye movement tracking device (2) and the eyes of the user, which can be adjusted in height, angle and distance,
• electronic and motorized wheelchair (7) onto which the user shall be seated, and which can be moved by means of parts aiding in motion and by means of the data received from the computer based system (1 ) having a screen,
• front and rear-view cameras (8) which receive the images from the front and the rear of the electronic and motorized wheelchair (7) and which submits said images to the computer based system screen application (4) .
The system subject to the application that enables to move the electronic and motorized wheelchair (7) with only eye movements, is used together with an eye movement tracking device (2) . The application is based on forming a system through which procedures/interactions can be carried out by means of the computer based system screen application (4) using only the eye movements of a user and on these system outputs to be processed by the electronic and motorized wheelchair (7) .
I n the system , the user needs to position himself/herself in front of the computer based system screen ( 1 ) . The eye movement tracking device (2) can track the movement of eyes when the user looks at the screen of the computer based system screen application (4) . The system regularly receives the data related to the eye movements obtained from the eye movement tracking device (2) . The data obtained from the eye movements of the user captured by the eye movement tracking device (2) is processed by the computer based system screen application (4) and as a result the action carried out by the user on the screen of the computer based system ( 1 ) is determined. Following this, the computer based system screen application (4) submits this data to the electronic and motorized wheelchair (7) . As a result, the electronic and motorized wheelchair (7) moves in accordance with the data received.
The invention subject to the application is a system which enables to move an electronic and motorized wheelchair by means of eye movements, wherein Figure 2 shows a screen shot of the computer based system screen application (4) . According to Figure 2;
• The user focuses for a predetermined period of time to the icon (9) which enables to turn the electronic and motorized wheelchair to the right, which is displayed on the computer based system screen application (4) in order to turn the electronic and motorized wheelchair (7) to the left and then the wheelchair (7) starts to move. The electronic and motorized wheelchair (7) starts to turn at a predetermined speed and when the user stops focusing, the movement is stopped.
• The user focuses on the icon (10) enabling the electronic and motorized wheelchair to turn right, which is displayed on the computer based system screen application (4) in order to turn the electronic and motorized wheelchair (7) to the right and then the wheelchair (7) starts to move. The electronic and motorized wheelchair (7) starts to turn at a predetermined speed and when the user stops focusing, the movement is stopped.
· The user focuses on the icon (1 1 ) enabling the electronic and motorized wheelchair to go straight forward, which is displayed on the computer based system screen application (4) in order to move the electronic and motorized wheelchair (7) forward and then the wheelchair (7) starts to move. The electronic and motorized wheelchair (7) starts to move forward at a predetermined speed and when the user stops focusing, the movement is stopped.
• The user focuses on the icon (12) enabling the electronic and motorized wheelchair to be reversed, which is displayed on the computer based system screen application (4) in order to reverse the electronic and motorized wheelchair (7) and then the wheelchair (7) starts to move. The electronic and motorized wheelchair (7) is reversed at a predetermined speed and when the user stops focusing, the movement is stopped.
The user focuses for a predetermined time on the icon (13) which enables the electronic and motorized wheelchair to make a left turn at a 90 degree angle, which is located on the computer based screen application (4) in order to turn the electronic and motorized wheelchair (7) to the left at a 90 degree angle and the electronic and motorized wheelchair (7) performs the turning motion.
The user focuses for a predetermined time on the icon (14) which enables the electronic and motorized wheelchair to make a right turn at a 90 degree angle, which is located on the computer based screen application (4) in order to turn the electronic and motorized wheelchair (7) to the right at a 90 degree angle and the electronic and motorized wheelchair (7) performs the turning motion.
The user focuses for a predetermined time on the icon (15) which enables the electronic and motorized wheelchair to make a left turn at a 180 degree angle, which is located on the computer based screen application (4) in order to turn the electronic and motorized wheelchair (7) to the left at a 180 degree angle and the electronic and motorized wheelchair (7) performs the turning motion.
The user focuses for a predetermined time on the icon (16) which enables the electronic and motorized wheelchair to make a right turn at a 1 80 degree angle, which is located on the computer based screen application (4) in order to turn the electronic and motorized wheelchair (7) to the right at a 180 degree angle and the electronic and motorized wheelchair (7) performs the turning motion.
The user can capture images by means of the front and rear cameras (8) connected to the computer based system ( 1 ) during the usage of the computer based system screen application (4) and the images obtained can be submitted to the camera image display ( 17) simultaneously by said cameras. The image on the screen can be a front image and/or a rear image depending on the movement type. The option to capture images at the same time from both cameras can be made active/ passive using the options button (19) .
The user uses the emergency button ( 18) in order to stop the movement of the electronic and motorized wheelchair (7) if there is any kind of problem .
The user uses the option button ( 19) in order to configure all settings of the system . The user can receive audio and/or visual warnings in relation to errors or warnings that may be faced in relation to completed procedures. The applicability of the invention to the I ndustry
The system enables to submit commands in relation to moving an electronic and motorized wheelchair by means of an application located on the screen of the system . A computer based system with eye movement tracking technology integrated enables users to move the electronic and motorized wheelchair in a desirable direction after commands from the user are received. Therefore this system can be sold with similar methods used to sell present motorized wheelchairs.

Claims

CLAI MS
The subject of the application is a system to move an electronic and motorized wheelchair using only eye movements without the need for any kind of physical contact, characterized in that it comprises;
• a computer based system ( 1 ) having a screen which enables to operate the system and which comprises the computer based system screen application (4) therein,
• eye movement tracking device (2) which tracks the eye movements of a user as soon as he/she looks at the screen of the computer based system (1 ) which has been positioned by means of an eye movement tracking device fixing apparatus (3) ,
• eye movement tracking device fixing apparatus (3) which can be adjusted according to the sitting position of the user in the electronic and motorized wheelchair (7) and which is used to position the eye movement tracking device (2) ,
• a computer based system screen application (4) which enables the communication between the eye movement tracking device (2) and the electronic and motorized wheelchair (7) , which can display the user interactions simultaneously on the screen of the computer based system (1 ) screen, which can send audio and/or visual warning signals if necessary, and which can display the image received from the front and rear-view cameras (8),
• lever (5) which holds the telescopic computer based system screen, whose height, angle and distance can be adjusted according to the user, and which is used to adjust the screen of the computer based system (1 ) to the eye level of the user,
• chin and forehead resting apparatus (6) which is attached to the electronic and motorized wheelchair (7), which is used to if necessary to stabilize the head of the user, where the user can rest his/her head-chin, which enables to maintain the distance between the eye movement tracking device (2) and the eyes of the user, which can be adjusted in height, angle and distance,
• electronic and motorized wheelchair (7) onto which the user shall be seated, and which can be moved by means of parts aiding in motion and by means of the data received from the computer based system (1 ) having a screen,
• front and rear-view cameras (8) which receive the images from the front and the rear of the electronic and motorized wheelchair (7) and which submits said images to the computer based system screen application (4).
A system to move an electronic and motorized wheelchair using only eye movements without the need for any kind of physical contact according to claim 1 , characterized in that it comprises a computer based system screen application (4) which; • enables to carry out procedures/interactions (clicking on icons, continuing to click on icons, activating etc) by means of eye movements,
• can process and simultaneously display the procedures/interactions performed by the eye movements of the user,
• enables to perform system setting such as changing the focus time required to perform the procedures and the movement speed of the electronic and motorized wheelchair (7) ,
• provides communication between the eye movement tracking device (2) and the electronic and motorized wheelchair (7) via the computer based system (1 ) having a screen,
• can provide audio and/or visual warning signals in relation to user interactions.
A system to move an electronic and motorized wheelchair using only eye movements without the need for any kind of physical contact according to claim 1 , characterized in that;
• The eye movement tracking device fixing apparatus (3) used to position the eye movement tracking device (2) such that it can be operated with the computer based system ( 1 ) having a screen can be adjusted according to the sitting position of the user,
• The height and the distance and angle of the lever (5) holding the telescopic computer based system screen that is used to adjust the screen of the computer based system (1 ) according to the eye level of the user is adjustable,
• The height and the distance of the chin-forehead resting apparatus (6) that is attached with an extension to the electronic and motorized wheelchair (7) can be adjusted according to the user.
The subject of the application is a system to move an electronic and motorized wheelchair using only eye movements without the need for any kind of physical contact, characterized in that;
• The user focuses for a predetermined period of time to the icon (9) which enables to turn the electronic and motorized wheelchair to the right, which is displayed on the computer based system screen application (4) in order to turn the electronic and motorized wheelchair (7) to the left and then the wheelchair (7) starts to move. The electronic and motorized wheelchair (7) starts to turn at a predetermined speed and when the user stops focusing, the movement is stopped.
• The user focuses on the icon (10) enabling the electronic and motorized wheelchair to turn right, which is displayed on the computer based system screen application (4) in order to turn the electronic and motorized wheelchair (7) to the right and then the wheelchair (7) starts to move. The electronic and motorized wheelchair (7) starts to turn at a predetermined speed and when the user stops focusing, the movement is stopped.
The user focuses on the icon (1 1 ) enabling the electronic and motorized wheelchair to go straight forward, which is displayed on the computer based system screen application (4) in order to move the electronic and motorized wheelchair (7) forward and then the wheelchair (7) starts to move. The electronic and motorized wheelchair (7) starts to move forward at a predetermined speed and when the user stops focusing, the movement is stopped.
The user focuses on the icon (12) enabling the electronic and motorized wheelchair to be reversed, which is displayed on the computer based system screen application (4) in order to reverse the electronic and motorized wheelchair (7) and then the wheelchair (7) starts to move. The electronic and motorized wheelchair (7) is reversed at a predetermined speed and when the user stops focusing, the movement is stopped.
The user focuses for a predetermined time on the icon (13) which enables the electronic and motorized wheelchair to make a left turn at a 90 degree angle, which is located on the computer based screen application (4) in order to turn the electronic and motorized wheelchair (7) to the left at a 90 degree angle and the electronic and motorized wheelchair (7) performs the turning motion at a predetermined speed. The user focuses for a predetermined time on the icon (14) which enables the electronic and motorized wheelchair to make a right turn at a 90 degree angle, which is located on the computer based screen application (4) in order to turn the electronic and motorized wheelchair (7) to the right at a 90 degree angle and the electronic and motorized wheelchair (7) performs the turning motion at a predetermined speed. The user focuses for a predetermined time on the icon (15) which enables the electronic and motorized wheelchair to make a left turn at a 180 degree angle, which is located on the computer based screen application (4) in order to turn the electronic and motorized wheelchair (7) to the left at a 180 degree angle and the electronic and motorized wheelchair (7) performs the turning motion at a predetermined speed. The user focuses for a predetermined time on the icon (16) which enables the electronic and motorized wheelchair to make a right turn at a 180 degree angle, which is located on the computer based screen application (4) in order to turn the electronic and motorized wheelchair (7) to the right at a 180 degree angle and the electronic and motorized wheelchair (7) performs the turning motion at a predetermined speed.
• The user can capture images by means of the front and rear cameras (8) connected to the computer based system ( 1 ) during the usage of the computer based system screen application (4) and the images obtained can be submitted to the camera image display ( 17) simultaneously by said cameras. The image on the screen can be a front image and/or a rear image depending on the movement type. The option to capture images at the same time from both cameras can be made active/passive using the options button (19) .
• The user uses the emergency button ( 18) in order to stop the movement of the electronic and motorized wheelchair (7) if there is any kind of problem.
• The user uses the option button ( 19) in order to configure all settings of the system.
• The user can receive audio and/or visual warnings in relation to errors or warnings that may be faced in relation to completed procedures.
EP17854223.9A 2016-09-28 2017-09-18 Electronic and motorized wheelchair system that can be controlled with eye movements Withdrawn EP3519922A2 (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
TR2016/13586A TR201613586A2 (en) 2016-09-28 2016-09-28 ELECTRONIC AND MOTORIZED WHEELCHAIR SYSTEM CONTROLLED BY EYE MOVEMENTS
PCT/TR2017/050433 WO2018063134A2 (en) 2016-09-28 2017-09-18 Electronic and motorized wheelchair system that can be controlled with eye movements

Publications (1)

Publication Number Publication Date
EP3519922A2 true EP3519922A2 (en) 2019-08-07

Family

ID=61760946

Family Applications (1)

Application Number Title Priority Date Filing Date
EP17854223.9A Withdrawn EP3519922A2 (en) 2016-09-28 2017-09-18 Electronic and motorized wheelchair system that can be controlled with eye movements

Country Status (3)

Country Link
EP (1) EP3519922A2 (en)
TR (1) TR201613586A2 (en)
WO (1) WO2018063134A2 (en)

Families Citing this family (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN112057251B (en) * 2020-09-21 2022-10-25 山西白求恩医院(山西医学科学院) Electric intelligent wheelchair controlled by eye-gaze and lip action signals and control method

Family Cites Families (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5360971A (en) * 1992-03-31 1994-11-01 The Research Foundation State University Of New York Apparatus and method for eye tracking interface
US6842670B2 (en) * 2003-05-02 2005-01-11 Chung Shan Institute Of Science And Technology Eye-tracking driving system
JP2007143859A (en) * 2005-11-28 2007-06-14 Rota Kk Mounting structure and mount adjusting method of video camera and sensor of autonomously moving wheelchair robot
SE533876C2 (en) * 2009-05-05 2011-02-15 Control and control system for a mobile disability aid
IL303037A (en) * 2015-03-10 2023-07-01 Eyefree Assisting Communication Ltd System and method for enabling communication through eye feedback

Also Published As

Publication number Publication date
WO2018063134A2 (en) 2018-04-05
TR201613586A2 (en) 2016-11-21
WO2018063134A3 (en) 2018-07-12

Similar Documents

Publication Publication Date Title
JP7153096B2 (en) System and method enabling communication by eye feedback
US10627900B2 (en) Eye-signal augmented control
Wanluk et al. Smart wheelchair based on eye tracking
Hansen et al. Head and gaze control of a telepresence robot with an hmd
Ilias et al. A nurse following robot with high speed kinect sensor
US20160249008A1 (en) Display apparatus, display method, and program
JP2010231290A (en) Input device and method using head motion
JP5548742B2 (en) Bi-directional eye motion communication system
TW201517616A (en) Method for controlling surveillance camera and system thereof
CN102197932B (en) System and method for adjusting cosmetic mirror as well as cosmetic mirror with same
JP2016502294A (en) Robot stand and system and method for controlling the stand during a video conference
US20180316911A1 (en) Information processing apparatus
Tall et al. Gaze-controlled driving
WO2012149713A1 (en) Method and apparatus for human-machine interaction
Lenz et al. NimbRo wins ANA Avatar XPRIZE immersive telepresence competition: human-centric evaluation and lessons learned
EP3519922A2 (en) Electronic and motorized wheelchair system that can be controlled with eye movements
CN105677040A (en) Terminal control method, device and wearable device
US9392223B2 (en) Method for controlling visual light source, terminal, and video conference system
Jiang et al. Autonomous performance of multistep activities with a wheelchair mounted robotic manipulator using body dependent positioning
Kalpana et al. An intelligent voice-recognition wheelchair system for disabled persons
TWI480764B (en) Device and method for controlling mouse cursor by head
TW201404136A (en) Method and device for prevention of defocus
Hussam et al. Intelligent control system of a wheelchair for people with quadriplegia paralysis
WO2015081705A1 (en) Air touch-control system
Yeo et al. OmniSense: Exploring Novel Input Sensing and Interaction Techniques on Mobile Device with an Omni-Directional Camera

Legal Events

Date Code Title Description
STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: UNKNOWN

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: THE INTERNATIONAL PUBLICATION HAS BEEN MADE

PUAI Public reference made under article 153(3) epc to a published international application that has entered the european phase

Free format text: ORIGINAL CODE: 0009012

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: REQUEST FOR EXAMINATION WAS MADE

17P Request for examination filed

Effective date: 20190320

AK Designated contracting states

Kind code of ref document: A2

Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR

AX Request for extension of the european patent

Extension state: BA ME

DAV Request for validation of the european patent (deleted)
DAX Request for extension of the european patent (deleted)
STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: EXAMINATION IS IN PROGRESS

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: EXAMINATION IS IN PROGRESS

17Q First examination report despatched

Effective date: 20201120

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: EXAMINATION IS IN PROGRESS

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: THE APPLICATION IS DEEMED TO BE WITHDRAWN

18D Application deemed to be withdrawn

Effective date: 20230401