WO2018063134A2 - Electronic and motorized wheelchair system that can be controlled with eye movements - Google Patents

Electronic and motorized wheelchair system that can be controlled with eye movements Download PDF

Info

Publication number
WO2018063134A2
WO2018063134A2 PCT/TR2017/050433 TR2017050433W WO2018063134A2 WO 2018063134 A2 WO2018063134 A2 WO 2018063134A2 TR 2017050433 W TR2017050433 W TR 2017050433W WO 2018063134 A2 WO2018063134 A2 WO 2018063134A2
Authority
WO
WIPO (PCT)
Prior art keywords
electronic
motorized wheelchair
user
computer based
based system
Prior art date
Application number
PCT/TR2017/050433
Other languages
English (en)
French (fr)
Other versions
WO2018063134A3 (en
Inventor
Mehmet DONMEZ
Kursat Cagiltay
Ersin KARA
Original Assignee
Donmez Mehmet
Kursat Cagiltay
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Donmez Mehmet, Kursat Cagiltay filed Critical Donmez Mehmet
Priority to EP17854223.9A priority Critical patent/EP3519922A2/en
Publication of WO2018063134A2 publication Critical patent/WO2018063134A2/en
Publication of WO2018063134A3 publication Critical patent/WO2018063134A3/en

Links

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/011Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
    • G06F3/013Eye tracking input arrangements

Definitions

  • the invention subject to the application is related to a system , in which commands using only eye movements, can be sent to the electronic and motorized wheelchair by means of an application located on the system screen in order to move the electronic and motorized wheelchair that is a part of a computer based system.
  • Wheelchairs are devices which enable people with temporary or permanent walking disabilities to move. I n present systems, mechanical wheelchairs that are moved by hand/arm power of the user and motorized wheelchairs having an electronic system moving with an engine are available.
  • the invention subject to the application is related to wheelchairs that move by means of engine power having an electronic system which is the second type. The movement of such wheelchairs can be performed manually using a controller, a computer with wireless connection, a tablet computer, or devices such as mobile phones.
  • the subject of the invention is related to the movement of an electronic and motorized wheelchair that is a part of a computer based system and said wheelchair is operated together with an eye movement tracking device.
  • the invention is based on moving an electronic and motorized wheelchair located in a real environment without the need for any kind of physical contact, by means of processing data related to eye movements that have been obtained when the user looks at the application on the screen of the computer based system.
  • the aim of the invention is to move an electronic wheelchair that is connected to a computer based system using only eye movements without the need to use any kind of devices such as a control lever, computer with wireless connection, tablet computer, and mobile phones that are usually necessary to use the motorized wheelchair.
  • Another aim of the invention is to enable disabled people who cannot use computer systems (mouse, keyboard and touch screen etc.) through physical contact as they cannot use their hands or arms and as a result who cannot operate an electronic and motorized wheelchair, to be able to move their wheelchairs by eye movements only.
  • Figure 1 The schematic view of the components of the electronic and motorized wheelchair movement system controlled by eye movements
  • Figure 2- A screen image from the application on the computer based system screen
  • I con enabling the electronic and motorized wheelchair to turn left at a 180 degree angle 16. Icon enabling the electronic and motorized wheelchair to turn right at a 180 degree angle
  • the subject of the application is a system that enables the usage of a wheelchair by means of only eye movements without the need for any kind of computer input devices such as keyboard, mouse and touchpad that necessitate physical contact in order to move the wheelchair with engine power having an electronic system located in a physical environment, wherein Figure 1 shows the components (parts) of the system of the invention.
  • a computer based system ( 1 ) having a screen which enables to operate the system and which comprises the computer based system screen application (4) therein, • eye movement tracking device (2) which tracks the eye movements of a user as soon as he/she looks at the screen of the computer based system which has been positioned by means of an eye movement tracking device fixing apparatus (3) ,
  • eye movement tracking device fixing apparatus (3) which can be adjusted according to the sitting position of the user in the electronic and motorized wheelchair (7) and which is used to position the eye movement tracking device (2) ,
  • a computer based system screen application (4) which enables the communication between the eye movement tracking device (2) and the electronic and motorized wheelchair (7) , which can display the user interactions simultaneously on the screen of the computer based system (1 ) screen, which can send audio and/or visual warning signals if necessary, and which can display the image received from the front and rear-view cameras (8) ,
  • lever (5) which holds the telescopic computer based system screen, whose height, angle and distance can be adjusted according to the user, and which is used to adjust the screen of the computer based system (1 ) to the eye level of the user,
  • chin and forehead resting apparatus (6) which is attached to the electronic and motorized wheelchair (7) , which is used to if necessary to stabilize the head of the user, where the user can rest his/her head-chin, which enables to maintain the distance between the eye movement tracking device (2) and the eyes of the user, which can be adjusted in height, angle and distance,
  • front and rear-view cameras (8) which receive the images from the front and the rear of the electronic and motorized wheelchair (7) and which submits said images to the computer based system screen application (4) .
  • the system subject to the application that enables to move the electronic and motorized wheelchair (7) with only eye movements, is used together with an eye movement tracking device (2) .
  • the application is based on forming a system through which procedures/interactions can be carried out by means of the computer based system screen application (4) using only the eye movements of a user and on these system outputs to be processed by the electronic and motorized wheelchair (7) .
  • the eye movement tracking device (2) can track the movement of eyes when the user looks at the screen of the computer based system screen application (4) .
  • the system regularly receives the data related to the eye movements obtained from the eye movement tracking device (2) .
  • the data obtained from the eye movements of the user captured by the eye movement tracking device (2) is processed by the computer based system screen application (4) and as a result the action carried out by the user on the screen of the computer based system ( 1 ) is determined.
  • the computer based system screen application (4) submits this data to the electronic and motorized wheelchair (7) .
  • the electronic and motorized wheelchair (7) moves in accordance with the data received.
  • the invention subject to the application is a system which enables to move an electronic and motorized wheelchair by means of eye movements, wherein Figure 2 shows a screen shot of the computer based system screen application (4) . According to Figure 2;
  • the user focuses for a predetermined period of time to the icon (9) which enables to turn the electronic and motorized wheelchair to the right, which is displayed on the computer based system screen application (4) in order to turn the electronic and motorized wheelchair (7) to the left and then the wheelchair (7) starts to move.
  • the electronic and motorized wheelchair (7) starts to turn at a predetermined speed and when the user stops focusing, the movement is stopped.
  • the user focuses on the icon (10) enabling the electronic and motorized wheelchair to turn right, which is displayed on the computer based system screen application (4) in order to turn the electronic and motorized wheelchair (7) to the right and then the wheelchair (7) starts to move.
  • the electronic and motorized wheelchair (7) starts to turn at a predetermined speed and when the user stops focusing, the movement is stopped.
  • the user focuses on the icon (1 1 ) enabling the electronic and motorized wheelchair to go straight forward, which is displayed on the computer based system screen application (4) in order to move the electronic and motorized wheelchair (7) forward and then the wheelchair (7) starts to move.
  • the electronic and motorized wheelchair (7) starts to move forward at a predetermined speed and when the user stops focusing, the movement is stopped.
  • the user focuses on the icon (12) enabling the electronic and motorized wheelchair to be reversed, which is displayed on the computer based system screen application (4) in order to reverse the electronic and motorized wheelchair (7) and then the wheelchair (7) starts to move.
  • the electronic and motorized wheelchair (7) is reversed at a predetermined speed and when the user stops focusing, the movement is stopped.
  • the user focuses for a predetermined time on the icon (13) which enables the electronic and motorized wheelchair to make a left turn at a 90 degree angle, which is located on the computer based screen application (4) in order to turn the electronic and motorized wheelchair (7) to the left at a 90 degree angle and the electronic and motorized wheelchair (7) performs the turning motion.
  • the user focuses for a predetermined time on the icon (14) which enables the electronic and motorized wheelchair to make a right turn at a 90 degree angle, which is located on the computer based screen application (4) in order to turn the electronic and motorized wheelchair (7) to the right at a 90 degree angle and the electronic and motorized wheelchair (7) performs the turning motion.
  • the user focuses for a predetermined time on the icon (15) which enables the electronic and motorized wheelchair to make a left turn at a 180 degree angle, which is located on the computer based screen application (4) in order to turn the electronic and motorized wheelchair (7) to the left at a 180 degree angle and the electronic and motorized wheelchair (7) performs the turning motion.
  • the user focuses for a predetermined time on the icon (16) which enables the electronic and motorized wheelchair to make a right turn at a 1 80 degree angle, which is located on the computer based screen application (4) in order to turn the electronic and motorized wheelchair (7) to the right at a 180 degree angle and the electronic and motorized wheelchair (7) performs the turning motion.
  • the user can capture images by means of the front and rear cameras (8) connected to the computer based system ( 1 ) during the usage of the computer based system screen application (4) and the images obtained can be submitted to the camera image display ( 17) simultaneously by said cameras.
  • the image on the screen can be a front image and/or a rear image depending on the movement type.
  • the option to capture images at the same time from both cameras can be made active/ passive using the options button (19) .
  • the user uses the emergency button ( 18) in order to stop the movement of the electronic and motorized wheelchair (7) if there is any kind of problem .
  • the user uses the option button ( 19) in order to configure all settings of the system .
  • the user can receive audio and/or visual warnings in relation to errors or warnings that may be faced in relation to completed procedures.
  • the system enables to submit commands in relation to moving an electronic and motorized wheelchair by means of an application located on the screen of the system .
  • a computer based system with eye movement tracking technology integrated enables users to move the electronic and motorized wheelchair in a desirable direction after commands from the user are received. Therefore this system can be sold with similar methods used to sell present motorized wheelchairs.

Landscapes

  • Engineering & Computer Science (AREA)
  • General Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Human Computer Interaction (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • User Interface Of Digital Computer (AREA)
  • Selective Calling Equipment (AREA)
PCT/TR2017/050433 2016-09-28 2017-09-18 Electronic and motorized wheelchair system that can be controlled with eye movements WO2018063134A2 (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
EP17854223.9A EP3519922A2 (en) 2016-09-28 2017-09-18 Electronic and motorized wheelchair system that can be controlled with eye movements

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
TR2016/13586A TR201613586A2 (tr) 2016-09-28 2016-09-28 Göz hareketleri̇ i̇le kontrol edi̇len elektroni̇k ve motorlu tekerlekli̇ sandalye si̇stemi̇
TR2016/13586 2016-09-28

Publications (2)

Publication Number Publication Date
WO2018063134A2 true WO2018063134A2 (en) 2018-04-05
WO2018063134A3 WO2018063134A3 (en) 2018-07-12

Family

ID=61760946

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/TR2017/050433 WO2018063134A2 (en) 2016-09-28 2017-09-18 Electronic and motorized wheelchair system that can be controlled with eye movements

Country Status (3)

Country Link
EP (1) EP3519922A2 (tr)
TR (1) TR201613586A2 (tr)
WO (1) WO2018063134A2 (tr)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN112057251A (zh) * 2020-09-21 2020-12-11 山西白求恩医院(山西医学科学院) 一种眼电与唇部动作信号控制的电动智能轮椅及控制方法

Family Cites Families (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5360971A (en) * 1992-03-31 1994-11-01 The Research Foundation State University Of New York Apparatus and method for eye tracking interface
US6842670B2 (en) * 2003-05-02 2005-01-11 Chung Shan Institute Of Science And Technology Eye-tracking driving system
JP2007143859A (ja) * 2005-11-28 2007-06-14 Rota Kk 自律移動型車椅子ロボットのビデオカメラ及びセンサの取り付け構造及び取り付け調整方法
SE533876C2 (sv) * 2009-05-05 2011-02-15 Styr- och kontrollsystem för ett rörligt handikapphjälpmedel
IL303037A (en) * 2015-03-10 2023-07-01 Eyefree Assisting Communication Ltd A system and method of communication through visual feedback

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
None

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN112057251A (zh) * 2020-09-21 2020-12-11 山西白求恩医院(山西医学科学院) 一种眼电与唇部动作信号控制的电动智能轮椅及控制方法

Also Published As

Publication number Publication date
WO2018063134A3 (en) 2018-07-12
TR201613586A2 (tr) 2016-11-21
EP3519922A2 (en) 2019-08-07

Similar Documents

Publication Publication Date Title
JP7153096B2 (ja) アイフィードバックによるコミュニケーションを可能にするシステム及び方法
US10627900B2 (en) Eye-signal augmented control
Wanluk et al. Smart wheelchair based on eye tracking
US20130154913A1 (en) Systems and methods for a gaze and gesture interface
CN116719415A (zh) 用于提供计算机生成的体验的设备、方法和图形用户界面
US20160249008A1 (en) Display apparatus, display method, and program
JP2010231290A (ja) 頭部運動による入力装置及び方法
JP5548742B2 (ja) 双方向アイ・モーション・コミュニケーション・システム
Ilias et al. A nurse following robot with high speed kinect sensor
Hansen et al. Head and gaze control of a telepresence robot with an hmd
TW201517616A (zh) 監視攝影裝置之控制方法及控制系統
CN102197932B (zh) 化妆镜调整系统、方法及具有该调整系统的化妆镜
US20180316911A1 (en) Information processing apparatus
Tall et al. Gaze-controlled driving
WO2012149713A1 (zh) 一种人机交互的方法及装置
WO2018063134A2 (en) Electronic and motorized wheelchair system that can be controlled with eye movements
CN105677040A (zh) 一种终端控制方法、装置及可穿戴设备
US9392223B2 (en) Method for controlling visual light source, terminal, and video conference system
Lenz et al. NimbRo wins ANA Avatar XPRIZE immersive telepresence competition: human-centric evaluation and lessons learned
Jiang et al. Autonomous performance of multistep activities with a wheelchair mounted robotic manipulator using body dependent positioning
TWI480764B (zh) 頭部控制游標之裝置及方法
EP3966664B1 (en) Virtual, augmented and mixed reality systems with physical feedback
Kalpana et al. An intelligent voice-recognition wheelchair system for disabled persons
TW201404136A (zh) 一種防脫焦的方法和裝置
Hussam et al. Intelligent control system of a wheelchair for people with quadriplegia paralysis

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 17854223

Country of ref document: EP

Kind code of ref document: A2

NENP Non-entry into the national phase

Ref country code: DE

ENP Entry into the national phase

Ref document number: 2017854223

Country of ref document: EP

Effective date: 20190429