WO2021162663A1

WO2021162663A1 - Disabled communication system

Info

Publication number: WO2021162663A1
Application number: PCT/TR2021/050116
Authority: WO
Inventors: Nezahat SOLMAZ; Melek Nur ÖZÜDOĞRU; Nalan ÖZKURT
Original assignee: Çi̇ğli̇ Fen Li̇sesi̇; Yaşar Üni̇versi̇tesi̇
Priority date: 2020-02-12
Filing date: 2021-02-10
Publication date: 2021-08-19
Also published as: TR202002077A2

Abstract

Disabled communication system is an improved communication means for bedridden patients who cannot communicate with the outside world but fulfills their brain functions such as ALS patients. Thanks to this system, it is possible to convey the health, social and emotional needs of the person to their relatives by using the attention level received from the EEG reader device. The system comprises EEG measurement device (1), which enables the detection of the change in brain waves with the focusing attention of the user, the computer (2) to which the EEG measurement device (1) is connected using a wireless connection for sending data, and attention level determination and communication interface (4) which are taking measurements of the attention level of the person using the EEG measurement device (1), providing the information of the key-pressed signal when the person's attention level is above the specified threshold, enabling the person to express the sentences or words they want to say aloud, showing the user by constantly highlighted sentences or words, also is flexible where the menu content can be changed.

Description

DISABLED COMMUNICATION SYSTEM TECHNICAL FIELD

The subject of invention, is related with a communication system for disabled people which detects the changes in brain waves by measuring the EEG waves created by focusing on the sentences displayed on screen, then the vocalizing the selected sentence.

PRIOR ART

Commonly the communication problems are solved by letter selection by brain waves or artificial intelligence technologies, but these processes are both costly and the process of expressing oneself takes a long time. For this reason, previous solution suggestions do not have widespread use as they do not facilitate individuals to express themselves.

BRIEF DESCRIPTION OF THE INVENTION

The present invention relates to a disabled communication system dial overcomes the above mentioned disadvantages. The product aims to enable patients who are bedridden or have speaking difficulties to express themselves in a more comfortable and practical way in daily life.

Definitions of Elements / Parts / Parts that Make Up the Invention

In order to explain this invention better, the components / part / elements of the developed disabled communication system are numbered separately and the explanation of each number is given below.

1. EEG measurement device

2. Computer

3. Attention level determination algorithm

4. Communication interface

BRIEF DESCRIPTION of FIGURES

For a better understanding of the disabled communication system, the invention, the figures prepared are explained below. Figure 1. Subunits of the disabled communication system

Figure 2. Algorithm for determining attention level Figure 3. Communication interface menu contents

Figure 4. Communication interface algorithm

DETAILED EXPLANATION OF INVENTION

In this detailed description, the innovation subject to the invention is explained with examples that are not limited to this, is just given for belter understanding of the subject. Forementioned invention relates to communication system for disabled patients.

Disabled communication system was developed for bedridden patients who can not communicate with the outside world but does not have a problem in fulfilling their brain function such as ALS patients. With this system, it is possible the people to express their health care, social and emotional needs to their relatives using the received attention level by EEG measurement device (1).

The invention consists of two main subsections.

1 -Detecting the changes in brain waves due to the attention level of the user. This partis made using the Phyton library provided by the Neurosky company.

2- Highlighting the words or phrases from the menu sequentially and narration of the selected word or phrase in Scratch programming environment.

For example, if the individuals would like to tell the person next to him/her that “He/she is hungry”. He/she should concentrate on the words on the screen, when "Basic Needs" is highlighted. In this way, the EEG measurement device (1), for example, the Neurosky Mindwave device, detects the increased level of individual attention and transmits it to the software, and the software decides which sentence is active and opens the “Basic Needs” menu. When the word "I'm hungry" is active, while the words in this menu change color sequentially, the relevant word is selected and the word is read aloud. The system returns to the main screen after a certain waiting period and continues to wait for a command state. The subunits of the system is given in Figure 1.

The subunits of disabled communication system are explained as follows: • EEG MEASUREMENT DEVICE (1) EEG signals are measured and send to the computer wirelessly such as Bluetooth connection with measurement device. Those devices are mostly used for entertainment and improving to focus attention applications commercially such as Neurosky Mindwave EEG measurement device (1).

• COMPUTER (2) There is no need to have any program other than Windows installed on the computer. After the EEG measurement device is introduced to the computer as a Bluetooth device, the system starts to operate by clicking our software in executable file ( exe ) format.

• ATTENTION LEVEL DETERMINATION ALGORITHM (3)

The attention level determination software (3) was developed by us in Phyton environment by using library Neuropy provided by Neurosky company. It sends information to the communication program when the attention exceeds the specified level. The algorithm of the program is given in Figure 2. After the required libraries are loaded in the Phyton environment, attention level is measured. Changes in attention level are variable from person to person and even during the day for the same person. For this reason, firstly the level reached by the person is determined when he/she gets his / her attention in the calibration program developed by us. The level of attention is then measured continuously. If the attention level is above the specified threshold, “the key pressed” signal is generated. The signal for the key press has the same effect as the key press on the keyboard and can be detected by other programs connected to the computer.

• COMMUNICATION INTERFACE (4) The communication interface was developed originally in Scrath program (also other interface programs may be used). The interface expresses what patient would like to say by measuring an increased level of attention by EEG measurement device (1). The advantage of this software compared to other interfaces algorithms currently available is that it is tailored to the communication requests of patients. When the program is run, the main menu appears. The sentences seen in the main menu and submenu are listed in Figure 3. Phrases or words in the main menu highlighted sequentially. When the “key is pressed” signal came from the attention level determination software, the active menu name is read aloud and the next menu is turned on. For example, if the "Basic Needs" menu is selected, the words "I'm hungry", "I'm thirsty", "I have to go to the toilet" and the return icon start to flash on the newly opened screen. Again, when the “key is pressed” information came from the attention determination software, the active sentence is read. The system continues to work like this. In addition to the buttons mentioned, there are also the words "Yes" and "No" on every screen. Figure 4 shows the algorithm of the communication software.

Communication interface (4) menu contents consist of sub-menus and can be changed, increased or decreased in case of need. As shown in Figure 3, the menu contents are organized in three main categories such as “Basic Needs”, “Social Needs” and “Health”. The statements such as “I’m hungry” or “I’m thirsty are listed in the “Basic Needs” sections. Similarly, “Hello”, “Good Morning” are listed in “Social Needs” category. The system is highly flexible, thus the content of the categories can be easily modified or expanded. Attention level determination software (3);

• Load Neuropy and Pynput libraries,

• Acquire EEG signals via Bluetooth,

• Measure attention level for calibration,

• Determine the personal threshold level,

• Measure the level of attention,

• Check whether the attention is greater than the threshold,

• If attention is greater than the threshold “key pressed” information is sent and then level of attention measured,

• If the Attention is not greater than the threshold, measure the Attention level again. Communication interface (4) algorithm;

• Displaying the Main Menu ,

• Highlight sentences sequentially,

• Is the “key pressed” information received?

• If the information came switch to next menu, and highlight sentences sequentially in this new screen

• If the information that the key was pressed is not detected then wait for it.

The invention is disabled communication system and its features are;

• EEG measuring device (1) that enables the detection of the change in brain waves with the user focusing attention,

• The computer (2) to which the EEG measurement device (1) is connected using a wireless connection (for example, bluetooth, etc. ) for sending data,

• Attention level determination (3) and communication interface (4) which is taking measurements of the attention level of the person using the EEG measurement device (1), providing the information of the key-pressed signal when the person's attention level is above the specified threshold, enabling the person to express the sentences or words they want to say aloud, showing the user by constantly highlighted sentences or words, also is flexible where the menu content can be changed. Based on the detailed explanations above, the working method of the disabled communication system processing steps are;

• Showing main menu to the patient,

• Highlighting the words or sentences in turn,

• Measuring the person's brain signals with the EEG measuring device (1),

• Transferring of the signal to computer via Bluetooth,

• Reading EEG signals via Bluetooth,

• Measuring attention level for calibration,

• Determining the personal threshold level,

• Measurement of attention level,

• Determining whether the level of attention is greater than the threshold,

• If the level of attention is greater than the specified threshold, reading the selected sentence or word aloud by sending the key pressed information,

• Then proceeding to step of measuring the level of attention again.

A preferred embodiment of the invention is that a device that enables the health, social and emotional needs of the person to be conveyed to their relatives by using the attention level using the above-mentioned method.

Claims

1. A disabled communication system comprising;

• EEG measurement device (1), which enables the detection of the change in brain waves with the focusing attention of the user,

• The computer (2) to which the EEG measurement device (1) is connected using a wireless connection for sending data,

• Attention level determination (3) and communication interface (4) which are taking measurements of the attention level of the person using the EEG measurement device (1), providing the information of the key-pressed signal when the person's attention level is above the specified threshold, enabling the person to express the sentences or words they want to say aloud, showing the user by constantly highlighted sentences or words, also is flexible where the menu content can be changed.

2. A working method of disabled communication system, comprising the steps of;