RU123556U1 - SOFTWARE AND HARDWARE COMPLEX FOR COMMUNICATION OF Hearing impaired, deaf, deaf, deaf, dumb people with hearing speaking people - Google Patents

Abstract

A hardware-software complex for expanding the possibilities of communication of hearing-impaired, deaf, deaf-mute, mute people with hearing speaking people, includes two devices connected to each other by wireless communication, with the ability to send text messages from device to device, characterized in that the devices are fixed on a common platform with the ability to rotate devices relative to each other, remove each of the devices from the platform, with the possibility of separating parts of the platform together with devices or using devices regardless of the platform, with the ability to synthesize speech and pronounce text messages by the first of the devices, with the possibility of voice dialing of messages by the second from devices, with the ability to enter messages using the built-in virtual keyboard in each of the devices with confirmation of incoming messages by device vibration.

Description

A hardware-software complex for communication between hearing-impaired, deaf, deaf-mute, dumb people with hearing speaking people.

Designed to expand the communication capabilities of the hearing impaired, deaf, deaf, dumb, dumb people with hearing speaking people.

There are well-known complexes for communication between deaf people and hearing people, such as UbiDuo (www.scomm.com) and Interpretype (www.interpretype.com). Each of these complexes consists of two devices designed for text messaging. The closest analogue of the claimed complex is the complex "UbiDuo". This complex consists of two devices mechanically connected together. After disconnecting the devices, one of the devices is transmitted to the hearing person, the second is located at the deaf person. Then, a connection is established between the devices using wireless communication. Then there is an exchange of text messages between the deaf and the hearing, the messages are entered using the physical keyboard built into each device, messages are displayed on the device displays.

The proposed hardware and software complex also consists of two devices connected wirelessly, also based on the exchange of text messages, while significantly different from the closest analogue:

1. the devices are mounted on a single platform, with the ability to rotate the devices relative to each other, with the possibility of removing each of the devices from the platform and disconnecting the parts of the platform together with the devices or the operation of devices without a platform, that is, the device, unlike the analogue, can work as a single complex without disconnecting devices. This solution allows hearing-impaired, deaf, deaf, dumb, and dumb people to communicate at a distance (through the counter, at the ticket office, etc.) with the help of a complex with audiovisual information to hearing people.

2. compactness, since a virtual keyboard is built into each of the devices of the complex, which significantly reduces the size of the complex. This solution allows you to use the complex in cramped conditions (turn, a large crowd of people, in transport, etc.).

3. built-in speech synthesizer in the device complex,

intended for a deaf person and the ability to pronounce messages in a synthesized voice. This solution allows the deaf to speak to the hearer using a synthesized voice (ask for help, ask for directions, etc.).

4. the possibility of voice dialing messages (speech to text) in the device complex, designed for the hearing person. This decision dramatically increases the ability to communicate, allows the hearing person to communicate with the deaf with the help of voice.

5. confirmation of received messages by vibration of devices for tactile perception of incoming messages. This solution allows a deaf person to tactfully perceive the receipt of a message if the complex devices are used at a distance.

The essence of the utility model:

The model is a compact complex (figure 1), which includes two devices (device No. 1 pos. 21 and device No. 2 pos. 22), paired with a wireless connection (bluetooth, etc.) pos. 12 fixed on a single platform pos.23, with the ability to rotate devices relative to each other pos.24, with the possibility of removing from the platform each of the devices and disconnecting parts of the platform together with the devices.

In the device No. 1, addressed to the hearing impaired person, the message text is entered into the window pos. 1 using the virtual keyboard pos. 2. Further, the hearing impaired has 2 options:

1. Send a text message to device No. 2 using the "Send" button pos.3.

2. Send a text message to device No. 2 using the Read and Send button, item 4, while the text message is loudly pronounced using the speech synthesizer built into device No. 1.

The sent message is displayed on the display pos.5 of device No. 2, in a font sufficient for visual perception from a distance of up to two meters. Thus, the hearing person receives visual and audio information from a hearing impaired person.

Feedback (message from the hearing person to the hearing impaired) is made in two ways:

1. On the device No. 2, a voice message is dialed using the “voice dialing” button, item 6, while the conversion of speech to text is performed using special speech recognition services (for example, Google - in this case, device No. 2 requires Internet access) or firmware version 11. The message converted to text is displayed in the text input window pos.8. Further, the message can be corrected with the virtual keyboard pos.7 (if necessary) and using the send button pos.10 send to device No. 1, where the message is displayed on the display pos.9.

2. On device No. 2, in the text input window, item 8, a message is dialed using the virtual keyboard pos. 7 built into the device. Next, the message is sent to device No. 1 using the “send” button, item 10, where the message is displayed on the display, item 9.

Thus, a hearing impaired person receives information from a hearing speaking person.

All incoming messages on devices No. 1, No. 2 are confirmed by vibration, for tactile perception of incoming messages.

The technical result of the application of the proposed complex is the expansion of opportunities for communication between deaf and hearing-impaired people with hearing and the increase in the ability of hearing impaired people to adapt in society, namely:

- the possibility of using the complex as a whole for contacting hearing people from a distance with audiovisual information.

- the possibility of using the complex in cramped conditions (turn, a large crowd of people in transport, etc.).

- the ability of the deaf to speak to the hearer with the help of a synthesized voice (ask for help, ask for directions, etc.).

- the ability of the hearing person to communicate with the deaf with the help of voice.

- the ability for a deaf person to tactfully perceive a message if the devices of the complex are used at a distance, in the absence of direct visibility between the interlocutors.

Implementation Model:

At this stage of technology development, the production of the complex is possible without any additional development.

As devices No. 1 and No. 2, smartphones based on the Android OS or other PDA devices (tablets, etc.) can be used. It is also possible to develop each of the devices separately, with the minimum necessary requirements, to reduce the cost of the complex. Speech synthesis systems are common and do not require serious hardware characteristics, while the quality of speech synthesis is quite high. Speech recognition systems are currently booming, while it’s convenient to use Internet services, in particular, Google speech recognition.

The program for networking devices and messaging does not present technical difficulties.

The production of a platform for mounting devices No. 1 and No. 2 does not present technical difficulties.

Claims (1)

The hardware-software complex for expanding the communication capabilities of hearing-impaired, deaf, deaf, dumb people with hearing speaking people includes two devices interconnected by wireless communication, with the ability to send text messages from the device to the device, characterized in that the devices are fixed to a common platform with the ability to rotate devices relative to each other, to remove each device from the platform, with the possibility of disconnecting parts of the platform together with the devices or using anija devices regardless of the platform, to synthesize the speech and text messages of pronunciation of the first device, with the possibility of voice dialing of the second communications device to input messages through the virtual keyboard built in each of the devices with acknowledgment messages incoming vibration devices.