AU2021105337A4

AU2021105337A4 - A device for conversion of visual gestures into handwritten of deaf /physically challenged people

Info

Publication number: AU2021105337A4
Application number: AU2021105337A
Authority: AU
Inventors: M. Kathiravan; Muthukumaran MALARVEL
Original assignee: Hindustan Institute of Technology and Science; KCG College of Technology
Current assignee: Hindustan Institute of Technology and Science; KCG College of Technology
Priority date: 2021-08-12
Filing date: 2021-08-12
Publication date: 2021-12-02
Anticipated expiration: 2029-08-12

Abstract

The present invention generally relates to a device for conversion of visual gestures into handwritten of deaf /physically challenged people comprises a camera coupled with a body for capturing visual gestures and signs; a conversion module for converting visual gestures and signs into text; a classification module for identifying task of a person; and a central processing unit configured for augmenting converted text to transliteration into identified person's own handwriting style. 10 4.0 D wj

Description

4.0 D

wj

A DEVICE FOR CONVERSION OF VISUAL GESTURES INTO HANDWRITTEN OF DEAF /PHYSICALLY CHALLENGED PEOPLE FIELD OF THE INVENTION

The present disclosure relates to a portable device for conversion of visual gestures into handwritten of deaf /physically challenged people. In more details, a device for conversion of visual gestures into handwritten of deaf/physically challenged people through image processing and machine learning techniques.

BACKGROUND OF THE INVENTION

Speech and handwriting recognition are the indispensable research areas in the real-time utility applications needed in society particularly physically challenged people. In the recent past, many research works have been carried out for speech and handwriting recognition However, many applications have been developed on these two areas (i.e., speech recognition, speaker recognition, speech to text conversion, offline handwriting recognition, online handwriting recognition, writer identification, postal address recognition etc.).

In the view of the forgoing discussion, it is clearly portrayed that there is a need to have a device for conversion of visual gestures into handwritten of deaf /physically challenged people.

SUMMARY OF THE INVENTION

The present disclosure seeks to provide a smart device to prepare a handwritten draft in her/his own handwriting style in an optimized time and reduce the paper writing work.

In an embodiment, a device for conversion of visual gestures into handwritten of deaf /physically challenged people is disclosed. The device includes a camera coupled with a body for capturing visual gestures and signs. The device further includes a conversion module for converting visual gestures and signs into text. The device further includes a classification module for identifying task of a person. The device further includes a central processing unit configured for augmenting converted text to transliteration into identified person's own handwriting style.

In an embodiment, the classification module is configured with image processing and machine learning techniques.

In an embodiment, the body includes a display is sued for visualizing converted text to transliteration into identified person's own handwriting style.

In an embodiment, a memory card is electrically coupled to the central processing unit for storing the captured visual gestures and signs along with converted text.

In an embodiment, a USB port is connected to charge battery or to share data from the memory card.

In an embodiment, an on/off button is engaged for turning on/off the operation, a mode button for selecting operational model, and a save button for storing the captured visual gestures and signs along with converted text.

An object of the present disclosure is to develop a device for conversion of visual gestures into handwritten of deaf/physically challenged people through image processing and machine learning techniques.

Another object of the present disclosure is to identify the person through face detection and converting text into handwritten format of the person.

Yet another object of the present invention is to deliver an expeditious and cost-effective device to make official documentation more secure and generating the large amount of text just based on visual gestures.

To further clarify advantages and features of the present disclosure, a more particular description of the invention will be rendered by reference to specific embodiments thereof, which is illustrated in the appended drawings. It is appreciated that these drawings depict only typical embodiments of the invention and are therefore not to be considered limiting of its scope. The invention will be described and explained with additional specificity and detail with the accompanying drawings. BRIEF DESCRIPTION OF FIGURES

These and other features, aspects, and advantages of the present disclosure will become better understood when the following detailed description is read with reference to the accompanying drawings in which like characters represent like parts throughout the drawings, wherein:

Figure 1 illustrates a block diagram of a device for conversion of visual gestures into handwritten of deaf /physically challenged people in accordance with an embodiment of the present disclosure; and Figure 2 illustrates an exemplary view of a portable device for conversion of visual gestures into handwritten of deaf /physically challenged people in accordance with an embodiment of the present disclosure.

Further, skilled artisans will appreciate that elements in the drawings are illustrated for simplicity and may not have necessarily been drawn to scale. For example, the flow charts illustrate the method in terms of the most prominent steps involved to help to improve understanding of aspects of the present disclosure. Furthermore, in terms of the construction of the device, one or more components of the device may have been represented in the drawings by conventional symbols, and the drawings may show only those specific details that are pertinent to understanding the embodiments of the present disclosure so as not to obscure the drawings with details that will be readily apparent to those of ordinary skill in the art having benefit of the description herein.

DETAILED DESCRIPTION

For the purpose of promoting an understanding of the principles of the invention, reference will now be made to the embodiment illustrated in the drawings and specific language will be used to describe the same. It will nevertheless be understood that no limitation of the scope of the invention is thereby intended, such alterations and further modifications in the illustrated system, and such further applications of the principles of the invention as illustrated therein being contemplated as would normally occur to one skilled in the art to which the invention relates.

It will be understood by those skilled in the art that the foregoing general description and the following detailed description are exemplary and explanatory of the invention and are not intended to be restrictive thereof.

Reference throughout this specification to "an aspect", "another aspect" or similar language means that a particular feature, structure, or characteristic described in connection with the embodiment is included in at least one embodiment of the present disclosure. Thus, appearances of the phrase "in an embodiment", "in another embodiment" and similar language throughout this specification may, but do not necessarily, all refer to the same embodiment.

The terms "comprises", "comprising", or any other variations thereof, are intended to cover a non-exclusive inclusion, such that a process or method that comprises a list of steps does not include only those steps but may include other steps not expressly listed or inherent to such process or method. Similarly, one or more devices or sub-systems or elements or structures or components proceeded by "comprises...a" does not, without more constraints, preclude the existence of other devices or other sub-systems or other elements or other structures or other components or additional devices or additional sub-systems or additional elements or additional structures or additional components.

Unless otherwise defined, all technical and scientific terms used herein have the same meaning as commonly understood by one of ordinary skill in the art to which this invention belongs. The system, methods, and examples provided herein are illustrative only and not intended to be limiting.

Embodiments of the present disclosure will be described below in detail with reference to the accompanying drawings.

Referring to Figure 1, a block diagram of a device for conversion of visual gestures into handwritten of deaf /physically challenged people is illustrated in accordance with an embodiment of the present disclosure. The device 100 includes a camera 102 coupled with a body 110 for capturing visual gestures and signs. The camera 102 is positioned to the rear side of the body 110.

In an embodiment, a conversion module 104 for converting visual gestures and signs into text. The conversion module 104 is based on machine learning.

In an embodiment, a classification module 106 for identifying task of a person. In an embodiment, a central processing unit 108 is configured for augmenting converted text to transliteration into identified person's own handwriting style.

In an embodiment, the classification module 106 is configured with image processing and machine learning techniques.

In an embodiment, the body 110 includes a display is sued for visualizing converted text to transliteration into identified person's own handwriting style.

In an embodiment, a memory card 112 is electrically coupled to the central processing unit 108 for storing the captured visual gestures and signs along with converted text.

In an embodiment, a USB port is connected to charge battery or to share data from the memory card 112.

In an embodiment, a battery is mechanically coupled with the device for providing electrical energy to the device.

Figure 2 illustrates an exemplary view of a portable device for conversion of visual gestures into handwritten of deaf /physically challenged people in accordance with an embodiment of the present disclosure. The device is configured to initially capture the visual gestures and signs (as used by deaf people), then the basis of this input (i) conversion of visual gestures to text and (ii) identification of the person tasks are performed. Thereafter, the converted text is further augmented to the transliteration into identified person's own handwriting style. The motivation to implement this idea is make the official documentation more secure and generating the large amount of text just based on visual gestures and it will be useful for deaf/physically challenged people.

The main objective to build this smart device is to prepare a handwritten draft in her/his own handwriting style in an optimized time and reduce the paper writing work.

The device body 110 contains a camera 102 positioned to the rear side of the device, a processing unit 108 positioned inside the body 110, a battery coupled with the processing unit 108, a memory card 112 engaged with the processing unit 108 , a display unit mounted on the front side of the body 110, on/off buttons and USB port.

The drawings and the forgoing description give examples of embodiments. Those skilled in the art will appreciate that one or more of the described elements may well be combined into a single functional element. Alternatively, certain elements may be split into multiple functional elements. Elements from one embodiment may be added to another embodiment. For example, orders of processes described herein may be changed and are not limited to the manner described herein. Moreover, the actions of any flow diagram need not be implemented in the order shown; nor do all of the acts necessarily need to be performed. Also, those acts that are not dependent on other acts may be performed in parallel with the other acts. The scope of embodiments is by no means limited by these specific examples. Numerous variations, whether explicitly given in the specification or not, such as differences in structure, dimension, and use of material, are possible. The scope of embodiments is at least as broad as given by the following claims.

Benefits, other advantages, and solutions to problems have been described above with regard to specific embodiments. However, the benefits, advantages, solutions to problems, and any component(s) that may cause any benefit, advantage, or solution to occur or become more pronounced are not to be construed as a critical, required, or essential feature or component of any or all the claims.

Claims

WE CLAIM

1. A device for conversion of visual gestures into handwritten of deaf /physically challenged people, the device comprises:

a camera coupled with a body for capturing visual gestures and signs; a conversion module for converting visual gestures and signs into text; a classification module for identifying task of a person; and a central processing unit configured for augmenting converted text to transliteration into identified person's own handwriting style.

2. The device as claimed in claim 1, wherein the classification module is configured with image processing and machine learning techniques.

3. The device as claimed in claim 1, wherein the body includes a display for visualizing converted text to transliteration into identified person's own handwriting style.

4. The device as claimed in claim 1, wherein a memory card is electrically coupled to the central processing unit for storing the captured visual gestures and signs along with converted text.

5. The device as claimed in claim 4, wherein a USB port is connected to charge battery or to share data from the memory card.

6. The device as claimed in claim 1, comprises an on/off button for turning on/off the operation, a mode button for selecting operational model, and a save button for storing the captured visual gestures and signs along with converted text.

Figure 2