KR101123212B1 - Touch screen apparatus for blind person and method for inputting characters in the apparatus - Google Patents

Abstract

PURPOSE: A touch screen apparatus and a character inputting method thereof are provided to enable the visually disabled person to input a character by using an input method in a Braille system. CONSTITUTION: A touch sensing unit(120) determines touch position and duration. If touch by three touch pointers is sensed, a Braille input initializing unit(130) determines ranges of coordinates corresponding to the touch position. The Braille input initializing unit initializes Braille input by deciding a touch area of the touch pointers. IF multi-touch is sense, a Braille recognizing unit(140) recognizes Braille input based on touch position and duration of multi-touch.

Description

Touch screen apparatus for blind person and method for inputting characters in the apparatus}

The present invention relates to a touch screen device for the visually impaired and a text input method in the device, and more particularly, when a touch by three touch pointers is detected, acquiring a coordinate value of the detected touch position, When the obtained coordinate value is within a predetermined valid range, the touch area of each touch pointer is determined to perform initialization for braille input, and when multi-touch is detected while initialization for the braille input is performed, Recognizing braille based on the touch position and the touch holding time by the multi-touch, interpreting the recognized braille as a character based on a braille table, and outputting the interpreted character as a voice while outputting on the touch screen The present invention relates to a touch screen device for a disabled person and a text input method in the device.

The touch screen device is a display device that adopts a touch screen input method that touches a character or a specific position displayed on the screen instead of a keyboard input method. have.

In addition, ATM devices for cash withdrawals and computer devices for guiding public spaces often adopt a touch screen input method.

However, since a touch screen cannot recognize a touch unlike a physically configured button type, a user with a visual impairment or a user who has poor vision has an inconvenience in recognizing a button input by the user.

In addition, the full touch type touch screen device for the visually impaired only outputs a voice when the keyboard letter key displayed on the touch screen is focused with a finger, and is randomly distributed to the blind who cannot predict the position and direction of the letter key. There was a disadvantage of requiring accidental operation through enemy manipulation.

The present invention has been made to solve the above problems, and an object of the present invention is to use a touch screen device operated by a visually impaired person in a full touch mode, using an input method using a braille system suitable for the characteristics of the visually impaired. The present invention provides a touch screen device for the visually impaired and a text input method thereof for enabling the user to input not only text input but also various functions provided by the touch screen device.

Another object of the present invention is to simplify the touch area and to introduce a braille system that is familiar to the visually impaired in its operation, so that the visually impaired user can input characters through gesture manipulation so as to be suitable for use by a blind or poor user. To provide a touch screen device and a character input method in the device.

According to an aspect of the present invention to achieve the above object, a touch screen, when the touch of the touch screen is detected, a touch sensing unit for determining the touch position and the touch holding time, the touch sensing unit to the three touch pointers When a touch is detected, it is determined whether the coordinate values corresponding to the touch positions are within a predetermined valid range, and when the touch is within the valid range, the touch area of each touch pointer is determined to perform initialization for braille input. When the multi-touch is detected while the input initialization unit, the initialization for the braille input is performed, a braille recognition unit for recognizing the braille based on the touch position and the touch holding time by the multi-touch, the braille recognition unit An inverted point region for interpreting braille into characters based on a pre-stored braille table and outputting the braille on the touch screen; Provided is a touch screen device for the visually impaired, which includes a speech synthesis processing unit for converting an interpreted text into text data using a text-to-speech engine.

The braille input initialization unit requests the voice synthesis processing unit to output a beep sound indicating that the touch position of each touch pointer is in the correct position when the coordinate values exist within a predetermined valid range, and at the same time, among the three touch areas. The voice synthesis processor requests the voice synthesis processor to correct the remaining touch area and output a warning sound indicating that the touch points of the touch pointers are not the correct positions if they are not within the effective range.

When the initialization for braille input is performed, the touch screen is divided into three touch regions inclined by a predetermined angle with respect to the horizontal axis or the vertical axis, thereby enabling multi-touch by three touch pointers.

The braille recognition unit is preset with braille according to the touch position and the touch holding time by the multi-touch.

The braille recognition unit recognizes the braille differently according to the case where the touch pointers are released within a predetermined time after the multi-touch, and when the touch pointers are removed after the predetermined time after the multi-touch.

The inverted and inverse part inquires the braille list, obtains the character value mapped with the recognized braille, and sequentially outputs the characters on the touch screen.

According to another aspect of the present invention, in the method for inputting a character in a touch screen device for the visually impaired, (a) when a touch by three touch pointers is detected, acquiring a coordinate value of the detected touch position (B) if the obtained coordinate value is within a predetermined valid range, determining a touch area of each touch pointer and outputting a beep sound indicating a correct position, and performing initialization for braille input, (c Recognizing the braille based on the touch position and the touch holding time by the multi-touch, when the multi-touch is detected in the initialization state for the braille input, (d) the recognized braille in the braille list Interpreting the text based on the touch screen, and outputting the interpreted text on the touch screen while outputting the sound as a touch screen for the visually impaired. Provides a method for entering characters in the device.

In the step (b), when the coordinate values exist within a predetermined valid range, the remaining touch areas are corrected and determined based on the center touch area among the three touch areas by the three touch pointers.

In addition, in the step (b), when the initialization for the braille input is performed, the touch screen is divided into three touch regions inclined by a predetermined angle with respect to the horizontal axis or the vertical axis, and thus is multi-touched by three touch pointers. Touch is possible.

As described above, according to the present invention, when a visually impaired person uses a touch screen device operating in a full touch method, a character input as well as a touch screen device are provided using an input method using a braille system suitable for the characteristics of the visually impaired person. Can input various functions.

In addition, the touch area is simplified for use by users who are blind or have low vision, and a braille system that is familiar to the visually impaired in operation can be used to input characters freely, such as a text message or a document by gesture manipulation. Can be.

In addition, in using the full touch type touch screen device, the additional cost for securing the usability of the visually impaired is reduced by using the full touch as it is without adding a separate physical additional device.

In addition, recently, various types of touch screen devices including smartphones are rapidly being converted to full-touch methods, so that the visually impaired users can be prepared in advance so that they are not violated by the 'Disability Discrimination Act'. It will be a chance to use the device smoothly and improve the quality of life.

1 is a block diagram schematically showing the configuration of a touch screen device for the blind according to the present invention.
2 is an exemplary view showing a touch screen when the initialization for braille input is performed according to the present invention.
3 is a flowchart illustrating a method of inputting a text in a touch screen device for the visually impaired according to the present invention.

Details of the above-described objects and technical configurations of the present invention and the effects thereof according to the present invention will be more clearly understood by the following detailed description based on the accompanying drawings.

1 is a block diagram schematically showing the configuration of a touch screen device for the visually impaired according to the present invention, and FIG. 2 is an exemplary view showing a touch screen when initialization for braille input is performed according to the present invention.

Referring to FIG. 1, the touch screen device 100 for the visually impaired includes a touch screen 110, a touch sensing unit 120, a braille input initialization unit 130, a braille recognition unit 140, and a reverse point reversing unit 150. And a speech synthesis processor 160.

The touch screen 110 receives or outputs a user command.

When the initialization for braille input is performed, the touch screen 110 is divided into three based on the horizontal axis or the vertical axis, and has a structure inclined diagonally by a predetermined angle. This is not a structure displayed on the touch screen 110, but a structure formed virtually for recognition of multi-touch.

That is, when initialization for braille input is performed, the touch screen 110 is inclined diagonally by a predetermined angle (for example, 30 degrees) of a touch area divided into three axes on a vertical axis as shown in FIG. Consists of compartments. This is to place the three fingers (e.g. index finger, middle finger, ring finger) most naturally within the effective range of the touch screen.

The touch area is fluidly moved along the vertical axis while maintaining a predetermined angle with the division. In this case, the width of the middle region in the three-part touched region is always constant according to a predetermined size (eg, a middle finger). Each touch area may be multi-touched and its meaning is different depending on the touch combination.

Three touch pointers are used to touch the touch screen 110, and the fingers of the index finger, middle finger, and ring finger are used. The index finger, middle finger, and ring finger can be touched simultaneously or in different combinations. For example, you can touch only the middle finger or the index finger and the ring finger at the same time.

In the three-split touch region, the upper region is determined by the ring finger, the middle region by the middle finger, and the lower region by black. 'Combination of three fingers' constitutes a series of meanings by single or multi-touching a three-part touch area.

When the touch of the touch screen 110 is detected, the touch detector 120 determines the touch position and the touch holding time.

When the touch sensed by the three touch pointers is detected by the touch sensing unit 120, the braille input initialization unit 130 determines whether coordinate values corresponding to the touch positions are within a predetermined valid range. If the determination result is within the effective range, the braille input initialization unit 130 determines the touch area of the touch pointers and initializes the braille input. Here, the touch pointer means a means for touching a touch screen such as a finger.

The braille input initialization unit 130 will be described in more detail. When the braille input initialization unit 130 detects a touch by three touch pointers in the touch sensing unit 120, the braille input initialization unit 130 corresponds to touch positions. Acquire coordinate values. Since the touch screen 110 has a coordinate value according to the resolution, the braille input initialization unit 130 may obtain a coordinate value corresponding to the touch position.

Then, the braille input initialization unit 130 determines whether the obtained coordinate values exist within a predetermined valid range. Here, the effective range refers to an area in which the touch pointer may be naturally placed in a range consisting of partitions inclined diagonally by a predetermined angle (for example, 30 degrees) by dividing the touch area of the touch screen into three vertical axes.

As a result of the determination, when the coordinate values exist within a predetermined valid range, the braille input initialization unit 130 determines the touch area of the touch pointers and outputs a beep sound indicating the correct position to the speech synthesis processor 150. Transmit beep output request signal. In this case, the braille input initialization unit 130 performs a role of correcting and determining the vertical division region 3 based on the center touch region with the notification that the position is correct.

If the coordinate values are not within a predetermined valid range, the braille input initialization unit 130 outputs a warning sound indicating that the touch points of the touch pointers are not the correct position. 150).

For example, as shown in FIG. 2A, when the user touches three fingers of the index finger and the middle finger on the touch screen, the braille input initialization unit 130 may predetermine coordinate values corresponding to the touch positions. Determine whether it is within the specified valid range. When the determination result is within the effective range, the braille input initialization unit 130 divides the touch area of the touch screen into three vertical axes as shown in (b), and inclines the first area 210 and the second area inclined by a predetermined angle. 220) and the third region 230. The first region 210 may be a ring finger, the second region 220 may be a middle finger, and the third region 230 may be an area touched by an index finger.

The braille recognition unit 140 recognizes the braille based on the touch position combination and the touch holding time by the detected multi-touches when the multi-touch is detected while the initialization for the braille input is performed. Here, the multi-touch means that at least one touch pointer among three touch pointers is simultaneously touched.

The braille recognition by the multi-touch is based on a braille rule, and the touch pointer is released within a predetermined time after the multi-touch and the touch pointer is released beyond the predetermined time after the multi-touch.

The braille rules are shown in Table 1.

Looking at Table 1, each braille is a column of six dots. These 6 points consist of 3 points vertically and 2 points horizontally, and each number is assigned a number from 1 to 6. According to which of the six points protrudes, 63 different point shapes are generated, which are letters given meaning to the point shapes. In the case of Hangeul, the point forms are promised differently for Choseong, Vowel, and Jongsung.

The braille recognition unit 140 recognizes braille differently according to a case where the touch pointer is released within a predetermined time after the multi-touch and when the touch pointer is released after the predetermined time after the multi-touch.

For example, when the three fingers of the index finger, middle finger, and ring finger are used as the touch pointer, the braille recognition unit 140 recognizes the braille.

The braille recognition unit 140 touches the index finger and ends the touch within a predetermined time, 1 point, and only the middle finger touches the finger within 2 seconds after releasing the finger. To be recognized.

In addition, the braille recognition unit 140 exceeds four hours when only the index finger is touched and then releases the finger, and only 5 seconds when the finger is released after touching the middle finger. If you release your finger, it is recognized as 6 points.

In addition, the braille recognition unit 140 touches the index finger and the middle finger at the same time and then releases a finger within a predetermined time, and then touches the index finger and the ring finger simultaneously. If you release the finger within the specified time after touching only the ring finger and at the same time, 2 points and 3 points, the index finger, middle finger and ring finger will be recognized as 1, 2 and 3 points if you release the finger within the set time after touching it at the same time.

In addition, the braille recognition unit 140 touches the index finger and the middle finger at the same time and then releases the finger for more than a predetermined time. And 6 points, only middle finger and ring finger at the same time and then release the finger for longer than the set time. Six points are recognized.

The inverse point region unit 150 interprets the braille recognized by the braille recognition unit 140 as a character based on the braille table as shown in Table 1. At this time, the power point station 150 outputs the interpreted character on the touch screen.

That is, since a series of meanings are configured by the multi-touch of the touch pointers, the reverse point station 150 searches the Braille list for the interpretation thereof, takes the mapped text value, and outputs the text on the touch screen in sequence.

For example, when one point, three points, four points, five points and six points, one point, three points and five points, one point, three points and six points are recognized by the braille recognition unit 140, the station point The reverse part 150 interprets the recognized braille as a letter 'you'.

The speech synthesis processing unit 160 converts the text interpreted by the inverted station 140 to text data using a text to speech (TTS) engine and outputs the converted text data.

In addition, when the voice output request signal is received from the braille input initialization unit 130, the voice synthesis processor 160 outputs a signal sound that the corresponding position is normal.

In addition, when the output of the warning sound is requested from the braille input initialization unit 130, the speech synthesis processor 160 outputs a warning sound indicating that the corresponding position is not a normal position.

3 is a flowchart illustrating a method of inputting a text in a touch screen device for the visually impaired according to the present invention.

Referring to FIG. 3, when a touch by three touch pointers is detected (S202), the touch screen device obtains coordinate values of the detected touch positions (S204). The touch pointer refers to three fingers (for example, index finger, middle finger, ring finger) and the like.

After performing S204, the touch screen device determines whether the obtained coordinate values exist within a predetermined valid range (S206). The effective range refers to a predetermined range for initialization for braille input, and refers to a predetermined range of the touch screen. In addition, the effective range is divided into three divisions of the touch area in the vertical axis, consisting of a section inclined diagonally by a predetermined angle (for example, 30 degrees), it may be a range that can be most naturally placed three touch pointers. .

If it is within the effective range as a result of the determination of S206, the touch screen device determines a touch area of the touch pointers, outputs a beep sound indicating the correct position, and performs initialization for braille input (S208). At this time, the width of the touch area is flexible, but the width of the middle area in the three-part touch partition is always constant to match the determined size.

When the multi-touch is sensed after performing the step S208 (S210), the touch screen device recognizes the braille based on the touch position and the touch holding time by the multi-touch (S212). That is, when a single or multi touch is detected by the touch pointers, the touch screen device recognizes the braille according to the touch position combination and the touch holding time by the multi-touch.

Then, the touch screen device combines the recognized braille into a text (S214), and outputs the interpreted text as a voice while outputting on the touch screen (S216). That is, the touch screen device interprets the recognized braille as text based on a pre-stored braille list. Here, the letters refer to Korean, English, numbers, and symbols.

For example, a case of inputting the word 'you' in English will be described.

First, the 'you' braille notation is (y = 1 point, 3 points, 4 points, 5 points, 6 points), (o = 1 point 3 points 5 points), (u = 1 point 3 points 6 points).

The user touches three fingers at the same time to initialize the braille input. Then, the touch screen device outputs a beep sound notifying the correct position when the touched coordinate is within a predetermined effective range.

The user touches the index finger and ring finger at the same time and releases his hand immediately to enter 'y'. Then touch the index finger, middle finger and ring finger at the same time and let go. Then, the letter 'y' is input on the touch screen and output as a voice.

Next, touch the index finger and ring finger at the same time to release 'o' and let go. Then touch Stop again and let go after 1 second. Then, the letter 'o' is input on the touch screen and output as a voice.

Lastly, touch the index finger and ring finger at the same time to release 'u' and let go. Then touch the ring finger again and let go after 1 second. Then, the letter 'u' is input on the touch screen and output as a voice.

As such, those skilled in the art will appreciate that the present invention can be implemented in other specific forms without changing the technical spirit or essential features thereof. Therefore, the embodiments described above are to be understood as illustrative and not restrictive in all aspects. The scope of the present invention is shown by the following claims rather than the detailed description, and all changes or modifications derived from the meaning and scope of the claims and their equivalents should be construed as being included in the scope of the present invention. do.

100: touch screen device 110: touch screen
120: touch detection unit 130: Braille input initialization unit
140: braille recognition unit 150: inverted station
160: speech synthesis processing unit

Claims (9)

touch screen;
A touch detector configured to determine a touch position and a touch holding time when a touch of the touch screen is detected;
When the touch sensing unit detects a touch by three touch pointers, it is determined whether coordinate values corresponding to the touch positions are within a predetermined valid range, and when the touch range is within the valid range, each touch area of each touch pointer is determined. A braille input initialization unit for determining and performing initialization for braille input;
A braille recognition unit recognizing the braille based on the touch position and the touch holding time by the multi-touch when the multi-touch is detected while the initialization for the braille input is performed;
An inverted point region for interpreting the braille recognized by the braille recognition unit into a character based on a pre-stored braille table and outputting it on the touch screen; And
A speech synthesis processing unit converting the interpreted text into speech data using a text-to-speech engine and outputting the speech data;
Touch screen device for the visually impaired comprising a.
The method of claim 1,
The braille input initialization unit requests the voice synthesis processing unit to output a beep sound indicating that the touch position of each touch pointer is in the correct position when the coordinate values exist within a predetermined valid range, and at the same time, among the three touch areas. Touch for the visually impaired, characterized in that to correct the remaining touch area on the basis of the reference, and to output a warning sound indicating that the touch position of the touch pointer is not the correct position if it is not within the effective range. Screen device.
The method of claim 1,
When the initialization for braille input is performed, the touch screen is divided into three touch regions inclined by a predetermined angle with respect to a horizontal axis or a vertical axis, so that multi-touch by three touch pointers is possible. Touch screen device for.
The method of claim 1,
The braille recognition unit is a touch screen device for the visually impaired, characterized in that the braille according to the touch position and the touch holding time by the multi-touch is set in advance.
The method of claim 1,
And the braille recognition unit recognizes the braille differently depending on a case where the touch pointers are released within a predetermined time after the multi-touch and when the touch pointers are removed after the multi-touch.
The method of claim 1,
The inverted station inquiring of the braille list, the touch screen device for the visually impaired, characterized in that to take a character value mapped to the recognized braille and output characters on the touch screen in sequence.
In the method for inputting text on the touch screen device for the visually impaired,
(a) obtaining a coordinate value of the detected touch position when a touch by three touch pointers is detected;
(b) when the obtained coordinate value is within a predetermined valid range, determining a touch area of each touch pointer and outputting a beep sound indicating a correct position, and performing initialization for braille input;
(c) recognizing the braille based on the touch position and the touch holding time by the multi-touch when the multi-touch is detected while the initialization for the braille is performed; And
(d) interpreting the recognized braille into a text based on a braille list, and outputting the interpreted text as a voice while outputting the interpreted text on a touch screen;
Character input method in a touch screen device for the visually impaired comprising a.
The method of claim 7, wherein
In step (b),
When the coordinate values exist within a predetermined valid range, the touch screen device for the visually impaired, wherein the remaining touch areas are corrected and determined based on the center touch area among the three touch areas by the three touch pointers. Character input method
The method of claim 7, wherein
In step (b),
When the initialization for the braille input is performed, the touch screen is divided into three touch areas inclined by a predetermined angle with respect to the horizontal axis or the vertical axis to enable multi-touch by three touch pointers. Input method on a touch screen device.

Images