KR101898194B1 - Method for operating touch screen apparatus for incoming braille - Google Patents

Abstract

A touch screen device for inputting a braille and an operating method thereof are disclosed. According to an embodiment of the present invention, the touch screen device for inputting a braille includes a touch screen unit for sensing a touch of a user, an input unit for simultaneously receiving a plurality of touch points in a row unit of a matrix through the touch screen unit, and a braille recognition unit for recognizing the braille by the plurality of touch points. Accordingly, the braille input speed of the touch screen device can be increased.

Description

TECHNICAL FIELD [0001] The present invention relates to a method of operating a touch screen device for inputting braille characters,

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to a method of operating a touch screen device for inputting braille characters, and more particularly, to a method of operating a touch screen device for inputting braille characters capable of increasing the efficiency of input of braille characters in a touch screen.

A touch screen is a touch screen that allows a person to touch a character or a specific position on a screen (screen) without using a normal keyboard, It is a screen that allows input data to be received. Currently, touch screens are used in various fields such as computer devices, mobile communication terminals, kiosk terminals, and automobile AV systems.

Unlike the conventional physically configured button method, the touch screen can not recognize the touch feeling by the user's hand. Therefore, a user with a visual impairment or a user with poor eyesight is very inconvenient in recognizing a button inputted by him / her. Especially, as the smartphone becomes popular, the keyboard is displayed on the touch screen. In the case of the visually impaired user, it is difficult to input characters.

In order to solve such a problem of the touch screen, conventionally, when a keyboard displayed on a touch screen is focused with a finger, a device corresponding to the focused point is output by voice to assist the input. However, There is a limitation in touching the precise position on the touch screen.

In order to solve the above-mentioned problems, a touch screen device having a braille support function and a control method thereof are disclosed in Korean Patent Application No. 2016-1646742 filed by the same applicant. According to the present invention, there is provided a touch screen capable of receiving a braille character according to a touch position of a user by recognizing a single dotted line or two dotted lines according to the direction of use of the touch screen.

The conventional touch screen device and its control method provided with the braille support function are for easily and accurately inputting six points of braille on the touch screen and judge a user input position based on the border line and the horizontal line of the touch screen To do this, you must have a baseline or reference point.

For this reason, the conventional touch screen device and its control method provided with the braille support function require the user to touch the finger within a predetermined range, and the point touched by the user is moved in any direction of the upper, lower, There is a problem in that it is not easy to distinguish the belonging.

SUMMARY OF THE INVENTION The present invention has been made to solve the above-mentioned problems occurring in the prior art, and it is an object of the present invention to provide a touch- The present invention provides a method of operating a touch screen device for inputting braille characters.

The solution of the present invention is not limited to those mentioned above, and other solutions not mentioned can be clearly understood by those skilled in the art from the following description.

According to an embodiment of the present invention, there is provided a method of detecting a touch of a user, a method of simultaneously receiving a plurality of RBs in units of rows of a matrix through a touch screen, A method of operating a touch screen device for braille input, comprising the step of recognizing braille by a RBI point.

Preferably, the receiving step may receive a plurality of RBs sequentially from the first row to the last row in the matrix.

Preferably, when the braille recognition unit recognizes the braille character, it may further include outputting the character corresponding to the recognized braille by voice.

Also, preferably, the receiving step may receive two RBs at a time if the matrix is a 3 × 2 matrix.

Preferably, in the step of inputting, when a user touches the touch screen, a touch is recognized as a point when a touch occurs within a predetermined recognition time, and when a drag occurs, the touch is recognized as a blank, Input can be received.

Also preferably, the drag may be a drag from left to right.

The method may further include receiving a predetermined gesture after the user's touch is sensed through the touch screen.

Preferably, the gesture includes a deletion gesture by dragging from right to left direction, a line break gesture by dragging from top to bottom direction, a character type conversion by one touch that does not move beyond a predetermined recognition time, A gesture, and an on / off conversion gesture of the ASCII keyboard by two touches with no movement beyond a predetermined recognition time.

Preferably, when the gesture is input, the method may further include generating a haptic uniquely set for each gesture.

Preferably, when the gesture is input, performing the function corresponding to the input gesture and outputting the result of performing the function corresponding to the gesture may be output as a voice.

Also, preferably, the receiving step may receive three RBs at a time if the matrix is a 2x3 matrix.

Also, preferably, the receiving step recognizes the touch when the touch of the user is detected through the touch screen, and if there is no movement within a predetermined recognition time, recognizes the touch point as a point and recognizes another touch point not recognized as a point as blank A plurality of RB points can be input.

According to the present invention, the user can simultaneously input a plurality of RBs at one time, and the position of the RBs is determined in accordance with time and order from the RBs input first, thereby eliminating the need to set a reference for determining the position of the point And provides a method of operating a touch screen device for inputting a braille character whose speed of braille input is very high.

The effects of the present invention are not limited to those mentioned above, and other effects not mentioned can be clearly understood by those skilled in the art from the following description.

1 is a block diagram of a touch screen device for braille input according to a preferred embodiment of the present invention.
FIG. 2 is a view showing a currently used Hangul Braille notation table,
FIGS. 3A and 3B are diagrams for explaining an example of braille input in a touch screen device for braille input according to a preferred embodiment of the present invention; FIG.
4A and 4B are views for explaining another example of braille input in a touch screen device for braille input according to a preferred embodiment of the present invention,
5 is a flowchart illustrating a method of operating a touch screen device for braille input according to an exemplary embodiment of the present invention.

BRIEF DESCRIPTION OF THE DRAWINGS The above and other objects, features, and advantages of the present invention will become more readily apparent from the following description of preferred embodiments with reference to the accompanying drawings. However, the present invention is not limited to the embodiments described herein but may be embodied in other forms. Rather, the embodiments disclosed herein are provided so that the disclosure can be thorough and complete, and will fully convey the scope of the invention to those skilled in the art.

In this specification, when an element is referred to as being on another element, it may be directly formed on another element, or a third element may be interposed therebetween. Further, in the drawings, the thickness of the components is exaggerated for an effective description of the technical content.

Where the terms first, second, etc. are used herein to describe components, these components should not be limited by such terms. These terms have only been used to distinguish one component from another. The embodiments described and exemplified herein also include their complementary embodiments.

Also, when it is mentioned that the first element (or component) is operated or executed on the second element (or component) ON, the first element (or component) It should be understood that it is operated or executed in an operating or running environment or is operated or executed through direct or indirect interaction with a second element (or component).

It is to be understood that when an element, component, apparatus, or system is referred to as comprising a program or a component made up of software, it is not explicitly stated that the element, component, (E.g., memory, CPU, etc.) or other programs or software (e.g., drivers necessary to run an operating system or hardware, etc.)

It is also to be understood that the elements (or elements) may be implemented in software, hardware, or any form of software and hardware, unless the context requires otherwise.

Also, terms used herein are for the purpose of illustrating embodiments and are not intended to limit the invention. In the present specification, the singular form includes plural forms unless otherwise specified in the specification. The terms "comprises" and / or "comprising" used in the specification do not exclude the presence or addition of one or more other elements.

1 is a block diagram of a touch screen device for braille input according to a preferred embodiment of the present invention.

Referring to FIG. 1, a touch screen device 100 for braille input according to a preferred embodiment of the present invention includes a display unit 110, a touch screen unit 120, an input unit 130, a braille recognition unit 140, A haptic generator 150, a voice output unit 160, a storage unit 170, and a control unit 180.

The display unit 110 displays information or data to be displayed to the user under the control of the control unit 180. [ Structurally, the display unit 110 may provide a screen by laminating the touch screen unit 120. FIG.

The touch screen unit 120 senses the user's touch. More specifically, the touch screen unit 120 senses a touch of a user's finger or a pen for a touch screen to sense the touch position of the user, and can detect a touch position of the user. The touch screen unit 120 may include a capacitive type, an infrared type, , And an ultrasonic method.

When the touch of the user is detected through the touch screen unit 120, the input unit 130 receives the RB from the sensed touch of the user. Here, the input unit 130 receives two or three RBs at the same time according to the arrangement of the predetermined six point shapes, that is, the structure of the matrix.

More specifically, when six points are arranged in a 3x2 matrix, the input unit 130 can simultaneously receive two points at a time (hereinafter referred to as "two-point input method"), When arranged in a 2x3 matrix, the input unit 130 can simultaneously receive three RBs at a time (hereinafter referred to as "three-point input method").

As described above, according to the present embodiment, in the case of the two-point input method, the user can simultaneously input two RBs at one time using the two fingers, and in the case of the three-point input method, You can enter three RBs at a time.

Therefore, the two-point input method or the three-point input method according to the present embodiment can reduce the number of times of input in a remarkable manner, as compared with the conventional method of inputting only one RB at a time, so that it is possible to input braille quickly and conveniently.

The input unit 130 can receive two different types of RBs. More specifically, the input unit 130 recognizes a point by a touch point that the user touches the touch screen unit 120 without touching the finger within a predetermined recognition time, 120) and recognizes the blank space by dragging from left to right. By this action, the input unit 130 can receive the braille by 6 points.

Also, the input unit 130 can receive various gestures in addition to the two types of RBs. Gestures include things for other actions that are needed in addition to the two types of RBs for point and space input. Normally, when inputting a text, it requires operations such as deletion, correction, line replacement, keyboard conversion, and storage for smooth text entry.

When inputting braille characters, it is necessary to perform operations such as delete, modify, line change, keyboard change, and storage for inputting braille characters. In this embodiment, in order to facilitate such operations, ) Is called a gesture. That is, the gesture can manage other touches except for the input of characters among the touches inputted through the user.

For example, function keys provided in a program for inputting text in a computer, such as a Hangul program or a word program, can be provided as a gesture in the present touch screen device 100 due to the nature of a blind person. The gesture will be described later in more detail with reference to FIGS. 2A to 3B.

The braille recognition unit 140 recognizes the braille characters by a plurality of RB points received through the input unit 130. [ In the present embodiment, a plurality of, that is, two or three, RBs are inputted at one time.

In the case of the two-point input method, the braille recognition unit 140 recognizes one braille character when three RB points are input through the input unit 130, and recognizes one braille character by inputting three points Method recognizes one braille character when two RB points are input through the input unit 130. [ In other words, the braille recognition unit 140 combines the RBs input three times or two times when three or two RBs are input by a predetermined method out of the two-point input method or the three-point input method Recognize one Braille character.

More specifically, in order for one braille character to be input, all six point types must be input. In the case of the two-point input method, the braille recognition unit 140 recognizes the braille by combining two more R, that is, three pairs of RBs, which are further input two times in the order of time from the input of the first two RBs , And the input RBs can be recognized as different Braille characters. In addition, in the case of the three-point input method, the braille recognition unit 140 combines three RBs, which are input one more time in order of time from the input of the first three RBs, And recognizes the input RB as a different Braille character.

The haptic generating unit 150 generates a haptic (touch vibration) uniquely set for each gesture when a gesture is input through the touch screen unit 120 and the input unit 130 by a user's operation. By generating the haptic corresponding to each gesture in the haptic generating unit 150, the user can know whether or not the gesture input by the user is correctly inputted. That is, the haptic generated by the haptic generating unit 150 corresponds to a feedback function for convenience of the user.

The sound output unit 160 can output information to be provided to the user in the touch screen apparatus 100 by voice under the control of the control unit 180. [ There are various kinds of voices output from the voice output unit 160, and the user can select voices as desired.

In this embodiment, the sound output unit 160 outputs the character corresponding to the braille recognized by the braille recognition unit 140 as a voice so that the user can confirm whether or not the user has correctly input the desired character as braille characters.

Also, when the gesture is input through the input unit 130, the voice output unit 160 outputs a result of performing a function corresponding to the inputted gesture as a voice, so that the user can check whether the desired function is performed.

Preferably, the voice output unit 160 can read the character currently being combined (being input) and can read the completed character. Also, the voice output unit 160 can read the deleted character and the currently completed character each time a deletion job is input, and read the entire sentence when the line change operation is input. In addition, the voice output unit 160 can read the type of the keyboard to be switched by voice during the keyboard switching operation. In addition, the voice output unit 160 may output appropriate voice for each operation in view of convenience of use in consideration of the characteristics of the user who uses the touch screen apparatus 100.

The storage unit 170 may store all information necessary for the present touch screen apparatus 100 to recognize the braille and provide the corresponding function to the user. For example, the storage unit 170 recognizes the user's input according to the braille system recognition information on the braille screen provided through the touch screen unit 120 and the braille system recognition method, and stores the input information such as letters, numbers, symbols, Lt; / RTI > may be stored. In addition, the braille input by the user may be stored in the storage unit 170 as text data.

The controller 180 controls the overall functions of the touch screen apparatus 100 and includes a display unit 110, a touch screen unit 120, an input unit 130, a braille recognition unit 140, a haptic generation unit 150 ), The sound output unit 160, and the storage unit 170, as shown in FIG. The control unit 180 may provide a braille input function through the touch screen unit 120 based on the control program stored in the storage unit 170. [

The touch screen apparatus 100 includes the display unit 110, the touch screen unit 120, the input unit 130, the braille recognition unit 140, the haptic generation unit 150, the audio output unit 160 The display unit 110 and the touch screen unit 120, the haptic generating unit 150, and the audio output unit 160 are connected to a hardware element .

2 is a view showing a Hangul Braille notation table currently in use.

FIG. 2 shows the braille representing the Korean consonant. When one consonant indicates the leading and trailing consonants, it can be seen that the position of the corresponding braille among the six types of points is changed.

FIG. 2 shows only a part of the braille characters. In Korean, one of the 64 point types is used to write non-pointed spaces between the words. In addition, 63 points are formed by 13 consonant consonants, ) Consists of 14 consonants, 21 vowels, 27 abbreviations, 7 abbreviations, numbers, and punctuation marks.

In the present touch screen apparatus 100, the braille notation table is stored in the storage unit 170, and an operation related to the recognition of braille is performed. For this reason, it is possible to communicate smoothly with users who are familiar with the existing Braille system.

When the Hangul Braille notation table illustrated in FIG. 2 is used, 6 braille characters forming one consonant are arranged in a 3 × 2 matrix as shown in the figure, so that braille input can be performed by the two-letter input method.

3A and 3B are views for explaining an example of braille input in a touch screen device for braille input according to a preferred embodiment of the present invention.

FIG. 3 illustrates a form in which six point types are arranged in a 3x2 matrix, that is, a two-point input method. The braille consists of 6 points, 3 points in length and 2 points in width. In this arrangement, the three points on the left side are assigned unique numbers 1-2-3 sequentially from top to bottom, and the three points on the right side and the top down direction are sequentially assigned a unique number of 4-5-6 .

Typically, the braille character forms 64 different point types depending on the number and position of the points selectively embossed in a rectangular braille cell according to the letter system, and the sequential combination of these forms a problem system.

In the case where the touch screen device 100 adopts the two-point input method as shown in FIG. 3A, the RB as shown in FIG. 3B may be input through the touch screen unit 120 and the input unit 130. [

As shown in FIG. 3B, in the two-point input method, four kinds of RB points can be input. As described above, in the two-point input method, two RBs can be input at the same time.

In the present embodiment, the case where the user inputs the general touch is denoted by "? &Quot;, and the case where the drag is input is denoted by"? &Quot;. Since two RBs can be input at the same time, four types can be input through two RBs.

In the case of No. 1, it corresponds to (√ {square root over (√ {square root over (√ {square root over (√ {square root over (√ {square root over In this case, the input unit 130 recognizes two points.

In the second case, the user drags the two fingers at the same time to the touch screen unit 120 and the front finger from the left to the right, and the back finger corresponds to the case where the general touch is input (? In this case, the input unit 130 sequentially recognizes one blank and one point.

In the case of No. 3, the user corresponds to the case where two fingers are simultaneously pushed to the touch screen unit 120, the front finger inputs a general touch, and the rear fingers are dragged from left to right (?). In this case, the input unit 130 sequentially recognizes one point and one blank.

In the case of No. 4, it corresponds to the case where the user simultaneously drages two fingers from the left to the right (→→) on the touch screen unit 120. In this case, the input unit 130 recognizes two spaces.

In the two-point input method, when any one of the first to fourth cases is input from the user three times, the braille recognition unit 140 recognizes the braille characters by the two RBs input three times, that is, a total of six RBs .

4A and 4B are views for explaining another example of braille input in a touch screen device for braille input according to a preferred embodiment of the present invention.

FIG. 4A is a diagram illustrating a method of inputting three RBs at a time for faster braille input by compensating for the disadvantages of the commonly used two-point input method. .

In this case, a unique number 1-2-3 is sequentially assigned to three points on the upper side from left to right, and a unique number 4-5-6 is assigned sequentially from left to right on three points on the lower side .

FIG. 4B illustrates RBs that can be input by the user when using the three-point input method shown in FIG. 4A. In this embodiment, the case where the user inputs the general touch is denoted by "? &Quot;, and the case where the drag is input is denoted by" ", as in the previous embodiment, but the two-point input method and the three- There are differences in the way they are represented.

In the case of No. 1, it corresponds to (√ {square root over ()) when the user inputs all three fingers to the touch screen unit 120 and inputs the general touch. Thereby, the input unit 130 recognizes three points.

In the case of No. 2, it corresponds to (√ {square root over ()) when the user inputs the general touch by placing the first two fingers of the three fingers on the touch screen unit 120. Herein, since the input unit 130 is based on a three-point input method, it is recognized as a blank for one touch that is not input.

In the case of No. 3, it corresponds to (√) when the user inputs a general touch with the first finger of the three fingers on the touch screen unit 120. Also in this case, the input unit 130 recognizes the two untouched touches as blank.

In the case of No. 4, it corresponds to (√ {square root over (2)} when the user touches the middle and back fingers of the three fingers on the touch screen unit 120 and inputs a general touch. Here, the input unit 130 recognizes one touch that is not input as a blank.

In the case of No. 5, it corresponds to (√) when the user inputs a general touch with only the fingers of the three fingers on the touch screen unit 120. Here, the input unit 130 recognizes the two untouched touches as blank.

In the case of No. 6, a user dragged three fingers on the touch screen unit 120 in a downward direction (↓ ↓ ↓), which corresponds to a case where all three RBs are blank. Here, the input unit 130 recognizes one line as an entire space.

In the seventh case, the user dragged two fingers of the three fingers except for the middle finger from the top to the bottom (↓ ↓), which recognizes the first and third rubbers as blank and recognizes the middle rub Function key.

In the 8th case, the user drags the middle finger of the three fingers in the downward direction (↓), corresponding to the function key for recognizing the first and third RB as a dot and the middle RB as a blank do.

As described above, in the case of the three-point input method, unlike the two-point input method, since three RBs can be input at a time, the functions of the function keys can be intuitively designated in order to utilize them more effectively.

In FIG. 4B, the case of 6 through 8 can be an example of a function key designated intuitively. Utilizing this intuitively specified function key, gesture operation is reduced to a minimum and user can learn easily.

In the two-point input method, the user has to input the RB three times in order to input one Braille character. On the other hand, in the three-point input method, three RBs can be input at one time, A braille character can be input.

5 is a flowchart illustrating a method of operating a touch screen device for braille input according to an exemplary embodiment of the present invention.

Hereinafter, a method of operating a touch screen device for braille input according to a preferred embodiment of the present invention will be described with reference to FIGS. 1 to 5. FIG.

When a user desires to input Braille characters using the touch screen apparatus 100, the user can select two braille characters according to the input method (two-point input method or three-point input method) prescribed in the screen, that is, Or touches three fingers, and if a character is desired to be input, a touch for braille input corresponding to the character to be input is performed (S200).

When the user inputs general touch or drag through the touch screen unit 120, the input unit 130 receives a plurality of RB points from the touch screen unit 120 (S210). In this case, when the touch screen apparatus 100 adopts the two-point input method, two RBs are input at a time, and when the three-point input method is adopted, three RBs are input at a time.

When inputting the six point types through the touch screen unit 120 and the input unit 130 is completed by the user's operation, the braille recognition unit 140 recognizes the braille characters by a plurality of RBs received at step S220.

The braille character recognized by the braille recognition unit 140 outputs the character or sentence as a voice by the voice output unit 160 so that the user can determine whether the user has input a correct character or sentence (S230).

The user can easily determine whether a character or a sentence inputted by the user is correctly inputted (S240). Here, if the character or sentence inputted by the user is correctly inputted (S240-Y), the user inputs a gesture corresponding to "save " and stores the inputted character or sentence (S250).

If the character or sentence output through voice is different from the character or sentence that the user wants to input in step S240, the user inputs a gesture corresponding to "delete" or "correction" (S260). Here, the modified character or sentence can be stored by the user's choice.

By this procedure, the touch screen apparatus 100 can simultaneously receive two or three points of RB at a time from the user. Therefore, it is possible to provide a quick feeling of speed compared with a conventional method of inputting only one RB at a time. Particularly, in the case of the two-point input method, since the user is using the state of the dot-like arrangement similar to the method used in the past, the user can use it without any training procedure. Also, in the case of the three-point input method, there is an advantage that a faster speed feeling can be provided than in the case of the two-point input method.

It will be understood by those skilled in the art that the present invention may be embodied in other specific forms without departing from the spirit or essential characteristics thereof. Therefore, it should be understood that the above-described embodiments are illustrative in all aspects and not restrictive. The scope of the present invention is defined by the appended claims rather than the detailed description and all changes or modifications derived from the meaning and scope of the claims and their equivalents are to be construed as being included within the scope of the present invention do.

100: touch screen device 110:
120: touch screen unit 130: input unit
140: Braille recognition unit 150: Haptic generation unit
160: audio output unit 170: storage unit
180:

Claims (12)

A method of operating a touch screen device capable of inputting braille by six point shapes formed in the form of a matrix,
Sensing a user's touch;
Receiving a plurality of RBs simultaneously on a row-by-row basis of the matrix through a touch screen; And
And recognizing the braille characters by the plurality of RBs inputted,
The method as claimed in claim 1, wherein when the user touches the touch screen and receives a touch having no movement within a predetermined recognition time, Wherein the touch panel device receives a touch point of the touch screen device. The method according to claim 1,
Wherein the receiving step sequentially receives the plurality of RBs from the first row to the last row in the matrix. The method according to claim 1,
And outputting a character corresponding to the recognized braille by voice when the braille is recognized in the step of recognizing the braille. The method according to claim 1,
Wherein the receiving step receives two RBs at a time when the matrix is a 3 × 2 matrix. delete The method according to claim 1,
Wherein the drag is a drag from left to right. ≪ RTI ID = 0.0 > 15. < / RTI > The method according to claim 1,
Further comprising: receiving a predetermined gesture after the touch of the user is sensed through the touch screen. 8. The method of claim 7,
The gesture may include a delete gesture by dragging from right to left, a line break gesture by dragging from top to bottom, a one-touch character type conversion gesture that does not move beyond a preset recognition time, And an on / off conversion gesture of the ASCII keyboard by two touches that do not move beyond a predetermined recognition time. 9. The method according to claim 7 or 8,
And generating haptics that are uniquely set for each gesture when the gesture is input. ≪ Desc / Clms Page number 19 > 8. The method of claim 7,
Performing a function corresponding to the input gesture when the gesture is input; And
And outputting a result of performing a function corresponding to the gesture as a voice to the touch screen device. The method according to claim 1,
Wherein the receiving step receives three RBs at a time when the matrix is a 2x3 matrix. 12. The method of claim 11,
The receiving step recognizes the touch when the touch of the user is detected through the touch screen and then moves within a predetermined recognition time, and recognizes another touch point not recognized as the touch point as a blank Wherein the plurality of RB points are input to the touch screen device.

Images