WO2018124564A1

WO2018124564A1 - Vibrational braille system and method for implementing vibrational braille on basis of touchscreen

Info

Publication number: WO2018124564A1
Application number: PCT/KR2017/014803
Authority: WO
Inventors: 임승혁; 김수현; 임담혁
Original assignee: 고려대학교 산학협력단
Priority date: 2016-12-28
Filing date: 2017-12-15
Publication date: 2018-07-05
Also published as: KR101848184B1

Abstract

According to one embodiment of the present invention, a vibrational braille system applicable to a touchscreen-based electronic device comprises: a matching unit in which a vibration pattern source corresponding to braille including six dots, which are deciphered in order from first to third rows of a first column and then first to third rows of a second column, is preset and a file text is matched with the vibration pattern source when the electronic device recognizes the file text; a vibration unit for outputting vibrations according to the vibration pattern source to a touchscreen; and a motion detection unit for detecting a first touch motion according to a contact with the touchscreen and a second touch motion consecutive to the first touch motion, wherein the first touch motion is a motion for detecting the presence/absence of a dot on the first row of the braille according to the presence/absence of vibrations during contact with the touchscreen, the second touch motion is a motion for detecting the presence/absence of dots on the second and third rows of the braille according to the presence/absence of vibrations, the length of vibrations, and the frequency of vibrations during contact with the touchscreen, and it is preferable that the vibration pattern source is a vibration signal which, according to a braille interpretation order, vibrates when a dot exists on a corresponding point, does not vibrate when no dot exists on the corresponding point, vibrates as short as the number of consecutive dots when the consecutive dots exist on a corresponding point, and vibrates long when a corresponding point is the third row, a dot exists on the third row and a dot does not exists on the second row.

Description

Vibration Braille System and Touch Screen Based Vibration Braille Implementation Method

The present invention relates to a vibration braille system and a touch screen-based vibration braille implementation method, and in detail, visual information expressed on a touch screen is represented by a physical tactile vibration braille so that visually impaired people can utilize a general-purpose device based on a touch screen. The present invention relates to a vibration braille system and a touch screen based vibration braille implementation method.

In the near future, it is expected that the era of so-called Internet of Things (IOT), which goes beyond simple IT technology, is coming, and its development speed is getting faster. In fact, as of 2010, the number of devices connected to the Internet has surpassed 2 billion and is expected to be more than 20 billion by 2020.

In order to use the IoT, most users can simultaneously transmit and receive information using a touch screen. In other words, touch-based displays will be attached to many things in the future, and they will serve as remote controllers as well as display visual information.

However, the touch screen-based device not only transmits signals using vision, but also cannot display physical uneven braille on the screen surface. As a result, the visually impaired people who cannot use vision have not been able to use all general-purpose electronic devices equipped with general touch screens including smartphones and tablet PCs, and the inconveniences will increase further in the future.

In addition, mainstream information communication devices and systems such as telephones, TVs, the Internet, and the like are often incompatible with existing visual aids such as screen readers and braille information terminals. In today's technology, the speed of development is so fast that even if the auxiliary equipment is made by applying the information and communication technology of the time, it does not meet the new technology trend and becomes useless. This problem prevents people with disabilities from fully enjoying the benefits of the new technology.

Meanwhile, with the development of modern technology, books printed on paper have been widely distributed through e-books. E-books can be easily accessed through tablets or various smart devices, and can hold a number of books in one device, so they can be read anywhere without restrictions such as volume or weight. Visually impaired people can also translate textbooks into electronic Braille and easily access them through general-purpose devices such as mobile phones, but because of the very limited demand for consumers, not only e-book devices but even common devices such as mobile devices are valuable. The reality is that expensive devices for the visually impaired should be used.

Existing screen technology for the blind is focused on providing physical tactile information such as braille through deformation of the display surface itself. Visually impaired people have to purchase and use a dedicated terminal rather than a general purpose product when using the display device. Due to insufficient demand, the device is more expensive and difficult to obtain than a general purpose product of the same performance.

In addition, although a terminal or a voice service for converting a visual signal into an audio signal has been released, it is difficult to apply to a web-based hyperlink interface. In addition, when the voice is provided to the external speaker, it is difficult to keep personal information such as banking because it is also heard by the surrounding people.

In the case of a technique for converting a visual signal into an electrical stimulus by applying an electrical stimulus at each point of a braille pattern, the stimulus is relatively insignificant, and there is a disadvantage in that the stimulus is blurred at the boundary of each point. In addition, as the stimulus of the same size and pattern is repeated, the stimulus is easily fatigued, and thus, the recognition of the pattern is difficult.

Korean Patent Publication No. 1020100019686 discloses a braille information terminal based on RF communication. A braille information terminal based on RF communication is a technology in which two or more vibrators contact a body part (finger, waist, and arm) of a visually impaired person to transmit braille information through a braille type vibration. Braille information terminal based on RF communication is convenient to deliver 6 Brailles by applying vibration stimulation directly to the body, but complex vibration pattern gives several vibration stimulation at the same time, so it is difficult for the disabled to distinguish practically. There is a problem that can be difficult to distinguish between complex braille patterns.

Meanwhile, Korean Patent Registration No. 10-1360828 discloses a glove type vibrating braille output device. Armored vibration braille output device is a technology that allows the user to conveniently recognize the six braille through the vibration tactile by mounting six vibration units on the back of the hand or palm of the glove. Armored type vibration type braille output device is a simple vibration method, so it is difficult to distinguish complex braille patterns, and the tactile surface has a problem that the sensitivity of the tactile sense decreases because the area is wider than the fingertips.

It is an object of the present invention to provide a vibrating braille system in which visual information represented on a touch screen is represented by a vibrating braille that is physical tactile, so that visually handicapped people can use a touch screen-based general purpose device.

The present invention provides a vibration braille system and a touch screen-based vibration braille implementation method that can easily express the braille of various patterns according to the number of vibrations, the length or the presence of vibration by controlling the operation of the vibration unit embedded in the electronic device It aims to do it.

In one embodiment of the present invention, the vibration braille system applicable to a touch screen-based electronic device corresponds to a braille consisting of six dots decoded in the order of one row to three rows in one column, and then one row to three rows in two columns. A matching unit configured to preset a vibration pattern source and match the file text to the vibration pattern source when the file text is recognized by the electronic device; Vibration unit for outputting the vibration according to the vibration pattern source to the touch screen; And a motion sensing unit configured to detect a first touch motion in contact with the touch screen and a second touch motion continuous to the first touch motion, wherein the first touch motion is braille depending on whether or not vibration occurs in contact with the touch screen. This motion detects the presence or absence of dots in the first row, and the second touch motion senses the presence or absence of vibration in contact with the touch screen, the presence or absence of vibration in the second and third lines of the braille according to the length of the vibration and the number of vibrations. The vibration pattern source is vibrated when there is a point in the corresponding position according to the decoding order of the braille, and when there is no point in the corresponding position, it is vibrated. It is preferable that the vibration signal is long and vibrates when there are three lines, and there are dots on three lines and no dots on two lines.

In one embodiment of the present invention, the vibration pattern source, according to the braille decoding order, if there is a dot in one row and there are no dots in two rows and three rows, there is a short vibration in the first touch motion, and in the second touch motion If there is no vibration, there are no points in one row and there are points in two rows and three rows, if there is no vibration in the first touch motion and there are two short vibrations in the second touch motion, there are points in one and three rows and there are no points in two rows, If there is one short vibration in one touch motion, and one long vibration in the second touch motion, and there are no dots in one row and three rows, and there are dots in two rows, it is vibration-free in the first touch motion and short vibration in the second touch motion 1 If there are no dots in 1 to 3 rows, the first touch motion and the second touch motion are vibrationless, and if there are no dots in the 1 and 2 rows and there are dots on the 3 rows, the first touch motion is vibration-free and the second touch It is preferable that the vibration signal is one long vibration in motion.

In one embodiment of the present invention, the vibration pattern source, according to the Braille decoding order, if there are dots in one row and two rows and there are no dots in three rows, the vibration pattern source is two short vibrations in the first touch motion, and rows 1 to 3 If there is a dot, it is preferable that the vibration signal is three short vibrations during the first touch motion.

In one embodiment of the present invention, according to the Braille decoding order is converted to the number 1 if there is a dot in the corresponding place, the number 0 if there is no dot in the place, 6-digit braille code consisting of a combination of number 0 and number 1 for each braille Further includes a preset conversion unit, and the 6-digit braille code is assigned to the first to third rows of rows 1 to 3 in units of braille columns, and the conversion unit automatically converts the file text into the braille code. desirable.

In one embodiment of the present invention, the vibration pattern source is oscillated at the number 1 of the braille code, oscillated at the number 0 of the braille code, and vibrated as short as the number of times arranged if the number 1 is arranged continuously, and the number 0 is continuous. If there is a first touch motion and a second touch motion, it is vibration-free, and if there is a number 1 in the first and third digits and the number 0 in the second digit, the first touch motion is one short vibration and the second touch motion is performed. If there is one long vibration,

number

1 and 3 with the number 0 and number 2 with the number 1, then there is no vibration in the first touch motion and one short vibration in the second touch motion. If there is a number 0, and the number 1 in the third position, it is preferable that the vibration signal is vibrationless during the first touch motion, and one long vibration in the second touch motion.

In one embodiment of the present invention, if there is a number 1 in the first and second digits, and the number 0 in the third digit, two short vibrations in the first touch motion, the number in the first to third consecutive positions If 1, it is preferable that the vibration signal is three short vibrations in the first touch motion.

Meanwhile, the method of implementing a touch screen based vibration braille includes: A) an electronic device in which a vibration pattern source corresponding to the braille consisting of six dots that are decoded in the order of 1 to 3 rows of 1 column, and then 1 to 3 rows of 2 columns is preset. In which the file text is searched; B) matching the file text with the vibration pattern source; C) when the first touch motion and the second touch motion continuous to the first touch motion are detected on the touch screen, outputting the vibration of the vibrating unit to the touch screen according to the vibration pattern source; And D) if the first touch motion is not detected on the touch screen, the vibration of the vibrating unit according to the vibration pattern source is not output to the touch screen. Therefore, the motion of detecting the presence or absence of dots in one row of braille, and the second touch motion is the presence or absence of vibration in contact with the touch screen, the presence or absence of dots in two or three rows of braille depending on the length of the vibration and the number of vibrations. The vibration pattern source is a vibration pattern source is vibrated if there is a point in the corresponding position according to the braille decoding order, if there is no point in the corresponding position, it is vibrated as short as the number of consecutive points. If the seat is 3 rows, there are dots on 3 rows, and there are no dots on 2 rows, it is preferable that the vibration signal be a long vibration.

In one embodiment of the present invention, the vibration pattern source, according to the braille decoding order, if there is a dot in one row and there are no dots in two rows and three rows, there is a short vibration in the first touch motion, and in the second touch motion If there is no vibration, there are dots in one and three rows and there are no dots in two rows, there is one short vibration in the first touch motion, one long vibration in the second touch motion, and there are no dots in the first and third rows, If there is a point, there is no vibration in the first touch motion and one short vibration in the second touch motion, and if there are no points in the first to third lines, the point is vibrationless in the first touch motion and the second touch motion, and the points are in the first and second rows. And if there are no dots in 3 rows, there are 2 short vibrations in the first touch motion, and if there are dots in 1 to 3 rows, there are 3 short vibrations in the first touch motion, there are no dots in 1 and 2 rows and there are dots in 3 rows. If present, it is preferably a vibration signal which is non-vibrating during the first touch motion and that is one long vibration during the second touch motion.

In an embodiment of the present invention, in step (A), if the file text is not searched in the electronic device, it is preferable to further include the step of outputting voice information about the search impossible in the electronic device.

In one embodiment of the present invention, the electronic device is converted to the number 1 if there is a point in the corresponding position according to the decoding order of the braille, and the number 0 if there is no point in the place, 6 digits consisting of a combination of the number 0 and number 1 for each braille The braille code of is set in advance, and the 6-digit braille code is assigned to the first to third digits of the first to third lines in column units of the braille. After the conversion, the braille code is matched to the vibration pattern source, and the vibration pattern source is vibrated at number 1 of the braille code, is oscillated at number 0 of the braille code, and vibrates as short as the number of times arranged if the number 1 is arranged consecutively. If the number 0 is continuous, the first touch motion and the second touch motion are vibration-free even if there are the first touch motion and the second touch motion. Long Jeans in 2nd Touch Motion If it is 1 time, there are number 0 in the 1st and 3rd digits, and the number 1 in the 2nd digit, there is no vibration in the 1st touch motion and 1 short vibration in the 2nd touch motion. If there is 0 and the number 1 is in the 3rd position, it is vibration-free in the first touch motion, there is one long vibration in the second touch motion, the number 1 is in the 1st and 2nd positions, the number 0 is in the 3rd position. If present, if the first touch motion is two short vibrations, and if the number 1 is consecutive to the first to third positions, it is preferable that the vibration signal is three short vibrations during the first touch motion.

According to the present invention, visual information represented on a touch screen is represented by a physical tactile vibration braille so that a visually-impaired person can utilize a touch screen-based general purpose device.

The present invention can easily express the braille of various patterns according to the number of vibrations, length or period by controlling the operation of the vibration unit built in the electronic device, it is possible to fast signal transmission. Because of this, the present invention can help visually impaired people to recognize the visual information of the smartphone. As a result, the present invention can enable the use of a smartphone for the visually impaired.

The present invention can be useful for the public interest of society if it is used to introduce an electronic textbook for education of children or students with visual impairment by converting text such as e-book into Braille.

The present invention is applied to smart home systems, such as energy consumption devices (water, electricity, heating and heating), security devices (door locks, surveillance cameras, etc.), including home appliances, converts the visual information of the touch screen to vibrating braille, People with disabilities can also use general-purpose displays, improving the quality of life for the visually impaired.

The present invention implements the vibration braille by adjusting the vibration motor existing in the smart watch, as a result, the visually impaired people to recognize the time or information displayed on the smart watch, so that even the visually impaired can use the smart watch. have.

The present invention is applied to the bank ATM machine, using the same touch screen as the general person, it is possible to recognize the information on the screen by vibrating stimulation that only the visually impaired people who touch the screen can reduce the risk of information leakage.

Figure 1 (a) is a braille table according to the letters, Figure 1 (b) shows the Braille reading order.

2 schematically illustrates a configuration of a vibration braille system according to an embodiment of the present invention.

Figure 3 shows an example of the long and short, presence and frequency of the vibration according to the vibration pattern source.

4 shows the number of cases of braille points.

5 exemplarily illustrates how the present invention is expressed in a touch screen-based electronic device.

Figure 6 schematically illustrates the principle of braille code generation according to a preferred embodiment of the present invention.

7 schematically illustrates a flowchart of a method of implementing a touch screen based vibration braille according to an embodiment of the present invention.

Hereinafter, with reference to the accompanying drawings, a description will be given of a vibration braille system and a touch screen-based vibration braille implementation method according to an embodiment of the present invention.

● 진동점자시스템Vibration Braille System

First embodiment

Figure 1 (a) shows the braille according to the letter. As shown in Fig. 1 (b), Braille is 1, 2, and 3 points in the order of 1 row to 3 rows of 1 column, followed by 4, 5, and 3 points in the order of 1 row to 3 rows of 2 columns. 6 points will be awarded. Braille decoding order is decoded from 1 to 6 points. Braille is a blind character that is read with a finger on a raised point on the ground.

Vibration Braille system according to an embodiment of the present invention is to implement a braille in a vibration manner in a touch screen-based electronic device. That is, the present invention outputs the braille in a vibrating manner through the touch screen, so that even the visually impaired may use a touch screen-based electronic device. Electronic devices based on touch screens can be applied to various products such as smartphones, tablet PCs, bank ATMs, smart watches, and home appliances.

As shown in FIG. 2, the present invention includes a touch screen 110, a motion detection unit 120, a controller 130, a vibration unit 140, and a matching unit 150.

The motion detector 120 detects the first touch motion and the second touch motion over the entire area of the touch screen 110. The motion detector 120 may detect a touch motion of the user, no matter what portion of the touch screen 110 the user touches.

The first touch motion is a motion for detecting the presence or absence of a dot in one row of braille according to the presence or absence of vibration in contact with the touch screen. The second touch motion is a motion for detecting the presence or absence of vibrations in contact with the touch screen, the presence or absence of vibrations, the length of the vibrations, and the number of vibrations. As the second touch motion, a drag operation may be taken as an example, but is not necessarily limited to the drag operation.

The vibrator 140 is a component embedded in the electronic device. The vibrator 140 is configured to output a vibration to the touch screen 110. The vibration unit 140 is vibrated according to the vibration pattern source. The operation of the vibrator 140 is controlled by the controller 130.

The controller 130 controls the operation of the vibrator 140 when the first touch motion is sensed by the motion detector 120. The vibration unit 140 outputs vibrations according to the vibration pattern source. On the other hand, if the first touch motion is not detected by the motion detector 120, the controller 130 controls the vibrator 140 to not operate.

The matching unit 150 matches the file text with the vibration pattern source when the file text is recognized by the electronic device. The matching unit 150 is set in braille and vibration pattern source corresponding to the character. The vibration pattern source is realized by the presence or absence of vibration, the short and long duration of the vibration, and the number of vibrations in the order of decoding the first column of braille and then the second column.

As shown in FIG. 3, the vibration pattern source is vibrated when there is a point in the corresponding position according to the decoding order of the braille, and is vibrated when there is no point in the corresponding position. The vibration pattern source vibrates as short as the number of continuous points if there are continuous points in the corresponding position.

The vibration pattern source has a vibration pattern as follows according to the braille decoding order. 4 shows the number of cases of braille points.

First, in FIG. 4A, when there are dots in one and three rows of braille and no dots in two rows, the vibration pattern source is vibrated briefly in the first touch motion and long in the second touch motion. This corresponds to the vibration pattern source representing the second column (right) decoding order of the initial "j" in FIG. 1 (a).

In the case of FIG. 4 (a), since the first braille signal is received during the first touch motion of the user, the short vibration is performed once, and the long vibration is performed once for the signal of the braille signal ③ at the second touch motion. The touch screen 110 is output from the 140. This position ③ is to give the user an intuitive meaning of the final braille, by using a long vibration can be avoided confusing whether it is ② or ③ times.

As shown in FIG. 4 (b), if there are dots in one and two rows of braille and no dots in three rows, the vibration pattern source is two short vibrations in the first touch motion. This corresponds to a vibration pattern source representing the first column (left) decoding order of the vowel " '"

In the case of FIG. 4B, the vibration pattern source is two short vibrations in the first touch motion. In the case of FIG. 4 (b), the first vibration is a short vibration once in accordance with the basic principle, but since the braille is continuously underneath, there are two short vibrations in the first touch motion.

Therefore, the user can easily recognize that there are two consecutive braille points at ① and ②, and since there is no long vibration, the user can know that the braille does not exist at the bottom ③. That is, braille information up to # 3 can be recognized even if the second touch motion does not move downward, thereby enabling fast braille recognition.

As shown in Fig. 4 (c), when there are no dots in the first row of braille and there are dots in the second row and the third row, the vibration pattern source is vibrationless in the first touch motion and two short vibrations in the second touch motion. This corresponds to the vibration pattern source representing the two-column (right) decoding order of the initial "ts" of FIG. 1 (a).

In the case of FIG. 4C, the vibration pattern source is non-vibrating in the first touch motion, and two short vibrations in the second touch motion. In the case of FIG. 4 (c), two braille points are present in the same manner as in FIG. 4 (b), but are present in ②, ③ instead of ①, and there is no vibration during the first touch motion, and the user touches the second touch motion. Only two consecutive short vibrations will come. Therefore, the user can know that two braille points are continuously present at the

positions

② and ③.

As shown in FIG. 4 (d), if there are dots in one row of braille and no dots in two and three rows, the vibration pattern source is one short vibration in the first touch motion and no vibration in the second touch motion. This corresponds to a vibration pattern source representing the first column (left) decoding order of the final "a" in FIG. 1 (a).

In the example shown in FIGS. 4 (d) to 4 (f), one short vibration may all be confusing to the user. However, in the case of FIG. 4 (d), since the braille exists only at position ①, the first short vibration occurs during the first touch motion, and there is no vibration when the second touch motion is performed. You can see that Braille exists.

As shown in Fig. 4 (e), if there are no dots on the first and third lines of the braille and there are dots on the second row, the vibration pattern source is vibrationless in the first touch motion and one short vibration in the second touch motion. This corresponds to the vibration pattern source representing the first column (left) decoding order of the initial "c" of FIG. 1 (a).

As shown in FIG. 4 (f), when there are no dots in the first and second rows of braille and there are dots in the third row, the vibration pattern source is vibrated in the first touch motion and vibrates long in the second touch motion. This corresponds to the vibration pattern source representing the second column (right) decoding order of the initial "s" of FIG. 1 (a).

4 (e) and 4 (f), both have no braille in the ① position, so there is no vibration during the first touch motion, and one vibration when the second touch motion is performed. However, in this single vibration, it can be confusing to find where braille is located in ② or ③. In order to solve this problem, the present invention is divided into vibration lengths, and FIG. 4 (e) is set to one short vibration at position ②, and FIG. 4 (f) is set to one long vibration at position ③.

This can give a feeling that the braille exists at a position passing by the user when the point is present in ② as shown in Fig. 4 (e), and the point is present at the position ③ as shown in Fig. 4 (f). In this case, long vibrations are given to give an intuitive meaning of the final braille.

As shown in FIG. 4 (g), when all of the rows 1 to 3 of the braille have a dot, the vibration pattern source has a pattern in which three consecutive short vibrations are repeated during the first touch motion. This corresponds to a vibration pattern source representing the first column (left) decoding order of the vowel " '"

In the case of FIG. 4 (g), since the braille is displayed from ① to ③ in three consecutive short vibrations during the first touch motion, the second touch motion does not need to be downward. And, in the present invention, two short vibrations are automatically displayed when there are two consecutive braille signals as shown in FIGS. 4 (b) and 4 (c).

On the other hand, although not shown in Figure 4, if there are no dots in the first row and the third row of the braille, the vibration pattern source is vibration-free during the first touch motion and the second touch motion. This corresponds to the vibration pattern source representing the first column (left) decoding order of the initial "s" of FIG. 1 (a).

Second embodiment

The present invention includes a touch screen 110, a motion detection unit 120, a matching unit 150, a vibration unit 140, and a control unit 130. The touch screen 110, the motion detection unit 120, the vibration unit 140, and the control unit 130 according to the present embodiment may include the touch screen 110, the motion detection unit 120, and the vibration of the first embodiment. The same as that of the eastern portion 140 and the controller 130, the description thereof will be omitted below.

However, unlike the first embodiment described above, the vibration braille system according to the present embodiment further includes a conversion unit.

The conversion unit automatically converts the file text into braille code. The braille code is preset in the converter. The Braille code is a 6-digit array consisting of a combination of

numbers

0 and 1 in Braille. The 6-digit braille code is assigned to the first to third digits in rows 1 to 3 in the unit of the braille column.

In the matching unit 150, the braille code converted in the conversion unit is matched with the vibration pattern source.

When the braille code is preset in the electronic device, the vibration pattern source is set to vibrate at number 1 of the braille code. The vibration pattern source is set to be vibration-free at the number zero in the braille code. When the number 0 is continuous, the vibration pattern source is not vibrated even if there is a first touch motion and a second touch motion.

In addition, the vibration pattern source is set to vibrate as short as the number of times arranged when the number 1 is arranged continuously. If the vibration pattern source has the number 1 in the first and second digits and the number 0 in the third digit, it is set to two short vibrations in the first touch motion. The vibration pattern source is set to three short vibrations during the first touch motion when the number 1 is continuously present in positions 1 to 3.

When the vibration pattern source has the number 1 in the first and third digits and the number 0 in the second digit, the vibration pattern source is set to one short vibration in the first touch motion and one long vibration in the second touch motion. When the vibration pattern source has the number 0 in the first and third digits and the number 1 in the second digit, the vibration pattern source is set to one vibration in the first touch motion and one short vibration in the second touch motion. When the vibration pattern source has the number 0 in the first and second digits and the number 1 in the third digit, the vibration pattern source is set to one long vibration in the first touch motion and one long vibration in the second touch motion.

For example, if the braille code is 100, the vibration pattern source is vibration-free in the second touch motion once in a short vibration in the first touch motion. If the braille code is 110, the vibration pattern source is two short vibrations in the first touch motion. If the braille code is 111, three short vibrations are performed during the first touch motion.

If the braille code is 011, the vibration pattern source is vibrationless in the first touch motion and two short vibrations in the second touch motion. If the braille code is 010, the vibration pattern source is non-vibrating in the first touch motion and one short vibration in the second touch motion. If the braille code 001, it is vibration-free in the first touch motion and a long vibration in the second touch motion.

In the case of the braille code 101, the vibration pattern source is one short vibration in the first touch motion and one long vibration in the second touch motion. If the braille code is 000, the vibration pattern source is vibrated even with the first touch motion and the second touch motion.

Hereinafter, referring to the braille table of FIG. 1 (a), a braille code according to braille and an example of converting a braille code into a vibration pattern source will be described.

For example, the initial "a" in FIG. 1 (a) has only four points out of six points. Thus, according to the braille code generation principle shown in Fig. 6, the braille code of the initial "a" is "000100". The braille code 000100 is implemented with a vibration pattern source for 000 in a first touch motion, and then a vibration pattern source for 100 in a new first touch motion. The vibration pattern source for the braille code 000 is vibrationless in both the first touch motion and the second touch motion, and the vibration pattern source for the braille code 100 is briefly vibrated once in the first touch motion and vibrationless in the second touch motion.

As another example, the initial "c" in FIG. 1 (a) has points at two and four points out of six points. According to the braille code generation principle shown in FIG. 6, the braille code of the initial "c" is "010100". The braille code 010100 is implemented with a vibration pattern source for 010 in a first touch motion, and then a vibration pattern source for 100 in a new first touch motion. The vibration pattern source for the braille code 010 is vibrationless in the first touch motion and one short vibration in the second touch motion, and the vibration pattern source for the braille code 100 is one short vibration in the first touch motion and the second touch motion City is vibration free.

As another example, the vowel “ㅏ” in FIG. 1 (a) has points at one, two and six points among six points. According to the braille code generation principle, the braille code of the initial "ㅏ" is "110001". In the braille code 110001, the vibration pattern source for the first touch motion 110 is implemented, and then the vibration pattern source for the new first touch motion 001 is implemented. The vibration pattern source for the braille code 110 is two short vibrations in the first touch motion, and the vibration pattern source for the braille code 001 is one long vibration in the non-responsive second touch motion in the first touch motion.

● 터치스크린 기반 진동점자 구현방법● How to implement vibration braille based on touch screen

Hereinafter, a method for implementing a touch screen based vibration braille according to an embodiment of the present invention will be described with reference to FIG. 7.

The touch screen-based vibration braille implementation method is implemented in a touch screen-based electronic device. The vibration pattern source corresponding to the braille is preset in the electronic device. Braille consists of six dots that are read in row 1 to row 3, followed by row 1 to row 3 in column 2.

First, a file text desired by a user is searched for in an electronic device (S1). If the file text is not searched in the electronic device, voice information regarding the search impossible is output from the electronic device (S2).

When the file text is recognized by the electronic device, the file text is converted into a braille code by the matching unit 150 of the electronic device, and then converted into a vibration pattern source in the braille code (S3).

The braille code is converted to the number 1 if there is a dot in the corresponding place, and the number 0 if there is no point in the braille code.

The vibration pattern source is vibrated at the number 1 of the braille code and is oscillated at the number 0 of the braille code. The vibration pattern source is vibrated as short as the number of times when the number 1 is arranged in succession, and is oscillated even if there is the first touch motion and the second touch motion when the number 0 is continued. When the vibration pattern source has the number 1 in the first and third positions of the braille coat and the number 0 in the second position, the vibration pattern source is briefly vibrated in the first touch motion and long in the second touch motion. When the vibration pattern source has the number 0 in the first and third positions of the braille code and the number 1 in the second position, the vibration pattern source is vibrated in the first touch motion and briefly vibrated in the second touch motion. When the vibration pattern source has the number 0 in the first and second positions of the braille code and the number 1 in the third position of the braille code, the vibration pattern source is vibrated in the first touch motion and vibrates long in the second touch motion.

When the first touch motion is performed on the touch screen 110 by the user, the first touch motion is detected by the motion detection unit 120 (S4). In the first touch motion, the vibrator 140 outputs vibrations to the touch screen 110 according to the vibration pattern source by the controller 130 (S6). On the other hand, if the first touch motion is not detected by the motion detection unit 120, the vibration unit 140 does not output the vibration according to the vibration pattern source to the touch screen (S5).

By controlling the vibration unit 140 embedded in the smart phone of the present invention, by converting the file text into a vibration pattern source corresponding to the braille code, the visually impaired to the vibration implemented on the touch screen 110 of the smartphone by tactile sense It can be detected. Because of this, the present invention can help visually impaired people to recognize the visual information of the smartphone. As a result, the present invention can enable the use of a smartphone for the visually impaired.

As another example, the present invention can be applied to an e-book reader. Many of the Braille books in Korea are occupied by literary works such as novels, and the proportion of educational books or major books for students is very small. The present invention can be useful for the public interest of society if it is used to introduce an electronic textbook for education of children or students with visual impairment by converting text such as e-book into Braille.

As another example, the present invention may be applied to a smart home system. Smart home system refers to a technology that connects and controls all devices in the house such as home appliances, energy consumption devices (water, electricity, heating and cooling), security devices (door locks, surveillance cameras, etc.). Recently, as part of the Internet of Things (IOT), there is a function to check the operating status of the remote control and the refrigerator, washing machine, etc. using the Internet. The present invention is applied to the smart home system, by converting the visual information of the touch display to vibrating braille, so that the visually impaired can also use a general-purpose display, it is possible to improve the quality of life of the visually impaired.

As another example, the present invention may be applied to a smart watch. Smartwatch is a touch display-based device that can be linked with a smartphone, and the general public can conveniently receive time, messages, and information. However, since smart watches are touch-based devices, they cannot be used by the visually impaired and are discriminated against by convenience or quality of life. The present invention implements the vibration braille by adjusting the vibration motor existing in the smart watch, as a result, the visually impaired people to recognize the time or information displayed on the smart watch, so that even the visually impaired can use the smart watch. have.

As another example, the present invention can be applied to a bank ATM. Current bank ATMs provide voice guidance services or enlarged screens for the visually impaired or those with low vision. However, the voice guidance service informs people around their personal information without plugging in earphones, and the low vision quotation screen also has a problem of leaking personal financial information because the font size is larger than the general screen. When the present invention is applied to the bank ATM machine, using the same touch display as the general person, it is possible to recognize the information on the screen by vibrating stimulation that only the visually impaired people who touch the screen can reduce the risk of information leakage.

As in the above-described example, the present invention can be applied to all electronic devices based on the touch display with a built-in vibration motor, the utilization is very high. The present invention allows the visually impaired to use a touch screen-based electronic device more easily by inputting the braille keyboard between the visually impaired and the normal person and outputting the system using the vibration braille system.

Although some embodiments of the invention have been shown and described, it will be apparent to those skilled in the art that modifications may be made to the embodiment without departing from the spirit or spirit of the invention. . It is intended that the scope of the invention be defined by the claims appended hereto and their equivalents.

Claims

In the vibration braille system applicable to the touch screen-based electronic device,

The vibration pattern source corresponding to the braille consisting of six dots decoded in the order of 1 to 3 rows of 1 column, and then 1 to 3 rows of 2 columns is preset, and when the file text is recognized by the electronic device, the file text is stored. A matching unit matching the vibration pattern source;

Vibration unit for outputting the vibration according to the vibration pattern source to the touch screen; And

A first touch motion in contact with the touch screen, and a motion sensing unit configured to detect a second touch motion continuous to the first touch motion,

The first touch motion is a motion for detecting the presence or absence of a dot in the first row of the braille according to the presence or absence of the vibration in contact with the touch screen,

The second touch motion is a motion for detecting the presence or absence of the two rows and three lines of the braille in accordance with the presence or absence of the vibration, the short and long periods of the vibration and the number of vibrations when contacting the touch screen,

The vibration pattern source is vibrated if the point is located in the corresponding position according to the decoding order of the braille, and if there is no point in the corresponding position, the vibration pattern is not vibrated, and if there is the point continuously in the corresponding position, the vibration is shortened by the number of continuous points. The vibration braille system, characterized in that the vibration is a long vibration signal when the corresponding seat is three rows and there are points in the third row and there are no points in the second row.
According to claim 1, wherein the vibration pattern source, according to the decoding order of the braille,

If there is a dot in the first row and there are no dots in the second row and the third row, it is one short vibration in the first touch motion, and vibrationless in the second touch motion,

If there is no dot in the first row and there are dots in the second row and the third row, the vibration is non-vibration in the first touch motion and two short vibrations in the second touch motion.

If there is the point in the first row and the third row and there is no point in the second row, there is one short vibration in the first touch motion, one long vibration in the second touch motion,

If there is no dot in the first row and the third row and there is a dot in the second row, the vibration is non-vibration in the first touch motion and a short vibration in the second touch motion,

If there is no dot in the first to third rows, the first touch motion and the second touch motion are vibration-free,

And the dot is in the first row and the second row, and the dot is in the third row. The vibration braille system is characterized in that the vibration signal is non-vibrated during the first touch motion and is a long vibration one time during the second touch motion.
According to claim 1, wherein the vibration pattern source, according to the decoding order of the braille,

If the dot is in the first row and the second row and the dot is not in the third row, two short vibrations in the first touch motion,

If the dot is in the first row to the third row, the vibration braille system, characterized in that the vibration signal of three short vibrations in the first touch motion.
The method of claim 1,

According to the decoding order of the braille, if the dot has the dot in the corresponding place, the dot is converted to the number 0 if the dot does not exist, and the 6-digit braille code consisting of the combination of the number 0 and the number 1 for each braille is Further comprising a preset conversion unit,

The 6-digit braille code is assigned to the first to third digits in rows 1 to 3 in units of columns of the braille,

And the converting unit automatically converts the file text into the braille code.
The method of claim 4, wherein the vibration pattern source,

Vibrates at the number 1 of the braille code,

Vibration-free at the number 0 in the braille code,

If the number 1 is arranged in a continuous oscillation as short as the number of arrangements,

When the number 0 is continuous, the first touch motion and the second touch motion are vibrated even if there is the second touch motion.

When the number 1 and the number 3 has the number 1 and the number 0 has the number 0, the first short vibration in the first touch motion, the long vibration in the second touch motion once,

When the number 0 and the number 3 has the number 0 and the number 1 has the number 1, it is non-vibrating in the first touch motion and a short vibration in the second touch motion.

When the number 0 and the number 0 has the number 0, and the number 1 has the number 1, the vibration signal is non-vibration during the first touch motion, and a long vibration signal during the second touch motion. Vibration braille system.
The method of claim 4, wherein

When the number 1 and the number 2 has the number 1 and the number 0 has the number 0, the first touch motion is two short vibrations,

If the number 1 in the first to the third place in a row, the vibration braille system, characterized in that the vibration signal of three short vibrations in the first touch motion.
A) searching for a file text in an electronic device in which a vibration pattern source corresponding to braille consisting of six dots which are read in order from 1 to 3 rows of 1 column, and then from 1 to 3 rows of 2 columns is preset;

B) matching the file text with the vibration pattern source;

C) if a first touch motion and a second touch motion continuous to the first touch motion are sensed on the touch screen, outputting the vibration of the vibrator to the touch screen according to the vibration pattern source; And

D) if the first touch motion is not detected in the touch screen, the vibration of the vibration unit according to the vibration pattern source is not output to the touch screen,

The first touch motion is a motion for detecting the presence or absence of a dot in the first row of the braille according to the presence or absence of the vibration in contact with the touch screen,

The second touch motion is a motion for detecting the presence or absence of the two rows and three lines of the braille in accordance with the presence or absence of the vibration, the short and long periods of the vibration and the number of vibrations when contacting the touch screen,

The vibration pattern source is vibrated if the point is located in the corresponding position according to the decoding order of the braille, and if there is no point in the corresponding position, the vibration pattern is not vibrated, and if there is the point continuously in the corresponding position, the vibration is shortened by the number of continuous points. If the corresponding seat is three rows and there is a dot in the third row and there is no point in the second row, the vibration screen vibration method of the touch screen, characterized in that the long vibration.
According to claim 7, wherein the vibration pattern source, according to the decoding order of the braille,

If there is a dot in the first row and there are no dots in the second row and the third row, it is one short vibration in the first touch motion, and vibrationless in the second touch motion,

If there is the point in the first row and the third row and there is no point in the second row, there is one short vibration in the first touch motion, one long vibration in the second touch motion,

If there is no dot in the first row and the third row and there is a dot in the second row, the vibration is non-vibration in the first touch motion and a short vibration in the second touch motion,

If there is no dot in the first to third rows, the first touch motion and the second touch motion are vibration-free,

If there is the point in the first row and the second row and there is no point in the third row, two short vibrations in the first touch motion,

If the dot is in the first row to the third row, three short vibrations during the first touch motion,

If there is no dot in the first row and the second row, and the dot is in the third row, the vibration signal is vibration-free during the first touch motion and is a vibration signal having one long vibration in the second touch motion. Implementation method.
The method of claim 7, wherein

In the step (A), if the file text is not searched in the electronic device further comprises the step of outputting voice information about the search impossible in the electronic device, characterized in that the touch screen-based vibration braille implementation method.
The method of claim 7, wherein

The electronic device converts the number 1 into the number 1 if the dot exists in the corresponding place according to the decoding order of the braille, and converts the number 0 into the number 0 if the dot does not exist in the corresponding place. The braille code of is preset,

The 6-digit braille code is assigned to the first to third digits in rows 1 to 3 in units of columns of the braille,

In the step (B), after the file text is automatically converted into the braille code, the braille code is matched with the vibration pattern source,

The vibration pattern source,

Vibrates at the number 1 of the braille code,

Vibration-free at the number 0 in the braille code,

If the number 1 is arranged in a continuous oscillation as short as the number of arrangements,

When the number 0 is continuous, the first touch motion and the second touch motion are vibrated even if there is the second touch motion.

When the number 1 and the number 3 has the number 1 and the number 0 has the number 0, the first short vibration in the first touch motion, the long vibration in the second touch motion once,

When the number 0 and the number 3 has the number 0 and the number 1 has the number 1, it is non-vibrating in the first touch motion and a short vibration in the second touch motion.

When the number 0 and the number 0 has the number 0, and the number 1 has the number 1, the first touch motion is non-vibration, the second touch motion is one long vibration,

When the number 1 and the number 2 has the number 1 and the number 0 has the number 0, the first touch motion is two short vibrations,

If the number 1 in the first to the third place in a row, the touch screen-based vibration braille implementation method characterized in that the vibration signal of three short vibrations during the first touch motion.