KR101848184B1 - Vibration-type braille system And Method for implementing Vibration-type braille based on touch screen - Google Patents

Abstract

An embodiment of the present invention relates to a vibration Braille system applicable to a touch screen-based electronic appliances, which comprises: a matching unit for matching a file text to a vibration pattern source when recognized in an electronic appliance to a predetermined vibration pattern source corresponding to Braille composed of six dots which are read in the order of line 1 to line 3 of a first column and then line 1 to line 3 of a second column; a vibration unit for outputting the vibration according to the vibration pattern source on a touch screen; and a motion sensing unit for sensing first touch motion in contact with the touch screen and second touch motion continuous to the first touch motion, wherein the first touch motion is configured to sense presence of dots in line 1 of Braille according to presence or absence of vibration in contact with the touch screen, the second touch motion is configured to sense presence of dots in line 2 and line 3 of Braille according to presence or absence, beat and frequency of vibration in contact with the touch screen, and the vibration pattern source is preferred to be a vibration signal which vibrates when dots are present in a corresponding place in a reading order of Braille, does not vibrate when dots are not present in the corresponding place, vibrates short as many as the number of continuous dots when dots are continuously present in the corresponding place, and vibrates longer when the corresponding place is line 3 and dots are present in line 3 and not in line 2.

Description

[0001] The present invention relates to a vibration-type braille system and a vibration-type braille based on touch screen,

The present invention relates to a vibration braille system and a touch screen-based vibration braille embodying method, and more particularly, to a vibration braille system capable of utilizing a touch screen-based general purpose device by showing visual information represented on a touch screen as a vibration braille, A vibrating braille system and a touch screen based vibration braille embodying method.

In the near future, the era of Internet of Things (IOT), which is beyond simple IT technology, is expected to come, and the speed of its development is accelerating. In fact, the number of devices connected to the Internet has surpassed 2 billion by 2010, and by 2020 it is expected to be more than 20 billion.

In order to use the Internet, most users can simultaneously transmit and receive information using the touch screen. In the future, touch-based displays will be attached to a number of things, and they will act like remote controls as well as visual information displays.

However, a touch screen-based device can not only transmit signals using the visual, but also express physical irregular Braille on the screen surface. As a result, visually impaired people who can not use the visuals have not been able to use any general purpose electronic devices equipped with a general touch screen, including smartphones and tablet PCs, and the inconvenience will increase in the future.

 In addition, mainstream information communication devices and systems such as telephones, TVs, and the Internet are often incompatible with existing assistive devices for the visually impaired, such as screen readers and Braille information terminals. Today, the speed of technology development is too fast, so even if auxiliary equipment is made by applying information and communication technology of that time, it does not fit with the new technology trend and becomes useless. This problem prevents people with disabilities from fully enjoying the benefits of virtually every device that introduces new technologies.

On the other hand, with the development of modern technology, many of the books that have been printed on paper have been widely distributed through e-books. E-books can be easily accessed through tablets or various smart devices, and can store a large number of books on a single device, so that they can be read anywhere without restriction of volume or weight. It would be nice if the visually impaired would also be able to translate textual books into electronic braille and easily access them through a general-purpose device such as a mobile phone. However, even a common device such as a portable terminal as well as an e- It is a reality that expensive devices for the visually impaired should be used.

The existing screen technology for the visually impaired is focused on providing physical tactile information such as braille through the transformation of the display surface itself. Visually impaired users should purchase and use a dedicated terminal instead of a general purpose product when using this display device. Because of the lack of demand, the device is expensive and difficult to obtain compared with a general purpose product having the same performance.

In addition, although a terminal or voice service for converting a visual signal into an auditory signal has been introduced, it is difficult to apply to a web-based hyperlink interface. In addition, when voice is provided by an external speaker, it is difficult to keep personal information such as banking because it can be heard by people around.

In the technique of converting the visual signal into the electrical stimulus by providing the electric stimulus at the portion having the dot for each braille pattern, there is a disadvantage that the stimulus is ambiguous at the boundary of the point having each point because the corresponding stimulus is relatively small. Further, as the stimulation of the same size and pattern is repeated, the stimulation is easily tired and the pattern recognition is difficult.

Korean Patent Publication No. 1020100019686 discloses a braille information terminal based on RF communication. A Braille information terminal based on RF communication is a technology in which two or more vibrators contact the body part (fingers, waist, arms) of a visually impaired person and transmit Braille information through braille vibration. The Braille information terminal based on RF communication has the convenience of transmitting 6 Braille characters directly to the body by applying vibrational stimulation directly to the body. However, the complicated type vibration pattern gives many vibration stimuli at the same time so that it is difficult for the disabled person to distinguish them practically. There is a problem that it is difficult to distinguish the complex Braille patterns.

On the other hand, Korean Patent Registration No. 10-1360828 discloses a glove type oscillatory braille output device. The glove type vibratory braille output device is a technology for allowing the user to conveniently recognize the six braille characters through the vibration tactile sense by mounting six vibration units on the palm of the hand or the palm of the gloves. Since the gloved type oscillatory braille output device is a simple vibration type, it is difficult to distinguish the complicated braille patterns, and there is a problem that the sensitivity of the tactile sense is deteriorated because the area of the tactile surface is not the fingertip but the palm.

It is an object of the present invention to provide a vibration braille system in which a visually impaired person can utilize a touch screen-based general purpose device by showing visual information expressed on a touch screen as vibration braille which is a physical tactile sense.

The present invention provides a vibration braille system and a touch screen-based vibration braille implementation method capable of easily expressing braille patterns of various patterns according to the number of vibrations, length, or vibration by controlling the operation of a vibration unit built in an electronic device .

In one embodiment of the present invention, a vibration braille system applicable to a touch-screen-based electronic device corresponds to a braille consisting of six points that are read from one row to three rows in one row and then one row to three rows in two rows A matching unit for matching the file text with a vibration pattern source when the file text is recognized in the electronic device; A vibration unit for outputting vibration corresponding to the vibration pattern source to the touch screen; And a motion sensing unit that senses a second touch motion that is continuous with the first touch motion, wherein the first touch motion includes at least one of a braille The second touch motion senses the presence or absence of points in the second row and third row of the braille according to the presence or absence of vibration, the shortness of vibration, and the number of vibrations in contact with the touch screen. And the vibration pattern source is vibrated when there is a point in the corresponding position according to the decoding order of the braille. When there is no point in the corresponding position, the vibrationless vibration is vibrated. If there is a continuous point in the corresponding position, the vibration pattern source is vibrated as short as the number of consecutive points. It is preferable that the vibration signal is a vibration signal that is oscillated long if there are three rows, three rows and no two rows.

In one embodiment of the present invention, the vibration pattern source has a short vibration in the first touch motion and a short vibration in the second touch motion when there is a dot in one row and no dot in the second row and third row, If there is no point in the first row and no vibration in the second row and the third row and there is no point in the second row and the third row and there are no points in the second row and the third row, When there is no point in the first row and the third row and there is a point in the second row, the vibration is non-vibration-free in the first touch motion and short vibration 1 in the second touch motion If there is no point in the first touch motion and the second touch motion, if there is no point in the first touch motion and the second touch motion, if there is no point in the first touch motion and the second touch motion, It is preferable that the vibration signal is a vibration signal having one long vibration in motion.

In one embodiment of the present invention, according to the order of deciphering the braille patterns, if there are dots in the first row and the second row and there are no dots in the third row, the short vibration in the first touch motion is twice, It is preferable that the vibration signal is a vibration signal that is three short vibrations in the first touch motion.

In the embodiment of the present invention, if there is a dot in the corresponding place according to the decoding order of the braille, it is converted into the number 1, and if there is no dot in the place, it is converted into the number 0, And the 6-digit Braille code is assigned to the first to third digits of the first to third rows in units of the braille characters, and the converting unit automatically converts the file text into the braille code desirable.

In one embodiment of the present invention, the vibration pattern source is vibrated at the number 1 of the braille code, non-vibration at the number 0 of the braille code, vibrated as short as the number of arrangements when the number 1 is arranged continuously, If there is a numeral 1 in the first and third digits and a numeral 0 in the second digits, a short vibration is generated in the first touch motion and a second vibration is generated in the second touch motion. If there is a long vibration 1, a number 0 in the first and third digits and a number 1 in the second digits, there is no vibration in the first touch motion, a short vibration in the second touch motion, It is preferable that the vibration signal is a vibration signal that is non-vibration in the first touch motion and one long vibration in the second touch motion when the numeral 1 is in the third position.

In the embodiment of the present invention, if the number 1 is in the first and second digits and the number 0 is in the third digits, there are two short vibrations in the first touch motion, 1, it is preferable that the vibration signal is a vibration signal having three short vibrations in the first touch motion.

On the other hand, the touch screen-based vibration braille embodying method is characterized in that: A) a vibration pattern source corresponding to braille consisting of six dots to be deciphered in one row to three rows in one row, In which the file text is searched; B) matching the file text with a vibration pattern source; C) outputting the vibration of the vibrating part to the touch screen according to the first pattern of touch when the first touch motion and the second touch motion following the first touch motion are detected on the touch screen; And D) if the first touch motion is not detected on the touch screen, the vibration of the vibrating part according to the vibration pattern source is not outputted to the touch screen, and the first touch motion includes And the second touch motion is a motion sensing the presence or absence of points in the second row and the third row of the braille according to the presence or absence of vibration, the shortness of vibration, and the number of vibrations. The vibration pattern source is vibrated when there is a point in the corresponding position according to the decoding order of the braille. When there is no point in the corresponding position, the vibration is non-vibration. If there is a continuous point in the corresponding position, the vibration pattern source is vibrated as short as the number of consecutive points. It is preferable that the vibration signal is a vibration signal that is long-lived if there are three rows, three rows and no two rows.

In one embodiment of the present invention, the vibration pattern source has a short vibration in the first touch motion and a short vibration in the second touch motion when there is a dot in one row and no dot in the second row and third row, If there is a dot on the first row and the third row and there is no dot on the second row, there is no vibration in the first touch motion and one vibration in the second touch motion, and there is no point in the first row and the third row, If there is a point, it is non-vibration-free in the first touch motion and once in the second touch motion. If there is no point in the first row and the third row, the vibration is non-vibrating in the first touch motion and the second touch motion, If there is no point on the third row, there are two short vibrations in the first touch motion, and if there is a point on the first to third rows, there are three short vibrations in the first touch motion. If there is no point on the first row and the second row, It is preferable that the vibration signal is a vibration signal that is non-vibration-free in the first touch motion and one long vibration in the second touch motion.

In one embodiment of the present invention, in the step (A), it is preferable that the step of outputting voice information for non-search in the electronic device if the file text is not found in the electronic device.

In one embodiment of the present invention, the electronic device is converted into a number 1 if there is a dot in the corresponding place according to the decoding order of braille, and a digit 0 when there is no dot in the place, And the 6-digit Braille code is assigned to the 1st to 3rd digits in the unit of the braille in the unit of the braille. In the step (B), the file text is automatically set to the braille code After the conversion, the braille code is matched to the vibration pattern source, the vibration pattern source is vibrated at the number 1 of the braille code, the vibrationless at the number 0 of the braille code, and the number 1 is arranged continuously, If there is a number 1 in the first and third digits and a number 0 in the second digits, a short vibration in the first touch motion and a short vibration in the first touch motion , The second touch motion If there is a number 0 in the first and third digits, and a number 1 in the second digits, the first vibration is non-vibration in the first touch motion, the short vibration in the second touch motion is one vibration, 0 and there is a number 1 in the third digit, it is non-vibration-free in the first touch motion, one long vibration in the second touch motion, the number 1 is in the first and second digits, , It is preferable that the vibration signal is a short vibration three times in the first touch motion when there are two short vibration in the first touch motion and a number one in succession in the first to third positions.

In the present invention, visual information expressed on a touch screen is represented by a physical braille which is a physical touch, so that a visually impaired person can utilize a touch screen based general purpose device.

According to the present invention, it is possible to easily express the braille patterns of various patterns according to the number of vibrations, the length or the cycle, and to transmit the signals quickly by controlling the operation of the vibration unit built in the electronic device. Thus, the present invention can help visually impaired people to recognize the visual information of the smartphone. As a result, the present invention may enable the visually impaired to use the smartphone.

The present invention can also contribute to the public interest of society by converting text such as an e-book into braille and using it to introduce electronic teaching materials for children or students with visual impairment.

The present invention is applied to smart home systems such as home appliances and energy consumption devices (water, electricity, air conditioning and heating), security devices (door locks, surveillance cameras, etc.), and converts visual information of the touch screen into vibrating braille, People with disabilities can also use a universal display, which can improve the quality of life for the visually impaired.

In the present invention, a vibrating motor built in a smart watch is adjusted to implement a vibrating braille. As a result, the visually impaired can recognize the time and information displayed on the smart watch, have.

The present invention is applied to a bank ATM machine, and it is possible to recognize information of a screen by a vibration stimulus that can be felt only by a visually impaired person who touches the screen using the same touch screen as a general person, thereby greatly reducing the risk of information leakage.

Fig. 1 (a) is a braille table according to characters, and Fig. 1 (b) shows a braille decryption sequence.
2 schematically shows a configuration of a vibration braille system according to an embodiment of the present invention.
FIG. 3 shows an example according to the length, the presence, and the number of vibrations according to the vibration pattern source.
Fig. 4 shows the number of braille points.
FIG. 5 exemplarily shows how the present invention is expressed in a touch-screen-based electronic device.
6 schematically shows a principle of generating braille codes according to a preferred embodiment of the present invention.
7 schematically shows a flowchart of a method of implementing a touch screen based oscillating braille device according to an embodiment of the present invention.

Hereinafter, a vibration braille system and a touch screen-based vibration braille embodying method according to a preferred embodiment of the present invention will be described with reference to the accompanying drawings.

● Vibrating braille system

1st Example

In Fig. 1 (a), braille characters are shown according to characters. As shown in Fig. 1 (b), the braille characters are arranged in the order of 1 point, 2 points and 3 points in the order of 1 row to 3 rows of 1 row, 4 points, 5 points in the order of 1 row to 3 rows, 6 points. Braille decoding order is decoded in order of 1 point to 6 points. Braille is a blind character that is read by touching a point on the ground with a finger.

The vibration braille system according to an embodiment of the present invention is to implement braille in a vibration mode in an electronic device based on a touch screen. That is, according to the present invention, braille is outputted through a touch screen in a vibration mode so that even a visually impaired person can use a touch screen-based electronic device. A variety of products such as smart phones, tablet PCs, bank ATMs, smart watches, and home appliances can be applied to touchscreen-based electronic devices.

2, the present invention includes a touch screen 110, a motion sensing unit 120, a control unit 130, a vibration unit 140, and a matching unit 150. As shown in FIG.

The motion sensing unit 120 senses a first touch motion and a second touch motion over the entire area of the touch screen 110. [ The motion sensing unit 120 can sense the touch motion of the user regardless of which portion of the touch screen 110 the user touches.

The first touch motion is a motion of sensing the presence or absence of one row of braille in accordance with the presence or absence of vibration when the touch screen is in contact with the touch screen. The second touch motion is a motion that detects the presence or absence of points in the second row and third row of the braille according to the presence or absence of vibration, the shortness of vibration, and the number of vibrations upon contact with the touch screen. The second touch motion may be a drag operation, but is not limited to the drag operation.

The vibration unit 140 is a component incorporated in the electronic apparatus. The vibration unit 140 is configured to output vibration to the touch screen 110. The vibration portion 140 is vibrated according to the vibration pattern source. The operation of the vibration unit 140 is controlled by the control unit 130. [

The control unit 130 controls the operation of the vibration unit 140 when the first touch motion is sensed by the motion sensing unit 120. [ The vibration unit 140 outputs vibration corresponding to the vibration pattern source. Meanwhile, if the first touch motion is not detected by the motion sensing unit 120, the control unit 130 controls the vibration unit 140 to not operate.

The matching unit 150 matches the file text with the vibration pattern source when the file text is recognized in the electronic device. In the matching unit 150, braille and vibration pattern sources corresponding to characters are preset. The vibration pattern source is implemented in the order in which the two rows are decoded after deciphering one row of the braille, in the presence of vibration, the shortest end of vibration, and the number of vibrations.

As shown in Fig. 3, the vibration pattern source is vibrated if there is a point in the corresponding place according to the decoding order of braille, and is vibrated if there is no point in the place. The vibration pattern source vibrates as short as the number of consecutive points if there are consecutive points in the place.

The vibration pattern source has the following vibration pattern according to the order of deciphering the braille. Fig. 4 shows the number of braille points.

First, in the case of Fig. 4 (a), if there are dots in the first and third rows of braille and there are no dots in the second row, the vibration pattern source is shortly vibrated during the first touch motion and vibrated long during the second touch motion. This corresponds to a vibration pattern source expressing the decoding order of the two columns (right side) of the primitive "X" in Fig. 1 (a).

In the case of FIG. 4 (a), since a signal of Braille No. 1 at the top of the first touch motion of the user is received, one long vibration is generated for the signal of Braille at one time of short vibration and at the time of the second touch motion, (140) to the touch screen (110). This ③ position can avoid the confusing confusing of ② or ③ by using long vibration to give intuitive meaning to the user.

As shown in Fig. 4 (b), if there are dots in the first and second rows of braille and there are no dots in the third row, the source of the vibration pattern is two short vibrations in the first touch motion. This corresponds to a vibration pattern source expressing one row (left) decoding order of the vowel "a " in Fig. 1 (a).

In the case of Fig. 4 (b), the source of the vibration pattern is two short vibrations in the first touch motion. In the case of FIG. 4 (b), although there is one short vibration in accordance with the basic principle in the first touch motion, there are two consecutive short vibrations in the first touch motion since there are consecutive braille characters directly below.

Therefore, the user can easily recognize that there are two consecutive braille characters in positions ① and ②, and it can be seen that braille does not exist automatically in the bottom ③ position because there is no long vibration. That is, even if the second touch motion is not performed downward, the braille information can be recognized up to the third time, so that the braille recognition can be performed quickly.

As shown in Fig. 4 (c), if there is no dot on one row of braille and there is a dot on the second row and third row, the vibration pattern source is non-vibrating during the first touch motion and twice during the second touch motion. This corresponds to a vibration pattern source expressing a decoding sequence of two columns (right side) of the prefix "I " in Fig. 1 (a).

In the case of Fig. 4 (c), the source of the vibration pattern is non-vibration in the first touch motion and twice in the second touch motion. In the case of FIG. 4 (c), there are two consecutive braille characters as in FIG. 4 (b), but since there exist no braces at the first touch motion, Only two consecutive short vibrations are required. Therefore, the user can know that there are two consecutive Braille characters in positions ② and ③.

As shown in Fig. 4 (d), if there is a dot on one row of braille and no dot on the second row and third row, the vibration pattern source is one short vibration during the first touch motion and no vibration during the second touch motion. This corresponds to a vibration pattern source expressing the decoding order of one column (left) of the longitudinal "a " in Fig. 1 (a).

In the example shown in Figs. 4 (d) to 4 (f), all of the short vibration is emitted once, which may confuse the user. However, in the case of FIG. 4 (d), since there is braille only at the position 1, there is no vibration at the time of the first touch motion, and there is no vibration at the time of the second touch motion. It can be recognized that braille exists.

As shown in Fig. 4 (e), if there are no points in the first and third rows of the braille and there are dots in the second row, the vibration pattern source is non-vibration in the first touch motion and one vibration in the second touch motion. This corresponds to a vibration pattern source expressing the decoding order of the first column (left) of the initial character "c " in Fig. 1 (a).

As shown in Fig. 4 (f), if there are no points in the first and second rows of the braille and there are dots in the third row, the vibration pattern source is non-vibrating at the first touch motion and vibrated at the second touch motion. This corresponds to a vibration pattern source expressing the decoding order of the two columns (right side) of the primitive "g" in Fig. 1 (a).

In the case of FIGS. 4 (e) and 4 (f), since there is no braille at position 1 in both cases, no vibration occurs in the first touch motion and one vibration occurs in the second touch motion. However, in such a one-time vibration, it can be confused with where the braille is located in the ② or ③. In order to solve this problem, the present invention is divided into vibration lengths. In Fig. 4 (e), one short vibration is performed at the position 2, and Fig. 4 (f) is set to one long vibration at the position 3.

4 (e), when there is a point at the point 2, a short vibration is given to give a feeling that braille is present at a position passing through the user, and as shown in FIG. 4 (f) It gives a long vibration to give the intuitive meaning of the last point in case.

As shown in Fig. 4 (g), if there is a dot on all the first to third rows of the braille pattern, the vibration pattern source has a pattern in which the short vibration is continuously repeated three times in the first touch motion. This corresponds to a vibration pattern source expressing the first column (left) decoding order of the vowel "? &Quot; in Fig. 1 (a).

In the case of FIG. 4 (g), too, it is not necessary to perform the second touch motion downward because it indicates that all of the braille characters are present from the first to the (3) th three consecutive short vibrations in the first touch motion. In the present invention, if there are two consecutive Braille signals as shown in Figs. 4 (b) and 4 (c), two short vibrations are automatically displayed.

On the other hand, although not shown in Fig. 4, if there are no points in the first to third rows of braille, the vibration pattern source is non-vibration-free in the first touch motion and the second touch motion. This corresponds to a source of the vibration pattern expressing the decoding order of the first column (left side) of the primitive "g" in Fig. 1 (a).

Second Example

The present invention includes a touch screen 110, a motion sensing unit 120, a matching unit 150, a vibration unit 140, and a control unit 130. The touch screen 110, the motion sensing unit 120, the vibration unit 140, and the control unit 130 according to the present embodiment are the same as those of the touch screen 110, the motion sensing unit 120, (140), and the control unit (130), and a description thereof will be omitted below.

However, the vibration braille system according to the present embodiment further includes a conversion unit, unlike the first embodiment described above.

The conversion unit automatically converts the file text into Braille code. A braille code is previously set in the conversion unit. The braille code is a six-digit numeric array composed of a combination of a number 0 and a number 1 for each braille character, converted to a number 1 if there is a dot in the corresponding place according to the decoding order of the braille, The 6-digit Braille code is assigned to the first to third digits in the unit of the braille.

In the matching unit 150, the braille code converted in the conversion unit is matched with the vibration pattern source.

When the braille code is preset in the electronic device, the vibration pattern source is set to vibrate at the number 1 of the braille code. The vibration pattern source is set to be non-vibrating at the number 0 of the braille code. The vibration pattern source is non-vibration-free even if there are the first touch motion and the second touch motion when the number 0 is consecutive.

Then, the vibration pattern source is set to vibrate as short as the number of times when the numeral 1 is continuously arranged. The vibration pattern source has a number 1 in positions 1 and 2, and a number 0 in position 3, and a short vibration is set in two times in the first touch motion. The vibration pattern source is set to three cycles of short vibration in the first touch motion if the number 1 is continuous in the first to third positions.

The vibration pattern source is set to one cycle of short vibration in the first touch motion and one cycle in the second touch motion when the number 1 is in the first and third positions and the number 0 is in the second position. The vibration pattern source is set to 1 vibration in the first touch motion and 1 vibration in the second touch motion when the number 0 and the number 1 are in the positions 1 and 3, respectively. The vibration pattern source has the number 0 in the positions 1 and 2 and the number 1 in the position 3, so that it is not vibration-free in the first touch motion and is set in the long vibration-1 circuit in the second touch motion.

For example, when the braille code is 100, the vibration pattern source is non-vibration at the time of the first touch motion and at the time of the second touch motion. If the braille code is 110, the vibration pattern source is a short vibration twice in the first touch motion. If the braille code is 111, the short vibration is three times in the first touch motion.

If the braille code is 011, the vibration pattern source is non-vibration at the first touch motion and twice at the second touch motion. When the braille code is 010, the vibration pattern source is non-vibration at the first touch motion and once at the second touch motion. If the braille code is 001, it is non-vibration at the first touch motion and once at the second touch motion.

In the braille code 101, the vibration pattern source is one short vibration in the first touch motion and one long vibration in the second touch motion. If the braille code is 000, the vibration pattern source is non-vibration-free even in the case of the first touch motion and the second touch motion.

Hereinafter, an example of converting a braille code according to braille and a braille code into a vibration pattern source will be described with reference to the braille table shown in Fig. 1 (a).

For example, the primitive "a" in Fig. 1 (a) has only four points out of the six points. Thus, according to the braille code generation principle shown in Fig. 6, the braille code of the prefix "a" is "000100 ". Braille code 000100 implements the vibration pattern source for the new first touch motion time 100 after the vibration pattern source for the first touch motion 000 is implemented. The source of the vibration pattern for the braille code 000 is deactivated in both the first touch motion and the second touch motion and the vibration pattern source for the braille code 100 is vibrated briefly once in the first touch motion and non-vibration in the second touch motion.

As another example, the prefix "c " in Fig. 1 (a) has two points and four points out of the six points. According to the braille code generation principle shown in Fig. 6, the braille code of the initial "c" is "010100 ". Braille code 010100 implements a vibration pattern source for the new first touch motion time 100 after the vibration pattern source for the first touch motion motion 010 is implemented. The source of the vibration pattern for the braille code 010 is non-vibrating at the first touch motion and once for the short vibration at the second touch motion, and the vibration pattern source for the braille code 100 is short at the first touch motion, The city will vibrate.

As another example, the vowel "a" in Fig. 1 (a) has points at one point, two points and six points out of the six points. According to the braille code generation principle, the braille code of the initial "a" is "110001". Braille code 110001 implements a vibration pattern source for a new first touch motion 001 after the vibration pattern source for the first touch motion motion 110 is implemented. The source of the vibration pattern for the braille code 110 is two short vibrations in the first touch motion, and the vibration pattern source for the braille code 001 is one long vibration in the first touch motion and no vibration in the second touch motion.

● Touch screen based Vibrating braille  How to implement

Hereinafter, with reference to FIG. 7, a method for implementing a touch screen based vibration braille method according to an embodiment of the present invention will be described.

 A touch screen based vibration braille implementation method is implemented in a touch screen based electronic device. A vibration pattern source corresponding to braille is preset in the electronic device. The braille character is composed of six points which are read from the first line to the third line in the first line, and then from the first line to the third line in the second line.

First, a file text desired by the user is searched in the electronic device (S1). If the file text is not searched in the electronic device, the electronic device outputs voice information indicating that the search is impossible (S2).

When the file text is recognized in the electronic device, the file text is converted into the braille code in the matching unit 150 of the electronic device, and then converted into the vibration pattern source in the braille code (S3).

The braille code is an array of six digits consisting of a combination of a number 0 and a number 1 for each braille, converted to a number 1 if there is a dot in the corresponding place according to the decoding order of the braille, and a number 0 if there is no dot in the place.

The vibration pattern source is vibrated at the number 1 of the braille code, and is non-vibration at the number 0 of the braille code. The vibration pattern source is vibrated as short as the number of arrangements when the numbers 1 are consecutively arranged. If the number 0 is continuous, the vibration pattern source is non-vibration-free even if there is the first touch motion and the second touch motion. The vibration pattern source vibrates briefly in the first touch motion and vibrate in the second touch motion when the number 1 is in the first and third positions of the braille coat and the number 0 is in the second position. If the vibration pattern source has the number 0 in the first and third positions of the braille code and the number 1 in the second position, the vibration pattern source is non-vibration in the first touch motion and short in the second touch motion. The vibration pattern source has the number 0 in positions 1 and 2 of the braille code, and is non-vibration-free in the first touch motion and long in the second touch motion when the number 1 is in the third position of the braille code.

When the first touch motion is performed on the touch screen 110 by the user, the first touch motion is sensed by the motion sensing unit 120 (S4). In the first touch motion, the vibration unit 140 outputs vibration to the touch screen 110 according to the vibration pattern source by the control unit 130 (S6). If the first touch motion is not detected by the motion sensing unit 120, the vibration unit 140 does not output the vibration corresponding to the vibration pattern source to the touch screen (S5).

The vibrating unit 140 incorporated in the smartphone of the present invention is controlled to convert the file text into a vibration pattern source corresponding to the braille code so that the blind realized by the tactile sense on the touch screen 110 of the smartphone Can be detected. Thus, the present invention can help visually impaired people to recognize the visual information of the smartphone. As a result, the present invention may enable the visually impaired to use the smartphone.

As another example, the present invention can be applied to an e-book reader. Many of the Braille books in Korea are occupied by literary works such as novels, and the proportion of education books or major books for students is very small compared to the number of books. The present invention can also contribute to the public interest of society by converting text such as an e-book into braille and using it to introduce electronic teaching materials for children or students with visual impairment.

As another example, the present invention can be applied to a smart home system. Smart home system refers to a technology that connects and controls all devices in the house, such as home appliances, energy consumption devices (water, electricity, air conditioning and heating), security devices (door locks, surveillance cameras, etc.). In recent years, as part of the Internet of Things (IOT), there is a function to remotely control household appliances using the Internet, and to check the operation status of refrigerators, washing machines, and the like. The present invention is applied to a smart home system, and can convert visual information of a touch display into a vibrating braille so that a visually impaired person can use a universal display, thereby improving the quality of life of a visually impaired person.

As another example, the present invention can be applied to a smart watch. The smart watch is a touch-based device that can be interfaced with a smart phone, so that the general public can conveniently receive time, messages, and information. However, because Smart Watch is a device based on touch display, it can not be used by the visually impaired and discriminates against convenience or quality of life. In the present invention, a vibrating motor built in a smart watch is adjusted to implement a vibrating braille. As a result, the visually impaired can recognize the time and information displayed on the smart watch, have.

As another example, the present invention can be applied to a bank ATM machine. Current bank ATMs offer voice guidance services or enlarged screens for the visually impaired or low vision. However, when the earphone is not plugged in the voice guidance service, the personal information of the user is notified to the surrounding people, and the screen of the low vision screen is larger in size than the normal screen. When the present invention is applied to a bank ATM machine, it is possible to recognize information on a screen by a vibration stimulus that can be felt only by a visually impaired person who touches the screen using the same touch display as a general person, thereby greatly reducing the risk of information leakage.

As described above, the present invention can be applied to all electronic devices based on a touch display having a built-in vibration motor. The present invention allows a visually impaired person to use an electronic device based on a touch screen in parallel with an input through a braille keyboard between a visually impaired person and a normal person and an output system using our vibration braille system.

Although several embodiments of the present invention have been shown and described, those skilled in the art will appreciate that various modifications may be made without departing from the principles and spirit of the invention . The scope of the invention will be determined by the appended claims and their equivalents.

110: touch screen 120: motion detection unit
130: Control section 140:
150:

Claims (10)

In a vibrating braille system applicable to a touch screen based electronic apparatus,
The vibration pattern source corresponding to the braille consisting of six dots to be read from the first line to the third line in the first line and then from the first line to the third line in the second line is determined in advance and the file text is recognized A matching unit matching the vibration pattern source;
A vibration unit for outputting a vibration corresponding to the vibration pattern source to the touch screen; And
A first touch motion that is in contact with the touch screen and a second touch motion that is continuous with the first touch motion;
Wherein the first touch motion is a motion of sensing the presence or absence of a point of one row of the braille in accordance with the presence or absence of the vibration when the touch screen is in contact with the touch screen,
The second touch motion is a motion of detecting the presence or absence of points in the second and third rows of the braille in accordance with the presence or absence of the vibration, the end of the vibration, and the number of vibrations when the touch screen is in contact with the touch screen.
Wherein the vibration pattern source is vibrated when the point exists in the corresponding place according to the decoding order of the braille pattern and is vibrated when the point is not present, Wherein the vibration signal is a vibration signal that is oscillated a long time when the corresponding position is three rows and the third row has a dot and the second row has no dot.
2. The method according to claim 1, wherein the vibration pattern source comprises:
If there is a point on the first row and there is no point on the second row and the third row, the short vibration is one time in the first touch motion, is non-vibration-free in the second touch motion,
If there is no point on the first row and there is a point on the second row and the third row, the first touch motion is non-vibration-free and the second touch motion is a short vibration twice,
If there is the point in the first row and the third row and there is no point in the second row, the short vibration is one time in the first touch motion and one time in the second touch motion,
If there is no point in the first row and the third row and there is a point in the second row, the first touch motion is non-vibration-free and the second touch motion is one short vibration,
If there is no point in the first to third rows, the first touch motion and the second touch motion are non-vibration-free,
Wherein the vibration signal is a vibration signal that is non-vibration-free in the first touch motion and is one long vibration in the second touch motion if there is no point in the first row and the second row and there is the point in the third row.
2. The method according to claim 1, wherein the vibration pattern source comprises:
If there is the point in the first row and the second row, and there is no point in the third row, the short vibration is twice in the first touch motion,
And if there is the point in the first row to the third row, the vibration signal is a vibration signal that is three short vibrations in the first touch motion.
The method according to claim 1,
A braille code of 6 digits consisting of a combination of the number 0 and the number 1 is converted into a number 1 if the corresponding point is in the corresponding place according to the decoding order of the braille characters and a number 0 if there is no point in the corresponding place, Further comprising a predetermined conversion unit,
Wherein the six-digit Braille code is assigned from the first row to the third row in the column units of the Braille characters to the first to third positions,
Wherein the converting unit automatically converts the file text into the braille code.
5. The method of claim 4,
Vibrated in said number 1 of said Braille code,
Is non-vibration-free at said number 0 of said Braille code,
If the number 1 is continuously arranged,
If the number 0 is consecutive, the first touch motion and the second touch motion are non-vibration-free,
If there is the number 1 in the 1 st and 3 rd places and the number 0 is in the 2 rd place, one short vibration in the first touch motion and one long vibration in the second touch motion,
If there is the number 0 in the first and third positions and the number 1 is in the second position, the first touch motion is non-vibration-free and the second touch motion is a short vibration one time,
The vibration signal is the vibration signal which is nonvibrating at the first touch motion and is one vibration at the time of the second touch motion if the number 0 is present in the first and second positions and the number 1 is present at the third position .
5. The method of claim 4,
If there is the number 1 in the first and second positions, and if the number 0 is in the third position, the short vibration is two times in the first touch motion,
Wherein the vibration signal is a vibration signal having three numbers of short vibrations in the first touch motion if the number 1 is present continuously in the first to third positions.
A) searching a file text in an electronic device having a preset vibration pattern source corresponding to a braille consisting of six points, which are read from one row to three rows in one row, and then from one row to three rows in two rows;
B) matching the file text with the vibration pattern source;
C) outputting the vibration of the vibration part to the touch screen according to the first touch motion on the touch screen and the second touch motion continuing to the first touch motion, according to the vibration pattern source; And
D) if the first touch motion is not detected on the touch screen, the vibration of the vibrating part according to the vibration pattern source is not outputted to the touch screen;
Wherein the first touch motion is a motion of sensing the presence or absence of a point of one row of the braille in accordance with the presence or absence of the vibration when the touch screen is in contact with the touch screen,
The second touch motion is a motion of detecting the presence or absence of points in the second and third rows of the braille in accordance with the presence or absence of the vibration, the end of the vibration, and the number of vibrations when the touch screen is in contact with the touch screen.
Wherein the vibration pattern source is vibrated when the point exists in the corresponding place according to the decoding order of the braille pattern and is vibrated when the point is not present, Wherein the vibration signal is a vibration signal that is oscillated a long time when the corresponding position is three rows and the third row has a dot and the second row has no dot.
8. The apparatus according to claim 7, wherein the vibration pattern source comprises:
If there is a point on the first row and there is no point on the second row and the third row, the short vibration is one time in the first touch motion, is non-vibration-free in the second touch motion,
If there is the point in the first row and the third row and there is no point in the second row, the short vibration is one time in the first touch motion and one time in the second touch motion,
If there is no point on the first row and the third row and there is a point on the second row, the first touch motion is non-vibration-free and the second touch motion is a short vibration once,
If there is no point in the first to third rows, the first touch motion and the second touch motion are non-vibration-free,
If there is the point in the first row and the second row and there is no point in the third row, then the short vibration in the first touch motion is two times,
If there is the point in the first to third rows, the short vibration is three times in the first touch motion,
Wherein the touch-screen-based vibration braille is a vibration signal that is non-vibration-free in the first touch motion and is one long vibration in the second touch motion if there is no point in the first row and the second row, Implementation method.
8. The method of claim 7,
Further comprising the step of: (a) outputting audio information for non-search in the electronic device if the file text is not searched in the electronic device.
8. The method of claim 7,
The electronic device is converted into the number 1 if the corresponding point exists in the corresponding place according to the decoding order of the Braille characters and the number 0 if the corresponding place does not have the corresponding point, Braille code of < RTI ID = 0.0 >
Wherein the six-digit Braille code is assigned from the first row to the third row in the column units of the Braille characters to the first to third positions,
In the step (B), after the file text is automatically converted into the braille code, the braille code is matched with the vibration pattern source,
Wherein the vibration pattern source comprises:
Vibrated in said number 1 of said Braille code,
Is non-vibration-free at said number 0 of said Braille code,
If the number 1 is continuously arranged,
If the number 0 is consecutive, the first touch motion and the second touch motion are non-vibration-free,
If there is the number 1 in the 1 st and 3 rd places and the number 0 is in the 2 rd place, one short vibration in the first touch motion and one long vibration in the second touch motion,
If there is the number 0 in the first and third positions and the number 1 is in the second position, the first touch motion is non-vibration-free and the second touch motion is a short vibration one time,
If the number 0 is present in the first position and the second position and the number 1 is present in the third position, the first touch motion is non-vibration-free, the second touch motion is one long vibration,
If there is the number 1 in the first and second positions, and if the number 0 is in the third position, the short vibration is two times in the first touch motion,
Wherein the vibration signal is a vibration signal having three numbers of short vibrations in the first touch motion when the number 1 is present in the first to third positions.

Images