KR20200109922A - Method, Device, and Non-transitory Computer-Readable Medium for Providing Braille Education Support Function By Tactile Interface Device - Google Patents

Abstract

The present invention relates to a method, a device and a non-transitory computer-readable medium for providing a braille education support function through a tactile interface device, and more particularly, to a method, a device and a non-transitory computer readable medium for providing a braille education support function through a tactile interface device, configured to allow the visually impaired to intuitively use, interact, and control the tactile interface device which corresponds to a multi-array tactile cell-based smart braille device so as to increase efficiency of the use of a smart device (a smartphone, a smart pad, etc.) or a smart braille device of the visually impaired and to improve the level of informatization. Therefore, the visually impaired can receive information on language-specific braille tactually and vocally to perform learning and to review the learned information through exercises.

Description

Method, Device, and Non-transitory Computer-Readable Medium for Providing Braille Education Support Function By Tactile Interface Device} for providing Braille education support function through tactile interface device.

The present invention relates to a method, an apparatus, and a non-transitory computer-readable medium for providing a braille education support function through a tactile interface device, and more particularly, to a smart device (smart phone, smart pad, etc.) or a smart In order to increase the efficiency of using braille devices and improve the level of information, the visually impaired can intuitively use, interact, and control the tactile interface device corresponding to the multi-array tactile cell-based smart braille device, so that information on braille by language A method, an apparatus, and a non-transitory computer-readable medium for providing braille education support functions through a tactile interface device that enables learning through tactile and auditory learning and review through exercises. .

In the information society, it is essential to acquire and use information using computers, and this trend is the same for the visually impaired as well as the general public.

In order to improve the level of informatization of the visually impaired, it is necessary to enable them to acquire and use information at a level similar to that of the normal person, which is important in that it makes daily life of the visually impaired more convenient and allows them to acquire and use information on their own. Do. In addition, through this, it can be said that it is very important in that the welfare of the visually impaired can be further improved by providing various educational opportunities to the visually impaired and expanding the opportunities for social advancement and participation.

However, the current general method of using a computer mainly uses a method of recognizing visual information output through a monitor with eyes and inputting information using an input tool such as a keyboard, mouse, or touch pad. Therefore, there is inevitably a great limitation in that the visually impaired, who cannot use the vision, perceives the output information of the computer at the same level as the general person and interacts with it, such as inputting information immediately. As a result, visual impairment significantly degrades the efficiency in computer use, greatly depriving the opportunity to acquire and use information through the computer.

In order to solve such difficulties in using computers by the visually impaired, various technologies have been developed to recognize visual information using hearing, touch, etc. and to interact with computers through this. As a representative technology, there is a screen reader that assists the visually impaired in computer use through hearing. This is a device or software that helps you to use the computer by outputting the contents displayed on the computer screen and the keyboard information inputted by you as a voice.

However, since screen readers search for Graphic User Interface (GUI) elements of the output screen only with linearized information in a single line without two-dimensional spatial location information on the output screen, it is difficult to recognize the screen output information. The more information there is, the greater the difficulty. Also, for various graphic information such as pictures and diagrams in addition to text and GUI elements, the screen reader only provides simple text-based descriptive explanations by voice, so it is difficult for the visually impaired to understand and interact with graphic information. You have great difficulty.

Another related technology is a braille information terminal that transmits text information by tactile sense through a braille cell. This is a method that provides several functions of a computer useful to the visually impaired, and is used as an independent device, and a method that is used as a screen output auxiliary device that outputs text information on a computer screen analyzed by a screen reader in Braille. Rather than acting as an interface for efficient interaction with a computer, both methods serve as an alternative device that performs only a few limited functions of the computer as a substitute for a computer, or as an output assistant that outputs text information in Braille. do. In particular, a braille information terminal specialized in braille output has a problem in that it cannot express graphic information like a screen reader.

Korean Patent Publication No. 10-2012-0063982

It is an object of the present invention to intuitively provide a tactile interface device corresponding to a smart braille device based on a multi-arrangement tactile cell in order to increase the efficiency of the use of smart devices (smart phones, smart pads, etc.) or smart braille devices by the visually impaired. Braille education through a tactile interface device that enables visually impaired people to learn by tactile and auditory information about braille for each language by enabling them to use, interact, and control them through a tactile interface device that allows them to review through exercises. It is to provide a method, apparatus, and non-transitory computer-readable medium for providing support functions.

In order to solve the above problems, the present invention is implemented as a computing device including a processor, and is connected to the computing device to provide a braille education support function through a tactile interface device capable of interacting with a user. A main screen step of outputting a braille education main screen for providing a braille education support function to the visually impaired by executing a braille education module in the computing device; Theoretical learning step of delivering information on Braille to perform learning; And a practice problem solving step of performing a review through practice questions on the learned braille. When any one of them is performed and the braille education module is executed, a screen according to the step is displayed on the computing device, and the screen displayed on the computing device is converted into an output signal to the tactile interface device, and the computing A tactile display corresponding to the screen displayed on the device may be displayed on the tactile interface device, and according to an input from the computing device or an input from the tactile interface device, one of the main screen step, the theory learning step, and the exercise problem solving step Provides a method of providing braille education support functions in which any one of the detailed processes is performed.

In the present invention, the tactile display displayed by the main screen step and the theoretical learning step includes: a cursor area tactilely displaying information on a current cursor position among a plurality of cursor positions; A content area tactilely displaying information corresponding to the position of each cursor; And a page area tactilely displaying information on a current page. It may include.

In the present invention, the theoretical learning step includes: a learning language selection step of selecting a language to perform braille education; An educational material loading step of loading braille educational materials for the language selected in the learning language selection step from the connected braille educational material DB; An educational content selection step of selecting educational content classified and stored in the braille educational material; And an educational data display step of displaying the educational content selected in the educational content selection step through the computing device and the tactile interface device. It may include.

In the present invention, the theoretical learning step, the educational material audio output step of outputting the educational content selected in the educational content selection step; It may further include.

In the present invention, the braille education data DB may store braille education data for two or more languages.

In the present invention, the exercise problem solving step, the exercise problem loading step of loading the exercise problem from the connected exercise problem DB; An exercise problem display step of displaying the retrieved exercise problem through the computing device and the tactile interface device; A correct answer input step in which a user inputs an answer to the exercise problem; A correct answer checking step of checking whether the answer input by the user is correct; And a grade management step of managing the user's grades based on whether or not the correct answer is checked in the correct answer confirmation step. It may include.

In the present invention, the exercise problem loading step may select an exercise problem to be loaded based on the result of the theoretical learning step performed before the exercise problem solving step.

In the present invention, the exercise problem display step, the exercise problem tactile output step of displaying the exercise on a tactile display in the tactile interface device; And a speech output step of outputting the exercise problem as a voice. It may include.

In the present invention, the correct answer checking step includes: a correct answer scoring step of comparing the received answer with a pre-stored correct answer to check whether they match; A scoring result tactile output step of outputting the match checked in the correct answer scoring step to a tactile display from the tactile interface device; And a scoring result voice output step of outputting an audio match whether or not the correct answer is matched. Including, wherein the grade management step, based on the match confirmed in the correct answer scoring step, a scoring result score reflecting step of updating the user's grades; A grade output step of outputting the updated grades through the tactile interface device; It may include.

In the present invention, the tactile display displayed by the exercise problem display step includes: a content area tactilely displaying information on the exercise problem; A page area tactilely displaying information on a current page; And a grade display area tactilely displaying information on the grade. May contain.

In order to solve the above problems, in the present invention, as a device that is implemented as a computing device including a processor and provides a braille education support function through a tactile interface device that is connected to the computing device to interact with a user. , The computing device includes a braille education module; Including, the braille education module, the theory learning module to perform learning by transmitting information about braille; And a practice problem solving module for performing a review through practice questions on the learned braille. Including, the theoretical learning module, a learning language selection step of selecting a language to perform braille education; An educational material loading step of loading braille educational materials for the language selected in the learning language selection step from the connected braille educational material DB; An educational content selection step of selecting educational content classified and stored in the braille educational material; And an educational data display step of displaying the educational content selected in the educational content selection step through the computing device and the tactile interface device. To do, provide a device that provides braille education support functions.

In order to solve the above problems, in the present invention, as a non-transitory computer-readable medium for providing a braille education support function to the visually impaired by controlling a tactile interface device connected to a computing device, the computer-readable medium, It stores instructions for causing the computing device to perform the following steps, the steps comprising: a main screen step of outputting a braille education main screen providing a braille education support function to the visually impaired; Theoretical learning step of delivering information on Braille to perform learning; And a practice problem solving step of performing a review through practice questions on the learned braille. Including, the theoretical learning step, a learning language selection step of selecting a language to perform braille education; An educational material loading step of loading braille educational materials for the language selected in the learning language selection step from the connected braille educational material DB; An educational content selection step of selecting educational content classified and stored in the braille educational material; And an educational data display step of displaying the educational content selected in the educational content selection step through the computing device and the tactile interface device. It provides a computer-readable medium, including.

According to an embodiment of the present invention, a visually impaired person uses a braille device or a tactile interface device to provide a variety of contents (books, education, multimedia, internet, games, etc.) at a level similar to that of ordinary people in daily life such as education, culture, and leisure. ) To utilize the Tactile User Interface for smart braille devices based on multi-array tactile cells and the main operating system-based Braille device such as Android for application interlocking/control/utilization or the operating system of a tactile interface device. Can be demonstrated.

According to an embodiment of the present invention, a multi-array braille cell by converting visual information (visually recognizable information) provided by a smart device to the visually impaired into tactile information (information recognizable by tactile sense) in real time. It is possible to provide an effect of providing a smart braille device operating system that can output through a tactile display, manage various user input information, and control and manage various application software operating on smart devices.

According to an embodiment of the present invention, the operation of the operating system (Android OS) and applications of the smart braille device is controlled through the input unit (braille keyboard/direction keys/function keys, etc.) of a smart braille device based on a multi-array tactile cell. By converting the GUI (Graphic User Interface) information displayed on the screen from the device into TUI (Tactile User Interface) data for the visually impaired and providing it as tactile and braille information, the visually impaired is a general smart device or smart braille device at a level similar to that of the general public. It can be more easily controlled to exert the effect of enabling various contents to be used.

According to an embodiment of the present invention, it is possible to exhibit an effect of supporting education on braille through tactile information and auditory information based on a smart braille device based on a multi-array tactile cell and a TUI for the visually impaired.

According to an embodiment of the present invention, it is possible to exert an effect of performing braille education for each language by selecting a language to perform braille education.

According to an embodiment of the present invention, braille education is performed step by step according to a language in which braille education is to be performed, thereby effectively performing braille education.

According to an embodiment of the present invention, an effect of effectively performing Braille education may be exhibited by performing a theoretical learning on Braille and then solving a practice problem and performing a review.

According to an embodiment of the present invention, it is possible to solve a practice problem for Braille and manage a grade for this so that a user can feel interested in Braille education, and a learning leader can have an effect of checking the educational outcome. .

1 is a diagram schematically showing an entire system including a tactile interface device and a computing device according to an embodiment of the present invention.
2 is a diagram schematically illustrating an internal configuration of a computing device according to an embodiment of the present invention.
3 is a diagram schematically illustrating an operating environment of a braille OS unit according to an embodiment of the present invention.
4 is a diagram schematically showing the internal configuration of a braille OS according to an embodiment of the present invention.
5 is a diagram schematically showing an internal configuration of a TUI module according to an embodiment of the present invention.
6 schematically shows a tactile display screen in a tactile interface device according to an embodiment of the present invention.
7 schematically shows a process of a method for controlling a tactile interface device according to an embodiment of the present invention.
8 schematically shows a detailed process of a trigger step according to an embodiment of the present invention.
9 schematically illustrates a display screen in a computing device according to an embodiment of the present invention and a tactile display in the tactile interface device according to the display screen.
10 schematically shows the configuration of a region of a tactile display in a tactile interface device according to an embodiment of the present invention.
11 schematically illustrates an input/output process of a tactile interface device according to an embodiment of the present invention.
12 schematically shows a process of generating an output signal according to an embodiment of the present invention.
13 schematically illustrates a process of generating a cursor area output signal according to an embodiment of the present invention.
14 schematically illustrates an example of a form of marking a cursor area according to an embodiment of the present invention.
15 schematically illustrates some examples of marking a cursor area according to an embodiment of the present invention.
16 schematically shows a process of generating a buffer output signal according to an embodiment of the present invention.
17 schematically shows an example of a TTS step according to an embodiment of the present invention.
18 schematically shows an example of an event step according to an embodiment of the present invention.
19 shows a screen for controlling a tactile interface device according to an embodiment of the present invention.
20 illustrates a screen for controlling a tactile interface device according to an embodiment of the present invention.
21 shows a screen for controlling a tactile interface device according to an embodiment of the present invention.
22 schematically shows a configuration of a braille education module and a tactile interface device according to an embodiment of the present invention.
23 schematically shows the internal configuration of the Braille education module according to an embodiment of the present invention.
24 schematically shows the internal configuration of an educational material database according to an embodiment of the present invention.
25 schematically shows the internal configuration of the theoretical learning module of the braille education module according to an embodiment of the present invention.
26 schematically shows the internal configuration of the Braille education data DB of the education data database according to an embodiment of the present invention.
27 schematically shows a detailed process of a theoretical learning step according to an embodiment of the present invention.
28 illustrates a screen of a tactile interface device in which a learning language selection step and a TUI conversion are performed for the learning language selection step according to an embodiment of the present invention.
29 shows a screen of a tactile interface device in which a TUI conversion is performed for the education content selection step and the education content selection step according to an embodiment of the present invention.
FIG. 30 shows a screen of a tactile interface device in which TUI conversion has been performed for an education content selection step and the education content selection step according to an embodiment of the present invention.
31 shows a screen of a tactile interface device in which TUI conversion is performed for the education content selection step and the education content selection step according to an embodiment of the present invention.
FIG. 32 shows a screen of a tactile interface device in which TUI conversion has been performed for the education data display step and the education data display step according to an embodiment of the present invention.
33 schematically shows the internal configuration of the exercise problem solving module of the Braille education module according to an embodiment of the present invention.
34 schematically shows a detailed process of the practice problem solving step according to an embodiment of the present invention.
35 schematically shows a detailed process of displaying a practice problem according to an embodiment of the present invention.
36 schematically shows a detailed process of the step of confirming a correct answer according to an embodiment of the present invention.
37 schematically shows a detailed process of the grade management step according to an embodiment of the present invention.
38 illustrates a screen of a tactile interface device in which TUI conversion is performed for the exercise problem solving step and the exercise problem solving step according to an embodiment of the present invention.
39 is a diagram illustrating an example of an internal configuration of a computing device according to an embodiment of the present invention.

In the following, various embodiments and/or aspects are now disclosed with reference to the drawings. In the following description, for purposes of explanation, a number of specific details are disclosed to aid in an overall understanding of one or more aspects. However, it will also be appreciated by those of ordinary skill in the art that this aspect(s) may be practiced without these specific details. The following description and the annexed drawings set forth in detail certain illustrative aspects of one or more aspects. However, these aspects are exemplary and some of the various methods in the principles of the various aspects may be used, and the descriptions described are intended to include all such aspects and their equivalents.

Further, various aspects and features will be presented by a system that may include multiple devices, components and/or modules, and the like. It is also noted that various systems may include additional devices, components and/or modules, and/or may not include all of the devices, components, modules, etc. discussed in connection with the figures. It must be understood and recognized.

As used herein, “an embodiment,” “example,” “aspect,” “example,” and the like may not be construed as having any aspect or design described as being better or advantageous than other aspects or designs. . The terms'~part','component','module','system', and'interface' used below generally mean a computer-related entity, for example, hardware, hardware It can mean a combination of software and software, or software.

In addition, the terms "comprising" and/or "comprising" mean that the corresponding feature and/or element is present, but excludes the presence or addition of one or more other features, elements, and/or groups thereof. It should be understood as not.

In addition, terms including ordinal numbers such as first and second may be used to describe various elements, but the elements are not limited by the terms. These terms are used only for the purpose of distinguishing one component from another component. For example, without departing from the scope of the present invention, a first element may be referred to as a second element, and similarly, a second element may be referred to as a first element. The term and/or includes a combination of a plurality of related listed items or any of a plurality of related listed items.

In addition, in the embodiments of the present invention, unless otherwise defined, all terms used herein including technical or scientific terms are commonly understood by those of ordinary skill in the art to which the present invention belongs. It has the same meaning as. Terms as defined in a commonly used dictionary should be interpreted as having a meaning consistent with the meaning in the context of the related technology, and unless explicitly defined in the embodiments of the present invention, an ideal or excessively formal meaning Is not interpreted as.

1. As a virtual operating system that controls tactile interface devices Braille OS module

1 is a diagram schematically illustrating an entire system including a tactile interface device and a computing device according to an embodiment of the present invention.

The tactile interface device 1000 illustrated in FIG. 1 is only an example, and the present invention is not limited thereto. The tactile interface device 1000 connected to the computing device (A) for controlling the tactile interface device of the present invention described below is an arbitrary interface device capable of providing a tactile graphic and a tactile interface device capable of interacting with a user. , And a computing device capable of outputting a tactile graphic.

As illustrated in FIG. 1, the computing device A is connected to the tactile interface device 1000, and such a connection is a connection including both a wired connection or a wireless connection.

The computing device A includes a smart phone, a tablet personal computer (PC, hereinafter referred to as'PC'), a mobile phone, a video phone, and an e-book reader ( e-book reader), a desktop PC, a laptop PC, a netbook PC, a personal digital assistant (PDA, hereinafter referred to as'PDA'), Portable multimedia player (PMP, hereinafter referred to as'PMP'), MP3 player, mobile medical device, camera, wearable device (for example, head- Mounted device (head-mounted device: HMD, for example, to be referred to as'HMD'), electronic clothing, electronic bracelet, electronic necklace, electronic appcessory, electronic tattoo, or smart watch watch), etc.

The computing device A may include one or more processors and a memory, and may be selectively connected to a display device such as a monitor or may have its own display module.

Alternatively, the computing device A may be combined with the tactile interface device 1000. In this case, the user's point of view may recognize the tactile interface device 1000 and the computing device A that controls it as one device. In the case of such a combined type of device, the computing device A and the tactile interface device 1000 may share a processor and a memory.

The tactile interface device 1000 illustrated in FIG. 1 includes an external device connection unit 1100 capable of performing wired or wireless communication with the computing device A; A tactile display unit 1200 for providing tactile information to a user through a plurality of pins; A direction key unit 1300 for changing an input coordinate or a position of a detailed focused item; A keyboard unit 1400 capable of receiving information in the form of a key input from a user; And a control unit 1500 for controlling the operation of the external device connection unit 1100, the tactile display unit 1200, the direction key unit 1300, and the keyboard unit 1400.

The external device connection unit 1100 includes at least one of a communication module unit capable of performing wireless communication and a wired connection unit capable of connecting to the external device by wire. The communication module unit includes a Bluetooth communication module, a zigbee communication module, an infrared communication module, a bluetooth low energy (BLE) communication module, an audio communication module, a long term evolution (LTE) communication module, and a WiFi communication module, IrDA. It includes at least one of a base infrared communication module, a wireless LAN (WLAN), a WiBro module, and a wireless USB (Wireless USB) module. Meanwhile, the wired connection unit 1120 preferably includes a connection module using a Universal Serial Bus (USB) interface, and a wired connection module capable of transmitting and receiving other data corresponds to this.

The tactile display unit 1200 provides tactile information to tactile pixels of one or more dimensions, and the tactile pixels are configured by a plurality of pins that move up and down by applying power to a transducer including a piezoelectric ceramic and an elastic body. . Preferably, the tactile pixel provides tactile information in two dimensions.

The tactile display unit 1200 may include a display data receiving unit for receiving data generated in the tactile interface device or based on data transmitted from an external user terminal; A tactile data conversion unit converting the data into tactile display data; And a plurality of pin driving modules driven by the tactile display data. And a driving power supply receiving power to drive the tactile display unit 1200, and providing tactile information or tactile graphics based on the received data.

The tactile display unit 1200 may display or provide one or more dimensional tactile pixels. In one example, the tactile pixel is configured by a plurality of pins that move up and down by applying power to a transducer including a piezoelectric ceramic and an elastic body.

Specifically, the tactile pixels are displayed by a plurality of pin driving module groups, and each of the pin driving module groups includes a plurality of pin driving modules. Alternatively, the entire pin drive module may constitute one pin drive module group.

Meanwhile, the direction key unit 1300 changes an input coordinate or a position of a detailed focused item.

The keyboard unit 1400 is in the form of a key that a visually impaired person can input to the tactile interface device 1000, and the keyboard unit 1400 may be composed of a plurality of keys, and the input of each key is the computing It can be converted into a command of an application running on the device A.

On the other hand, the user performs an input to the tactile interface device through the direction key unit 1300 and the keyboard unit 1400, and the tactile interface unit 1000 converts the input command or information to the user terminal. Transfer to (A).

Meanwhile, the keyboard unit 1400 preferably includes a braille keyboard that converts braille commonly used by visually impaired people into general characters and transmits a character input signal to a computer.

The keyboard unit 1400 receives braille input and transmits it to the tactile interface device 1000 or the computing device A connected to the tactile interface device 1000. The keyboard unit 1400 may include a braille key, a shortcut key, and an execution or space key.

In Braille, several dots are gathered to form a single character, so if the Braille keys are pressed at the same time, the final Braille information can be transmitted. The transmitted braille information may be translated into a general character through software inside the tactile interface device 1000 or software of a computing device.

Therefore, for the computer input/output function for the visually impaired, the tactile display unit 1100 serves as a monitor of a general computer, and the direction key unit 1300 and the keyboard unit 1400 are used for the keyboard and mouse of a general computer. It plays the role of an input device.

2 is a diagram schematically illustrating an internal configuration of a computing device according to an embodiment of the present invention.

The computing device for controlling the tactile interface device 1000 according to the present embodiment may include a processor, a bus (corresponding to a double arrow between a processor, a memory, and a network interface unit), a network interface, and a memory. The memory may include a braille OS part execution code 3400, a general OS part execution code 3500, an application program part execution code 3600, and an input/output control routine 3700. The processor includes a braille OS unit 2000; General OS unit 3100; And an application program unit 3200. Here, the general OS unit 3100 corresponds to the main operating system of the computing device, and may correspond to GOOGLE's ANDROID OS, MICROSOFT's WINDOWS OS, and the like.

In other embodiments, the computing device A that controls the tactile interface device 1000 may include more components than the components of FIG. 2.

The memory is a computer-readable recording medium and may include a permanent mass storage device such as a random access memory (RAM), a read only memory (ROM), and a disk drive. In addition, a braille OS unit execution code 3400, a general OS unit execution code 3500, an application program unit execution code 3600, and an input/output control routine 3700 may be stored in the memory. These software components may be loaded from a computer-readable recording medium separate from the memory using a drive mechanism (not shown). Such a separate computer-readable recording medium may include a computer-readable recording medium (not shown) such as a floppy drive, a disk, a tape, a DVD/CD-ROM drive, or a memory card. In another embodiment, software components may be loaded into the memory through the network interface unit 3300 rather than a computer-readable recording medium.

The bus may enable communication and data transmission between components of a computing device that controls the tactile interface device. The bus may be configured using a high-speed serial bus, a parallel bus, a storage area network (SAN) and/or other suitable communication technology.

The network interface unit 3300 may be a computer hardware component for connecting the computing device A controlling the tactile interface device 1000 to a computer network. The network interface unit 3300 may connect a computing device that controls the tactile interface device to a computer network through a wireless or wired connection. A computing device that controls the tactile interface device through the network interface unit 3300 may be wirelessly or wiredly connected to the tactile interface device.

The processor may be configured to process instructions of a computer program by performing input/output operations of a computing device that controls basic arithmetic, logic, and tactile interface devices. The instructions may be provided by the memory or network interface unit 3300 and to the processor through a bus. The processor includes a braille OS unit 2000; General OS unit 3100; And it may be configured to execute a program code for the application program unit 3200. Such program codes may be stored in a recording device such as a memory.

The braille OS unit 2000 may be configured to perform a method of controlling the tactile interface device 1000 to be described below. In the processor described above, some components may be omitted, additional components (not shown) may be further included, or two or more components may be combined according to a method of controlling the tactile interface device.

3 is a diagram schematically illustrating an operating environment of a braille OS unit according to an embodiment of the present invention.

The general OS unit 3100 corresponds to a software module corresponding to the main operating system of the computing device A, and under the control of the general OS unit 3100, the braille OS unit 2000 and the application program unit 3200 are driven. do. That is, the method of controlling the tactile interface device according to the present invention is implemented by a braille OS unit corresponding to a virtual sub-operating system for the tactile interface device, which operates under the control of the main operating system of the computing device (A). I can.

Such a braille OS unit 2000 controls the driving and input/output of the tactile interface device 1000, while at the same time, the application program unit 3200 and the application program unit 3200 operating under the control of the general OS unit 3100. Input/output between the tactile interface device 1000 is controlled.

In addition, the braille OS unit 2000 may include an application program that controls the environment of the tactile interface device 1000 and a built-in basic program capable of input/output from the tactile interface device 1000.

Meanwhile, in the environment of the braille OS unit 2000, developers develop software or application programs for the visually impaired based on the display of an actual computing device, for example, a smartphone, and the tactile sense of such an application program. Input/output to the interface device 1000 may be performed by the braille OS unit 2000.

That is, the braille OS unit 2000 that performs the control method of the tactile interface device of the present invention develops software having a general GUI by a general developer, and the software developed as described above is used by the visually impaired through the braille OS unit 2000. This input/output can be implemented in the tactile interface device 1000 in a form capable of performing input/output, so that a general software developer can provide a wider variety of software to the visually impaired.

4 is a diagram schematically showing an internal configuration of a braille OS unit according to an embodiment of the present invention. As shown in FIG. 4, the braille OS unit 2000 includes a trigger module 2100, a main screen module 2200, an environment setting module 2300, a tactical user interface (TUI) module 2400, and an embedded application module. (2500), a TTS (Text To Speech) module 2600, and an e-ment module 2700.

The trigger module 2100 confirms a connection between the computing device A and the tactile interface device 1000; And when it is determined that the computing device A and the tactile interface device 1000 are interconnected, a step of invoking execution of the step of executing the main screen module 2200 is performed.

The braille OS unit 2000 is basically executed in a computing device that interfaces with a visual display. Accordingly, in order for the visually impaired to use the tactile interface device by executing each module of the braille OS unit in the computing device, the braille OS unit must be executed.

Execution of an application in a general smartphone is executed by a user checking an application icon or the like in a GUI of a smartphone and performing a touch input, but such an operation may be difficult for the visually impaired.

Since the execution of the braille OS unit must be executed by a visually impaired person, unlike the execution of an application executed in a general computing device, the trigger module 2100 operates in the background of the main operating system, When a visually impaired person makes a connection between the tactile interface device and the computing device A (preferably, such a connection is made when the visually impaired person inputs a physical button on the tactile interface device), the trigger module 2100 ) Primarily calls the execution of the main screen module 2200.

The main screen module 2200, for example, when starting the tactile interface device as shown in FIG. 9, displays the main screen of the braille OS unit like a window desktop, and selects a module or function desired by the user on the main screen. You can provide a page that performs to do so.

Preferably, the main screen module 2200 provides an interface that is simply displayed on the computing device, as shown in FIG. 9A. That is, when the main screen module is executed, the visual display device connected to the computing device displays a GUI interface as shown in FIG. 9A. At the same time, the output signal of the GUI interface is converted into an output signal of the tactile interface by the TUI module 2400 and transmitted to the tactile interface device 1000, so that the visually impaired can tactilely perceive the main screen. have. Both an application program embedded in the Braille OS unit or an external application program that can operate under the control of the Braille OS unit can be manufactured to provide such a GUI.

Meanwhile, the main screen module 2200 is provided by the braille OS unit 2000. That is, when the braille OS unit 2000 is executed, the main screen module provided by the braille OS unit, that is, a sub operating system executed under the control of the main operating system, is executed. Alternatively, the main screen module may be executed by the trigger module.

The environment setting module 2300 is a module that provides an interface for setting the environment of the braille OS unit 2000 and/or the environment of the tactile interface device 1000. Similarly, when the environment setting module 2300 is executed, an interface for environment setting is provided in a display device connected to the computing device A, and at the same time, the TUI module 2400 connects the interface to the tactile interface device 1000. Converts it into a form that can be input/output.

The TUI module 2400 generates an output signal for implementing a tactile screen of the tactile interface device 1000 corresponding to a screen that can be displayed on the computing device A by the main screen module or another application application module. And generates an input signal for input to the main screen module 2200 from a user input input by the tactile interface device 1000.

That is, the TUI module 2400 is provided by the main screen module 2200 and the braille OS unit 2000 and provides a built-in application or a GUI of an external application application operating under the control of the main operating system. 1000) converts to TUI that can be interfaced. Therefore, if a general developer develops only general software operating in the computing device A, the interface of the software is converted into a form that can be interfaced with the tactile interface device by the TUI module 2400, and as a result, visual The software can be used by people with disabilities.

That is, in the braille OS unit 2000, an application module execution step called from the main screen module 2200 according to a user's input; And a second TUI step of executing a TUI module provided by the sub-operating system, wherein the second TUI step includes the tactile interface device corresponding to a screen that can be displayed on the computing device by the application module An output signal for realizing the tactile screen of is generated, and an input signal for inputting to the application module is generated from a user input input from the tactile interface device.

The built-in application module 2500 may correspond to an application such as an alarm, a clock, a basic document creator, and a basic document viewer, and similarly, the built-in application is manufactured based on a GUI for the general public, but the TUI module ( 2400) can also be used by the visually impaired through the tactile interface device.

The TTS module 2600 itself performs a TTS function for elements displayed or tactile displayed by the main screen module 2200, the environment setting module 2300, or other application modules, or the TTS operating in the main operating system. It performs the function of requesting TTS execution while providing text information subject to TTS to the functioning module.

The event module 2700 performs a function of generating an event notification output signal to the tactile interface device based on a connection state between the user terminal and the tactile interface device. A visually impaired person cannot easily recognize the case that the connection with the computing device is released by the tactile interface device they are interfacing with, and in order to solve this problem, the Braille OS unit provides an event module to provide information on connection failure. It performs the function of immediately transmitting to the tactile interface device.

5 is a diagram schematically showing an internal configuration of a TUI module according to an embodiment of the present invention. (This drawing is not attached to the word document)

The TUI module generates an output signal for implementing a tactile screen of the tactile interface device 1000 corresponding to a screen that can be displayed on the computing device A by the main screen module 2200 or other applications. An output signal generator 2410; An input signal generator (2420) for converting an input such as a key input from the tactile interface device into a form that can be input to a main screen module or other application executed in the computing device to generate an input signal; A scaling information loading unit (2430) for loading scaling information suitable for a pixel of a tactile display unit of a tactile interface device connected in the operation of the output signal generation unit; And a buffer output signal generator 2440 for generating a buffer output signal based on the output signal and previous tactile display information of the tactile interface device.

Here, the output signal and the buffer output signal include a control signal for a two-dimensional tactile cell array.

A program module including the main screen module 2200 and the like may convert input/output signals to a tactile interface device through the TUI module 2400.

Meanwhile, it is preferable that the scaling information loading unit 2430 loads the tactile display pixel information in a manner that automatically receives the tactile display pixel information of the corresponding tactile interface device from the connected tactile interface device. Alternatively, such tactile display pixel information may be stored in the memory of the computing device A.

6 schematically shows a tactile display screen in a tactile interface device according to an embodiment of the present invention.

As described above, the TUI module 2400 is an output signal generator that generates an output signal for implementing a tactile screen of the tactile interface device 1000 corresponding to a screen that can be displayed on the computing device A. It includes (2410).

Meanwhile, the output signal includes a control signal for the two-dimensional tactile cell array, and the tactile screen of the tactile interface device implemented by the output signal can be displayed on the computing device by the main screen module 2200. A content area L1 implemented based on a content portion of the existing screen; A cursor area (L2) for implementing the location and shape of the current user's cursor; And a page area L3 implemented based on page information of a screen that can be displayed on the computing device by the main screen module.

Meanwhile, as shown in FIG. 6, various physical keys are provided in the tactile interface device, and each physical key is assigned a function to perform a more intuitive function. By inputting such a physical key, the TUI module 2400 performs the function, and the TUI module generates a command for an application running on the computing device, and the command is input to an application running on the computing device. Can be.

7 schematically shows a process of a method for controlling a tactile interface device according to an embodiment of the present invention.

In step S10, a trigger step of calling execution of the main screen module is performed by the visually impaired user turning on the tactile interface device or inputting a key for connection of the tactile interface device to the computing device.

As described above, the trigger module 2100 of the braille OS unit 2000 operates in the background under the control of the main operating system of the computing device, and when the above conditions are satisfied, the main screen module ( 2200).

In the case of the visually impaired, it is more advantageous that the first starting page is constant, so that the trigger step (S10) preferably calls the execution of the main screen module 2200.

In step S20, the main screen module 2200 is executed. In the GUI display connected to the computing device A by the execution of the main screen module, the screen of the main screen module 2200 is visually displayed. As described above, since the main screen module 2200 is basically in a form that is visually displayed, developers can develop the main screen module 2200 or other application applications in a general manner without considering Braille or the visually impaired. . In addition, when a blind person has a problem in using a specific application, the general person manipulates a general interface element (for example, a touch display) connected to the computing device to solve the problem that occurs when the blind person uses the application. You can do it.

In step S30, the TUI module 2400 is executed for the main screen displayed by the main screen module 2200, and the output elements of the main screen module 2200 are displayed in the tactile display of the tactile interface device 1000. It converts into a driving signal of the unit 1200 or converts an input from the tactile interface device 1000 into a command that can be input to the main screen module 2200. This is referred to as a first TUI step (S30) for convenience.

In step S40, a separate application is executed by the user's operation. The separate application may be an application provided by the braille OS 2000 unit or an application separately provided from the braille OS unit 2000.

In step S50, the TUI module 2400 is executed for the screen displayed by the separate application, and the output element of the screen is converted into a driving signal of the tactile display unit 1200 of the tactile interface device 1000. Or converts the input from the tactile interface device into a command that can be input to the application. This is referred to as a second TUI step (S50) for convenience. Here, the second TUI step may also be performed by the TUI module 2400 provided by the braille OS unit 2000.

In step S60, execution of the TTS function for a specific area is called according to the user's operation of the tactile interface device. Preferably, the braille OS unit 2000 determines a portion to be TTS target, and requests the TTS application operated by the main operating system to perform the TTS function.

In step S70, based on the connection state between the computing device and the tactile interface device, an event module for notifying the tactile interface device 1000 is executed.

8 schematically shows a detailed process of a trigger step according to an embodiment of the present invention.

The trigger step may be performed before the step of executing the main screen module 2200. That is, the main screen module 2200 is not called by a general user executing the braille OS unit 2000 on a computing device, but a blind user turns on the power of the tactile interface device (in this case, automatically allocated Connected to a computing device) or a tactile display device that is ON to request access to the computing device.

The triggering step may include checking the connection between the computing device (A) and the tactile interface device (1000) (S11); And invoking execution of the step of executing the main screen module 2200 when it is determined that the computing device A and the tactile interface device 1000 are interconnected (S12).

9 schematically illustrates a display screen in a computing device according to an embodiment of the present invention and a tactile display in the tactile interface device according to the display screen.

FIG. 9(A) shows a display screen of the computing device when the main screen module is executed when the computing device is a smart phone, and FIG. 9(B) shows a time point when FIG. 9(A) is displayed. The state of the tactile interface device at the same time point is shown.

The main screen module 2200 displays each menu (contents) in a one-dimensional arrangement, and displays a cursor thereon in a manner to be positioned next to each menu. That is, the main screen module divides the content into a plurality of units and displays the content in a form divided into a plurality of units on the computing device. Thereafter, the TUI module 2400 divides the content divided into a plurality of units into a plurality of subcontent areas.

Meanwhile, the tactile interface device 1000 also displays each menu (contents) in a one-dimensional arrangement, and displays a cursor for this in a form such that it is positioned next to each menu.

10 schematically shows the configuration of a region of a tactile display in a tactile interface device according to an embodiment of the present invention.

The tactile screen of the tactile interface device implemented by the output signal generated by the TUI module 2400 is a content portion of the screens that can be displayed on the computing device A by the main screen module 2200 (Fig. In 9, a content area L1 implemented based on a menu); A cursor area L2 that implements the position and shape of the current user's cursor; And a page area L3 implemented based on page information of a screen that can be displayed on the computing device by the main screen module 2200.

In addition, the content area may be divided into a plurality of sub-content areas, the cursor area may be divided into a plurality of sub-cursor areas, and the position of the cursor implemented in the cursor area is the position of the focused sub-content area It is preferable to correspond to. This type of tactile display corresponds to a structure in which the visually impaired can most efficiently check information and perform input.

The sub-content area is composed of a plurality of braille cell groups, and each braille cell group includes a plurality of braille cells, for example, six braille cells. Here, one braille cell refers to one braille hole.

Likewise, each of the sub-cursor regions also includes one or more braille cells, preferably a plurality of braille cells in a shape capable of informing information on the location and shape of the cursor.

More preferably, as in the "focused L2 area" and "focused L1 area" of FIG. 10, the sub-cursor area and the sub-content area corresponding to the sub-cursor area are aligned with each other along one axis. In such a structure, the visually impaired can most effectively grasp where the part of the cursor is focused. Such an interface form corresponds to a form derived by the applicant of the present invention through various experiments with the visually impaired.

11 schematically illustrates an input/output process of a tactile interface device according to an embodiment of the present invention.

Steps S110, S120, and S130 are performed by the TUI module 2400. Meanwhile, in step S140, a command is input to the application, and accordingly, the interface or screen output of the application is changed.

Steps S150, S160, and S170 are performed by the TUI module 2400. By performing these steps, changes in the interface or screen output of the application are transmitted to the tactile interface device 1000, and the user can immediately recognize such changes.

12 schematically shows a process of generating an output signal according to an embodiment of the present invention.

The output signal generation step includes: a content area output signal generation step (S310) of generating a control signal of the two-dimensional tactile cell array for the content area; A cursor region output signal generating step (S320) of generating a control signal of the two-dimensional tactile cell array for the cursor region; And a page region output signal generating a control signal of the two-dimensional tactile cell array for the page region Step (S330); includes.

As shown in FIG. 10, the content area may be divided into a plurality of sub-content areas, the cursor area may be divided into a plurality of sub-cursor areas, and the content area output signal generation step (S310) is performed by the main screen module By separating the data of the content portion of the screen that can be displayed on the computing device, generating an output signal for implementing the plurality of sub-content areas, and generating the cursor area output signal (S320) comprises: An output signal for controlling a tactile cell array at a portion of the cursor area corresponding to a sub-content area in which the user's cursor is located is generated among the content areas.

13 schematically illustrates a process of generating a cursor area output signal according to an embodiment of the present invention.

The cursor region output signal generation step (S320) may include determining a position of the user's cursor (S321); And determining the shape of the user's cursor (S322 and S323).

The user's cursor performs a function of focusing a part of the detailed content area. In the case of a general cursor, only position information needs to be displayed, but in the case of a tactile display device, since the braille pixel has a lower pixel than the general display pixel, there may be a problem that information in one detailed content area cannot be displayed at once. .

In an embodiment of the present invention, in addition to determining the position of the cursor, steps (S322 and S323) of determining the shape of the user's cursor are performed, so that the visually impaired can intuitively use the software.

Specifically, determining the shape of the user's cursor (S322 and S323) is a tactile interface of the original text of the sub-content area where the cursor is located or the sub-content area indicated by the cursor, and the sub-content area where the cursor is located or indicated by the cursor. Loading the output signal of the device or tactile display information from the tactile interface device (S322), and determining a cursor shape based on the original text and the output signal or the tactile display information to generate a cursor layer output signal (S323). Include.

That is, in the cursor region output signal generation step, the tactile display information of the tactile interface device in the sub-content region where the user's cursor is positioned and the original text information of the main screen module in the sub-content region where the user's cursor is positioned. Based on the user's cursor shape is determined.

Preferably, the determining of the shape of the user's cursor (S322 and S323) includes the tactile display information of the tactile interface device in the sub-content area where the user's cursor is located. When all the original text information of the main screen module of the content area is included, the first cursor form is determined,

When the tactile display information of the tactile interface device in the sub-content area where the user's cursor is located includes part of the original text information of the main screen module in the sub-content area where the user's cursor is located, the second cursor form To decide.

More preferably, the original text information of the main screen module 2200 in the sub-content area where the user's cursor is positioned is first original text information, second original text information following the first original text information, and the second original text information Next, when the third original text information is included, the second cursor shape is, when tactile display information in the tactile interface device in the subcontent area where the user's cursor is located corresponds to the first original text information 2-1 cursor shape displayed; A 2-2 cursor type displayed when the tactile display information of the tactile interface device in the sub-content area where the user's cursor is positioned corresponds to a part of the second original text information; And a 2-2 cursor type displayed when the tactile display information of the tactile interface device in the sub-content area where the user's cursor is positioned corresponds to the third original text information.

In a preferred embodiment of the present invention, information in the content area is divided into a plurality of content sub-areas and displayed on the tactile interface device.

For example, it is assumed that the information in the content area is as follows.

"The base of a refreshable braille display often integrates a pure braille keyboard.There, the input is performed by two sets of four keys on each side, while output is via a refreshable braille display consisting of a row of electro-mechanical character cells, each of which can raise or lower a combination of eight round-tipped pins.Other variants exist that use a conventional QWERTY keyboard for input and braille pins for output, as well as input-only and output-only devices.

On some models the position of the cursor is represented by vibrating the dots, and some models have a switch associated with each cell to move the cursor to that cell directly.

The mechanism which raises the dots uses the piezo effect of some crystals, whereby they expand when a voltage is applied to them. Such a crystal is connected to a lever, which in turn raises the dot. There has to be a crystal for each dot of the display, i.e. eight per character."

In this case, the TUI module is "The base of a refreshable braille display often integrates a pure braille keyboard. There, the input is performed by two sets of four keys on each side, while output is via a refreshable braille display consisting of a row of electro-mechanical character cells, each of which can raise or lower a combination of eight round-tipped pins.Other variants exist that use a conventional QWERTY keyboard for input and braille pins for output, as well as input-only and output-only devices." is assigned to the first sub-content area, and an output signal for this is generated,

Assign "On some models the position of the cursor is represented by vibrating the dots, and some models have a switch associated with each cell to move the cursor to that cell directly." as the second sub-content area, and an output signal for this is assigned. And create

"The mechanism which raises the dots uses the piezo effect of some crystals, whereby they expand when a voltage is applied to them. Such a crystal is connected to a lever, which in turn raises the dot.There has to be a crystal for each By allocating dot of the display, ie eight per character." to the third sub-content area, an output signal for this may be generated.

However, when it is assumed that one sub-content area can display 30 CHARACTERs, the original text of the second sub-content area can be classified as follows.

"On some models the position of" (1st original information)

"the cursor is represented by v" (the first part of the second original information)

"ibrating the dots, and some mo" (2nd part of the 2nd original information)

"dels have a switch associated" (the third part of the second original information)

"with each cell to move the cur" (Part 4 of the 2nd original information)

"sor to that cell directly." (3rd original text information)

Here, one sub-content area may display only one of the first original information to the third original information. In this case, the visually impaired person checks the braille information of the cursor displayed in the sub-cursor area corresponding to the sub-content area (the second sub-content area), and the information of the sub-content area currently output from the tactile interface device is among the total information. You can see where it is located. Thereafter, the visually impaired can move between the first original information to the third original information by operating the direction keys of the tactile interface device. In this way, while minimizing discomfort due to the limitation of the tactile pixels of the tactile display device, the visually impaired can more intuitively grasp information.

14 schematically shows an example of a form of marking a cursor area according to an embodiment of the present invention.

14 shows an example of a cursor shape that can be displayed in a total of four cursor areas, more preferably a sub-cursor area. By grasping the shape of the cursor and manipulating the arrow keys, the display items of the sub-content layer can be changed.

The first cursor shape, the 2-1 cursor shape, the 2-2 cursor shape, and the 2-3 cursor shape are respectively the first cursor shape, the second cursor shape, and the third cursor shape in FIG. , Corresponds to the fourth cursor shape.

15 schematically illustrates some examples of marking a cursor area according to an embodiment of the present invention.

As shown in (A) of FIG. 15, the entire content is divided into contents 1 to 6, and is shown in each sub-content area. When the user focuses on the first sub-content area, the first sub-content area The tactile graphic for the cursor is displayed in the sub-cursor area located in parallel or aligned with the.

Here, when the content 1 cannot be displayed in one sub-content area, the content 1 is virtually divided into “content 1A content 1B content 1C”, and initially, content 1A is tactile as shown in FIG. 15B. It is displayed as a graphic, and the tactile graphic for the left cursor has the second cursor shape of FIG. 14.

Subsequently, when the user presses the right arrow key, the content 1B is displayed as a tactile graphic as in FIG. 15C, and the tactile graphic for the left cursor has the third cursor shape of FIG. 14.

Thereafter, when the user presses the right direction key, the content 1C is displayed as a tactile graphic as in FIG. 15D, and the tactile graphic for the left cursor has the fourth cursor shape of FIG. 14.

16 schematically shows a process of generating a buffer output signal according to an embodiment of the present invention.

Hereinafter, for convenience of explanation, the operation of the buffer output signal generation step for conversion of the main screen module will be described. However, the step of generating the buffer output signal may be applied not only to the conversion of the main screen module, but also to the conversion of a display screen of another application.

As described above, the first TUI step (S30) is an output for realizing a tactile screen of the tactile interface device corresponding to a screen that can be displayed on the computing device by the main screen module 2200 or another application. An output signal generation step of generating a signal (S150); And a buffer output signal generation step (S160) of generating a buffer output signal based on the output signal and previous tactile display information of the tactile interface device.

Here, the output signal and the buffer output signal include a control signal for a two-dimensional tactile cell array.

Preferably, the first TUI step (S30) is performed whenever a screen that can be displayed on the computing device is changed by the main screen module, and the buffer output signal generation step is performed immediately before the output Based on the difference between the signal and the current changed output signal, the buffer output signal is generated.

Specifically, the step of generating the buffer output signal (S160) may include loading a previous output signal generated by the output signal generator before the screen is changed to the previous, that is, a current user's input (S410);

Calculating a difference between the current output signal generated by the output signal generator and the previous output signal after the screen is changed by the input of the current user (S420);

And generating a buffer output signal based on the difference between the current output signal and the previous output signal (S430).

Since such a buffer output signal includes only a control signal for the currently changed portion of the tactile array in the tactile interface device, the tactile interface device can operate more physically and smoothly.

17 schematically shows an example of a TTS step according to an embodiment of the present invention.

As described above, the method of controlling the tactile interface device 1000 further includes a TTS step of performing a TTS command according to a user's command.

The TTS step may include determining whether to perform TTS based on an input signal or command from the tactile interface device (S510); Loading information on the currently set TTS mode (S520); A cursor position loading step of loading a current user's cursor position (S530); And determining original text information subject to TTS based on the TTS mode and the position of the user's cursor (S540). And requesting execution of the original text information determined in step S540 to the TTS execution module (S550).

Preferably, the TTS step may be performed for each sub-content area. That is, the original text of the sub-content area in which the cursor is currently positioned may be output as a voice by the TTS step.

More preferably, the TTS mode includes a mode for performing TTS on the focused sub-content area; And a mode for performing TTS including the focused sub-content area and a sub-content area following the focused sub-content area.

That is, "On some models the position of the cursor is represented by vibrating the dots, and some models have a switch associated with each cell to move the cursor to that cell directly." corresponds to the first subcontent area, and "The mechanism which raises the dots uses the piezo effect of some crystals, whereby they expand when a voltage is applied to them.Such a crystal is connected to a lever, which in turn raises the dot.There has to be a crystal for each dot of the display, ie eight per character." corresponds to the second sub-content area, and the area in which the cursor is focused is the first sub-content area, the TTS mode is the first mode and the first mode processing only the first sub-content area. A second mode may be included in which the first sub-content area and the second sub-content area are processed, but when a user's OFF-related command is inputted, a second mode is stopped.

18 schematically shows an example of an event step according to an embodiment of the present invention.

As shown in Fig. 18, the event step includes determining a connection state between the user terminal and the tactile interface device (S610); And generating (S620) an event output signal to be output to the tactile interface device when it is determined that the connection state corresponds to a preset reference.

By performing such an event step, the visually impaired can intuitively determine whether or not there is a failure in connection between the tactile interface device and the computing device.

FIG. 19 is a screen for controlling a tactile interface device according to an embodiment of the present invention, FIG. 20 is a screen for controlling a tactile interface device according to an embodiment of the present invention, and FIG. A screen for controlling a tactile interface device according to an embodiment is shown.

19 to 21, the method of controlling the tactile interface device according to an embodiment of the present invention allows any program to intuitively interface with a program to a visually impaired user, and also, a program developer Even if you do not know Braille, and do not develop a separate input/output API for this, software for the visually impaired can be supplied through the development of general software.

2. Method of providing Braille education support function through tactile interface device

22 schematically shows the configuration of a braille education module and a tactile interface device according to an embodiment of the present invention.

The configuration of the computing device A illustrated in FIG. 22 follows the description with reference to FIGS. 2 and 3 described above. Meanwhile, the configuration of the braille OS unit 2000 of FIG. 22 follows the description with reference to FIGS. 4 to 18.

Meanwhile, the braille education module 5000 of FIG. 22 may correspond to one type of the application program unit 3200 of FIG. 3, or may correspond to the embedded application module 2500 of FIG. 4.

Likewise, the information output from the braille education module 5000 may be displayed in a visual form that can be recognized by the general public on a display device connected to the computing device A, and is similarly embedded in the braille OS unit 2000. The input/output signal may be converted in a form in which the visually impaired can interface in the tactile interface device 1000 by a common TUI module or a special TUI module for only the braille education module built in the braille education module 5000.

Preferably, in an embodiment of the present invention, the braille OS unit 2000 includes a common TUI module 2400, and the braille education module 5000 has a visual impairment in consideration of the specificity of the braille education module. It is preferable to include a separate TUI module (not shown) that can make the interface more smooth.

Similarly, the execution of the braille education module 5000 is controlled by the braille OS unit 2000, and while the braille education module 5000 is controlled, the TTS module 2600, the event module 2700, etc. This can also be done at the same time.

On the other hand, in the computing device (A), the braille education module 5000 is executed, the main screen step of outputting a braille education main screen providing a braille education support function to the visually impaired; Theoretical learning step of delivering information on Braille to perform learning; And a practice problem solving step of performing a review through practice questions on the learned braille. Either of these can be performed. Accordingly, any one of a main screen step, a theory learning step, and an exercise problem solving step may be performed according to an input from the computing device A or an input from the tactile interface device 1000.

When the braille education module 5000 is executed, the screen according to the step is displayed on the computing device (A), and the screen displayed on the computing device (A) is converted into an output signal to the tactile interface device 1000 Thus, a tactile display corresponding to the screen displayed on the computing device A may be displayed on the tactile interface device 1000.

The Braille education module 5000 may be located inside or connected to an education data database 7000 provided as a separate device outside. In the education data database 7000, braille education materials that can provide a braille education program to a user through the computing device A or the tactile interface device 1000 and exercise questions that can check the results of education are stored. There may be. In one embodiment of the present invention, the braille education module 5000 retrieves the education material or exercise stored from the education data database 7000 according to the user's selection, and the computing device (A) or the tactile interface device (1000) Education can be performed by printing through ).

23 schematically shows the internal configuration of the Braille education module according to an embodiment of the present invention.

As described above, the Braille education module 5000 is implemented as a computing device (A) including a processor, and is connected to the computing device (A) through a tactile interface device 1000 capable of interacting with a user. Braille education support function is provided.

On the other hand, the braille education module 5000 is a TUI module 5100 that converts signals input/output from the internal function module of the braille education module into a form that can be more intuitively recognized or input by the tactile interface device 1000 (Here, the TUI module is preferably a module included in the Braille education module separately from the TUI module 2400 of the Braille OS unit 2000 of FIG. 4); A theory learning module 5200 that transmits information about Braille to perform learning; And a practice problem solving module 5400 for performing a review through practice problems for the learned braille. Includes.

The TUI module 5100 converts information that can be displayed graphically in the theory learning module 5200 and the exercise problem solving module 5400 into a form that can be displayed as a tactile graphic in the tactile interface device 1000 do.

First, when the braille education module 5000 is driven, the theoretical learning module 5200 is executed in the computing device A. The theoretical learning module 5200 allows the user to select the educational content among the braille educational materials stored in the educational data database 7000 and provides the selected educational content directly to the visually impaired through the tactile interface device 1000. Corresponds to the component to do. After providing theoretical education to the user through the theory learning module 5200, the exercise problem solving module 5400 for outputting the exercise questions for the educational content and receiving and evaluating the user's answer may be executed.

With such a configuration, it is possible to exhibit the effect of supporting education on braille through tactile information and auditory information based on a smart braille device based on a multi-array tactile cell and a TUI for the visually impaired.

24 schematically shows the internal configuration of an educational material database according to an embodiment of the present invention.

Referring to FIG. 24, the education data database 7000 according to an embodiment of the present invention may include a Braille education data DB 7100 and an exercise problem DB 7200.

The Braille educational material DB 7100 stores educational materials for educating users in Braille. In an embodiment of the present invention, educational materials for two or more languages may be stored so as to educate braille for various languages. The educational material may enable a user to easily learn Braille through a theoretical explanation of Braille to the user.

The exercise problem DB 7200 may store exercise questions that enable a user who has performed learning through the education materials of the Braille education material DB 7100 to check the learning outcome through solving the exercise problems. This exercise may be linked to the educational material of the Braille educational material DB 7100 to perform a role of reviewing the educational material.

25 schematically shows the internal configuration of the theoretical learning module of the braille education module according to an embodiment of the present invention.

According to an embodiment of the present invention, the theory learning module 5200 of the braille education module 5000 includes: a learning language selection unit 5210 for selecting a language to perform braille education; An education material loading unit 5220 for loading braille education data for the language selected in the learning language selection step from the connected braille education data DB; And a learning progress unit 5230 for performing braille learning based on the educational content classified and stored in the braille educational material. Includes.

The learning language selection unit 5210 selects a language to perform Braille education. The commonly used Braille is based on the six-point Braille system created by Louis Braille in France. This 6-point braille is a system in which letters are marked by a dot type that is distinguished by the number and position of dots, and out of 64 (2 ⁶ ) dot types that can be created with six dots, 63 dot types excluding the case with no dot Use to mark Braille.

At this time, it is very difficult to represent a large number of letters or symbols with only 63 dots. Accordingly, the notation using Braille for each language is different, and the system is also different. Therefore, in order to learn Braille, it is necessary to learn through different educational content depending on the language in which the learning is to be performed. In an embodiment of the present invention, when training is conducted using the education data database 7000 in which education materials for braille in various languages are stored, the language to be trained in Braille is selected by the learning language selection unit 5210. By selecting, it is possible to perform learning on Braille in the selected language.

The education material load unit 5220 loads braille education data for the language selected by the learning language selection unit 5210 from the connected braille education data DB 7100. In the Braille educational material DB 7100 according to an embodiment of the present invention, educational materials for teaching Braille for each language are stored, and educational materials for each language are classified according to the progress of education. Education materials may be stored.

The learning progress unit 5230 performs braille learning based on the education contents classified and stored in the braille education material. The learning progress unit 5230 may allow the user to select educational materials that are classified and stored according to classifications that can be classified according to the progress of the training so that the user can perform the desired training. The education material loading unit 5220 may load a classification list of stored education data when calling braille education data from the braille education data DB 7100, and the learning progress unit 5230 may call the classification list of the education data. The display device connected to the computing device A and output through the braille interface device 1000 may be output, and the user may select a classification to proceed with education.

Preferably, the learning progress unit 5230 may recommend educational content to the user based on the previously conducted training content by storing information on the previously performed training progress. For example, the learning progress unit 5230 may recommend education content following the last education content previously conducted, or identify the user's education preference by grasping the progress pattern of the previously conducted education content. Therefore, it is possible to recommend educational content that users may prefer.

When the user selects the educational material, the learning progress unit 5230 performs education by displaying the contents of the educational material to the user. The learning progress unit 5230 may display educational materials through a display device connected to the computing device A and the tactile interface device 1000. In this case, since the user is a learner who learns Braille, it is difficult for the user to easily understand it when information is transmitted through only Braille. Accordingly, in an embodiment of the present invention, the learning progress unit 5230 may enhance the user's understanding by outputting the educational material through voice.

26 schematically shows the internal configuration of the Braille education data DB of the education data database according to an embodiment of the present invention.

In an embodiment of the present invention, the Braille educational material DB 7100 may store Braille educational materials for two or more languages as shown in FIG. 26. In the embodiment shown in Fig. 26, the Braille educational material DB 7100 is a Korean Braille DB 7110 storing educational materials for Korean Braille and an English Braille DB 7120 storing educational materials for English Braille. Includes. As described above, when braille education materials for two or more languages are stored, the user can select one of them and perform braille learning for the selected language.

In the embodiment of FIG. 26, braille education materials for consonants 7111, vowels 7112, abbreviations/abbreviations 7113, and symbols/numbers 7114 are stored in the Korean Braille DB 7110. As described above, in the case of the Hangul Braille DB 7110, educational materials are classified and stored so that Braille education can be performed through steps in the order of consonants, vowels, abbreviations and abbreviations, codes, and numbers.

On the other hand, the English Braille DB (7120) includes an alphabet (7121), special characters (7122), numbers/symbols (7123), an alphabetic word abbreviation (7124), an onkan word abbreviation (7125), an onkan abbreviation (7126), and Braille educational materials for verbatim 7129 are stored. Although not shown in FIG. 26, Braille education data for an on-kan abbreviation, a low-order abbreviation, a low-order abbreviation, a proto abbreviation, and a ending abbreviation may be stored in the English Braille DB 7120. This is where educational materials are classified and stored so that braille education can be performed through steps similar to the Hangul Braille DB 7110.

According to the above configuration of the present invention, it is possible to exert the effect of selecting a language for braille education to perform braille education for each language, and to perform braille education step by step according to the language for braille education It can be effective in performing Braille education.

26 shows an embodiment in which educational materials for two languages of the Korean Braille DB 7110 and the English Braille DB 7120 are stored in the Braille educational material DB 7100, but in another embodiment of the present invention In addition, educational materials for other languages such as Japanese Braille DB, Chinese Braille DB, and Russian Braille DB may be further stored.

27 schematically shows a detailed process of a theoretical learning step according to an embodiment of the present invention.

Referring to FIG. 27, the theoretical learning step (S700) according to an embodiment of the present invention includes: a learning language selection step (S710) of selecting a language in which braille education is to be performed; The educational material loading step (S720) of loading braille education materials for the language selected in the learning language selection step (S710) from the connected braille education material DB (7100); Education content selection step (S730) of selecting the education contents classified and stored in the braille education material; An education data display step (S740) of displaying the education content selected in the education content selection step through the computing device (A) and the tactile interface device (1000); And an educational material audio output step (S750) of outputting the educational content selected in the education content selection step as a voice. Includes.

In the theoretical learning step (S700), first, a learning language selection step (S710) of selecting a language to perform braille education is performed. In the learning language selection step (S710), a list of languages for braille education is displayed on the display device connected to the computing device A and the tactile interface device 1000, and the user selects one of the lists. You can choose the language in a way. This is the same as the operation in the learning language selection unit 5210.

Thereafter, an educational material loading step (S720) of loading braille educational materials for the language selected in the learning language selection step (S710) from the connected Braille educational material DB (7100) is performed. In the Braille education data DB 7100, education materials for teaching Braille for each language are stored, and only education materials corresponding to the language selected in the learning language selection step (S710) are fetched, and braille education is performed. You can be ready to do it. This is the same as the operation in the educational material loading unit 5220.

After that, the education content selection step (S730) of selecting the education content classified and stored in the braille education material is performed. In the education content selection step (S730), the user can select educational materials that are classified and stored according to classifications that can be classified according to the progress of the education, so that the user can perform the desired education. In the education content selection step (S730), the classification list of stored education materials is displayed on the display device connected to the computing device A and the tactile interface device 1000, and the user selects one of the list. Content can be selected. This is the same as the operation in the learning progress unit 5230.

Thereafter, an educational material display step (S740) of displaying the educational content selected in the educational content selection step through the computing device A and the tactile interface device 1000 is performed. In the educational data display step (S740), education on Braille is performed by delivering the educational content to the user. In this case, since the user is a learner who learns Braille, it is difficult for the user to easily understand it when information is transmitted through only Braille. Therefore, in an embodiment of the present invention, after the educational material display step (S740) or at the same time as the educational material display step (S740), the educational material audio output step of outputting the educational content selected in the educational content selection step by voice (S750) may be performed.

After that, return to the education content selection step (S730) again, and select another education material, and may perform learning on the selected education material, or perform the exercise problem solving step (S800) to review through the practice And it is also possible to perform an assessment of the learning level.

28 illustrates a screen of a tactile interface device in which a learning language selection step and a TUI conversion are performed for the learning language selection step according to an embodiment of the present invention.

28 shows a state in which the learning language selection step S710 is performed according to an embodiment of the present invention. In the learning language selection step S710, a language in which braille education is to be performed is selected. To this end, the learning language selection unit 5210 is executed in the computing device A to output a screen as shown in FIG. 28A to a visual display device connected to the computing device A.

Referring to (A) of FIG. 28, in the learning language selection step (S710), a list of languages for braille education stored in the Braille education material DB 7100 is output, and the user selects one of them. Is done.

At this time, the TUI module 5100 is executed in the computing device A, and the tactile screen of the tactile interface device 1000 corresponding to the screen displayed on the display device by the learning language selection unit 5210 An output signal is generated for realizing the system, and an input signal for input to the learning language selection unit 5210 is generated from a user input input from the tactile interface device 1000.

A tactile screen of the tactile interface device 1000 output through this process is shown in FIG. 28B.

Referring to FIG. 28, in an embodiment of the present invention, the tactile display displayed by the main screen step and the theoretical learning step is a cursor area tactilely displaying information on a current cursor position among a plurality of cursor positions. (L2); A content area L1 for tactilely displaying information corresponding to the position of each cursor; And a page area L3 for tactilely displaying information on a current page. It may include. Referring to FIG. 28B, the content area L1, the cursor area L2, and the page area L3 are shown separately.

In (B) of FIG. 28, a user-selectable table of contents such as "1. Learning Korean Braille 2. Learning English Braille" is displayed in Braille in the contents area L1, and the table of contents is displayed in the cursor area L2. A cursor (>) for selection is displayed so that the current cursor position can be identified. In addition, in the page area L3, information on the currently displayed page "1/1" (the first page out of total 1 page) is displayed in Braille, so that the user can see the current page as the first page out of total 1 pages, You can make sure that the next page does not exist.

29 to 31 illustrate screens of a tactile interface device in which TUI conversion is performed for the education content selection step and the education content selection step according to an embodiment of the present invention.

When Hangul Braille learning is selected in the learning language selection step (S710), the education content selection step (S730) is executed to select the education content according to the classification stored in the Hangul Braille DB 7110. To this end, the learning progress unit 5230 is executed in the computing device to output a screen as shown in (A) of FIG. 29 to a visual display device connected to the computing device (A).

At this time, the TUI module 5100 is executed in the computing device A, and the tactile screen of the tactile interface device 1000 corresponding to the screen displayed on the display device by the learning progress unit 5230 is displayed. An output signal to be implemented is generated, and an input signal for input to the learning progress unit 5230 is generated from a user input input from the tactile interface device 1000.

A tactile screen of the tactile interface device 1000 output through this process is shown in FIG. 29B.

In FIG. 29(B), as shown in FIG. 29(A) in the content area L1, "1. Learning consonants 2. Learning vowels 3. Learning abbreviations and abbreviations 4. Learning signs and numbers" A table of contents that can be selected by the user is displayed.

30 and 31 illustrate a process in which a user selects education content in more detail by the education content selection step (S730) on the screen of FIG. 29. In (A) of FIG. 30, when the user selects "learning consonants" in FIG. 29, a screen in which "first letter" and "support letter", which are detailed classifications for the learning of the consonants, are displayed in a list. In (A) of FIG. 31, when the user selects "first sound letter" in FIG. 30, detailed classifications of the first sound letter are "a ㄴ ㄷ learning", "ㄹ ㅁ ㅂ learning", and ㅅ ㅇ ㅈ ㅊ learning" , "Lol learning" and "heusori learning" are shown as a list.

In addition, in FIG. 30(B) and FIG. 31(B), the TUI module 5100 is executed in the computing device (A), respectively, so that FIGS. 30(A) and 31(A) A tactile screen of the tactile interface device 1000 driven by an output signal generated to implement a tactile screen of the tactile interface device 1000 corresponding to the screen of is shown.

FIG. 32 shows a screen of a tactile interface device in which TUI conversion has been performed for the education data display step and the education data display step according to an embodiment of the present invention.

When the training content is selected in the training content selection step (S730), the training content display step (S740) is executed to display the selected training content through the computing device (A) and the tactile interface device (1000). To this end, the learning progress unit 5230 is executed in the computing device to output a screen as shown in FIG. 32A to a visual display device connected to the computing device A.

At this time, the TUI module 5100 is executed in the computing device A, and the tactile screen of the tactile interface device 1000 corresponding to the screen displayed on the display device by the learning progress unit 5230 is displayed. An output signal to be implemented is generated, and an input signal for input to the learning progress unit 5230 is generated from a user input input from the tactile interface device 1000.

A tactile screen of the tactile interface device 1000 output through this process is shown in FIG. 32B.

In (B) of FIG. 32, as shown in (A) of FIG. 32, in the content area (L1), Hangul "a" and a detailed description of a are displayed in Braille. The educational content displayed in this way is output as a voice through the educational material audio output step (S750), so that the user can learn Braille by listening to the explanation of the "a" and directly touching the braille for the "a". do.

33 schematically shows the internal configuration of the exercise problem solving module of the Braille education module according to an embodiment of the present invention.

According to an embodiment of the present invention, the exercise problem solving module 5400 of the braille education module 5000 includes: an exercise problem load unit 5410 for loading exercise problems from the connected exercise problem DB; An exercise question presentation unit 5420 for presenting the loaded exercise to the user; And a grade management unit 5430 for managing the user's grades. Includes.

The exercise problem load unit 5410 loads the exercise problem from the connected exercise problem DB 7200. The exercise problem DB 7200 may store exercise questions that enable a user who has performed learning through the education materials of the Braille education material DB 7100 to check the learning outcome through solving the exercise problems. This exercise may be linked to the educational material of the Braille educational material DB 7100 to perform a role of reviewing the educational material. By calling such a practice question, the user can solve the above practice question and check the correct answer to review the educational material and evaluate the learning outcome.

The exercise question presentation unit 5420 outputs the exercise question through a display device connected to the computing device A and the tactile interface device 1000 to present the exercise to the user. The exercise problem is a question that can evaluate the degree of understanding of the educational material, and may be a multiple choice or short answer. If the exercise is multiple choice, an example of the exercise can be also output. In this case, the exercise question presentation unit 5420 may receive an answer from the user.

The grade management unit 5430 manages the user's grades. In the exercise, the question and the correct answer are stored together, and the grade management unit 5430 calculates the grade by grasping whether the answer input by the user matches the correct answer, and manages the user's grade by recording the user grade. can do. At this time, the grade management unit 5430 may output the scoring result and the calculated grade of the answer input by the user through the display device connected to the computing device A and the tactile interface device 1000 and display it to the user. have. Users can raise awareness of goals and achieve a sense of accomplishment through these scoring results and grades, and learning leaders, etc., who serve as assistants to users learning Braille, can check the grades and evaluate the user's learning achievement. It can exert an effect.

34 schematically shows a detailed process of the practice problem solving step according to an embodiment of the present invention.

Referring to FIG. 34, the practice problem solving step (S800) according to an embodiment of the present invention includes a practice problem loading step (S810) of loading a practice problem from the connected practice problem DB 7200; The exercise problem display step (S820) of displaying the retrieved exercise problem through the computing device (A) and the tactile interface device (1000); Correct answer input step (S830) in which the user inputs an answer to the exercise problem; Correct answer confirmation step (S840) of checking whether the answer input by the user is correct; And a grade management step (S850) of managing the user's grades based on whether or not the correct answer is checked in the correct answer checking step (S840). Includes.

In the practice problem solving step (S800), the exercise problem loading step (S810) is first performed. In the exercise problem loading step (S810), the exercise problem is loaded from the connected exercise problem DB 7200 so that the exercise problem can be solved. The exercise problem DB 7200 stores exercise questions that can perform the role of review and evaluation on the user's learning performed through the theoretical learning step S700. At this time, the saved exercise includes a question and a correct answer.

At this time, in an embodiment of the present invention, the exercise problem loading step (S810) includes an exercise to be called based on the result of the theoretical learning step (S700) performed before the exercise problem solving step (S800). You can choose. The practice problem solving step (S800) according to an embodiment of the present invention is generally performed after the theoretical learning step (S700) is performed to review and evaluate the contents learned in the theoretical learning step (S700). Since it plays a role, in the exercise problem loading step (S810) of the exercise problem solving step (S800), the learning contents are grasped from the result of the theoretical learning step (S700), and the exercises related to the learning contents are analyzed. You can perform efficient learning by selecting and calling.

After that, the exercise display step (S820) is performed. In the exercise display step S820, the retrieved exercise is displayed through the computing device A and the tactile interface device 1000 so that the user can recognize the exercise. The displayed exercise can be multiple choice or short answer. When the exercise is multiple-choice, an example included in the problem may also be displayed through the tactile interface device 1000.

In the exercise display step (S820), when displaying the exercise through the tactile interface device 1000, the exercise may be output not only through a tactile display but also through a voice.

After that, the correct answer input step (S830) is performed. In the correct answer input step (S830), the user inputs an answer to the exercise question displayed in the exercise question display step (S820). In an embodiment of the present invention, the exercise may be multiple choice, and the user may select one of the multiple choice questions displayed in the exercise display step S820 and submit it as an answer.

After that, the correct answer checking step (S840) is performed. In an embodiment of the present invention, the correct answer checking step (S840) performs a scoring on the answer input by the user in the correct answer input step (S830), and displays the scoring result, thereby allowing the user to answer the correct answer of the answer inputted by the user. You can check whether or not. In another embodiment of the present invention, without performing an evaluation on an answer input by the user, the correct answer may be output so that the user can check the correct answer and score by itself.

After that, the grade management step (S850) is performed. The grade management step (S850) manages the user's grades based on whether or not the correct answer is checked in the correct answer checking step (S840). In an embodiment of the present invention, a user's answer to the exercise may be evaluated and recorded to calculate and manage a grade. In an embodiment of the present invention, the user's grade is displayed as a score, and the score may rise or fall depending on whether the exercise is answered correctly.

As described above, according to an exemplary embodiment of the present invention, after performing theoretical learning on Braille, by solving a practice problem and performing a review, it is possible to effectively perform Braille education.

35 schematically shows a detailed process of displaying a practice problem according to an embodiment of the present invention.

Referring to FIG. 35, the exercise problem display step (S820) according to an embodiment of the present invention includes an exercise problem tactile output step (S821) of displaying the exercise problem on a tactile display in the tactile interface device 1000; And a speech output step (S822) of outputting the exercise problem as a voice. It may include.

Since the present invention allows the user to learn Braille, when outputting exercises to the user through the tactile interface device 1000, if only Braille is outputted, the user who is learning Braille cannot read or read Braille. Since it may be difficult, the user can easily understand the exercise and solve the exercise, including the exercise sound output step (S822) of outputting the exercise problem output through the tactile display as a voice. .

36 schematically shows a detailed process of the step of confirming a correct answer according to an embodiment of the present invention.

Referring to FIG. 36, the correct answer checking step (S840) according to an embodiment of the present invention includes a correct answer scoring step (S841) of comparing an input received answer with a previously stored correct answer to check whether they match; A scoring result tactile output step (S842) of outputting the match checked in the correct answer scoring step (S841) to a tactile display from the tactile interface device (1000); And a scoring result voice output step (S842) of outputting a voice whether or not the match is checked in the correct answer scoring step (S841). Includes.

In the correct answer scoring step (S841), it is checked whether the answer input by the user is the correct answer. Thereafter, in the scoring result tactile output step (S842) and the scoring result voice output step (S842), the scoring result in the correct answer scoring step (S841) is output by tactile sense and voice, so that the user's answer is correct You can check if it is wrong. By receiving feedback on the scoring result in this way, the user can inspire a sense of goal and achieve a sense of accomplishment. In addition, by outputting the scoring results not only through a tactile display but also through voice, a user who is learning Braille can easily check the scoring results.

37 schematically shows a detailed process of the grade management step according to an embodiment of the present invention.

Referring to FIG. 37, the grade management step (S850) according to an embodiment of the present invention includes a scoring result score reflecting step (S851) of updating the user's grades based on the match checked in the correct answer scoring step (S841). ); And a grade output step of outputting the updated grade through the tactile interface device (S852). Includes.

In an embodiment of the present invention, a user's answer to the exercise may be evaluated and recorded to calculate and manage a grade. To this end, the scoring result score reflecting step (S851) updates the user's score according to the scoring result of the correct answer scoring step (S841). In an embodiment of the present invention, the user's grade may be displayed as a score. In an embodiment of the present invention, if the scoring result is a correct answer, a score may be added to the grade, and if the scoring result is an incorrect answer, the score may be subtracted from the grade. Alternatively, only when the scoring result is the correct answer, the score may be added to the grade, and in another embodiment, the score may be displayed as a ratio of the correct answer to the number of solved exercises.

In this case, in the grade management step S850, grades for two or more users may be managed for each user. Preferably, by receiving information that can identify a user in the practice problem solving step (S800) or the theoretical learning step (S700), and managing grades based on the information that can identify the user, two or more When each user performs learning, it is possible to separately manage the grades for each user.

As described above, the score updated by reflecting the scoring result of the exercise is outputted through the display device of the computing device A and the tactile interface device 1000 so that the user can check it.

As described above, according to an embodiment of the present invention, by reflecting and managing whether or not the answer to the exercise is correct in the accumulated grade, the user can solve the exercise problem for Braille and manage the grade for the braille education. It can have the effect of making people feel interested in learning and helping learning leaders check educational outcomes.

38 illustrates a screen of a tactile interface device in which TUI conversion is performed for the exercise problem solving step and the exercise problem solving step according to an embodiment of the present invention.

38 shows a state in which the practice problem solving step (S800) is performed according to an embodiment of the present invention. In the practice problem solving step (S800), a practice problem is output, and a user inputs an answer to the practice problem to perform learning through the practice problem. To this end, the exercise problem solving module 5400 is executed in the computing device A, and a screen as shown in (A) of FIG. 38 is output to a visual display device connected to the computing device A.

Referring to (A) of FIG. 38, in the exercise problem solving step (S800), the exercise problem stored in the exercise problem DB 7200 is called and output, and the user inputs an answer to perform the exercise problem solution. .

At this time, the TUI module 5100 is executed in the computing device A, and the tactile screen of the tactile interface device 1000 corresponding to the screen displayed on the display device by the exercise problem solving module 5400 An output signal is generated for realizing and, from a user input input from the tactile interface device 1000, an input signal for input to the exercise problem solving module 5400 is generated.

A tactile screen of the tactile interface device 1000 output through this process is shown in FIG. 38B.

Referring to FIG. 38, in an embodiment of the present invention, the tactile display displayed by the exercise display step (S820) includes: a content area (L1) that tactilely displays information on the exercise; A page area L3 for tactilely displaying information on a current page; And a grade display area (L4) that tactilely displays information on the grade. It may include. Referring to FIG. 38B, the content area L1, the page area L3, and the grade display area L4 are shown separately.

In (B) of FIG. 38, "practice problems", "ㄹ", "ㅁ" and "ㅌ" are displayed in Braille in the content area L1, and the page area L3 shows the currently displayed page. Information "6/6" (6th out of 6 pages) is displayed in Braille, allowing the user to confirm that the current page is the last of 6 pages, there are no next pages, and there are 5 more pages before. I can. In addition, in the grade display area (L4), "the number of correct answers: 2" is displayed in Braille, so that the user checks his or her grades while solving the exercises to inspire learning, and a learning leader who assists the user in learning You can make it possible to manage the user's grades.

In the embodiment of FIG. 38, a problem may be output through voice. For example, the sentence "Please choose a braille note" is outputted by voice, and three examples as shown in FIG. 38 are shown on the visual display device connected to the computing device A and the tactile display of the tactile interface device 1000. Can be output. In this case, the user may select number 2 "ㅁ" displayed in braille among the views output on the tactile display and submit it as an answer.

39 is a diagram illustrating an example of an internal configuration of a computing device according to an embodiment of the present invention.

As shown in FIG. 39, the computing device 11000 includes at least one processor 11100, a memory 11200, a peripheral interface 11300, and an input/output subsystem ( I/O subsystem) 11400, power circuit 11500, and communication circuit 11600. In this case, the computing device 11000 may correspond to the user terminal A connected to the tactile interface device or the aforementioned computing device A.

The memory 11200 may include, for example, high-speed random access memory, magnetic disk, SRAM, DRAM, ROM, flash memory, or nonvolatile memory. have. The memory 11200 may include a software module, an instruction set, or other various data necessary for the operation of the computing device 11000.

In this case, accessing the memory 11200 from another component such as the processor 11100 or the peripheral device interface 11300 may be controlled by the processor 11100.

The peripheral device interface 11300 may couple input and/or output peripheral devices of the computing device 11000 to the processor 11100 and the memory 11200. The processor 11100 may execute various functions for the computing device 11000 and process data by executing a software module or instruction set stored in the memory 11200.

The input/output subsystem 11400 may couple various input/output peripherals to the peripherals interface 11300. For example, the input/output subsystem 11400 may include a monitor, a keyboard, a mouse, a printer, or a controller for coupling a peripheral device such as a touch screen or a sensor to the peripheral device interface 11300 as needed. According to another aspect, the input/output peripheral devices may be coupled to the peripheral device interface 11300 without going through the input/output subsystem 11400.

The power circuit 11500 may supply power to all or part of the components of the terminal. For example, the power circuit 11500 may include a power management system, one or more power sources such as batteries or alternating current (AC), a charging system, a power failure detection circuit, a power converter or inverter, a power status indicator or power. It may contain any other components for creation, management, and distribution.

The communication circuit 11600 may enable communication with another computing device using at least one external port.

Alternatively, as described above, the communication circuit 11600 may enable communication with other computing devices by transmitting and receiving an RF signal, also known as an electromagnetic signal, including an RF circuit, if necessary.

The embodiment of FIG. 39 is only an example of the computing device 11000, and the computing device 11000 omits some of the components shown in FIG. 39, further includes additional components not shown in FIG. 39, or 2 It can have a configuration or arrangement that combines two or more components. For example, a computing device for a communication terminal in a mobile environment may further include a touch screen or a sensor, in addition to the components shown in FIG. 39, and various communication methods (WiFi, 3G, LTE) in the communication circuit 1160 , Bluetooth, NFC, Zigbee, etc.) may include a circuit for RF communication. Components that may be included in the computing device 11000 may be implemented in hardware, software, or a combination of hardware and software including one or more signal processing or application-specific integrated circuits.

Methods according to an embodiment of the present invention may be implemented in the form of program instructions that can be executed through various computing devices and recorded in a computer-readable medium. In particular, the program according to the present embodiment may be composed of a PC-based program or an application dedicated to a mobile terminal. An application to which the present invention is applied may be installed on a user terminal through a file provided by the file distribution system. For example, the file distribution system may include a file transmission unit (not shown) that transmits the file according to the request of the user terminal.

The apparatus described above may be implemented as a hardware component, a software component, and/or a combination of a hardware component and a software component. For example, the devices and components described in the embodiments are, for example, a processor, a controller, an arithmetic logic unit (ALU), a digital signal processor, a microcomputer, a field programmable gate array (FPGA). , A programmable logic unit (PLU), a microprocessor, or any other device capable of executing and responding to instructions, such as one or more general purpose computers or special purpose computers. The processing device may execute an operating system (OS) and one or more software applications executed on the operating system. In addition, the processing device may access, store, manipulate, process, and generate data in response to the execution of software. For the convenience of understanding, although it is sometimes described that one processing device is used, one of ordinary skill in the art, the processing device is a plurality of processing elements and/or a plurality of types of processing elements. It can be seen that it may include. For example, the processing device may include a plurality of processors or one processor and one controller. In addition, other processing configurations are possible, such as a parallel processor.

The software may include a computer program, code, instructions, or a combination of one or more of these, configuring the processing unit to operate as desired or processed independently or collectively. You can command the device. Software and/or data may be interpreted by a processing device or to provide instructions or data to a processing device, of any type of machine, component, physical device, virtual equipment, computer storage medium or device. , Or may be permanently or temporarily embodyed in a transmitted signal wave. The software may be distributed over networked computing devices and stored or executed in a distributed manner. Software and data may be stored on one or more computer-readable recording media.

The method according to the embodiment may be implemented in the form of program instructions that can be executed through various computer means and recorded in a computer-readable medium. The computer-readable medium may include program instructions, data files, data structures, and the like alone or in combination. The program instructions recorded on the medium may be specially designed and configured for the embodiment, or may be known and usable to those skilled in computer software. Examples of computer-readable recording media include magnetic media such as hard disks, floppy disks, and magnetic tapes, optical media such as CD-ROMs and DVDs, and magnetic media such as floptical disks. -A hardware device specially configured to store and execute program instructions such as magneto-optical media, and ROM, RAM, flash memory, and the like. Examples of the program instructions include not only machine language codes such as those produced by a compiler, but also high-level language codes that can be executed by a computer using an interpreter or the like. The hardware device described above may be configured to operate as one or more software modules to perform the operation of the embodiment, and vice versa.

As described above, although the embodiments have been described by the limited embodiments and drawings, various modifications and variations are possible from the above description by those of ordinary skill in the art. For example, the described techniques are performed in a different order from the described method, and/or components such as a system, structure, device, circuit, etc. described are combined or combined in a form different from the described method, or other components Alternatively, even if substituted or substituted by an equivalent, an appropriate result can be achieved.

Therefore, other implementations, other embodiments, and claims and equivalents fall within the scope of the claims to be described later.

Claims (9)

A method of providing a braille education support function through a tactile interface device that is implemented as a computing device including a processor and is connected to the computing device to interact with a user,
A main screen step of executing a braille education module in the computing device to output a braille education main screen providing a braille education support function to the visually impaired; Theoretical learning step of delivering information on Braille to perform learning; And a practice problem solving step of performing a review through practice questions on the learned braille. Either of which is performed,
When the braille education module is executed, the screen according to the step is displayed on the computing device, and the screen displayed on the computing device is converted into an output signal to the tactile interface device, corresponding to the screen displayed on the computing device. A tactile display can be displayed on the tactile interface device,
A method of providing a Braille education support function in which any one of a main screen step, a theory learning step, and an exercise problem solving step is performed according to an input from the computing device or an input from the tactile interface device.
The method according to claim 1,
The tactile display displayed by the main screen step and the theoretical learning step,
A cursor area tactilely displaying information on a current cursor position among the plurality of cursor positions;
A content area tactilely displaying information corresponding to the position of each cursor; And
A page area tactilely displaying information on a current page; Containing, how to provide Braille education support function.
The method according to claim 1,
The theoretical learning step,
A learning language selection step of selecting a language to perform braille education;
An education material loading step of loading braille education data for the language selected in the learning language selection step from the connected braille education data DB;
An educational content selection step of selecting educational content classified and stored in the braille educational material; And
An educational data display step of displaying the educational content selected in the educational content selection step through the computing device and the tactile interface device; Containing, how to provide braille education support function.
The method of claim 3,
The theoretical learning step,
An educational material audio output step of outputting the educational content selected in the educational content selection step by voice; A method of providing a braille education support function that further includes.
The method of claim 3,
The Braille educational material DB,
A method of providing braille education support functions in which braille education materials for two or more languages are stored.
The method according to claim 1,
The above practice problem solving step,
Loading exercise questions from the connected exercise database;
An exercise problem display step of displaying the retrieved exercise problem through the computing device and the tactile interface device;
A correct answer input step in which a user inputs an answer to the exercise problem;
A correct answer checking step of checking whether the answer input by the user is correct; And
A grade management step of managing the user's grades based on whether or not the correct answer is checked in the correct answer checking step; Containing, how to provide braille education support function.
The method of claim 6,
The exercise loading step,
A method of providing a Braille education support function for selecting an exercise to be called based on the result of the theoretical learning step performed before the exercise problem solving step.
The method of claim 6,
The step of confirming the correct answer,
A correct answer scoring step of comparing the received answer with a pre-stored correct answer to check whether they match;
A scoring result tactile output step of outputting the match checked in the correct answer scoring step to a tactile display from the tactile interface device; And
A scoring result voice output step of outputting an audio match whether or not the correct answer is checked in the scoring step; Including,
The grade management step,
A scoring result score reflecting step of updating the user's score based on whether or not they match the correct answer scoring step;
A grade output step of outputting the updated grades through the tactile interface device; Containing, how to provide braille education support function.
A device that is implemented as a computing device including a processor and provides a braille education support function through a tactile interface device that is connected to the computing device to interact with a user,
The computing device includes: a Braille education module; Including,
The Braille education module,
Theoretical learning module for carrying out learning by delivering information on Braille; And
A practice problem solving module that allows you to review through practice questions about the learned braille; Including,
The theory learning module,
A learning language selection step of selecting a language to perform braille education;
An education material loading step of loading braille education data for the language selected in the learning language selection step from the connected braille education data DB;
An educational content selection step of selecting educational content classified and stored in the braille educational material; And
An educational data display step of displaying the educational content selected in the educational content selection step through the computing device and the tactile interface device; A device that provides braille education support functions to perform.

Images