WO2017183853A1 - Tactile interface device and tactile interface method - Google Patents

Abstract

The present invention relates to a tactile interface device and a tactile interface method for allowing a visually impaired person to interact with a computer more intuitively and efficiently using the sense of touch in a way similar to the way an ordinary person uses a computer. The tactile interface device according to one embodiment of the present invention comprises: a tactile display unit for providing tactile information to a user by means of multiple pins on the basis of data received from a connected external device or data generated in the tactile interface device; and an input sensing unit for sensing a user input.

Description

Tactile interface device and tactile interface method

The present invention relates to a tactile interface device and a tactile interface method. More particularly, the present invention relates to a tactile interface device and a tactile interface method. The present invention relates to a tactile interface device and a tactile interface method.

In the information society, it is essential to acquire and use information using computers, and this trend is true not only for the general public but also for the blind.

In order to improve the informatization level of the visually impaired, they should be able to acquire and utilize information at a similar level to the normal person, which is important because it makes life easier for the visually impaired and can acquire and use information on their own. Do. In addition, it can be said to be very important in that they can ultimately improve their well-being by providing various educational opportunities to the visually impaired and expanding their opportunities to enter and participate in society.

However, the current method of using a computer generally uses a method of recognizing visual information output through a monitor and inputting information using an input tool such as a keyboard, a mouse, or a touch pad. Therefore, the visually impaired people who cannot use the visual perception have a great limitation in interacting with the computer at the same level as the general public and promptly inputting the information. As a result, visual impairments significantly reduce the efficiency of computer use, greatly depriving the computer of the opportunity to acquire and use information.

In order to solve the difficulty of using the computer of the visually impaired, various technologies have been developed to recognize visual information using hearing, touch, and the like and to interact with the computer. A representative technology is a screen reader that assists the visually impaired to use a computer through hearing. This is a device or software that helps to use the computer by outputting the audio output on the computer screen and the keyboard information input by the user.

However, the screen reader searches for Graphic User Interface (GUI) elements of the output screen with only one linearized information without two-dimensional spatial position information on the output screen, which makes it difficult to recognize the screen output information. The more information, the greater the difficulty. In addition to text and GUI elements, the screen reader provides only text-based, descriptive explanations such as pictures and diagrams, so that visually impaired people can understand and interact with graphic information. You will have great difficulty.

Another related technology is a braille information terminal that delivers text information through a braille cell. This is used as an independent device by providing some functions of computer useful to the visually impaired and as a display output device that outputs text information of computer screen in Braille by screen reader. Both methods serve as an alternative device for performing some limited functions of the computer, instead of acting as an interface for efficient interaction with the computer, or as an output auxiliary device for printing text information in Braille. do. In particular, a braille information terminal specialized for braille output has a problem in that it cannot express graphic information like a screen reader.

Prior Art Documents: (Patent Document 1) Korean Patent Publication No. 10-2012-0063982

It is an object of the present invention to provide a new concept of tactile interface device and tactile interface method that enables the visually impaired to interact with the computer more intuitively and efficiently by using the sense of touch in a manner similar to that of the general computer use.

In order to solve the above problems, the present invention provides a tactile interface device capable of interacting with a user, based on data received from a connected external device or data generated inside the tactile interface device. Tactile display unit for providing tactile information to the user; And an input sensing unit configured to sense a user input.

In the present invention, the tactile interface device further comprises an external device connecting portion that can be connected to an external device, the external device connecting portion is capable of connecting with the external device in a wired communication module unit capable of performing wireless communication. It may include one or more of the wired connection.

In the present invention, the tactile interface device may further include a keyboard unit capable of receiving information in a key input form from a user.

In the present invention, the tactile interface device may include a speaker unit capable of outputting sound to the outside.

In the present invention, the tactile display unit provides tactile information in tactile pixels of one or more dimensions, wherein the tactile pixels are constituted by a plurality of pins moving up and down by applying power to a transducer including a piezoelectric ceramic and an elastic body. Can be.

In the present invention, the tactile display unit, a display data receiving unit for receiving the data; A tactile data converter converting the data into tactile display data; And a plurality of pin driving modules driven by the tactile display data, wherein the plurality of pin driving modules may constitute tactile pixels having one or more dimensions.

In the present invention, each of the plurality of pin drive module, the transducer for converting the vibration motion into a linear motion; A shaft coupled to the transducer; A movable body capable of vertically moving in the axial direction of the shaft on the shaft; And a pin that can move according to the movement of the movable body.

In the present invention, the input sensing unit may be performed in a non-contact manner.

In the present invention, the input sensing unit emits a plurality of lights, senses the plurality of emitted lights, and has a changed sensing value when a sensing value of the light emitted by physical blocking is changed. The user input may be sensed from the location information of the light.

In the present invention, the input sensing unit; And a positioning unit, wherein the position sensing module includes a plurality of light emitters and a plurality of light receiving sensors, and the positioning unit may sense a user input from sensing data of the plurality of light receiving sensors.

In the present invention, the plurality of light emitters may be disposed along the first axis and the second axis, and the plurality of light receiving sensors may be disposed along the first axis and the second axis.

In order to solve the above problems, the present invention provides a tactile interface device that can interact non-visually, tactile display unit that can provide tactile information to the user by a plurality of pins; And an input sensing unit capable of sensing a user input, wherein the tactile display unit displays a tactile pixel of at least one dimension.

In the present invention, the haptic pixel may provide tactile information to a user, which is composed of a plurality of pins moving up and down by applying power to a transducer including a piezoelectric ceramic and an elastic body.

In the present invention, the tactile display unit master board; A display data receiver electrically connected to the master board and receiving primary data for a tactile display; A tactile data converter for converting the primary data received from the display data receiver into data for tactile display; A plurality of slave boards electrically connected to the master board; And a plurality of pin driving modules disposed on an outer surface of each of the plurality of slave boards.

In the present invention, the tactile data converter comprises a first tactile data converter disposed on the master board; And a second tactile data converter disposed on the slave board, wherein the first tactile data converter converts the primary data into secondary data as tactile data for each slave board, and converts the second tactile data. The unit may convert the secondary data into tertiary data for driving a group of a plurality of pin driving modules disposed on each slave board.

In order to solve the above problems, the present invention is a tactile interface method that can interact with the user, based on the primary data received from the connected external device or the primary data generated inside the tactile interface device, A tactile display step of providing tactile information to a user by a plurality of pins; And an input sensing step of sensing a user input in a non-contact manner, wherein the tactile display step and the input sensing step are performed in real time.

In the present invention, the tactile display step may provide tactile information by means of tactile pixels represented by a plurality of pins moving up and down by applying power to a transducer including a piezoelectric ceramic and an elastic body.

In the present invention, the tactile pixel may be represented by a plurality of pin driving module groups, and each of the pin driving module groups may include a plurality of pin driving modules.

In the present invention, the input sensing step, the light emitting step of emitting a plurality of light (emitting); A light sensing step of sensing light for each of the plurality of lights at a position spaced at a predetermined distance in a direction in which the light is emitted from a position where the light is emitted; And a user input calculation step of calculating a user input based on the result sensed by the light sensing step.

In order to solve the above problems, the present invention is a tactile interface device that can interact with the user, based on the data received from the connected external device or the data generated inside the tactile interface device, a plurality of pins Tactile display unit for providing the tactile information to the user by; An input sensing unit sensing a user input in a non-contact manner; An external device connection unit capable of connecting with an external device; A keyboard unit capable of receiving information in a key input form from a user; And the tactile display unit, the input sensing unit, and the external device connection unit. And a control unit for controlling the operation of the keyboard unit.

In the present invention, the tactile display unit displays tactile pixels of one or more dimensions, and the tactile pixels may be constituted by a plurality of pins that move up and down by applying power to a transducer including a piezoelectric ceramic and an elastic body.

In the present invention, the tactile display unit displays tactile pixels of one or more dimensions, and the tactile pixels may be constituted by a plurality of pins that move up and down by applying power to a transducer including a piezoelectric ceramic and an elastic body.

In the present invention, the input sensing unit emits a plurality of lights, senses the plurality of emitted lights, and has a changed sensing value when a sensing value of the light emitted by physical blocking is changed. The user input may be sensed from the location information of the light.

In order to solve the above problems, the present invention provides a method for sensing a user's input in the interfacing device for providing tactile information, the light emitting step of emitting a plurality of light (emitting); A light sensing step of sensing light for each of the plurality of lights at a position spaced at a predetermined distance in a direction in which the light is emitted from a position where the light is emitted; And a user input calculation step of calculating a user input based on the result sensed by the light sensing step.

In the present invention, the light emitting step emits a plurality of light from a plurality of first axis light emitters disposed along a first axis and a plurality of second axis light emitters disposed along a second axis, wherein the light In the sensing step, a plurality of lights may be sensed by a first axis light receiving sensor corresponding to a plurality of first axis light emitters and a second axis light receiving sensor corresponding to a plurality of second axis light emitters.

In the present invention, the user input calculation step may calculate the user input based on the change value of the received light amount of the plurality of first axis light receiving sensor and the plurality of second axis light receiving sensor.

In the present invention, the input sensing step may be performed in a non-contact manner, and an area in which the user may input in the input sensing step may be disposed above the operation area of the pin driving module group.

The tactile interface device and the tactile interface method according to the present invention can have an effect that enables the visually impaired to intuitively recognize the items displayed tactilely in real time.

In addition, the tactile interface device and the tactile interface method according to the present invention can realize the effect that the visually impaired person can immediately input the information based on the perceived information at the same time.

In addition, the tactile interface device and the tactile interface method according to the present invention, based on the tactile display capable of touch and gesture recognition, the visually impaired person recognizes the screen output information of the computer in the form of braille, voice and tactile graphics and immediately and intuitively By enabling information input, the computer can be used effectively in a manner very similar to that of the general public.

In addition, the tactile interface device and the tactile interface method according to the present invention can solve the problem of the damage of the elevated pin state that can occur in the existing touch-based tactile display through the infrared-based touch recognition device, and the light and fast touch and gesture operation Can recognize the effect.

In addition, the tactile interface device according to the present invention can exert an effect that it can be easily extended to use various functions of the OS and various application software.

In addition, the tactile interface device and the tactile interface method according to the present invention can exhibit an effect of providing a visually impaired person with significantly improved work execution speed and convenience when compared to a device such as a conventional screen reader.

In addition, the tactile interface device and the tactile interface method according to the present invention can have an effect that a visually impaired person can conveniently perform graphics-related tasks that are difficult to perform with a screen reader.

In addition, the tactile interface device and the tactile interface method according to the present invention can significantly improve the computer literacy of the visually impaired, and have an effect of expanding the computer hardware and software market for the visually impaired.

1 is a view schematically illustrating the internal structure of a tactile interface device and a user terminal according to an embodiment of the present invention.

2 is a view schematically showing the internal structure of the tactile interface device according to an embodiment of the present invention.

3 is a three-dimensional view of the tactile interface device according to an embodiment of the present invention.

4 is a view three-dimensionally showing the tactile display unit according to an embodiment of the present invention.

5A, 5B, 5C, and 5D show examples of a pin drive module according to an embodiment of the present invention.

6 is a cross-sectional view of an example of a pin drive module according to an embodiment of the present invention.

7 is a diagram schematically illustrating a plane of an input sensing unit according to an embodiment of the present invention.

8 is a diagram schematically illustrating a side of an input sensing unit according to an embodiment of the present invention.

9 is a view schematically showing the steps of the tactile interface method according to an embodiment of the present invention.

10 is a view schematically showing the detailed steps of the tactile display step according to an embodiment of the present invention.

11 is a diagram schematically showing the detailed steps of the input sensing step according to an embodiment of the present invention.

12 is a diagram illustrating an example of use of a tactile interface device according to an embodiment of the present invention.

Aspects, features, and advantages of the present disclosure will be understood by reference to the following embodiments and the accompanying drawings. Like reference numerals in different drawings may represent the same or similar elements. Furthermore, the following description does not limit the invention, but rather the scope of the invention is defined by the appended claims and equivalents.

1 is a view schematically showing the internal structure of the tactile interface device 1000 and the user terminal according to an embodiment of the present invention.

As shown in FIG. 1, the tactile interface device 1000 is connected to the user terminal A in a wired or wireless manner and configured to transmit and receive data. For example, the tactile interface device 1000 may be a user. The graphic signal from the terminal A may be received to provide tactile information. However, in the present invention, unlike in FIG. 1, the tactile interface device 1000 itself operates without an external user terminal by an independent operating system, and the tactile interface device is operated by an operation based on a program and an internal memory inside the tactile interface device 1000. 1000 may operate. However, even in this case, the tactile interface device 1000 may be provided with a communication function.

The user terminal A may be a smart phone, a tablet personal computer (PC), a mobile phone, a video phone, an e-book. E-book reader, desktop PC, laptop PC, netbook PC, personal digital assistant (PDA), hereinafter referred to as 'PDA' A portable multimedia player (PMP, hereinafter referred to as PMP), an mp3 player, a mobile medical device, a camera, a wearable device (e.g., Head-mounted devices (HMDs, for example referred to as 'HMD'), electronic clothing, electronic bracelets, electronic necklaces, electronic accessories, electronic tattoos or smart watches (smart watch) and the like.

As shown in FIG. 1 or FIG. 3, the tactile interface device 1000 according to an embodiment of the present invention includes an external device connection unit 1100, a tactile display unit 1200, an input sensing unit 1300, and a keyboard unit ( 1400, a controller 1500, and a speaker 1600. The tactile display unit 1200 converts the visual graphic that the computer outputs to the monitor into the tactile graphic and outputs it.

The input sensing unit 1300 may be coupled to the tactile display unit 1200. The input sensing unit 1300 recognizes a finger touch of a visually handicapped person and a variety of predetermined gestures for tactile information or tactile graphics output from the tactile display unit 1200 and transmits an input signal to a computer. On the other hand, the keyboard unit 1400 is preferably a braille keyboard that transmits a character input signal to a computer by converting the braille commonly used by the visually-impaired to general characters.

The braille keyboard transmits the braille input to the tactile interface device 1000 or the user terminal connected to the tactile interface device 1000 like the braille keyboard which is widely used. The braille keyboard consists of 1 ~ 6 points, backspace, space, and enter button, and because the braille consists of several dots to form a single letter, the braille keyboard can transmit the information of the pressed button at the same time. The transmitted braille information is interpreted as a general character through software inside the tactile interface device 1000 or software of the user terminal.

Therefore, for the computer input / output function for the visually impaired, the tactile display unit 1200 performs a role like a monitor of a general computer, and the input sensing unit 1300 performs a role like a touch screen of a mouse or a tablet PC. The keyboard unit 1400, or preferably, the braille keyboard serves as a keyboard of a general computer.

2 is a view schematically showing the internal structure of the tactile interface device 1000 according to an embodiment of the present invention.

According to an embodiment of the present invention, the tactile interface device 1000 provides tactile information to a user through a plurality of pins based on data received from a connected external device or data generated inside the tactile interface device 1000. A tactile display unit 1200; An input sensing unit 1300 for sensing a user input; An external device connection unit 1100 capable of connecting to an external device; A keyboard unit 1400 capable of receiving information in a key input form from a user; A speaker unit 1600 capable of outputting sound to the outside; And a controller 1500 for controlling operations of the tactile display unit 1200, the input sensing unit 1300, the external device connection unit 1100, the keyboard unit 1400, and the speaker unit 1600. Include.

The tactile display unit 1200 provides tactile information in tactile pixels of one or more dimensions, and the tactile pixels are constituted by a plurality of pins which move up and down by applying power to a transducer including a piezoelectric ceramic and an elastic body. . Preferably, the tactile pixel provides tactile information in two dimensions.

The tactile display unit 1200 may include a display data receiver 1210 based on data received from an external user terminal or receiving data generated in the tactile interface device 1000; A tactile data converter 1220 for converting the data into tactile display data; And a plurality of pin drive modules 1230 driven by the tactile display data. And a driving power supply unit 1240 supplied with power for driving the tactile display unit 1200, and provides tactile information or tactile graphics based on the received data.

Meanwhile, the input sensing unit 1300 emits a plurality of lights, senses the plurality of emitted light, and changes the sensing value when the sensing value of the light emitted by physical blocking is changed. Sensing a user input from position information of light having

Specifically, the input sensing unit 1300 includes a position sensing module 1310; And a positioning unit 1320, wherein the position detecting module 1310 includes a plurality of light emitters and a plurality of light receiving sensors, and the positioning unit 1320 is provided from sensing data of the plurality of light receiving sensors. Sensing user input

Preferably, the light used in the input sensing unit 1300 is infrared rays, and the light is preferably emitted in a form of irradiating a predetermined cross section.

The input sensing unit 1300 is disposed adjacent to, or more preferably, coupled to, the tactile display unit 1200 or the pin driving module 1230 of the tactile display unit 1200. Accordingly, the user may recognize the tactile information or the tactile graphic provided from the tactile display unit 1200 as a tactile sense and immediately perform an input or a gesture on the tactile display.

However, when the user inputs to the input sensing unit 1300, the user's finger is strongly in contact with the pin driving module 1230 of the tactile display unit 1200, thereby damaging the pin driving module 1230. In order to prevent this, the position sensing module 1310 of the input sensing unit 1300 is preferably spaced apart from the pin driving module 1230. Alternatively, an area in which the user may input the input sensing unit 1300 may be spaced apart from an operating area of the pin driving module 1230. Alternatively, an area in which the user can input the input sensing unit 1300 may be disposed at a height higher than the height when the pin driving module 1230 is raised.

On the other hand, it is preferable that the plurality of light emitters are disposed along a first axis and a second axis, and the plurality of light receiving sensors are disposed along a first axis and a second axis, and the plurality of light receiving sensors are the plurality of light receiving sensors. More preferably, it is arranged to correspond to the light emitter.

The external device connection unit 1100 includes at least one of a communication module unit 1110 capable of performing wireless communication and a wired connection unit 1120 that can be connected to the external device in a wired manner. The communication module unit 1110 may include a Bluetooth communication module, a Zigbee communication module, an infrared communication module, a Bluetooth low energy (BLE) communication module, an audio communication module, a long term evolution (LTE) communication module, and WiFi. At least one of a communication module, an IrDA based infrared communication module, a wireless LAN (WLAN), a WiBro module, and a wireless USB module. On the other hand, the wired connection unit 1120 preferably includes a connection module using a USB (Universal Serial Bus) interface, this is a wired connection module capable of transmitting and receiving data other than this.

On the other hand, the speaker 1600 has a function of reading the information output in response to the information displayed by the tactile interface device 1000, the text information, or the information input by the input sensing unit 1300 as a voice. Can be done.

The controller 1500 may be a general operation of the tactile interface device or the external device connection unit 1100; The keyboard unit 1400; Alternatively, the operation of the speaker unit 1600 is controlled. For example, when data is received from an external user terminal, the data is transmitted to the display data receiver 1210 of the tactile display unit 1200, and commands the operation of the tactile display unit 1200. Alternatively, when a user input is input from the input sensing unit 1300, the controller 1500 processes the input or transmits an input signal to the user terminal A connected through the external device connection unit 1100.

If the tactile display device is not connected to an external user terminal but is operated by its own OS and application, the tactile display device may include a CPU and a memory device capable of performing its own operation and may operate independently. Even when it is independently operable, the tactile display may communicate with the outside.

3 is a three-dimensional view of the tactile interface device 1000 according to an embodiment of the present invention.

As shown in FIG. 3, the tactile interface device 1000 according to the present invention is a tactile display in the form of a pixel with components of the tactile display unit 1200 exposed to the outside, specifically, a plurality of pin driving modules 1230. To provide. By the tactile display unit 1200 as described above, the user may tactilely recognize the plurality of pin driving modules 1230 of the tactile display unit 1200.

In addition, as shown in FIG. 3, an area through which the user can input an input sensing unit is disposed above the operation area of the pin driving module 1230.

Meanwhile, the user may tactilely recognize the tactile display and simultaneously input a command through a touch input through the input sensing unit 1300. Here, the 'touch input' is not interpreted as a consultation, and includes both an input of touching the uppermost pin of the pin driving module of the tactile display unit and an input of not touching the uppermost pin of the pin driving module. do.

Preferably, when the user performs an input to the input sensing unit 1300, the user's finger is in strong contact with the pin drive module 1230 of the tactile display unit 1200 damage the pin drive module 1230 In order to prevent this from happening, the input sensing unit 1300 according to the present invention is preferably used in the tactile pins unlike the capacitive type sensing the electric capacity change of the surface of the tactile pins used in the general touch display. In order to recognize motions, inputs, gestures, etc., irrespective of touch, a non-contact recognition method based on light sensing, more preferably based on infrared sensing, has been introduced. That is, preferably, the input sensing unit is performed in a non-contact manner.

In the present specification, the non-contact sensing or non-contact recognition refers to a sensing method in which a sensing element or sensor can recognize a physical operation or a physical form, even though no physical contact is made to the sensing element or sensor. As an example, an embodiment of the present invention uses an infrared sensing based recognition scheme.

In addition, as illustrated in FIG. 3, the position sensing module 1310 of the input sensing unit 1300 may be spaced apart from the pin driving module 1230. Alternatively, an area in which the user may input the input sensing unit 1300 may be spaced apart from an operating area of the pin driving module 1230. Alternatively, an area in which the user can input the input sensing unit 1300 may be disposed at a height higher than the height when the pin driving module 1230 is raised.

In order to input specific information, the user may input information to the tactile interface device 1000 through the keyboard unit 1400, for example, to input text information.

In addition, in order to output voice or sound information of text to the user, the tactile interface device 1000 may output voice information to the user through the speaker unit 1600.

As shown in FIG. 3, the tactile interface device 1000 may be connected to an external user terminal through a wired connection unit 1120 or may be connected to an external user terminal through wireless communication through a communication module unit 1110. In this case, the GUI elements in the user terminal are tactilely displayed by the tactile interface device 1000, and the user may input a response or an input to the GUI elements through the input sensing unit 1300 or the keyboard. In addition, according to a command input by the user through the input sensing unit 1300, the tactile interface device 1000 may output according to the tactile display unit 1200 or the speaker unit 1600, In the case of a disabled person, a user terminal such as a graphic screen-based PC can be used more intuitively.

In addition, such a tactile interface device 1000 is not limited to simply recognize the tactile information by the visually impaired person, and can recognize the tactile information and thereby intuitively input a command or the like to the tactile interface device 1000. As a result, it is possible to exert an effect that a user terminal such as a graphic screen-based PC can be used for convenience as a general public.

4 is a three-dimensional view of the tactile display unit 1200 according to an embodiment of the present invention.

The tactile display unit 1200 may display or provide tactile pixels of one or more dimensions. 4 illustrates an example of the tactile display unit 1200 capable of providing two-dimensional tactile pixels. The tactile pixel is constituted by a plurality of pins moving up and down by applying power to a transducer including a piezoelectric ceramic and an elastic body.

In detail, the tactile pixel is represented by a plurality of pin driving module groups, and each of the pin driving module groups includes a plurality of pin driving modules 1230. Alternatively, the entire pin drive module may constitute one pin drive module group.

Specifically, the tactile display unit 1200 includes a master board 1250; A display data receiver 1210 electrically connected to the master board 1250 and receiving primary data for a tactile display; A tactile data converter 1220 for converting the primary data received from the display data receiver 1210 into data for a tactile display; A plurality of slave boards 1260 electrically connected to the master board 1250; And a plurality of pin driving modules 1230 disposed on an outer surface of each of the plurality of slave boards 1260. And a driving power supply unit 1240 for supplying driving power to the above components through the master board 1250.

The driving power supply 1240 is preferably in the form of inputting the power supplied from the outside to the master board 1250.

The tactile data converter 1220 may include a first tactile data converter 1221 disposed on the master board 1250; And a second tactile data converter 1222 disposed on the slave board 1260, wherein the first tactile data converter 1221 is configured to convert the primary data into tactile data for each slave board 1260. The second tactile data converter 1222 converts the secondary data into secondary data, and drives the group of the plurality of pin driving modules 1230 disposed on the respective slave boards 1260. Convert to data.

The tactile display unit 1200 is a device for converting and transmitting visual graphics into tactile graphics through vertical movement of the pins of the pin driving module 1230 configured in a multiple arrangement. Since the tactile display unit 1200 according to the present invention does not require the configuration of an additional module, as compared to the relay mechanism of the piezoelectric bimorph, which is a structure in which a pin rises when a voltage is applied and a pin falls when a voltage is not applied. It has a structure that can be miniaturized and can be easily arranged in multiples.

Therefore, the tactile display unit 1200 as in the present invention can achieve the effect of miniaturizing the device and at the same time providing a high resolution tactile display.

The master board 1250 receives the tactile graphic data input through the display data receiver 1210 and transmits the tactile graphic data to the first tactile data converter 1221. The display data receiver 1210 may be a universal asynchronous receiver / transmitter (UART), and the first tactile data converter 1221 may be a micro controller unit (MCU).

Preferably, the first tactile data converter 1221 analyzes the tactile graphic data input through the display data receiver 1210 and transmits the tactile graphic data to the plurality of slave boards 1260. In this transfer, the first tactile data converter 1221 may convert the data based on the information of the plurality of slave boards 1260, and then transfer the data to the slave boards 1260.

Alternatively, the first tactile data converter 1221 may convert the tactile graphic data into data corresponding to each slave board 1260, and transfer each converted data to each slave board 1260. It may be.

Alternatively, the tactile graphic data transmitted through the display data receiver 1210 may be directly transmitted to the slave board 1260 without the first tactile data converter 1221.

Subsequently, the second tactile data converter 1222 embedded in the slave board 1260 may use the data or the data received from the first tactile data converter 1221 using a preprogrammed CPLD (Complex Programmable Logic Device). The data received through the display data receiver 1210 is separated according to each pin drive module array composed of each pin drive module 1230 or a plurality of pin drive modules 1230, and each pin drive module 1230. Alternatively, the operation signal is transmitted to a pin drive module array including a plurality of pin drive modules 1230.

According to such an operation signal, the pin of the pin driving module 1230 can move up and down, and preferably, the pin spacing and the rising height are in the range of 1 mm to 10 mm.

5 is a diagram illustrating examples of the pin driving module 1230 according to an embodiment of the present invention.

Hereinafter, an embodiment of the pin driving module 1230 illustrated in FIGS. 5A and 5B will be described.

As shown in FIG. 5A, the pin drive module 1230 includes a transducer 1231 which converts vibrational motion into linear motion, respectively; A shaft 1232 connected to the transducer; A movable body 1233 capable of vertically moving in the axial direction of the shaft 1232 on the shaft 1232; And a pin 1234 that can move according to the movement of the movable body 1233.

Preferably, the transducer 1231 includes a plurality of piezoceramic and elastic bodies, and when the power is applied, linearly converts vibration caused by expansion / contraction of the piezoelectric ceramic to move the movable body 1233 up and down. By controlling the transducer, the movement of the movable body 1233 may be controlled.

Hereinafter, an embodiment of the pin driving module 1230 illustrated in FIGS. 5C and 5D will be described.

As shown in FIG. 5C, the pin drive module 1230 includes a transducer 1231 for converting the vibration motion into the linear motion, respectively; A shaft 1232 connected to the transducer; A movable body 1233 capable of vertically moving in the axial direction of the shaft 1232 on the shaft 1232; And a pin 1234 that can move according to the movement of the movable body 1233. And a casing part 1235 surrounding the shaft 1232 and having one end of the pin 1234 inserted therein.

Preferably, the transducer 1231 includes a plurality of piezoceramic and elastic bodies, and when the power is applied, linearly converts vibration caused by expansion / contraction of the piezoelectric ceramic to move the movable body 1233 up and down. By controlling the transducer, the movement of the movable body 1233 may be controlled.

6 is a cross-sectional view of an example of a pin drive module 1230 according to an embodiment of the present invention.

As shown in FIG. 6, the transducer 1231 of the pin driving module 1230 includes a housing 1231.1; a first piezoelectric ceramic 1231.2 and a second piezoelectric ceramic 1231.4 disposed inside the housing 1231.1; And an elastic member 1231.3 disposed between the first piezoelectric ceramic and the second piezoelectric ceramic.

Meanwhile, the movable body 1233 includes a movable body 1233.1 and a rubber ring 1233.2 disposed inside the movable body 1233.1.

In such a structure, the vertical motion of the movable body 1233 can be efficiently controlled by controlling the voltages applied to the first piezoelectric ceramic 121.2 and the second piezoelectric ceramic 121.4.

7 is a diagram schematically illustrating a plane of an input sensing unit 1300 according to an embodiment of the present invention.

The input sensing unit 1300 according to an embodiment of the present invention may perform intuitive interactions and various information inputs of the visually impaired to the tactile graphics output by the tactile display unit 1200. In addition, the input sensing unit 1300 may add a finger touch and a finger gesture recognition function by coupling a finger touch recognition device to the tactile display unit 1200.

Unlike general touch displays such as tablet PCs, the tactile interface device 1000 according to the present invention expresses tactile graphics by physically raising the tactile pins, and excessive pressure exceeding a force gauge on the tactile pins. When the touch operation of the touched tactile graphic or tactile information output is damaged, it may confuse the information.

Therefore, preferably, the input sensing unit 1300 according to the present invention has a relationship with the touch on the tactile pins, unlike the capacitive method for detecting a change in the capacitance of the tactile pin surface used in a general touch display. In order to recognize the motion, input, gesture, etc. without a light sensing based, more preferably infrared sensing based non-contact recognition. That is, preferably, the input sensing unit is performed in a non-contact manner.

In the present specification, the non-contact sensing or non-contact recognition refers to a sensing method in which a sensing element or sensor can recognize a physical operation or a physical form, even though no physical contact is made to the sensing element or sensor. As an example, an embodiment of the present invention uses an infrared sensing based recognition scheme.

According to the input sensing unit 1300 of the present invention, it is designed so that the infrared beams can be projected slightly higher than the maximum height of the raised tactile cell pins, so that a light touch on the output tactile graphics regardless of the vertical movement of the tactile pins. Only the touch operation can be recognized at high speed without damaging the rising state of the pins.

In addition, various touch-based gestures, such as swipe and rotation, can be recognized without physical jamming of the tactile pins, thereby further diversifying the interaction between the blind and the computer. Another advantage of such an input sensing unit 1300 is that it is designed in a detachable manner and can be easily combined with other existing tactile displays, thereby achieving an effect of increasing scalability.

The input sensing unit 1300 emits a plurality of lights, senses a plurality of emitted lights, and has a changed sensing value when a sensing value of light emitted by physical blocking is changed. The user input is sensed from the position information of the light.

Here, the change in the sensing value of the emitted light includes not only the case where the emitted light is blocked and thus the light cannot be sensed, but also the case where the intensity of the emitted light is weakened.

Preferably, the light used in the input sensing unit 1300 is infrared rays, and the light is emitted in a form of irradiating the light to a predetermined cross section.

The input sensing unit 1300, the input sensing unit 1300 is a position sensing module 1310; And a positioning unit 1320, wherein the position detecting module 1310 includes a plurality of light emitters and a plurality of light receiving sensors, and the positioning unit 1320 is provided from sensing data of the plurality of light receiving sensors. Sensing user input

In detail, the position detecting module 1310 includes a first axis light emitter 1311, a second axis light emitter 1312, a first axis light receiving sensor 1313, and a second axis light receiving sensor 1314. It is preferable to include. With the configuration of the optical emitter and the light receiving sensor, two-dimensional tactile display or tactile pixel can be realized.

The first axis light receiving sensor 1313 is disposed at a position spaced apart from the position of the first axis light emitter 1311 by a predetermined distance in the direction of being emitted, and the second axis light receiving sensor 1314 is formed of a first axis light receiving sensor 1314. The biaxial optical emitter 1312 is disposed at a position spaced apart by a predetermined distance in a direction that emits.

Preferably, the plurality of first axis light receiving sensors 1313 may be disposed to correspond to the plurality of first axis light emitters 1311, respectively. For example, when the first, second, third and fourth optical emitters are provided on the first axis, the first light receiving sensor corresponding to the first optical emitter and the second corresponding to the second optical emitter Preferably, a light receiving sensor, a light receiving sensor 3 corresponding to a light emitter 3, and a light receiving sensor 4 corresponding to a light emitter 4 are provided, and one light receiving sensor emits light from a corresponding light emitter. It is desirable to be able to sense the light to be. In this arrangement, the number of first axis optical emitters 1311 x the number of second axis optical emitters 1312 is the resolution of the tactile pixel that can be sensed.

8 is a diagram schematically illustrating a side of the input sensing unit 1300 according to an embodiment of the present invention.

As shown in FIG. 8, when the light emitted by the light emitter is blocked by the user's finger, the corresponding light receiving sensor causes a change in the sensed value of the received light. Calculate

The optical emitter and the light receiving sensor of the input sensing unit 1300 are disposed adjacent to, or more preferably, coupled to, the tactile display unit 1200 or the pin driving module 1230 of the tactile display unit 1200. do. Accordingly, the user may recognize the tactile information or the tactile graphic provided from the tactile display unit 1200 as a tactile sense and immediately perform an input or a gesture on the tactile display.

However, when the user inputs to the input sensing unit 1300, the user's finger is strongly in contact with the pin driving module 1230 of the tactile display unit 1200, thereby damaging the pin driving module 1230. In order to prevent this, the position sensing module 1310 of the input sensing unit 1300 is preferably spaced apart from the pin driving module 1230. Alternatively, an area in which the user may input the input sensing unit 1300 may be spaced apart from an operating area of the pin driving module 1230. Alternatively, an area in which the user can input the input sensing unit 1300 may be disposed at a height higher than the height when the pin driving module 1230 is raised.

Specifically, the maximum ascending height H1 of the pin from the cap layer 1201 having a plurality of holes in which the pins of the pin driving module 1230 are capable of vertical movement is determined from the cap layer 1201. The height, more preferably lower than the height H2 from the cap layer to the lowest region of the light irradiated from the light emitter is preferred.

9 is a view schematically showing the steps of the tactile interface method according to an embodiment of the present invention. Hereinafter, a tactile interface method implemented by the tactile interface device described with reference to FIGS. 1 to 8 will be described. For convenience, portions overlapping with the contents described with reference to FIGS. 1 to 8 will be omitted for convenience.

According to an embodiment of the present invention, a tactile interface method capable of interacting with a user may be based on a plurality of primary data received from a connected external device or based on primary data generated inside the tactile interface device 1000. A tactile display step of providing information on the display providing the tactile information to the user by the pin (S10); And an input sensing step S20 of sensing a user input in a non-contact manner.

Preferably, the tactile display step and the input sensing step are performed in real time, so that the visually impaired person is not limited to recognizing the tactile information. 1000) can be input such as a command, which can result in an effect that a user terminal, such as a graphic screen-based PC can be used for convenience as a general public.

10 is a view schematically showing the detailed steps of the tactile display step according to an embodiment of the present invention.

The tactile display step S10 provides tactile information by means of tactile pixels represented by a plurality of pins moving up and down by applying power to a transducer including a piezoelectric ceramic and an elastic body.

Specifically, the tactile display step includes receiving primary data received from the connected external device or primary data generated inside the tactile interface device 1000 (S11);

A slave board information loading step (S12) of loading slave board 1260 information such as the number of slave boards 1260 and the number of tactile pixels that can be expressed in each slave board 1260;

A secondary data conversion step (S13) of converting the primary data into secondary data according to the loaded slave board 1260 information;

Slave board transmission step (S14) for transmitting the converted secondary data to each slave board (1260);

Tertiary data conversion in which each slave board 1260 converts the secondary data into tertiary data as a drive signal of a pin drive module array composed of each pin drive module 1230 or a plurality of pin drive modules 1230. Step S15;

And a pin driving step S16 for driving each pin driving module 1230 with the generated driving signal.

The tactile display step is a step of converting and transmitting the visual graphic into a tactile graphic form through the vertical movement of the pins of the pin drive module 1230 configured in a multi-array. In the tactile display step as in the present invention, since the pin is raised when the voltage is applied and the pin is lowered when the voltage is not applied, since the configuration of the module does not require an additional module, a miniaturization is required. It can be implemented in a structure that can be easily and multi-array.

Therefore, the tactile display step as in the present invention can achieve the effect of miniaturizing the device and at the same time providing a tactile display of high resolution.

The primary data reception step S11 is performed by the master board 1250, receives tactile graphic data input from the outside, and is performed through a universal asynchronous receiver / transmitter (UART) module.

On the other hand, the slave board information loading step (S12) and the secondary data conversion step (S13) is preferably performed by a MCU (Micro Controller Unit) electrically connected to the master board (1250).

Preferably, the secondary data conversion step S13 analyzes the tactile graphic data input through the primary data receiving step S11. Subsequently, the slave board transmission step S14 transfers the analyzed tactile graphic data to the slave board 1260.

In the secondary data conversion step (S13) and the slave board transmission step (S14) as described above, after converting the data based on the information of the plurality of slave boards 1260, it is preferably transferred to the slave board 1260. Do.

Alternatively, the secondary data conversion step S13 may convert the tactile graphic data into data corresponding to each slave board 1260 and transfer each converted data to each slave board 1260. have.

Alternatively, the tactile graphic data transmitted through the primary data receiving step S11 may be directly transmitted to the slave board 1260 without the secondary data converting step S13.

Thereafter, the tertiary data conversion step S15 is performed by the processing apparatus built in the slave board 1260. In the third data conversion step, each of the pin drive module 1230 or the plurality of pin drive modules 1230 includes data received through the data received using a preprogrammed CPLD (Complex Programmable Logic Device). Separated according to the pin drive module array, and transmits the operation signal to the pin drive module array consisting of each pin drive module 1230 or a plurality of pin drive module 1230.

The plurality of slave boards 1260 may be disposed on a single master board 1250 and electrically connected to the master board 1250.

11 is a diagram schematically showing the detailed steps of the input sensing step according to an embodiment of the present invention.

The input sensing step is a method for sensing a user's input in an interfacing device that provides tactile information, and emits a plurality of lights, senses a plurality of the emitted lights, and emits a physical block. When the sensing value of the light changes, the user input is sensed from the position information of the light having the changed sensing value. Such an input sensing method can perform intuitive interactions and various information inputs of the visually impaired to the tactile graphics output by the tactile display unit 1200. In addition, the input sensing unit 1300 may add a finger touch and a finger gesture recognition function by coupling a finger touch recognition device to the tactile display unit 1200.

Specifically, the input sensing step,

A light emitting step (S21) for emitting a plurality of lights (emitting);

A light sensing step (S22) for each of the plurality of lights, the light being sensed at a position spaced at a predetermined distance in a direction in which the light is emitted from a position where the light is emitted;

An optical sensor information loading step of loading information of the light receiving sensor having a change in the sensing value (S23); And

And a user input calculation step (S24) of calculating a user's input based on the result sensed by the light sensing step.

On the other hand, the photo-emitting step is to emit a plurality of light from a plurality of first axis optical emitter 1311 disposed along a first axis and a plurality of second axis optical emitter 1312 disposed along a second axis The light sensing step may include a first axis light receiving sensor 1313 corresponding to a plurality of first axis light emitters 1311 and a second axis light reception corresponding to a plurality of second axis light emitters 1312. A plurality of light is sensed by the sensor 1314.

In addition, the user input calculation step, the user's input to calculate the user's input based on the change value of the received light amount of the plurality of first axis light receiving sensor 1313 and the plurality of second axis light receiving sensor 1314 Sensing.

Unlike general touch displays such as tablet PCs, the tactile interface device 1000 according to the present invention expresses tactile graphics by physically raising the tactile pins, and excessive pressure exceeding a force gauge on the tactile pins. When the touch operation of the touched tactile graphic or tactile information output is damaged, it may confuse the information.

Therefore, the input sensing step in the present invention is based on the light sensing, so that the touch operation can be recognized on the tactile pins, unlike the capacitive method of detecting a change in the capacitance of the tactile pin surface used in a general touch display. More preferably, a non-contact recognition method based on infrared sensing is introduced.

According to the input sensing step of the present invention, the infrared beams are projected to be projected slightly higher than the maximum height of the raised tactile cell pins, so that the pins are only touched on the tactile graphic output regardless of the vertical motion of the tactile pins. The touch operation can be recognized at high speed without compromising the rising state.

In addition, various touch-based gestures, such as swipe and rotation, can be recognized without physical jamming of the tactile pins, thereby further diversifying the interaction between the blind and the computer.

12 is a diagram illustrating an example of use of the tactile interface device 1000 according to an embodiment of the present invention.

As shown in FIG. 12, according to an embodiment of the present invention, a pin may be raised in real time according to a finger movement, and a free drawing function may be performed to draw a graphic freely, and a tactile display or tactile information may be checked in real time In doing so, the user can easily draw the graphic while recognizing the graphic previously drawn.

Accordingly, the tactile display device according to an embodiment of the present invention is very similar to a general computer usage method in which ordinary people of normal vision recognize visual information through a monitor and input information through a mouse (or a touch screen of a tablet PC) and a keyboard. In a similar way, visually impaired people can interact with their computers more easily and intuitively using touch.

In one or more example implementations, the functions presented herein may be implemented through hardware, software, firmware, or a combination thereof. If implemented in software, the functions may be stored on or transmitted over as one or more instructions or code on a computer-readable medium. Computer-readable media includes computer storage media and communication media including any medium for facilitating the transfer of a computer program from one place to another. The storage medium may be any available medium that can be accessed by a general purpose computer or a special purpose computer. For example, such computer-readable media may be any of the program code means required in the form of RAM, ROM, EEPROM, CD-ROM or other optical disk storage media, magnetic disk storage media or other magnetic storage devices, or instructions or data structures. Include, but are not limited to, a general purpose computer, special purpose computer, general purpose processor, or any other medium that can be accessed by a special processor.

Those skilled in the art will appreciate that the various exemplary elements, components, logic blocks, modules, and algorithm steps described above may be implemented as electronic hardware, computer software, or a combination thereof. To clarify the interoperability of hardware and software, various illustrative elements, blocks, modules, and steps have been described in terms of their functionality. Whether such functionality is implemented in hardware or software depends on the design constraints added for the particular application and the overall system. Skilled artisans may implement these functions in varying ways for each particular application, but such implementation decisions do not depart from the scope of the present invention.

Various exemplary logic blocks and modules described herein include general purpose processors, digital signal processors (DSPs), application specific semiconductors (ASICs), field programmable gate arrays (FPGAs) or other programmable logic devices, discrete gate or transistor logic, It may be implemented or performed through discrete hardware components or any combination designed to implement the functions described herein. A general purpose processor may be a microprocessor; In alternative embodiments, such a processor may be an existing processor, controller, microcontroller, or state machine. A processor may be implemented as a combination of computing devices, such as, for example, a DSP and a microprocessor, a plurality of microprocessors, one or more microprocessors in conjunction with a DSP core, or a combination of these configurations.

With respect to a hardware implementation, various example logics, logic blocks, and modules of the processing units described in connection with aspects disclosed herein may include one or more application specific semiconductors (ASICs), digital signal processors (DSPs), Digital signal processing devices (DSPDs), programmable logic devices (PLDs), field programmable gate arrays (FPGAs), discrete gate or transistor logic, discrete hardware components, general purpose processors, controllers, micro- It may be implemented in controllers, microprocessors, other electronic units designed to perform the functions described herein, or a combination thereof. A general-purpose processor may be a microprocessor, but in the alternative, may be any existing processor, controller, microcontroller, or state machine. A processor may also be implemented in a combination of computing devices (eg, a DSP and a microprocessor, a plurality of microprocessors, a combination of one or more microprocessors associated with a DSP core, or any other suitable configuration). Additionally, at least one processor may include one or more modules that may implement one or more of the steps and / or operations described herein.

In addition, various aspects or features described herein can be implemented as a method, apparatus, or article of manufacture using standard programming and / or engineering techniques. In addition, the steps and / or operations of a method or algorithm described in connection with the aspects disclosed herein may be embodied directly in hardware, in a software module executed by a processor, or in a combination thereof. In addition, in some aspects, steps or operations of a method or algorithm may be present as at least one or any combination of a set of codes or instructions on a machine-readable medium, or a computer-readable medium, and Can be integrated into computer program objects. The term article of manufacture, as used herein, is intended to include a computer program accessible from any suitable computer-readable device or medium.

The description of the presented embodiments is provided to enable any person skilled in the art to make or use the present invention. Various modifications to these embodiments will be apparent to those skilled in the art, and the generic principles defined herein may be applied to other embodiments without departing from the scope of the invention. Thus, the present invention should not be limited to the embodiments set forth herein but should be construed in the broadest scope consistent with the principles and novel features set forth herein.

Claims (16)

1. As a tactile interface device that can interact with the user,

   A tactile display unit for providing tactile information to a user through a plurality of pins based on data received from a connected external device or data generated inside the tactile interface device; And

   And an input sensing unit sensing a user input.
2. The method according to claim 1,

   The tactile interface device,

   Further comprising an external device connecting portion that can be connected to the external device,

   The external device connection unit includes at least one of a communication module unit capable of performing wireless communication and a wired connection unit capable of connecting to the external device in a wired manner.
3. The method according to claim 1,

   The tactile interface device,

   And a keyboard unit capable of receiving information from a user in the form of a key input.
4. The method according to claim 1,

   The tactile interface device,

   remind

   Tactile interface device including a speaker unit capable of outputting sound to the outside.
5. The method according to claim 1,

   The tactile display unit provides tactile information with tactile pixels of one or more dimensions,

   The haptic pixel is constituted by a plurality of pins moving up and down by applying power to a transducer including a piezoelectric ceramic and an elastic body.
6. The method according to claim 1,

   The tactile display unit,

   A display data receiver which receives the data;

   A tactile data converter converting the data into tactile display data; And

   And a plurality of pin driving modules driven by the tactile display data.

   The plurality of pin drive module constitutes a tactile pixel of one or more dimensions.
7. The method according to claim 6,

   Each of the plurality of pin drive modules,

   A transducer for converting the vibration motion into a linear motion;

   A shaft coupled to the transducer;

   A movable body capable of vertically moving in the axial direction of the shaft on the shaft; And

   And a pin that can move in accordance with the movement of the movable body.
8. The method according to claim 6,

   The input sensing unit is performed in a non-contact manner,

   An area in which a user can input to the input sensing unit is disposed above the operating area of the pin driving module.
9. The method according to claim 1,

   The input sensing unit,

   Emitting a plurality of lights, sensing a plurality of emitted lights,

   When the sensing value of the light emitted by the physical block is changed, the tactile interface device for sensing a user input from the position information of the light having the changed sensing value.
10. The method according to claim 1,

    The input sensing unit position detection module; And a positioning unit,

    The position sensing module includes a plurality of light emitters and a plurality of light receiving sensors,

    And the positioning unit senses a user input from sensing data of the plurality of light receiving sensors.
11. The method according to claim 10,

    The plurality of optical emitters are disposed along a first axis and a second axis,

    And the plurality of light receiving sensors are disposed along a first axis and a second axis.
12. As a tactile interface method that can interact with the user,

    A tactile display step of providing tactile information to the user by a plurality of pins based on the primary data received from the connected external device or the primary data generated inside the tactile interface device; And

    And an input sensing step of sensing a user input in a non-contact manner.

    The tactile display step and the input sensing step are performed in real time.
13. The method according to claim 12,

    The tactile display step,

    A tactile interface method for providing tactile information by means of tactile pixels represented by a plurality of pins moving up and down by applying power to a transducer including a piezoelectric ceramic and an elastic body.
14. The method according to claim 12,

    The haptic pixel is represented by a plurality of pin drive module groups,

    Wherein each group of pin drive modules comprises a plurality of pin drive modules.
15. The method according to claim 12,

    The input sensing step,

    An optical emitting step of emitting a plurality of lights;

    A light sensing step of sensing light for each of the plurality of lights at a position spaced at a predetermined distance in a direction in which the light is emitted from a position where the light is emitted; And

    And a user input calculation step of calculating a user input based on the result sensed by the light sensing step.
16. The method according to claim 14,

    The input sensing step is performed in a non-contact manner,

    An area in which the user can input in the input sensing step is disposed above the operating area of the pin drive module group.

Images