JP2008124599A - Braille adaptive portable terminal device - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide a braille adaptive portable terminal device on which information displayed in braille by converting key-input character information or received mail information can smoothly be read. <P>SOLUTION: The braille adaptive portable terminal device comprises a communication means; an input means provided on a first main surface side for inputting character information; a braille information converting means for converting information input by the input means and/or information received by the communication means into braille information; a braille display means provided on a second main surface side on the opposite side from the first main surface for displaying in braille the braille information obtained by the braille information converting means, the braille display means being configured to display the information in braille in (n) rows by (m) columns (n, m: integers of ≥2); a braille erasing means of erasing the information displayed in braille by the braille display means; and an undisplayed-braille detecting means of detecting whether there is information not displayed in braille by the braille display means. <P>COPYRIGHT: (C)2008,JPO&INPIT

Description

  The present invention relates to a Braille-compatible mobile terminal device.

  A mobile communication terminal provided with a plurality of input keys on the front surface of the main body, wherein braille characters indicating the functions of the input keys are provided on the back surface of the main body corresponding to the input keys. A portable communication terminal characterized by this is proposed (Japanese Patent Laid-Open No. 2002-305573).

  In addition, the mobile phone has a function for receiving e-mail and can express Braille that represents the contents of the received e-mail, and a specific dial key in the key operation unit corresponds to each point constituting Braille. The first side switch unit for designating the next character and the second side switch unit for designating the previous character are provided on the casing of the mobile phone and received as a specific key. A control unit that creates Braille information by converting characters contained in an e-mail into Braille, and a key that expresses Braille by performing protrusion control of the specific key based on Braille information notified from the control unit An operation unit control unit; and a voice output unit that outputs a sound. The key operation unit control unit, when the first side switch unit is pressed, specifies the identification in the braille-converted e-mail. Express with key When the second side switch unit is pressed, the Braille immediately before the Braille represented by the specific key is represented when the second side switch unit is pressed, and the control unit When the first side switch is pressed, if the braille represented by the specific key corresponds to the last character in the e-mail, a sound indicating the end of the sentence is output from the voice output unit, When the second side switch is pressed, if the Braille represented by the specific key corresponds to the first character in the e-mail, the sound output unit outputs a sound indicating the first character. A mobile phone capable of expressing Braille characterized by this is proposed (Japanese Patent Laid-Open No. 2003-60742).

Also, input means for inputting character information, input character information, and character information other than the input character information (character information other than the input character information is specifically the inside of the terminal (RAM or the like). And braille conversion means for converting character information such as operation explanations stored in the mail, character information acquired via a network such as received mail, information provided on the Internet, etc.) into braille information; Display means having a function of displaying the input character information as Braille information and a function of displaying character information other than the input character information as Braille information (in particular, the display means displays the input character information A first display unit that displays as braille information; and a second display unit that displays character information other than the input character information as braille information. The input character information and other text Braking correspondence provided with means for adding identification information to each piece of information and inputting the information to the Braille conversion means and further inputting character information to the Braille conversion means in response to a scrolling operation if necessary A terminal has been proposed (Japanese Patent Laid-Open No. 2006-171307).
JP 2002-305573 A JP 2003-60742 A JP 2006-171307 A

  By the way, since the technique of the said patent document 1 can recognize the function of the input key corresponding to Braille, the operability of the input key is improved when operating the mobile phone. However, problems remain in reading and writing (input / output) of character information such as e-mail documents. That is, when reading the received mail information, the visually impaired person cannot read because the mail information is not Braille. In addition, since the information input with the input key is converted into Braille and the Braille is not displayed, it cannot be confirmed whether or not correct input has been performed.

  With respect to such problems, the technique of Patent Document 2 has been improved. That is, since the characters included in the received electronic mail are converted into Braille and the Braille is expressed by controlling the protrusion of the specific key, the visually impaired can also read the mail information. However, since this proposal uses the input key for Braille expression, the number of Braille that can be expressed at one time is extremely small, and the work of reading the information becomes slow and does not proceed slowly. It seems that visually impaired persons who read email information will be frustrated. Even in this case, since the information input with the input key is converted into Braille and the Braille is not displayed, it cannot be confirmed whether or not the correct input has been performed. In addition, since the protrusion control function in Patent Document 2 only supports a specific key of 2 rows and 3 columns, there is a problem that muddy sounds, plosives, numbers, etc. that are displayed in braille by arranging two 2 rows and 3 columns cannot be expressed. Yes.

  The technique of the above-mentioned patent document 3 is displayed by including a display unit having a function of displaying input character information as Braille information and a function of displaying character information other than the input character information as Braille information. Therefore, it is possible to improve the convenience for the visually impaired because it is possible to input characters while checking the Braille information. That is, since received mail information and mail information to be transmitted (mail information key-input for transmission) are displayed in Braille, it is possible to read and write mail, and to improve the problems of Patent Documents 1 and 2. It has been. And since the means for inputting character information to the Braille conversion means according to the scrolling operation is provided, it is also provided with the feature that the user can convert the character information into Braille information at the user's pace and confirm it.

  However, in any of the techniques of Patent Documents 1, 2, and 3, for example, the number of Braille characters displayed on the Braille display unit is limited. For example, the number of characters in a transmitted or received mail is generally larger than the number of characters displayed on the braille display unit.

  For this reason, Patent Document 3 proposes converting character information into Braille information by a scroll operation.

However, smooth reading is not possible if the next braille is displayed only after scrolling. In other words, it is like reading while pausing repeatedly.
Therefore, it is expected that smooth reading can be performed.

  Therefore, the problem to be solved by the present invention is to solve the above problems. In particular, it is to provide a Braille-compatible mobile terminal device capable of smoothly reading Braille displayed by converting character information input by key or received mail information.

The problem is communication means,
Input means for inputting character information provided on the first main surface side;
Braille information conversion means for converting information input by the input means and / or information received by the communication means into Braille information;
In order to display the braille information converted by the braille information conversion means as braille, braille display means provided with a braille display means provided on the second main surface side opposite to the first main surface Mobile terminal device,
The braille display means is configured to display braille in n rows and m columns (n and m are integers of 2 or more),
A sensor is provided on the second main surface side corresponding to the end of each row and / or the end of each column of n rows and m columns in the braille display means,
When the sensor is turned on, the displayed braille in the corresponding row / column is erased and the braille corresponding to the next content is displayed again. Solved.

In particular, communication means,
Input means for inputting character information provided on the first main surface side;
Braille information conversion means for converting information input by the input means and / or information received by the communication means into Braille information;
In order to display the braille information converted by the braille information conversion means as braille, the braille display means provided on the second main surface side opposite to the first main surface;
Comprising braille erasing means for erasing the braille displayed on the braille display means,
The braille display means is a mobile terminal device for braille configured to display braille in n rows and m columns (n and m are integers of 2 or more),
A sensor is provided on the second main surface side corresponding to the end of each row and / or the end of each column of n rows and m columns in the braille display means,
The Braille erasing means is operated by a signal from the sensor to erase the displayed Braille corresponding to the corresponding row / column and display the Braille corresponding to the next content again. This is solved by a Braille-compatible mobile terminal device.

And communication means;
Input means for inputting character information provided on the first main surface side;
Braille information conversion means for converting information input by the input means and / or information received by the communication means into Braille information;
In order to display the braille information converted by the braille information conversion means as braille, the braille display means provided on the second main surface side opposite to the first main surface;
Braille erasing means for erasing Braille displayed on the Braille display means;
Undisplayed braille detecting means for detecting the presence or absence of undisplayed braille in the braille display means,
The braille display means is a mobile terminal device for braille configured to display braille in n rows and m columns (n and m are integers of 2 or more),
A sensor is provided on the second main surface side corresponding to the end of each row and / or the end of each column of n rows and m columns in the braille display means,
The braille erasing means operates in response to a signal from the sensor to erase the displayed brailles in the corresponding rows and columns, and the braille corresponding to the next content detected by the undisplayed braille detecting means is displayed again. This is solved by a Braille-compatible portable terminal device characterized by being configured as described above.

In addition, the mobile terminal device for braille described above,
It further comprises vertical / horizontal designation means for designating whether the braille displayed on the braille display means is vertical writing or horizontal writing,
When vertical writing is designated by the vertical / horizontal designation means, braille is displayed vertically on the braille display means, and when horizontal writing is designated by the vertical / horizontal designation means, braille is displayed on the braille display means. Is solved by a Braille-compatible mobile terminal device characterized in that it is configured to be displayed horizontally.

In addition, the mobile terminal device for braille described above,
This is solved by a Braille-compatible mobile terminal device further comprising Braille display speed control means.

  According to the present invention, the Braille display means for displaying the Braille information converted by the Braille information conversion means as Braille is provided with input means for inputting character information such as key input means. Since it is provided on the second main surface side opposite to the above, it can have a relatively large area. That is, as many braille as possible can be expressed at once, reading by the visually impaired is smooth.

  And even if not all information is displayed on the braille display means at once, that is, undisplayed braille is displayed in order, but even in that case, each row of n rows and m columns of braille in the braille display means is displayed. The sensors provided corresponding to the end portions and / or the end portions of the respective columns are configured such that the displayed brailles in the corresponding rows and columns are erased and the brailles corresponding to the following contents are displayed again. Therefore, smooth reading is possible. In other words, the braille that has been read while all the braille has not yet been read is replaced with the next braille, so that all the braille is expressed at once, and the reading work can be performed smoothly. The

  If the vertical / horizontal designation means is further provided, by using the vertical / horizontal designation means, the braille display means can know whether the braille is displayed vertically or horizontally. It is very convenient because it can be adapted to the user's convenience and there are no mistakes in reading. In other words, if the eye is healthy, it is obvious whether the sentence is vertical or horizontal, but it is not understood by visually impaired people, and it is difficult to understand immediately by touching Braille. Is resolved.

  The Braille-compatible mobile terminal device according to the present invention has communication means. Furthermore, it has an input means for inputting character information provided on the first main surface side of the casing of the braille-compatible mobile terminal device. Braille information conversion means for converting information input by the input means and / or information received by the communication means into Braille information. Also, in order to display the braille information converted by the braille information conversion means as braille, the braille provided on the second main surface side opposite to the first main surface of the casing of the braille-compatible mobile terminal device It has a display means. This Braille display means is particularly configured to display n rows and m columns (n and m are integers of 2 or more). And it has Braille erasure means for erasing Braille displayed on the Braille display means. The braille display means has undisplayed braille detection means for detecting the presence or absence of undisplayed braille. Further, a sensor is provided on the second main surface side corresponding to the end of each row and / or the end of each column of n rows and m columns in the braille display means. When the sensor is turned on, the already displayed braille in the row and column corresponding to the sensor is erased and the braille corresponding to the next content is displayed again. In particular, the Braille erasing means is operated by a signal from the sensor to erase the displayed Braille corresponding to the corresponding row / column and redisplay the Braille corresponding to the next content. In particular, the braille erasing means operates in response to a signal from the sensor to erase the displayed braille in the corresponding row / column and display the braille corresponding to the next content detected by the undisplayed braille detecting means. It is configured to be redone. Further, it further comprises vertical / horizontal designation means. In addition, braille display speed control means is further provided.

Hereinafter, the present invention will be described in more detail.
1 to 4 show a Braille-compatible mobile terminal device (a mobile phone or a personal) according to the present invention.
1A and 1B show a schematic front view and a schematic rear view of a braille-compatible mobile terminal device, and FIG. 2 shows each part of the braille-compatible mobile terminal device. FIGS. 3A and 3B are diagrams for explaining the relationship between the keys in the input means and the Braille in the Braille display means, and FIG. 4 is a diagram for explaining the reading of the Braille displayed on the Braille display means. is there.

  As shown in FIGS. 1A and 1B, the device of the present invention (braille-compatible mobile terminal device) is provided with a screen display unit 12 and a key unit 13 on the surface of a main body (housing) 11. That is, input means (key part: total of 12 keys in 4 rows and 3 columns) 13 for inputting character information is provided on the front surface (first main surface) side of the housing 11. Although not shown, a vertical / horizontal designation means (key) is provided on the surface of the main body (housing) 11. Of course, this key can be replaced by the 12 keys 13 described above. For example, when the “*” and “1” keys are pressed, the vertical writing display of the vertical / horizontal designation means is selected. When the “*” and “2” keys are pressed, the horizontal writing display of the vertical / horizontal designation means is selected. It may be chosen. The screen display unit 12 is a display device using a monochrome or color liquid crystal panel or organic EL (electrofluorescence).

  A Braille display unit (Braille display means) 14 is provided on the back surface (second main surface) side of the housing 11. In other words, the braille display unit 14 displays braille converted from the character information input from the key unit 13 or braille converted from information by mail document or download. In particular, the braille display unit 14 is configured to display n rows and m columns (n and m are integers of 2 or more). And the key part 13 is comprised on the front side of the housing | casing 11, and the braille display part 14 is comprised in the back side, The back surface is simultaneously with the character input from the key part 13 of the surface (front). Since braille is output to the braille display 14 on the back side, the user can recognize with one hand that the character he / she entered with the index finger is accurate in braille while inputting the character with the thumb. ing. The Braille display unit 14 uses, for example, a sheet-like organic EL (thin film organic EL) or the like, and is configured to be able to express Braille convex portions (unevenness) by electrode operation. The number of characters expressed in Braille depends on the size and resolution of the organic EL or the like applied to the Braille display unit 14. When the braille input / output function is not required, the color may be added to the organic EL or the like when the switch is OFF, or the cover may be added. .

  As shown in FIG. 2, the device of the present invention (a braille compatible mobile terminal device) incorporates a CPU (central processing unit) 22. Further, a ROM 24, a Braille conversion unit 25, a transmission / reception control unit 26, a key control unit 27, a display control unit 29, a work memory 31, a key input unit 28, a display unit 30, and a character memory 32 are incorporated. The CPU 22 is connected to each unit (ROM 24, Braille conversion unit 25, transmission / reception control unit 26, key control unit 27, display control unit 29, work memory 31, key input unit 28, display unit via the bus 23. 30 and a character memory 32).

  Among them, the ROM 24 is a read-only memory in which fixed data such as various control programs to be executed by the CPU 22 and a dictionary used for character conversion are stored. A Braille conversion unit (a Braille information conversion unit for converting information input by the key unit 13 or information received by the communication unit into Braille information) 25 has a function of converting character information into Braille information. The transmission / reception control unit (communication means) 26 is a circuit that transmits and receives data wirelessly. The key control unit 27 controls normal input and braille input set by the user, and the key input unit 28 is an input circuit that receives key inputs from the various keys 13. The display control unit 29 is a control circuit that controls display on the display unit (the screen display unit 12 and the Braille display unit 14 in FIG. 1) 30. The work memory 31 is constituted by a RAM (Random Access Memory), and stores data temporarily required for the CPU 22 to execute the program. The character memory 32 stores character data obtained by mail reception and download.

  Although not shown, the device of the present invention (Braille-compatible mobile terminal device) has Braille erasing means for erasing Braille displayed on the display unit 30 (Braille display unit 14: Braille display means). The display unit 30 (Braille display unit 14: Braille display unit) includes an undisplayed Braille detection unit that detects the presence or absence of undisplayed Braille. For example, if the total number of brailles to be displayed is k, the undisplayed braille detection means has a total number of brailles displayed on the braille display unit 14 of n × m, so k−n × m It is calculated by computing. If k> n × m, it is determined that there are still brailles to be displayed on the braille display unit 14. If k ≦ n × m, it is determined that there is no remaining braille to be displayed on the braille display unit 14.

  Further, although not shown, the device of the present invention (braille-compatible mobile terminal device) has vertical / horizontal display control means. That is, when the vertical writing display is selected by the vertical / horizontal designation means (key) provided on the surface of the main body (housing) 11, the vertical / horizontal display control means controls the braille display section (braille display means) 14. Is displayed in vertical writing (in this case, the reading of Braille is reading along the line). When horizontal writing display is selected, the vertical / horizontal display control means displays the braille in horizontal writing on the braille display section (braille display means) 14 (in this case, the reading of the braille is on a line). Read along).

  As shown in FIG. 4, the device of the present invention (a Braille compatible mobile terminal device) includes convex (uneven) sensors 51, 52, 53 provided on the back surface (second main surface) side of the housing 11. Have. The sensor 51 is provided next to the rightmost braille in the first row among the n rows and m columns of braille displayed on the braille display unit 14. The sensor 52 is provided next to the rightmost braille in the second row of the n rows and m columns of braille displayed on the braille display unit 14. The sensor 53 is provided next to the rightmost braille in the third row of the n rows and m columns of braille displayed on the braille display unit 14. In FIG. 4, only three sensors are shown, but n sensors are provided according to the number of n rows. And in this embodiment, it is the case where it is provided corresponding to the row, but it is provided corresponding to the column because Braille is not read from left to right but may be read sequentially from top to bottom. It may be what was made. That is, it may be provided below the braille at the lowest end of the braille in each column in the n rows and m columns of braille displayed on the braille display unit 14. Of course, it may be provided corresponding to each row and column.

  When the hand (tip of the finger) touches the sensor 51, the sensor 51 is turned on and this signal is input to the braille erasing means to operate, thereby erasing the braille displayed on the first line. The In addition, the sensor-on signal is input to the non-displayed braille detecting means to operate, and the braille information at the position next to the braille displayed on the nth row (the third row in the example of FIG. 4) is detected. This is displayed on the first line. Further, when the hand (tip of the finger) touches the sensor 52, the sensor 52 is turned on, and this signal is inputted to the braille erasing means to operate, thereby erasing the braille displayed on the second line. The In addition, the Braille information at the position next to the braille displayed on the (n + 1) th line (fourth (3 + 1) line in the example of FIG. 4) is activated when a sensor-on signal is input to the undisplayed braille detection means. Is detected and displayed on the second line. Further, when the hand (tip of finger) touches the sensor 53, the sensor 53 is turned on and this signal is input to the braille erasing means to operate, thereby erasing the braille displayed on the third line. The In addition, the braille information at the position next to the braille displayed on the n + 2th line (the 5th (3 + 2) line in the example of FIG. 4) is activated by inputting the sensor-on signal to the undisplayed braille detection means. Is detected and displayed on the third line.

Next, how to use the Braille-compatible mobile terminal device configured as described above will be described.
[Sequence 1 (Braille input / output)]
Two character input methods that enable Braille expression are described.
The first method is an input method in which each point of Braille and each dial key provided in the mobile terminal device have a one-to-one correspondence. In other words, 2 rows and 3 columns of keys 13 in total (six keys in total) are regarded as one Braille composed of unevenness of 2 rows and 3 columns. Each key corresponding to Braille may be in 2 rows and 3 columns. The combination of 2 rows and 3 columns can be arbitrarily set. Examples of combinations of 2 rows and 3 columns of input keys in FIG. 3 are (1, 2, 4, 5, 7, 8), (2, 3, 5, 6, 8, 9), (4, 5, 7, 8, *, 0), (5, 6, 8, 9, 0, #). FIG. 3 shows an example in which the points in 2 rows and 3 columns of the braille 42 are set to the keys 41 (1, 2, 4, 5, 7, 8) of the key unit 13. Braille protrusion control is performed in conjunction with each point of each key 41 and Braille 42. For example, when the key “1” is linked with the braille “1” and the key “1” is pressed once, the braille “1” automatically protrudes. When the key “1” is pressed again, the protruding portion of the Braille “1” disappears. Thereby, the user can always confirm immediately whether the character and number which he / she entered can be correctly input as braille of the correct character / number. In addition, the correspondence between each key and each point can be arbitrarily set by the user. That is, settings such as a symmetrical mirror character display such as a key “1” and Braille “2” and a key “2” and Braille “1” can be made possible. As a result, the user can input Braille with the same feeling as the Braille device.

  The second method is an input method in which character conversion is performed as it is in Braille. For example, to express “e”, “e” is input by pressing the key “1 (assign line)” four times. At that time, the Braille 42 of the Braille display unit 14 is displayed in Braille in order “A, I, U, E” each time the key “1” is pressed once. The user inputs characters while touching the braille 42, and it is possible to reduce conversion errors. Similarly, two-touch input (pager input method) can be set. For example, by pressing the key “1” twice, it is possible to input characters “A”, the key “1” once and the key “2” once “I”. In this way, character input corresponding to the skill level of the user's portable operation can be performed.

Next, the outline of the Braille output method is described.
Braille output display starts from the upper left of the display unit with the back of the terminal facing itself (Braille 42 in FIG. 3B). During character input or Braille conversion, each point is repeatedly convex and flat so that the user can be notified that input is in progress (during conversion). Alternatively, the vibration of the mobile terminal is interlocked. Then, the character confirmation is performed using a determination key or a function key assigned to the key unit 13.

  When the input (conversion) is confirmed, the braille 42 is confirmed. Then, the repetition of the convex and the flat stops, and the convex and the flat are repeated at the position immediately adjacent to the Braille 42 (step 21). In this way, character conversion is sequentially performed.

  In addition, since it is possible to display Braille in two rows and three columns, it is possible to express muddy sounds, plosives, numbers, and the like.

[Sequence 2 (Reading displayed braille)]
As shown in FIG. 4, braille characters in n rows and m columns are displayed on the braille display unit 14. In the column direction, the braille can be read by moving the finger in either the left or right direction, and in the row direction, the braille can be read by moving the finger from the top to the bottom. The user can set which reading direction. In FIG. 4, it is set to read from the left to the right with the back of the terminal facing itself. As a result, the user can read Braille in the same way as a Braille book. When reading from the right to the left, character input (conversion) is the same as in sequence 2, but the start position of the braille display and the sequential braille display section are adjacent to the left.

  FIG. 4 shows an example of a state where character input and braille display are completed. As described above, Braille is read from the left with the back surface (back surface) of the portable terminal facing itself (step 31). Since sensors 51, 52, and 53 are provided at the right end of each column, when Braille in one row is read, a finger touches the sensor (for example, sensor 51) immediately after the reading. If it does so, the signal from the sensor 51 will be input into the braille erasure | elimination means and it will operate | move, and, thereby, the braille displayed on the 1st line will be erase | eliminated. That is, at the position of the first row, the unevenness is eliminated and flattened. In addition, a signal from the sensor 51 is input to the non-display braille detecting means to operate, information to be displayed on the fourth line is detected, and this is displayed on the first line.

  The user knows that there is no more Braille at the position of the first row by touching the unevenness of the sensor 51 with the finger. Therefore, the finger is moved to the position of the next second row and the leftmost position. Then, the finger is moved in the right direction from the leftmost end in the second row, and the braille is read (step 32). When all the braille characters at the position of the second row are read, the finger touches the sensor 52 immediately after the reading. If it does so, the signal from the sensor 52 will be input into the braille erasure | elimination means and it will operate | move, and the braille displayed on the 2nd line will be erase | eliminated by this. That is, at the position of the second row, the unevenness is eliminated and flattened. In addition, a signal from the sensor 52 is input to the non-display braille detecting means to operate, information to be displayed on the fifth line is detected, and this is displayed on the second line.

  When the user touches the unevenness of the sensor 52, the user knows that there is no more Braille at the position of the second row. Therefore, the finger is moved to the position of the next third row and the leftmost position. Then, the finger is moved in the right direction from the leftmost end in the third line, and the braille is read (step 33). When all the braille characters at the position of the third row are read, the finger touches the sensor 53 immediately after the reading. If it does so, the signal from the sensor 53 will be input into the braille erasure | elimination means and it will operate | move, and, thereby, the braille displayed on the 3rd line will be erase | eliminated. That is, at the position of the third row, the unevenness is eliminated and flattened. In addition, a signal from the sensor 53 is inputted to the non-display braille detecting means to operate, information to be displayed on the sixth line is detected, and this is displayed on the third line.

  Thereafter, the user moves his / her finger to the position on the first line and to the leftmost position. Then, the same repetition is performed. Therefore, the reading operation can be performed smoothly without delay.

  It should be noted that the braille in the line once erased can be displayed again by the function key or the like. Therefore, in such a case, it can be read again by an operation using a function key.

[Sequence 3 (Braille guide for mobile devices)]
In the device of the present invention (a braille compatible mobile terminal device), the user can always display the menu at the top of the braille display unit 14 so that the user can recognize the currently selected menu. ing. For example, when mail is selected on the menu selection, “mail” is displayed on the upper part of the braille display unit 14. Similarly, the menus selected for the telephone, camera, application, etc. are displayed in braille. Even if the menu is selected and one menu level is lowered, the selected sequence name is always displayed in braille as described above. As a result, the user can check and select the currently selected menu.

[Sequence 4 (mail transmission / reception)]
Next, an outline of a mail transmission / reception method using braille display will be described.
In the device of the present invention (a Braille-compatible mobile terminal device), when a mail is received, the mail character information is stored in the character memory 32. When the mail character information is kanji, hiragana, katakana, or the like, the character conversion unit 25 performs character conversion to braille. Character conversion is performed for each break (punctuation mark, space, paragraph, etc.) of the sentence, and is displayed on the braille display unit 14 via the display control unit 29 after conversion. Alternatively, a method may be used in which each converted character is displayed and read by the user one by one. If the mail character information is in braille, the conversion is omitted and displayed as it is on the braille display unit 14.

  The top line of the braille display unit 30 always displays the current function so that the user can recognize what the user is doing (see sequence 3). In the case of mail reception, “mail reception: sender: title” is always displayed at the top.

[Sequence 5 (Braille display by character data)]
Character data can be displayed in Braille by using the device of the present invention (a Braille compatible portable terminal device). Character data (for example, information on books, newspapers, advertisements, maps, etc.) is downloaded to the work memory 31 and stored. Then, the character data is converted into Braille by the Braille conversion unit 25. After the conversion, the user can obtain information in Braille by displaying on the Braille display unit 14.

[Sequence 6 (Character data voice playback with earphone)]
Information can be obtained reliably by linking the braille display and the reading function. The audio reproduction is output from an earphone or a speaker provided in the mobile terminal.

[Sequence 7 (braille data creation, input / output possible)]
If the created braille data can be output as a text file, it can be output from a portable terminal to an external device such as a personal computer. Accordingly, Braille printout output and the like are possible.

[Sequence 8 (Braille phone)]
When the device (Braille-compatible mobile terminal device) of the present invention is a mobile terminal dedicated to a visually impaired person, a Braille display unit 14 may be provided instead of the screen display unit 12 on the surface of the mobile terminal. If it is a foldable portable terminal, it will not change the appearance of a normal portable device in the folded state.

The apparatus of the present invention has a control means that enables fast reading and rereading by controlling the braille display speed as required. Further, it has a grid forming means for subdividing (griding) the convex portion expressing portion of the Braille display panel portion.
That is, as shown in FIG. 5, one point of the convex portion is expressed by a plurality of grids. As described above, the grid of the braille display portion becomes a convex portion by electrode operation. The broken line in FIG. 5A shows a part touched with a finger, and the broken line in FIG. 5B shows a tactile image of a point.

  First, the braille is moved as in (step 61 to step 63) in FIG. That is, the braille (dot a row, point b row) initially displayed gradually moves to the left (step 61 to step 62). At the same time, the next braille (dot c row, dot d row) moves from the right direction (step 62). After that, as in step 63, the next braille (dot c row, dot d row) is replaced with the previous braille (dot a row, point b row) and displayed. Although the movement of the braille is not shown, it can be operated with, for example, an “access key”. The display speed of Braille can be changed by key operation, and the speed that the reader wants to read (the speed at which Braille moves horizontally) can be adjusted. Therefore, skipping by quick reading and reading back in the reverse direction can be easily performed.

In addition, it is preferable to put a fixed space (flat) between brailles. With this sequence, the user who is touching the braille can read the braille text so that it flows from left to right. That is, it is possible to easily read Braille simply by operating the access key with a free finger while the finger to be read is fixed.
For example, when the “access key” is operated with a neuro pointer, the braille information can be read by fixing the braille display panel with the index finger and operating the neuro pointer with the thumb. In the present invention, since it can be read in the vertical and horizontal directions, a function such as a neuro pointer can be used sufficiently. Accordingly, it is not necessary to move the index finger to read Braille, and Braille reading can be easily performed while the mobile terminal is operated with one hand.

Moreover, Braille expression becomes rich by making a convex part into grid expression. That is, the point size, the point interval, the line interval, and the mass interval (see FIG. 6) can be freely changed.
Therefore, a braille beginner can display a large point, and an expert can make a setting according to the skill level of the user, such as reducing the point and reducing the cell interval.

It is also possible to display braille text that matches the standards of each country. Moreover, not only braille but also drawings and pictures can be displayed as dot representations by the grid. If the area of the braille table is sufficiently large, a map display with dots is also possible. Therefore, the braille display unit can expand not only the convex display but also the concave display.
Therefore, not only text information but also drawing information can be expressed, and a healthy person can provide visual information to a disabled person. Furthermore, since the number of characters is not limited by the braille display unit, the number of lines need not be calculated. In addition, by adding a vibration function to the grid, it can also be used as a print / printer. Further, the braille display portion is the back of the first main surface portion (the back surface of the mobile terminal), but may be mounted on the back side of the folding screen display portion (LCD panel).

Schematic front view and schematic rear view of mobile terminal device for Braille according to the present invention Block diagram of Braille-compatible mobile terminal device of the present invention The figure explaining the relationship between the key in the input means of the braille corresponding portable terminal device of this invention, and the Braille in a braille display means. The figure explaining the reading of the braille displayed on the braille display means of the braille terminal corresponding to the present invention Operation explanatory diagram of the Braille-compatible mobile terminal device of the present invention Explanatory drawing of Braille expression of the mobile terminal device for Braille according to the present invention

Explanation of symbols

11 Body (housing)
12 Screen display part 13 Key part (input means)
14 Braille display (braille display means)
22 CPU
23 Bus 24 ROM
25 Braille conversion unit 26 Transmission / reception control unit 27 Key control unit 28 Key input unit 29 Display control unit 30 Display unit 31 Work memory 32 Character memory 51, 52, 53 Sensor

Patent Applicant NEC Corporation
Representative Katsumi Udaka

Claims (5)

Communication means;
Input means for inputting character information provided on the first main surface side;
Braille information conversion means for converting information input by the input means and / or information received by the communication means into Braille information;
In order to display the braille information converted by the braille information conversion means as braille, braille display means provided with a braille display means provided on the second main surface side opposite to the first main surface Mobile terminal device,
The braille display means is configured to display braille in n rows and m columns (n and m are integers of 2 or more),
A sensor is provided on the second main surface side corresponding to the end of each row and / or the end of each column of n rows and m columns in the braille display means,
When the sensor is turned on, the displayed braille in the corresponding row / column is erased and the braille corresponding to the next content is displayed again. Communication means;
Input means for inputting character information provided on the first main surface side;
Braille information conversion means for converting information input by the input means and / or information received by the communication means into Braille information;
In order to display the braille information converted by the braille information conversion means as braille, the braille display means provided on the second main surface side opposite to the first main surface;
Comprising braille erasing means for erasing the braille displayed on the braille display means,
The braille display means is a mobile terminal device for braille configured to display braille in n rows and m columns (n and m are integers of 2 or more),
A sensor is provided on the second main surface side corresponding to the end of each row and / or the end of each column of n rows and m columns in the braille display means,
The Braille erasing means is operated by a signal from the sensor to erase the displayed Braille corresponding to the corresponding row / column and display the Braille corresponding to the next content again. Braille-compatible mobile terminal device. Communication means;
Input means for inputting character information provided on the first main surface side;
Braille information conversion means for converting information input by the input means and / or information received by the communication means into Braille information;
In order to display the braille information converted by the braille information conversion means as braille, the braille display means provided on the second main surface side opposite to the first main surface;
Braille erasing means for erasing Braille displayed on the Braille display means;
Undisplayed braille detecting means for detecting the presence or absence of undisplayed braille in the braille display means,
The braille display means is a mobile terminal device for braille configured to display braille in n rows and m columns (n and m are integers of 2 or more),
A sensor is provided on the second main surface side corresponding to the end of each row and / or the end of each column of n rows and m columns in the braille display means,
The braille erasing means operates in response to a signal from the sensor to erase the displayed brailles in the corresponding rows and columns, and the braille corresponding to the next content detected by the undisplayed braille detecting means is displayed again. It is comprised so that it may be configured. A Braille-compatible portable terminal device. It further comprises vertical / horizontal designation means for designating whether the braille displayed on the braille display means is vertical writing or horizontal writing,
When vertical writing is designated by the vertical / horizontal designation means, braille is displayed vertically on the braille display means, and when horizontal writing is designated by the vertical / horizontal designation means, braille is displayed on the braille display means. The mobile terminal device for braille according to any one of claims 1 to 3, characterized in that is displayed in horizontal writing.   5. The Braille-compatible mobile terminal device according to claim 1, further comprising Braille display speed control means.

Images