CN112908111A - Touch reading method, device and system for blind people - Google Patents
Touch reading method, device and system for blind people Download PDFInfo
- Publication number
- CN112908111A CN112908111A CN202110132057.7A CN202110132057A CN112908111A CN 112908111 A CN112908111 A CN 112908111A CN 202110132057 A CN202110132057 A CN 202110132057A CN 112908111 A CN112908111 A CN 112908111A
- Authority
- CN
- China
- Prior art keywords
- characters
- image information
- module
- braille
- point
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000000034 method Methods 0.000 title claims abstract description 35
- 230000002194 synthesizing effect Effects 0.000 claims abstract description 11
- 238000013507 mapping Methods 0.000 claims description 15
- 230000015572 biosynthetic process Effects 0.000 claims description 14
- 238000003786 synthesis reaction Methods 0.000 claims description 14
- 238000006243 chemical reaction Methods 0.000 claims description 6
- 238000010586 diagram Methods 0.000 description 4
- 238000005516 engineering process Methods 0.000 description 3
- 230000008569 process Effects 0.000 description 3
- 201000009487 Amblyopia Diseases 0.000 description 2
- 230000006870 function Effects 0.000 description 2
- 238000004519 manufacturing process Methods 0.000 description 2
- 238000013461 design Methods 0.000 description 1
- 238000011161 development Methods 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 230000008447 perception Effects 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
- G09B—EDUCATIONAL OR DEMONSTRATION APPLIANCES; APPLIANCES FOR TEACHING, OR COMMUNICATING WITH, THE BLIND, DEAF OR MUTE; MODELS; PLANETARIA; GLOBES; MAPS; DIAGRAMS
- G09B21/00—Teaching, or communicating with, the blind, deaf or mute
- G09B21/001—Teaching or communicating with blind persons
- G09B21/006—Teaching or communicating with blind persons using audible presentation of the information
Landscapes
- Engineering & Computer Science (AREA)
- Health & Medical Sciences (AREA)
- Audiology, Speech & Language Pathology (AREA)
- General Health & Medical Sciences (AREA)
- Business, Economics & Management (AREA)
- Physics & Mathematics (AREA)
- Educational Administration (AREA)
- Educational Technology (AREA)
- General Physics & Mathematics (AREA)
- Theoretical Computer Science (AREA)
- User Interface Of Digital Computer (AREA)
Abstract
The invention provides a touch and talk method, a device and a system for blind people, comprising the following steps: acquiring image information of a click-to-read file, and identifying the image information as braille or common characters; if the image information is Braille, entering a Braille point reading mode: identifying a point reading code corresponding to the image information; converting the point reading code into characters; synthesizing the characters into voice, and playing the synthesized voice; if the image information is the common characters, entering a common character point reading mode: identifying characters corresponding to the image information; and synthesizing the characters into voice, and playing the synthesized voice. The problem that the audio cannot be played and the normal text cannot be read without the pre-recorded audio in the prior art can be solved, so that great convenience is brought to the reading of the blind, and an information acquisition channel of the blind is enlarged.
Description
Technical Field
One or more embodiments of the invention relate to the technical field of reading, in particular to a reading method, a reading device and a reading system for blind people.
Background
This section is intended to provide a background or context to the embodiments of the invention that are recited in the claims. The description herein may include concepts that could be pursued, but are not necessarily ones that have been previously conceived or pursued. Thus, unless otherwise indicated herein, what is described in this section is not prior art to the description and claims in this application and is not admitted to be prior art by inclusion in this section.
Braille is a pinyin word composed of raised dots. The blind person touches the position of the point by hand so as to read the characters. Therefore, braille books are printed using a special method. The printing process of the Braille book comprises the following steps: editing → typesetting → proofing → changing → plate making → printing → bookbinding.
The Braille book has higher manufacturing complexity and high manufacturing cost; therefore, in the market, the number of braille books is small, and the braille can be read only by the blind through tactile perception, so that the braille book is inconvenient to use.
With the continuous development of economy and science, people pay more and more attention to the blind and the amblyopia group, and the corresponding printing technology, the point reading method and the point reading equipment for helping the blind and the amblyopia group to read are continuously updated. The current point-reading method in the market is mainly as follows: and recognizing the click-to-read code corresponding to the click-to-read Braille file by using a click-to-read device, responding to the click-to-read code, and playing the corresponding acquired Braille audio content in a voice mode. However, this technique has the following problems:
(1) the audio content corresponding to the braille needs to be recorded in advance, and if the audio content is not recorded in advance, the audio cannot be played;
(2) for normal texts, the blind cannot read the texts, so that the reading range and the reading way of the blind are limited.
Therefore, there is a need to provide a new touch-and-talk method and device for the blind to solve the above technical problems.
Disclosure of Invention
One or more embodiments of the present specification describe a touch and talk method and apparatus for the blind, which solve the problems in the prior art that the audio cannot be played and the normal text cannot be read without the pre-recorded audio.
The technical scheme provided by one or more embodiments of the specification is as follows:
in a first aspect, the present invention provides a touch reading method for blind people, including:
acquiring image information of a point-reading file;
identifying the image information as braille or common characters;
if the image information is Braille, entering a Braille point reading mode:
identifying a point reading code corresponding to the image information;
converting the point reading code into characters;
synthesizing the characters into voice, and playing the synthesized voice;
if the image information is the common characters, entering a common character point reading mode:
identifying characters corresponding to the image information;
and synthesizing the characters into voice, and playing the synthesized voice.
In one example, the point reading code is converted into a text, specifically:
and establishing a mapping table of the point reading codes and the characters, and converting the point reading codes into the characters based on the mapping table.
In a second aspect, the invention provides a touch and talk device for blind people, which comprises an acquisition module, a recognition module, a voice synthesis module, a voice playing module, a braille module and a common character module; the Braille module comprises a first identification submodule and a conversion module; the common character module comprises a second identification submodule:
the acquisition module is used for acquiring the image information of the read-on-demand file;
the identification module is used for identifying the image information as braille or common characters;
the first identification submodule is used for identifying a corresponding reading code when the image information is braille;
the conversion module is used for converting the point reading code into characters;
the second identification submodule is used for identifying corresponding characters when the image information is common characters;
the voice synthesis module is used for synthesizing voice by characters;
and the voice playing module is used for playing the voice synthesized by the characters.
In one example, the apparatus further includes a mapping table module configured to establish a mapping table of the point-reading code and the word, and convert the point-reading code into the word based on the mapping table
In a third aspect, the present invention provides a click-to-read system for blind people, the system comprising at least one processor and a memory;
the memory to store one or more program instructions;
the processor is configured to execute one or more program instructions to perform the method according to one or more of the first aspects.
In a fourth aspect, the present invention provides a chip, which is coupled to a memory in a system, so that the chip calls program instructions stored in the memory when running to implement the method according to one or more of the first aspects.
In a fifth aspect, the invention provides a computer readable storage medium comprising one or more program instructions executable by a system according to the third aspect to implement a method according to one or more of the first aspects.
The method provided by the embodiment of the invention has the following advantages:
(1) through adding the Braille/character recognition module, the switching between Braille point reading and common point reading can be realized, and the problem that only Braille point reading can be realized is solved;
(2) through the sound synthesis module, the synthesis from characters to voice is realized, and the problem that the audio frequency needs to be recorded in advance is solved.
Drawings
Fig. 1 is a schematic flow chart of a touch reading method for the blind according to an embodiment of the present invention;
FIG. 2 is a second schematic flow chart of a touch reading method for the blind according to an embodiment of the present invention
Fig. 3 is a schematic structural diagram of a point reading device for blind persons according to an embodiment of the present invention;
FIG. 4 is a schematic structural diagram of a blind module;
fig. 5 is a schematic structural diagram of a point reading system for blind people according to an embodiment of the present invention.
Detailed Description
The present application will be described in further detail with reference to the following drawings and examples. It is to be understood that the specific embodiments described herein are merely illustrative of the relevant invention and not restrictive of the invention. It should be further noted that, for the convenience of description, only the portions related to the related invention are shown in the drawings.
It should be noted that the embodiments and features of the embodiments in the present application may be combined with each other without conflict. The present application will be described in detail below with reference to the embodiments with reference to the attached drawings.
Fig. 1 shows a flow chart of a point reading method for the blind, according to an embodiment, as shown in fig. 1, the method includes the following steps:
and step 10, acquiring image information of the point reading file.
Specifically, the pointing device acquires image information of the pointed braille file. The reading device can read any contents such as characters, pictures, numbers and the like, and essentially distinguishes various contained information.
And 20, identifying the image information as braille or common characters.
Specifically, whether the acquired image information is braille or common characters is identified, and the function is selected according to the identification result: braille reading or ordinary character reading. If the image information is braille, the process goes to step 30, if the image information is common characters, the process goes to step 40, and the steps 30 and 40 are not in a specified sequence and are determined according to the identification result of the image information.
And step 30, if the image information is the Braille, entering a Braille point reading mode.
When the blind person reads the braille, the braille can be read on the braille book through the reading device, so that the braille can be played in a voice mode through audio equipment, and the blind person can listen to the content of the braille.
The dot reading codes are printed on the Braille file which can be subjected to dot reading, and the dot reading device can identify the dot reading codes printed on the Braille file.
Specifically, a mapping table of the point reading code and the characters is established, and the point reading code is converted into the characters based on the mapping table.
The converted text is synthesized into voice by using a voice synthesis technology, which is a prior art and known to those skilled in the art, and will not be described herein again.
The step is the same as step 303, and the converted text is synthesized into a voice by using a voice synthesis technology, which is a prior art and known to those skilled in the art, and will not be described herein again.
I.e. step 303 and step 402 may be merged here into the same step execution, like step 50 in fig. 2.
According to the method provided by the embodiment of the invention, the Braille/character recognition module is added, so that the switching between Braille point reading and common point reading can be realized, and the problem that only Braille point reading can be realized is solved, thereby bringing great convenience to the reading of the blind and expanding the information acquisition channel of the blind; in addition, the synthesis from characters to voice is realized through the voice synthesis module, and the problem that the audio frequency needs to be recorded in advance is solved.
Corresponding to the method of the above embodiment, the present invention further provides a touch and talk device for blind people, fig. 3 is a schematic structural diagram of the device, and as shown in fig. 3, the device includes an obtaining module 1, a recognition module 2, a voice synthesis module 3, a voice playing module 4, a braille module 5 and a common text module 6; wherein, the braille module 5 comprises a first identification submodule 51 and a conversion module 52; the generic text module 6 comprises a second recognition submodule 61:
the acquisition module 1 is used for acquiring image information of the read-on-demand file.
And the identification module 2 is used for identifying that the image information is braille or common characters.
If the image information is identified as the Braille, entering a Braille module 5: the point reading code corresponding to the braille is identified and converted into characters, specifically:
and the first identification submodule 51 is used for identifying the corresponding reading code when the image information is braille.
A conversion module 52, configured to convert the click-to-read code into a text.
If the image information is recognized as the common characters, entering a common character module 6: recognizing characters corresponding to the common characters, specifically:
and the second identification submodule 61 is used for identifying corresponding characters when the image information is common characters.
And the voice synthesis module 3 is used for synthesizing voice by characters.
And the voice playing module 4 is used for playing the voice synthesized by the characters.
In one example, as shown in fig. 5, the apparatus further includes a mapping table module 7, configured to establish a mapping table of the point-reading codes and the words, and convert the point-reading codes into the words based on the mapping table.
The functions executed by each component in the apparatus provided in the embodiment of the present invention have been described in detail in the above-mentioned method, and therefore, redundant description is not repeated here.
Corresponding to the above embodiments, the embodiment of the present invention further provides a touch and talk system for blind people, specifically as shown in fig. 5, the system includes at least one processor 51 and a memory 52;
a memory 51 for storing one or more program instructions;
a processor 52 for executing one or more program instructions to perform any of the method steps of the touch-and-talk method for the blind as described in the above embodiments.
Corresponding to the above embodiment, the embodiment of the present invention further provides a chip, which is coupled to the memory in the above system, so that the chip calls the program instructions stored in the memory when running, thereby implementing the point-reading method for the blind person as described in the above embodiment.
Corresponding to the above embodiments, the embodiments of the present invention also provide a computer storage medium, which includes one or more programs, wherein one or more program instructions are used by the touch-and-talk system for the blind to execute the touch-and-talk method for the blind as described above.
According to the scheme, the point-reading device is used for identifying whether the point-read image information is the Braille or the common characters, different identification modules are selected according to different identification results, then the characters corresponding to the image information are obtained, and finally the audio content corresponding to the played characters is obtained, so that the blind can read the Braille without sensing through touch, the point-reading device is used for reading the Braille, the point-reading device can be used for reading the common characters, great convenience is brought to the reading of the blind, and an information acquisition channel of the blind is enlarged.
Therefore, the scheme provided by the application solves the problems existing in the prior art:
(1) through adding the Braille/character recognition module, the switching between Braille point reading and common point reading can be realized, and the problem that only Braille point reading can be realized is solved;
(2) through the voice synthesis module, the synthesis from characters to voice is realized, and the problem that the audio frequency needs to be recorded in advance is solved.
Those of skill would further appreciate that the various illustrative components and algorithm steps described in connection with the embodiments disclosed herein may be implemented as electronic hardware, computer software, or combinations of both, and that the various illustrative components and steps have been described above generally in terms of their functionality in order to clearly illustrate this interchangeability of hardware and software. Whether such functionality is implemented as hardware or software depends upon the particular application and design constraints imposed on the implementation. Skilled artisans may implement the described functionality in varying ways for each particular application, but such implementation decisions should not be interpreted as causing a departure from the scope of the present invention.
The steps of a method or algorithm described in connection with the embodiments disclosed herein may be embodied in hardware, a software module executed by a processor, or a combination of the two. A software module may reside in Random Access Memory (RAM), memory, Read Only Memory (ROM), electrically programmable ROM, electrically erasable programmable ROM, registers, hard disk, a removable disk, a CD-ROM, or any other form of storage medium known in the art.
The above embodiments are provided to further explain the objects, technical solutions and advantages of the present invention in detail, it should be understood that the above embodiments are merely exemplary embodiments of the present invention and are not intended to limit the scope of the present invention, and any modifications, equivalents, improvements and the like made within the spirit and principle of the present invention should be included in the scope of the present invention.
Claims (7)
1. A point reading method for blind people is characterized by comprising the following steps:
acquiring image information of a point-reading file;
identifying the image information as braille or common characters;
if the image information is Braille, entering a Braille point reading mode:
identifying a point reading code corresponding to the image information;
converting the point reading code into characters;
synthesizing the characters into voice, and playing the synthesized voice;
if the image information is the common characters, entering a common character point reading mode:
identifying characters corresponding to the image information;
and synthesizing the characters into voice, and playing the synthesized voice.
2. The point-reading method according to claim 1, wherein converting the point-reading code into a text specifically comprises:
and establishing a mapping table of the point reading codes and the characters, and converting the point reading codes into the characters based on the mapping table.
3. A point reading device for blind people is characterized by comprising an acquisition module, an identification module, a voice synthesis module, a voice playing module, a Braille module and a common character module; the Braille module comprises a first identification submodule and a conversion module; the common character module comprises a second identification submodule:
the acquisition module is used for acquiring the image information of the read-on-demand file;
the identification module is used for identifying the image information as braille or common characters;
the first identification submodule is used for identifying a corresponding reading code when the image information is braille;
the conversion module is used for converting the point reading code into characters;
the second identification submodule is used for identifying corresponding characters when the image information is common characters;
the voice synthesis module is used for synthesizing voice by characters;
and the voice playing module is used for playing the voice synthesized by the characters.
4. The apparatus of claim, further comprising a mapping table module for creating a mapping table of the point-reading code and the word, and converting the point-reading code into the word based on the mapping table.
5. A point-and-read system for the blind, characterized in that it comprises at least one processor and a memory;
the memory to store one or more program instructions;
the processor, configured to execute one or more program instructions to perform the method according to one or more of claims 1 to 2.
6. A chip, characterized in that it is coupled to a memory in a system such that it, when run, invokes program instructions stored in said memory, implementing the method according to one or more of claims 1 to 2.
7. A computer-readable storage medium, characterized in that the computer-readable storage medium comprises one or more program instructions that are executable by the system of claim 6 to implement the method of one or more of claims 1 to 2.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110132057.7A CN112908111A (en) | 2021-01-30 | 2021-01-30 | Touch reading method, device and system for blind people |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110132057.7A CN112908111A (en) | 2021-01-30 | 2021-01-30 | Touch reading method, device and system for blind people |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN112908111A true CN112908111A (en) | 2021-06-04 |
Family
ID=76121996
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202110132057.7A Pending CN112908111A (en) | 2021-01-30 | 2021-01-30 | Touch reading method, device and system for blind people |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN112908111A (en) |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN114120769A (en) * | 2021-11-29 | 2022-03-01 | 云知声智能科技股份有限公司 | Braille reading method, device, storage medium and electronic device |
Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101009095A (en) * | 2007-01-24 | 2007-08-01 | 蒋清晓 | Fully-automatic intelligent blind reader |
| CN101493996A (en) * | 2009-01-15 | 2009-07-29 | 北方工业大学 | Intelligent reader and implementation method thereof |
| CN201340677Y (en) * | 2008-12-18 | 2009-11-04 | 文俊燃 | Reading and writing machine for blind people |
| CN103077625A (en) * | 2013-01-30 | 2013-05-01 | 中国盲文出版社 | Blind electronic reader and blind assistance reading method |
| CN105303932A (en) * | 2015-11-23 | 2016-02-03 | 宋禹辰 | Bump Braille pronunciation reading and self-learning method |
| CN107331249A (en) * | 2017-07-26 | 2017-11-07 | 中国盲文出版社 | Braille reading method and device |
| CN110728886A (en) * | 2019-10-30 | 2020-01-24 | 京东方科技集团股份有限公司 | Braille learning system, fingertip sensor and forming method thereof |
-
2021
- 2021-01-30 CN CN202110132057.7A patent/CN112908111A/en active Pending
Patent Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101009095A (en) * | 2007-01-24 | 2007-08-01 | 蒋清晓 | Fully-automatic intelligent blind reader |
| CN201340677Y (en) * | 2008-12-18 | 2009-11-04 | 文俊燃 | Reading and writing machine for blind people |
| CN101493996A (en) * | 2009-01-15 | 2009-07-29 | 北方工业大学 | Intelligent reader and implementation method thereof |
| CN103077625A (en) * | 2013-01-30 | 2013-05-01 | 中国盲文出版社 | Blind electronic reader and blind assistance reading method |
| CN105303932A (en) * | 2015-11-23 | 2016-02-03 | 宋禹辰 | Bump Braille pronunciation reading and self-learning method |
| CN107331249A (en) * | 2017-07-26 | 2017-11-07 | 中国盲文出版社 | Braille reading method and device |
| CN110728886A (en) * | 2019-10-30 | 2020-01-24 | 京东方科技集团股份有限公司 | Braille learning system, fingertip sensor and forming method thereof |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN114120769A (en) * | 2021-11-29 | 2022-03-01 | 云知声智能科技股份有限公司 | Braille reading method, device, storage medium and electronic device |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| Kern | Language, literacy, and technology | |
| US7836399B2 (en) | Detection of lists in vector graphics documents | |
| US8719029B2 (en) | File format, server, viewer device for digital comic, digital comic generation device | |
| US20080042970A1 (en) | Associating a region on a surface with a sound or with another region | |
| KR910012986A (en) | Document correction device of document reading translation system | |
| CN105677777B (en) | Dot matrix encodes document generating method | |
| WO2023123590A1 (en) | Answering processing method based on handwriting track identification, stylus, system and terminal | |
| CN103065522A (en) | Book for blind, book printing method, voice broadcasting equipment and broadcasting method | |
| EP2447854A1 (en) | Method and system of automatic diacritization of Arabic | |
| CN112908111A (en) | Touch reading method, device and system for blind people | |
| CN1359514A (en) | Multimodal data input device | |
| KR100593589B1 (en) | Multilingual Interpretation / Learning System Using Speech Recognition | |
| WO2017206861A1 (en) | Human-machine conversation platform | |
| KR20180017556A (en) | The Method For Dictation Using Electronic Pen | |
| CN105531765A (en) | Method for generating and recognizing voice-based playback information, and recording medium | |
| KR20140087951A (en) | Apparatus and method for learning english grammar by using native speaker's pronunciation data and image data. | |
| KR20060116432A (en) | Method and system for providing braille-points data and outputting braille-points data | |
| KR20170101871A (en) | Electronic pen and content transplantation method of the electronic pen | |
| KR20050012864A (en) | The system and method of automatically making a handwriting-liked autographical sentence image by combination of handwriting phoneme digital image | |
| KR20070008993A (en) | Method of data acquisition using collaboration between input modalities | |
| KR20180017558A (en) | The Electronic Pen Supplying Different Voice | |
| KR20180010649A (en) | The Method For Stepwise Supplying Explanation Content of Question Using Electronic Pen | |
| Zhao et al. | TADA: Making Node-link Diagrams Accessible to Blind and Low-Vision People | |
| JP4799604B2 (en) | Document structure template paper and document information reproduction system | |
| CN113345408B (en) | Chinese and English voice mixed synthesis method and device, electronic equipment and storage medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20210604 |