CN114120334A - Braille processing method, device, storage medium and electronic device - Google Patents

Braille processing method, device, storage medium and electronic device Download PDF

Info

Publication number
CN114120334A
CN114120334A CN202111437479.1A CN202111437479A CN114120334A CN 114120334 A CN114120334 A CN 114120334A CN 202111437479 A CN202111437479 A CN 202111437479A CN 114120334 A CN114120334 A CN 114120334A
Authority
CN
China
Prior art keywords
braille
image information
text
unit
content
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN202111437479.1A
Other languages
Chinese (zh)
Inventor
赵东阳
李霄寒
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Unisound Intelligent Technology Co Ltd
Original Assignee
Unisound Intelligent Technology Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Unisound Intelligent Technology Co Ltd filed Critical Unisound Intelligent Technology Co Ltd
Priority to CN202111437479.1A priority Critical patent/CN114120334A/en
Publication of CN114120334A publication Critical patent/CN114120334A/en
Pending legal-status Critical Current

Links

Images

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/017—Gesture based interaction, e.g. based on a set of recognized hand gestures
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0481—Interaction techniques based on graphical user interfaces [GUI] based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance
    • G06F3/0483—Interaction with page-structured environments, e.g. book metaphor
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0487—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser
    • G06F3/0488—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures
    • G06F3/04883—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures for inputting data by handwriting, e.g. gesture or text
    • G—PHYSICS
    • G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09B—EDUCATIONAL OR DEMONSTRATION APPLIANCES; APPLIANCES FOR TEACHING, OR COMMUNICATING WITH, THE BLIND, DEAF OR MUTE; MODELS; PLANETARIA; GLOBES; MAPS; DIAGRAMS
    • G09B21/00—Teaching, or communicating with, the blind, deaf or mute
    • G09B21/001—Teaching or communicating with blind persons
    • G09B21/007—Teaching or communicating with blind persons using both tactile and audible presentation of the information

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • General Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Human Computer Interaction (AREA)
  • Health & Medical Sciences (AREA)
  • Audiology, Speech & Language Pathology (AREA)
  • General Health & Medical Sciences (AREA)
  • Business, Economics & Management (AREA)
  • Educational Administration (AREA)
  • Educational Technology (AREA)
  • Machine Translation (AREA)

Abstract

The invention discloses a Braille processing method, a Braille processing device, a storage medium and an electronic device. The Braille processing method comprises the following steps: acquiring image information of the non-Braille text, wherein the image information corresponds to one page of content of the non-Braille text; extracting text content and symbols from the image information; according to the character content and symbol, it can be translated into phonetic alphabet and punctuation mark, and by splitting phonetic alphabet and punctuation mark, it can be translated into braille using square as unit. The method converts non-Braille text into Braille to assist the blind to read and improve the speed and efficiency of Braille processing. And then solved prior art, the technical problem that the efficiency is low is read to the braille.

Description

Braille processing method, device, storage medium and electronic device
Technical Field
The invention relates to the field related to Braille processing, in particular to a Braille processing method, a Braille processing device, a storage medium and an electronic device.
Background
Braille, also called braille and raised letters, is specially designed for blind people and is sensed by touch. The paper is formed by making different combinations of salient points on the paper through a dot plate, a dot printer and the like, and generally, each square dot is formed by six dots, the left side is 123 from top to bottom, the right side is 456, and the name is called one. As shown in the following figure, two words of "hello" each word is composed of 3 parts, and the 3 parts of one word respectively represent initial consonant, final consonant and tone.
The blind people mainly have two modes for knowing the content of the common text, one mode is that the common text is converted into braille through various means through braille to be touched and read; one is to convert the common text into voice through various means by voice and broadcast the voice.
The two main technologies of reading common texts by the blind, namely the voice broadcasting technology and the Braille point and display technology, have the problems of limited use occasions, incapability of fine reading, high conversion cost, long period, high requirement on professional skills and the like.
The problem of converting the common text into the voice broadcast is that the common text is not suitable for the voice broadcast in many occasions, for example, in public classrooms and examination places, the common text needs to be kept quiet; or in noisy environments, voice broadcasts are susceptible. On the other hand, the method is fine reading, content can be repeatedly understood and thought one by one in a Braille touch mode, and the effect that one voice broadcast is difficult to realize is repeatedly listened. The problem of converting the common text into the braille is that the conversion period is long, the cost is high and the requirement on professional skills is high.
In view of the above problems, no effective solution has been proposed.
Disclosure of Invention
The embodiment of the invention provides a method and a device for processing braille, a storage medium and an electronic device, which are used for at least solving the technical problem of low braille reading efficiency in the prior art.
According to an aspect of an embodiment of the present invention, there is provided a braille processing method including: acquiring image information of a non-Braille text, wherein the image information corresponds to one page of content of the non-Braille text; extracting text content and symbols from the image information; according to the said literal content and the said symbols, it translates into phonetic alphabet and punctuation marks, and through splitting phonetic alphabet and punctuation marks, translates into braille taking square as unit.
Optionally, after the translating into the pinyin and the punctuation marks according to the text content and the symbols, and the translating into the braille with the square as the unit by splitting the pinyin and the punctuation marks, the method further comprises the following steps: the braille with the square as the unit is rearranged according to the square number displayed in one line of the display screen to form the braille in one line; and storing the braille in one line and one line.
Optionally, the method further includes: acquiring touch operation of a user; and responding to the touch operation, and displaying the Braille text on the display screen.
Optionally, the displaying the braille text on the display screen in response to the touch operation includes: and displaying the selected braille texts in a plurality of rows under the condition that the braille texts in the plurality of rows on the display screen are selected by the touch operation.
Optionally, the extracting text content and symbols from the image information includes: performing a preprocessing operation on the image information to obtain processed image information, wherein the preprocessing operation includes one of the following operations: denoising, filtering and rotating; converting the processed image information into a text by an Optical Character Recognition (OCR) technology; and extracting the literal content and the symbols from the text.
Optionally, the acquiring image information of the non-braille text includes: and shooting the non-Braille text through a head-mounted camera or a camera placed at a fixed position to obtain the image information.
According to another aspect of the embodiments of the present invention, there is also provided a braille processing apparatus including: the device comprises a first acquisition unit, a second acquisition unit and a display unit, wherein the first acquisition unit is used for acquiring image information of non-Braille texts, and the image information corresponds to one page of content of the non-Braille texts; an extraction unit for extracting text content and symbols from the image information; and the translation unit is used for translating the character content and the symbols into pinyin and punctuation marks and translating the pinyin and the punctuation marks into braille taking the square as the unit by splitting the pinyin and the punctuation marks.
Optionally, the apparatus further comprises: the first display unit is used for translating the character content and the symbols into pinyin and punctuation marks, translating the pinyin and punctuation marks into square unit braille by splitting the pinyin and punctuation marks, and rearranging the square unit braille according to the number of squares displayed in one line on the display screen to form one line of braille; and the storage unit is used for storing the braille in one line.
Optionally, the apparatus further comprises: the second acquisition unit is used for acquiring touch operation of a user; and the second display unit is used for responding to the touch operation and displaying the Braille text on the display screen.
Optionally, the second display unit includes: and the display module is used for displaying the selected braille texts in a plurality of rows under the condition that the braille texts in a plurality of rows on the display screen are selected by the touch operation.
Optionally, the extracting unit includes: a preprocessing module, configured to perform a preprocessing operation on the image information to obtain processed image information, where the preprocessing operation includes one of: denoising, filtering and rotating; the conversion module is used for converting the processed image information into a text through an Optical Character Recognition (OCR) technology; and the extraction module is used for extracting the character content and the symbol from the text.
Optionally, the first obtaining unit includes: and the shooting module is used for shooting the non-Braille text through a head-wearing camera or a camera placed at a fixed position to obtain the image information.
According to another aspect of the embodiments of the present invention, there is also provided a braille processing system including: the device comprises a shooting device and a processing device, wherein the shooting device is used for shooting non-Braille texts and obtaining image information of the non-Braille texts, and the image information corresponds to one page of content of the non-Braille texts; the processor is used for receiving image information shot by the shooting equipment and extracting character contents and symbols from the image information; according to the said literal content and the said symbols, it translates into phonetic alphabet and punctuation marks, and through splitting phonetic alphabet and punctuation marks, translates into braille taking square as unit.
Optionally, the system further includes: and the Braille point display device is connected to the processor in a USB or serial port line communication mode and used for displaying Braille points.
According to a first aspect of embodiments of the present application, there is provided a computer-readable storage medium, characterized in that the storage medium has a computer program stored therein, wherein the computer program is configured to execute the above braille processing method when running.
According to a first aspect of embodiments of the present application, there is provided an electronic device comprising a memory and a processor, wherein the memory stores a computer program therein, and the processor is configured to execute the computer program to perform the above braille processing method.
In the embodiment of the invention, image information of the non-Braille text is acquired, wherein the image information corresponds to one page of content of the non-Braille text; extracting text content and symbols from the image information; according to the character content and symbol, it can be translated into phonetic alphabet and punctuation mark, and by splitting phonetic alphabet and punctuation mark, it can be translated into braille using square as unit. The method converts non-Braille text into Braille to assist the blind to read and improve the speed and efficiency of Braille processing. And then solved prior art, the technical problem that the efficiency is low is read to the braille.
Drawings
The accompanying drawings, which are included to provide a further understanding of the invention and are incorporated in and constitute a part of this application, illustrate embodiment(s) of the invention and together with the description serve to explain the invention without limiting the invention. In the drawings:
fig. 1 is a block diagram of a hardware configuration of a mobile terminal according to an alternative braille processing method of an embodiment of the present invention;
FIG. 2 is a flow chart of an alternative method of Braille processing in accordance with embodiments of the present invention;
FIG. 3 is a diagram illustrating image information of an alternative plain text, according to an embodiment of the present invention;
FIG. 4 is a diagram of an alternative plain text extraction text and punctuation according to an embodiment of the present invention;
FIG. 5 is a diagram illustrating an alternative common text pinyin, in accordance with an embodiment of the present invention;
FIG. 6 is an alternative schematic representation of Braille in accordance with embodiments of the present invention;
FIG. 7 is an alternative schematic representation of rearranged Braille in accordance with embodiments of the present invention;
FIG. 8 is a diagram of an alternative Braille processing apparatus according to an embodiment of the present invention.
Detailed Description
In order to make the technical solutions of the present invention better understood, the technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the drawings in the embodiments of the present invention, and it is obvious that the described embodiments are only a part of the embodiments of the present invention, and not all of the embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention.
It should be noted that the terms "first," "second," and the like in the description and claims of the present invention and in the drawings described above are used for distinguishing between similar elements and not necessarily for describing a particular sequential or chronological order. It is to be understood that the data so used is interchangeable under appropriate circumstances such that the embodiments of the invention described herein are capable of operation in sequences other than those illustrated or described herein. Furthermore, the terms "comprises," "comprising," and "having," and any variations thereof, are intended to cover a non-exclusive inclusion, such that a process, method, system, article, or apparatus that comprises a sequence of steps or elements is not necessarily limited to those steps or elements expressly listed, but may include other steps or elements not expressly listed or inherent to such process, method, article, or apparatus.
For a better understanding of the present application, some of the names are now described below:
TTS is an abbreviation of Text To Speech, i.e., "from Text To Speech," which is part of a human-machine conversation To enable a machine To speak.
OCR (Optical Character Recognition) refers to a process in which an electronic device (e.g., a scanner or a digital camera) checks a Character printed on paper, determines its shape by detecting dark and light patterns, and then translates the shape into a computer text by a Character Recognition method; the characters in the paper document are optically converted into image files with black and white dot matrixes for the print characters, and the characters in the images are converted into text formats through recognition software for further editing and processing by character processing software.
The embodiment of the Braille processing method provided by the embodiment of the application can be executed in a mobile terminal, a computer terminal or a similar arithmetic device. Taking the operation on a mobile terminal as an example, fig. 1 is a hardware structure block diagram of the mobile terminal of a braille processing method according to the embodiment of the present invention. As shown in fig. 1, the mobile terminal 10 may include one or more (only one shown in fig. 1) processors 102 (the processor 102 may include, but is not limited to, a processing device such as a microprocessor MCU or a programmable logic device FPGA) and a memory 104 for storing data, and optionally may also include a transmission device 106 for communication functions and an input-output device 108. It will be understood by those skilled in the art that the structure shown in fig. 1 is only an illustration, and does not limit the structure of the mobile terminal. For example, the mobile terminal 10 may also include more or fewer components than shown in FIG. 1, or have a different configuration than shown in FIG. 1.
The memory 104 can be used for storing computer programs, for example, software programs and modules of application software, such as computer programs corresponding to the braille processing method in the embodiment of the present invention, and the processor 102 executes various functional applications and data processing by running the computer programs stored in the memory 104, namely, the method described above is implemented. The memory 104 may include high speed random access memory, and may also include non-volatile memory, such as one or more magnetic storage devices, flash memory, or other non-volatile solid-state memory. In some instances, the memory 104 may further include memory located remotely from the processor 102, which may be connected to the mobile terminal 10 via a network. Examples of such networks include, but are not limited to, the internet, intranets, local area networks, mobile communication networks, and combinations thereof.
The transmission device 106 is used for receiving or transmitting data via a network. Specific examples of the network described above may include a wireless network provided by a communication provider of the mobile terminal 10. In one example, the transmission device 106 includes a Network adapter (NIC), which can be connected to other Network devices through a base station so as to communicate with the internet. In one example, the transmission device 106 may be a Radio Frequency (RF) module, which is used for communicating with the internet in a wireless manner.
In the present embodiment, a braille processing method is further provided, and fig. 2 is a flowchart of the braille processing method according to the embodiment of the present invention, and as shown in fig. 2, the flow of the braille processing method includes the following steps:
step S202, image information of the non-Braille text is obtained, wherein the image information corresponds to one page of content of the non-Braille text.
In step S204, the text and symbols are extracted from the image information.
Step S206, according to the character content and the symbol, translating into the pinyin and the punctuation, and by splitting the pinyin and the punctuation, translating into the braille taking the square as the unit.
In the present embodiment, the above-described braille processing method can improve the braille processing speed. The intelligent device can include, but is not limited to, a voice acquisition device, a gesture sensing sensor, such as an intelligent BIM display screen.
The executing body of the braille processing method can include, but is not limited to, intelligent devices, servers, terminal devices and the like.
In the present embodiment, the apparatus for performing the above-described braille processing method may include a photographing device, a processor, and a braille display.
The shooting device is used for shooting the content of a common text to form a picture, the shooting device is relatively flexible in form, can be a head-mounted camera, can be a fixed camera placed on a desktop and the like, and through simple learning and training, a blind user can conveniently determine the shooting position, angle and the like. The device is connected to the processor by means of communication means such as USB, serial lines, etc.
And the processor is used for receiving the image shot by the shooting equipment, performing OCR (optical character recognition), extracting the character content in the image, converting the character content into braille, rearranging the braille according to the displayable square number of one line of the point display device, and storing the rearranged braille.
The Braille point display device is connected to the processor through communication modes such as a USB (universal serial bus) and a serial port line, and is used for displaying one line of Braille points. And simultaneously, the extension points display the information of the total number of lines and the current number of lines. The integrated control keys comprise a picture taking, an upper line and a lower line. The Braille display is in charge of receiving one line of Braille sent by the processor on one hand; on the other hand, the key operations of the user for photographing and the previous line and the next line are received and sent to the processor for processing.
According to the embodiment provided by the application, the image information of the non-Braille text is obtained, wherein the image information corresponds to one page of content of the non-Braille text; extracting text content and symbols from the image information; according to the character content and symbol, it can be translated into phonetic alphabet and punctuation mark, and by splitting phonetic alphabet and punctuation mark, it can be translated into braille using square as unit. The method converts non-Braille text into Braille to assist the blind to read and improve the speed and efficiency of Braille processing. And then solved prior art, the technical problem that the efficiency is low is read to the braille.
Optionally, after translating into pinyin and punctuation marks according to the text content and the symbols, and translating into braille taking the square as the unit by splitting the pinyin and the punctuation marks, the method may further comprise: the braille with the square as the unit is rearranged according to the square number displayed in one line of the display screen to form the braille in one line; and storing the braille one line by one line.
Optionally, the method may further include: acquiring touch operation of a user; and responding to the touch operation, and displaying the braille text on the display screen.
Optionally, the displaying braille text on the display screen in response to the touch operation may include: and displaying the selected braille texts in a plurality of rows under the condition that the braille texts in the plurality of rows on the display screen are selected through touch operation.
Optionally, extracting text content and symbols from the image information may include: the image information is preprocessed to obtain processed image information, wherein the preprocessing operation comprises one of the following operations: denoising, filtering and rotating; converting the processed image information into a text by an Optical Character Recognition (OCR) technology; text content and symbols are extracted from the text.
Optionally, acquiring the image information of the non-braille text may include: the non-Braille text is shot by the head-wearing camera or the camera placed at a fixed position to obtain the image information.
As an alternative embodiment, the present application further provides a method of assisting the blind in reading plain text. The specific process is as follows.
Step 1, the Braille processing device is started, a blind user places a common text at a position which is used to shoot, shoots the common text through a shooting key on a control point display to obtain a text picture, and processes noise reduction, filtering, rotation and the like are carried out on the picture. As shown in fig. 3, a schematic diagram of image information of plain text (corresponding to non-braille text).
And 2, recognizing the text image by the OCR module, and extracting character contents and symbols in the text image. As shown in fig. 4, the general text extracts a schematic diagram of text and punctuation.
And 3, translating the text extracted by the OCR module into pinyin and punctuation marks by the common text-braille translation module. As shown in fig. 5, a diagram of common text pinyin.
And 4, further translating into braille taking the square as a unit by splitting pinyin and punctuation marks. As shown in fig. 6, a schematic representation of braille.
And 5, the storage module rearranges the braille on one side according to the number of the squares displayed in one line on the point display to form the braille in one line and one line, and stores the braille. As shown in fig. 7, the rearranged braille schematic diagram.
And 6, extracting one line from the storage by the processor, and sending the line to the Braille point display, wherein the Braille point display displays touchable Braille. And meanwhile, the number of lines, namely the current first line, is displayed in a braille manner, so that the touch of a user is facilitated.
And 7, the user touches the point display device, reads the braille and selects the text content through the keys in the upper row and the lower row.
According to the embodiment provided by the application, the common text is quickly converted and presented in the form of the Braille through the application and combination of technologies such as OCR (optical character recognition), common text-Braille translation and Braille point display. The method expands the occasions for reading the common texts, realizes that the blind persons independently, conveniently and finely read the common texts, shortens the conversion period of the texts, reduces the cost and also reduces the professional threshold for the blind persons to independently read the common texts.
As an alternative embodiment, the present application also provides a system for assisting the blind in reading plain text. The specific process is as follows.
In this embodiment, a system for assisting the blind in reading the plain text may include a camera module, an OCR module, a plain text-braille translation module, a storage module, a pointing and displaying module, and an operation module.
The camera module controls the camera to shoot a common text to form an image, and processes noise reduction, filtering, rotation and the like are performed on the image, so that the accuracy of text recognition is improved.
And the OCR module is used for converting the processed image into a text.
The common text-Braille translation module translates the text extracted by the OCR module into pinyin and punctuation marks, further translates the pinyin and the punctuation marks into Braille taking the square as the unit by splitting the pinyin and the punctuation marks, and stores the Braille in a memory.
And the storage module rearranges the braille on one side according to the number of the squares displayed in one line on the point display to form the braille in one line, and stores the braille in one line after rearrangement.
And the point display module is arranged in the Braille point display and is used for controlling the Braille point display to display Braille.
The control module receives the photographing operation triggered by the Braille point display device and performs corresponding photographing processing; and receiving the operation of the previous line and the next line of the Braille point display, calling corresponding Braille from the storage module, and sending the Braille to the point display for displaying.
According to the embodiment provided by the application, the common text is quickly converted and presented in the form of the Braille through the application and combination of technologies such as OCR (optical character recognition), common text-Braille translation and Braille point display. The method expands the occasions for reading the common texts, realizes that the blind persons independently, conveniently and finely read the common texts, shortens the conversion period of the texts, reduces the cost and also reduces the professional threshold for the blind persons to independently read the common texts.
Through the above description of the embodiments, those skilled in the art can clearly understand that the method according to the above embodiments can be implemented by software plus a necessary general hardware platform, and certainly can also be implemented by hardware, but the former is a better implementation mode in many cases. Based on such understanding, the technical solutions of the present invention may be embodied in the form of a software product, which is stored in a storage medium (e.g., ROM/RAM, magnetic disk, optical disk) and includes instructions for enabling a terminal device (e.g., a mobile phone, a computer, a server, or a network device) to execute the method according to the embodiments of the present invention.
In this embodiment, a braille processing device is further provided, and the braille processing device is used for implementing the above embodiments and preferred embodiments, and the description of the braille processing device is omitted. As used below, the term "module" may be a combination of software and/or hardware that implements a predetermined function. Although the means described in the embodiments below are preferably implemented in software, an implementation in hardware, or a combination of software and hardware is also possible and contemplated.
Fig. 8 is a structural block diagram of a braille processing apparatus according to the embodiment of the present invention, which includes, as shown in fig. 8:
the first acquiring unit 81 is used for acquiring image information of the non-braille text, wherein the image information corresponds to one page of content of the non-braille text.
An extracting unit 83 for extracting the text content and the symbol from the image information.
And the translation unit 85 is used for translating the characters into pinyin and punctuation marks according to the character contents and the symbols, and translating the pinyin and the punctuation marks into braille taking the square as the unit by splitting the pinyin and the punctuation marks.
By the embodiment provided by the application, the first obtaining unit 81 obtains the image information of the non-braille text, wherein the image information corresponds to one page of content of the non-braille text; the extracting unit 83 extracts the text contents and symbols from the image information; the translating unit 85 translates the character content and the symbol into the pinyin and the punctuation, and translates the pinyin and the punctuation into the braille in square as a unit by splitting the pinyin and the punctuation. The method converts non-Braille text into Braille to assist the blind to read and improve the speed and efficiency of Braille processing. And then solved prior art, the technical problem that the efficiency is low is read to the braille.
Optionally, the apparatus may further include: the first display unit is used for translating the braille into pinyin and punctuation marks according to the text content and the symbols, translating the pinyin and the punctuation marks into the braille taking the square as the unit, and rearranging the braille taking the square as the unit according to the number of squares displayed in one line on the display screen to form the braille in one line; and the storage unit is used for storing the braille one line by one line.
Optionally, the apparatus may further include: the second acquisition unit is used for acquiring touch operation of a user; and the second display unit is used for responding to the touch operation and displaying the Braille text on the display screen.
Optionally, the second display unit may include: and the display module is used for displaying the selected braille texts in a plurality of rows under the condition that the braille texts in a plurality of rows on the display screen are selected through touch operation.
Optionally, the extracting unit 83 may include: the image processing device comprises a preprocessing module and a processing module, wherein the preprocessing module is used for preprocessing image information to obtain processed image information, and the preprocessing operation comprises one of the following operations: denoising, filtering and rotating; the conversion module is used for converting the processed image information into a text through an Optical Character Recognition (OCR) technology; and the extraction module is used for extracting the character content and the symbol from the text.
Optionally, the first obtaining unit 81 may include: and the shooting module is used for shooting the non-Braille text through a head-wearing camera or a camera placed at a fixed position to obtain image information.
According to another aspect of the embodiment of the invention, a braille processing system is further provided, which specifically comprises the following contents.
The shooting equipment is used for shooting the non-Braille text and acquiring the image information of the non-Braille text, wherein the image information corresponds to one page of content of the non-Braille text; the processor is used for receiving image information shot by the shooting equipment and extracting character contents and symbols from the image information; according to the character content and symbol, it can be translated into phonetic alphabet and punctuation mark, and by splitting phonetic alphabet and punctuation mark, it can be translated into braille using square as unit.
According to the embodiment disclosed by the application, the shooting equipment is used for shooting the non-Braille text and obtaining the image information of the non-Braille text, wherein the image information corresponds to one page of content of the non-Braille text; the processor is used for receiving image information shot by the shooting equipment and extracting character contents and symbols from the image information; according to the character content and symbol, it can be translated into phonetic alphabet and punctuation mark, and by splitting phonetic alphabet and punctuation mark, it can be translated into braille using square as unit. The method converts non-Braille text into Braille to assist the blind to read and improve the speed and efficiency of Braille processing. And then solved prior art, the technical problem that the efficiency is low is read to the braille.
Optionally, the system may further include: and the Braille point display device is connected to the processor through a USB or serial port line communication mode to display the Braille points.
It should be noted that, the above modules may be implemented by software or hardware, and for the latter, the following may be implemented, but not limited to: the modules are all positioned in the same processor; alternatively, the modules are respectively located in different processors in any combination.
Embodiments of the present invention also provide a storage medium having a computer program stored therein, wherein the computer program is arranged to perform the steps of any of the above method embodiments when executed.
Alternatively, in the present embodiment, the storage medium may be configured to store a computer program for executing the steps of:
s1, acquiring image information of the non-Braille text, wherein the image information corresponds to one page of content of the non-Braille text;
s2, extracting text content and symbols from the image information;
s3, according to the character content and symbol, it translates into spelling and punctuation, and translates into braille with square as unit by splitting the spelling and punctuation.
Optionally, in this embodiment, the storage medium may include, but is not limited to: a U-disk, a Read-only Memory (ROM), a Random Access Memory (RAM), a removable hard disk, a magnetic disk, or an optical disk, which can store computer programs.
Embodiments of the present invention also provide an electronic device comprising a memory having a computer program stored therein and a processor arranged to run the computer program to perform the steps of any of the above method embodiments.
Optionally, the electronic apparatus may further include a transmission device and an input/output device, wherein the transmission device is connected to the processor, and the input/output device is connected to the processor.
Optionally, in this embodiment, the processor may be configured to execute the following steps by a computer program:
s1, acquiring image information of the non-Braille text, wherein the image information corresponds to one page of content of the non-Braille text;
s2, extracting text content and symbols from the image information;
s3, according to the character content and symbol, it translates into spelling and punctuation, and translates into braille with square as unit by splitting the spelling and punctuation.
Optionally, the specific examples in this embodiment may refer to the examples described in the above embodiments and optional implementation manners, and this embodiment is not described herein again.
It will be apparent to those skilled in the art that the modules or steps of the present invention described above may be implemented by a general purpose computing device, they may be centralized on a single computing device or distributed across a network of multiple computing devices, and alternatively, they may be implemented by program code executable by a computing device, such that they may be stored in a storage device and executed by a computing device, and in some cases, the steps shown or described may be performed in an order different than that described herein, or they may be separately fabricated into individual integrated circuit modules, or multiple ones of them may be fabricated into a single integrated circuit module. Thus, the present invention is not limited to any specific combination of hardware and software.
The above is only a preferred embodiment of the present invention, and is not intended to limit the present invention, and various modifications and changes will occur to those skilled in the art. Any modification, equivalent replacement, or improvement made within the principle of the present invention should be included in the protection scope of the present invention.

Claims (16)

1. A braille processing method is characterized by comprising:
acquiring image information of a non-Braille text, wherein the image information corresponds to one page of content of the non-Braille text;
extracting text content and symbols from the image information;
according to the said literal content and the said symbols, it translates into phonetic alphabet and punctuation marks, and through splitting phonetic alphabet and punctuation marks, translates into braille taking square as unit.
2. The method of claim 1, wherein after translating to pinyin and punctuation based on the textual content and the symbols, translating to braille in units of squares by splitting pinyin and punctuation, the method further comprises:
the braille with the square as the unit is rearranged according to the square number displayed in one line of the display screen to form the braille in one line;
and storing the braille in one line and one line.
3. The method according to claim 1 or 2, characterized in that the method further comprises:
acquiring touch operation of a user;
and responding to the touch operation, and displaying the Braille text on the display screen.
4. The method according to claim 3, wherein the displaying the Braille text on the display screen in response to the touch operation comprises:
and displaying the selected braille texts in a plurality of rows under the condition that the braille texts in the plurality of rows on the display screen are selected by the touch operation.
5. The method of claim 3, wherein said extracting text and symbols from said image information comprises:
performing a preprocessing operation on the image information to obtain processed image information, wherein the preprocessing operation includes one of the following operations: denoising, filtering and rotating;
converting the processed image information into a text by an Optical Character Recognition (OCR) technology;
and extracting the literal content and the symbols from the text.
6. The method of claim 1, wherein said obtaining image information of non-braille text comprises:
and shooting the non-Braille text through a head-mounted camera or a camera placed at a fixed position to obtain the image information.
7. A braille processing apparatus, characterized by comprising:
the device comprises a first acquisition unit, a second acquisition unit and a display unit, wherein the first acquisition unit is used for acquiring image information of non-Braille texts, and the image information corresponds to one page of content of the non-Braille texts;
an extraction unit for extracting text content and symbols from the image information;
and the translation unit is used for translating the character content and the symbols into pinyin and punctuation marks and translating the pinyin and the punctuation marks into braille taking the square as the unit by splitting the pinyin and the punctuation marks.
8. The apparatus of claim 7, further comprising:
the first display unit is used for translating the character content and the symbols into pinyin and punctuation marks, translating the pinyin and punctuation marks into square unit braille by splitting the pinyin and punctuation marks, and rearranging the square unit braille according to the number of squares displayed in one line on the display screen to form one line of braille;
and the storage unit is used for storing the braille in one line.
9. The apparatus of claim 7 or 8, further comprising:
the second acquisition unit is used for acquiring touch operation of a user;
and the second display unit is used for responding to the touch operation and displaying the Braille text on the display screen.
10. The apparatus of claim 9, wherein the second display unit comprises:
and the display module is used for displaying the selected braille texts in a plurality of rows under the condition that the braille texts in a plurality of rows on the display screen are selected by the touch operation.
11. The apparatus of claim 9, wherein the extraction unit comprises:
a preprocessing module, configured to perform a preprocessing operation on the image information to obtain processed image information, where the preprocessing operation includes one of: denoising, filtering and rotating;
the conversion module is used for converting the processed image information into a text through an Optical Character Recognition (OCR) technology;
and the extraction module is used for extracting the character content and the symbol from the text.
12. The apparatus of claim 7, wherein the first obtaining unit comprises:
and the shooting module is used for shooting the non-Braille text through a head-wearing camera or a camera placed at a fixed position to obtain the image information.
13. A Braille processing system, comprising:
the device comprises a shooting device and a processing device, wherein the shooting device is used for shooting non-Braille texts and obtaining image information of the non-Braille texts, and the image information corresponds to one page of content of the non-Braille texts;
the processor is used for receiving image information shot by the shooting equipment and extracting character contents and symbols from the image information; according to the said literal content and the said symbols, it translates into phonetic alphabet and punctuation marks, and through splitting phonetic alphabet and punctuation marks, translates into braille taking square as unit.
14. The system of claim 13, further comprising:
and the Braille point display device is connected to the processor in a USB or serial port line communication mode and used for displaying Braille points.
15. A computer-readable storage medium, in which a computer program is stored, wherein the computer program is configured to carry out the method of any one of claims 1 to 6 when executed.
16. An electronic device comprising a memory and a processor, wherein the memory has stored therein a computer program, and wherein the processor is arranged to execute the computer program to perform the method of any of claims 1 to 6.
CN202111437479.1A 2021-11-29 2021-11-29 Braille processing method, device, storage medium and electronic device Pending CN114120334A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202111437479.1A CN114120334A (en) 2021-11-29 2021-11-29 Braille processing method, device, storage medium and electronic device

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202111437479.1A CN114120334A (en) 2021-11-29 2021-11-29 Braille processing method, device, storage medium and electronic device

Publications (1)

Publication Number Publication Date
CN114120334A true CN114120334A (en) 2022-03-01

Family

ID=80367708

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202111437479.1A Pending CN114120334A (en) 2021-11-29 2021-11-29 Braille processing method, device, storage medium and electronic device

Country Status (1)

Country Link
CN (1) CN114120334A (en)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN114913745A (en) * 2022-05-26 2022-08-16 深圳大学 Braille reader, Braille coding method and system

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN114913745A (en) * 2022-05-26 2022-08-16 深圳大学 Braille reader, Braille coding method and system

Similar Documents

Publication Publication Date Title
US10963760B2 (en) Method and apparatus for processing information
EP2383970A1 (en) Camera based method for text input and keyword detection
CN110060524A (en) Robot-assisted reading method and reading robot
KR20130058053A (en) Method and apparatus for segmenting strokes of overlapped handwriting into one or more groups
JPH09507936A (en) How to combine handwriting input
EP3916634A3 (en) Text recognition method and device, and electronic device
CN103854019A (en) Method and device for extracting fields in image
JP2020170309A (en) Image processing system, image processing device, image processing method, and program
CN114120334A (en) Braille processing method, device, storage medium and electronic device
CN101751512A (en) Recipe management system applied to communication device and method
CN114327233A (en) Haptic interaction system, method and storage medium
KR101513856B1 (en) Braille-to-Voice Translation System
CN114120769A (en) Braille reading method, device, storage medium and electronic device
KR101865251B1 (en) Intelligent braille translation device
CN110674825A (en) Character recognition method, device and system applied to intelligent voice mouse and storage medium
CN111553365B (en) Question selection method and device, electronic equipment and storage medium
CN111582281B (en) Picture display optimization method and device, electronic equipment and storage medium
US11442981B2 (en) Information providing device, information providing method, and recording medium with combined images corresponding to selected genre
De Luna A Tesseract-based optical character recognition for a text-to-braille code conversion
CN111898387B (en) Translation method and device, storage medium and computer equipment
CN114115542A (en) Braille processing method, device, storage medium and electronic device
Chellaswamy et al. Deep Learning-Based Braille Technology for Visual and Hearing Impaired People
KR20070095028A (en) The voice service for mobile comic contents
Gopinath et al. Development of Speech and Text to Braille Script Converter for Blind and Deaf People
CN114022886B (en) Handwriting recognition training set generation method, system and medium for tablet

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination