CN111079503B - Character recognition method and electronic equipment - Google Patents
Character recognition method and electronic equipment Download PDFInfo
- Publication number
- CN111079503B CN111079503B CN201910716356.8A CN201910716356A CN111079503B CN 111079503 B CN111079503 B CN 111079503B CN 201910716356 A CN201910716356 A CN 201910716356A CN 111079503 B CN111079503 B CN 111079503B
- Authority
- CN
- China
- Prior art keywords
- result
- character recognition
- recognition result
- splitting
- module
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V30/00—Character recognition; Recognising digital ink; Document-oriented image-based pattern recognition
- G06V30/10—Character recognition
- G06V30/32—Digital ink
- G06V30/36—Matching; Classification
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F18/00—Pattern recognition
- G06F18/20—Analysing
- G06F18/22—Matching criteria, e.g. proximity measures
-
- G—PHYSICS
- G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
- G09B—EDUCATIONAL OR DEMONSTRATION APPLIANCES; APPLIANCES FOR TEACHING, OR COMMUNICATING WITH, THE BLIND, DEAF OR MUTE; MODELS; PLANETARIA; GLOBES; MAPS; DIAGRAMS
- G09B5/00—Electrically-operated educational appliances
- G09B5/02—Electrically-operated educational appliances with visual presentation of the material to be studied, e.g. using film strip
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Computer Vision & Pattern Recognition (AREA)
- Data Mining & Analysis (AREA)
- Educational Technology (AREA)
- Educational Administration (AREA)
- Business, Economics & Management (AREA)
- Multimedia (AREA)
- Life Sciences & Earth Sciences (AREA)
- Artificial Intelligence (AREA)
- Bioinformatics & Cheminformatics (AREA)
- Bioinformatics & Computational Biology (AREA)
- Evolutionary Biology (AREA)
- Evolutionary Computation (AREA)
- General Engineering & Computer Science (AREA)
- Character Discrimination (AREA)
- User Interface Of Digital Computer (AREA)
Abstract
The embodiment of the invention discloses a character recognition method and electronic equipment, which are applied to the technical field of education and can solve the problem of inaccuracy of recognized characters. The method comprises the following steps: collecting a first image comprising a written page; recognizing writing handwriting from the first image, and performing text association recognition on the writing handwriting by utilizing an OCR mode to recognize target text; splitting the target text according to the component structure to obtain a first splitting result; identifying the first splitting result to obtain a first character identification result; splitting the writing trace according to the component structure to obtain a second splitting result; identifying the second splitting result to obtain a second character identification result; and outputting the written characters corresponding to the written handwriting according to the first character recognition result and the second character recognition result.
Description
Technical Field
The embodiment of the invention relates to the technical field of education, in particular to a character recognition method and electronic equipment.
Background
Currently, electronic devices typically employ optical character recognition (Optical Character Recognition, hereinafter OCR) technology to recognize text in printed or handwritten documents. In the process of recognizing characters, the characters are automatically associated and corrected in order to improve the recognition rate, so that wrongly written characters are corrected, and the recognized characters are inaccurate.
Disclosure of Invention
The embodiment of the invention provides a character recognition method and electronic equipment, which are used for solving the problem of inaccurate characters recognized in the prior art.
In order to solve the technical problems, the embodiment of the invention is realized as follows:
in a first aspect, a text recognition method is provided, the method comprising:
collecting a first image comprising a written page;
recognizing writing handwriting from the first image, and performing text association recognition on the writing handwriting in an OCR mode to recognize target text;
splitting the target text according to the component structure to obtain a first splitting result;
identifying the first splitting result to obtain a first character identification result;
splitting the writing trace according to the component structure to obtain a second splitting result;
identifying the second splitting result to obtain a second character identification result;
and outputting the writing characters corresponding to the writing handwriting according to the first character recognition result and the second character recognition result.
In a first aspect of the embodiment of the present invention, after the first text recognition result is obtained and the second text recognition result is obtained, the method further includes:
Comparing the first character recognition result with the second character recognition result, and outputting comparison information of the first character recognition result and the second character recognition result;
the comparison information comprises the first character recognition result, the second character recognition result and difference content of the first character recognition result and the second character recognition result.
As an optional implementation manner, in the first aspect of the embodiment of the present invention, after the outputting the written text corresponding to the writing trace, the method further includes:
acquiring dictation content broadcasted in a learning environment where the electronic equipment is located;
correcting the written characters according to the dictation content to obtain correction results;
and the electronic equipment displays the correction result. As an optional implementation manner, in the first aspect of the embodiment of the present invention, after the electronic device displays the modification result, the method further includes:
if the correction result shows that the wrongly written characters exist in the written characters, the electronic equipment determines a target area where the wrongly written characters are located from the written page;
The electronic device projects a prompt cursor to the target area.
As an alternative implementation, in the first aspect of the embodiment of the present invention,
after the electronic device displays the correction result, the method further includes:
if the correction result shows that the wrongly written characters exist in the written characters, acquiring exercise content associated with the wrongly written characters;
displaying the exercise content;
receiving user input for the exercise content, displaying exercise results of the user for the exercise content in response to the input, and displaying a score for the exercise results.
In a second aspect, there is provided an electronic device comprising:
the acquisition module is used for acquiring a first image comprising a writing page;
the recognition module is used for recognizing writing handwriting from the first image and carrying out word association recognition on the writing handwriting in an OCR mode so as to recognize target words;
the splitting module is used for splitting the target text according to the component structure so as to obtain a first splitting result;
the recognition module is further used for recognizing the first splitting result to obtain a first character recognition result;
The splitting module is further used for splitting the writing trace according to the component structure so as to obtain a second splitting result;
the recognition module is further used for recognizing the second splitting result to obtain a second character recognition result;
and the output module is used for outputting the writing characters corresponding to the writing handwriting according to the first character recognition result and the second character recognition result.
As an optional implementation manner, in the second aspect of the embodiment of the present invention, the electronic device further includes:
the comparison module is used for comparing the first character recognition result with the second character recognition result after the recognition module obtains the first character recognition result and the second character recognition result;
the output module is further used for outputting comparison information of the first character recognition result and the second character recognition result;
the comparison information comprises the first character recognition result, the second character recognition result and difference content of the first character recognition result and the second character recognition result. As an alternative implementation, in the second aspect of the embodiment of the present invention,
The electronic device further includes:
the acquisition module is used for acquiring the dictation content broadcasted in the learning environment where the electronic equipment is located after the output module outputs the writing text corresponding to the writing handwriting;
the correcting module is used for correcting the written characters according to the dictation content to obtain correcting results;
and the display module is used for displaying the correction result.
As an alternative implementation, in the second aspect of the embodiment of the present invention,
the electronic device further includes:
the determining module is used for determining a target area where the wrongly written characters are located from the writing page if the wrongly written characters exist in the writing characters after the display module displays the correction result;
and the projection module is used for projecting a prompt cursor to the target area.
As an alternative implementation, in the second aspect of the embodiment of the present invention,
the acquisition module is further used for acquiring exercise content associated with the wrongly written characters if the correction result indicates that the wrongly written characters exist in the written characters;
the display module is also used for displaying the exercise content;
the electronic device further includes: a receiving module for receiving user input for the exercise content;
The display module is further configured to display an exercise result of the user for the exercise content in response to the input, and display a score for the exercise result.
In a third aspect, there is provided an electronic device comprising:
a memory storing executable program code;
a processor coupled to the memory;
the processor invokes the executable program code stored in the memory to perform the method for recognizing a chinese character according to the first aspect of the embodiment of the present invention.
In a fourth aspect, a computer-readable storage medium is provided, which stores a computer program that causes a computer to execute the text recognition method in the first aspect of the embodiment of the present invention. The computer readable storage medium includes ROM/RAM, magnetic disk or optical disk, etc.
In a fifth aspect, there is provided a computer program product for causing a computer to carry out some or all of the steps of any one of the methods of the first aspect when the computer program product is run on the computer.
In a sixth aspect, an application publishing platform is provided for publishing a computer program product, wherein the computer program product, when run on a computer, causes the computer to perform part or all of the steps of any one of the methods of the first aspect.
Compared with the prior art, the embodiment of the invention has the following beneficial effects:
in the embodiment of the invention, the electronic equipment can acquire the first image comprising the written page; recognizing writing handwriting from the first image, and performing text association recognition on the writing handwriting by utilizing an OCR mode to recognize target text; splitting the target text according to the component structure to obtain a first splitting result; identifying the first splitting result to obtain a first character identification result; splitting the writing trace according to the component structure to obtain a second splitting result; identifying the second splitting result to obtain a second character identification result; and outputting the written characters corresponding to the written handwriting according to the first character recognition result and the second character recognition result. According to the scheme, the electronic equipment can output the written characters corresponding to the written handwriting according to the character recognition results recognized by two different recognition modes (one is recognition firstly, splitting and recognition secondly, the other is recognition firstly, splitting and recognition secondly), so that compared with the mode that the characters are automatically associated and corrected for improving the recognition rate in the process of recognizing the characters, the accuracy of the recognized characters can be improved in the mode that misprinted characters are corrected.
Drawings
In order to more clearly illustrate the technical solutions of the embodiments of the present invention, the drawings that are needed in the embodiments will be briefly described below, and it is obvious that the drawings in the following description are only some embodiments of the present invention, and other drawings may be obtained according to these drawings without inventive effort for a person skilled in the art.
FIG. 1 is a schematic flow chart of a text recognition method according to an embodiment of the present invention;
FIG. 2 is a second flow chart of a text recognition method according to an embodiment of the present invention;
FIG. 3 is a flowchart of a text recognition method according to an embodiment of the present invention;
FIG. 4 is a flowchart of a text recognition method according to an embodiment of the present invention;
fig. 5 is a schematic structural diagram of an electronic device according to an embodiment of the present invention;
fig. 6 is a schematic structural diagram of a second electronic device according to an embodiment of the present invention;
fig. 7 is a schematic structural diagram III of an electronic device according to an embodiment of the present invention;
fig. 8 is a schematic structural diagram of an electronic device according to an embodiment of the present invention;
fig. 9 is a schematic diagram of an electronic device according to an embodiment of the present invention.
Detailed Description
The following description of the embodiments of the present invention will be made clearly and fully with reference to the accompanying drawings, in which it is evident that the embodiments described are some, but not all embodiments of the invention. All other embodiments, which can be made by those skilled in the art based on the embodiments of the invention without making any inventive effort, are intended to be within the scope of the invention.
The terms first and second and the like in the description and in the claims, are used for distinguishing between different objects and not necessarily for describing a particular sequential or chronological order of the objects. For example, the first word recognition result and the second word recognition result, etc., are used to distinguish between different word recognition results, and are not used to describe a particular order of word recognition results.
The terms "comprises," "comprising," and "having," and any variations thereof, are intended to cover a non-exclusive inclusion, such that a process, method, system, article, or apparatus that comprises a list of steps or elements is not necessarily limited to those steps or elements expressly listed or inherent to such process, method, article, or apparatus.
It should be noted that, in the embodiments of the present invention, words such as "exemplary" or "such as" are used to mean serving as an example, instance, or illustration. Any embodiment or design described herein as "exemplary" or "e.g." in an embodiment should not be taken as preferred or advantageous over other embodiments or designs. Rather, the use of words such as "exemplary" or "such as" is intended to present related concepts in a concrete fashion.
The embodiment of the invention provides a character recognition method and electronic equipment, which can improve the accuracy of recognized characters.
The electronic device related to the embodiment of the invention can be a mobile phone, a tablet computer, a point-to-read machine, a home teaching machine, a notebook computer, a palm computer, a vehicle-mounted electronic device, a wearable device, an Ultra-Mobile Personal Computer (UMPC), a netbook or a personal digital assistant (Personal Digital Assistant, PDA) and the like. The wearable device may be an intelligent watch, an intelligent bracelet, a watch phone, an intelligent foot ring, an intelligent earring, an intelligent necklace, an intelligent earphone, etc., and the embodiment of the invention is not limited.
The execution main body of the text recognition method provided by the embodiment of the invention can be the electronic equipment, or can be a functional module and/or a functional entity which can realize the text recognition method in the electronic equipment, and the execution main body can be specifically determined according to actual use requirements. The text recognition method provided by the embodiment of the invention is exemplified by an electronic device.
The character recognition method provided by the embodiment of the invention can be applied to recognizing characters in a printed document or scenes of characters in a handwritten document.
Example 1
As shown in fig. 1, an embodiment of the present invention provides a text recognition method, which may include the following steps:
101. the electronic device captures a first image including a written page.
Alternatively, the electronic device may acquire the written page using a camera to obtain the first image including the written page.
In one embodiment, the electronic device may acquire the first image including the written page through a photographing module of the electronic device itself or an external photographing module.
For example, the electronic device may control its own photographing module to photograph a mirror image in a mirror mounted on the electronic device, where the mirror image is an image of the writing page in the mirror, so as to collect the first image including the writing page.
For another example, the electronic device may control a camera module on a smart watch worn by the user to capture a first image including a written page. Optionally, before the shooting module on the intelligent watch worn by the electronic device control user collects the first image including writing the page, the electronic device can control the shooting module on the intelligent watch worn by the user to rotate first so as to adjust the shooting direction of the shooting module on the intelligent watch worn by the dictation user to cover the writing page, and then the electronic device controls the shooting module on the intelligent watch worn by the user to shoot the first image of writing the page.
In one embodiment, the manner in which the electronic device controls the camera module on the smart watch worn by the user to rotate may include:
the electronic device can send (such as Bluetooth send) a shooting module rotation instruction to the intelligent watch worn by the user, wherein the instruction comprises identity information of the electronic device;
correspondingly, after receiving the instruction, the intelligent watch worn by the user can check whether the instruction comprises the identity information of the electronic device and the identity information of legal equipment preset by the intelligent watch and allowing the shooting module of the intelligent watch to be controlled to rotate, if so, the intelligent watch can control the shooting module of the intelligent watch to rotate, and in the process of rotating the shooting module of the intelligent watch, if the intelligent watch detects that the shooting direction of the shooting module of the intelligent watch covers a writing page, the intelligent watch can control the shooting module of the intelligent watch to pause rotating and send a notification message to the electronic device, wherein the notification message is used for indicating that the shooting direction of the shooting module of the intelligent watch worn by a user is regulated to cover the writing page; further, the electronic device may send a photographing control instruction to the smart watch, and after the smart watch receives the photographing control instruction, the photographing module on the smart watch may be controlled to collect a first image including a writing page and send the first image to the electronic device.
102. The electronic device recognizes the writing handwriting from the first image, and performs text associative recognition on the writing handwriting in an OCR mode to recognize the target text.
The character association recognition is carried out on the writing handwriting by utilizing an OCR mode, the character recognition training can be carried out through a deep learning algorithm, and the wrongly written character scene is optimized, so that when wrongly written characters are recognized, the wrongly written characters can be corrected, and corrected target characters are output.
103. The electronic equipment splits the target text according to the component structure to obtain a first splitting result.
For example, the "about" word is a top-bottom structure, and the "about" word can be split into "western" and "female".
104. And the electronic equipment identifies the first splitting result to obtain a first character identification result.
For example, after the "western" word and the "woman" word are recognized, the "to" word may be recognized based on the context.
105. The electronic equipment splits the handwriting according to the component structure to obtain a second splitting result.
106. And the electronic equipment identifies the second splitting result to obtain a second character identification result.
In the embodiment of the present invention, the above 105 and 106 are text recognition results obtained by splitting and then recognizing. The specific splitting and identifying manners are the same as those in 103 and 104, but the order is different, and will not be repeated here.
It should be noted that, the embodiment of the present invention is not limited to the execution sequence of 102 to 104 and 105 to 106, i.e., the embodiment of the present invention may execute 102 to 104 first and then 105 to 106 later; it is also possible to perform 105 to 106 first and then 102 to 104 above; 102 to 104 and 105 to 106 may also be performed simultaneously.
107. And the electronic equipment outputs the written characters corresponding to the written handwriting according to the first character recognition result and the second character recognition result.
In the embodiment of the invention, the judgment is comprehensively carried out according to the first character recognition result and the second character recognition result, and the written characters corresponding to the written handwriting are output.
For example, assuming that the first text recognition result is "you" and the second text recognition result is "small", it may be determined that the right half of the text written by the user is "small" and the left half is one of single person and female person. Specifically, since the first character recognition result is that the character association recognition is performed on the writing handwriting according to the OCR mode, and then the recognized character is split, the character may be corrected for the original writing handwriting and is not the original font, so that the character side of the female character in the second character recognition result can be considered to be closer to the actual writing handwriting and more accurate, and at the moment, the writing character corresponding to the writing handwriting is determined to be "the character".
Alternatively, for some cases where it is not necessary to obtain writing closer to the actual writing, but it is desired to obtain corrected writing, it may be determined that "you" are writing in the above example.
The written text can be a first text recognition result or a second text recognition result, and the written text can also be a third text recognition result obtained according to the first text recognition result and the second text recognition result, wherein the third text recognition result is different from the first text recognition result and the second text recognition result.
As an alternative implementation manner, the above 107 may be specifically implemented by the following steps:
107a, the electronic device displays the first text recognition result and the second text recognition result.
107b, the electronic device receives a selection input of a target character recognition result from a user.
107c, the electronic device responds to the selection input, and the target character recognition result is displayed in a first interface of the electronic device as writing characters corresponding to writing handwriting.
The first control is used for indicating a third character recognition result, and the third character recognition result is a character recognition result except the target character recognition result in the first character recognition result and the second character recognition result.
Through the optional implementation manner, the electronic device can display two character recognition results, and the user can select one of the character recognition results as the writing character corresponding to the writing handwriting to be displayed in the first interface of the electronic device through selection input, so that the user can determine the displayed character recognition result, and the man-machine interaction performance of the electronic device is improved.
Further, the electronic device may further hover display the first control on the first interface, and the method may further include the following steps:
107d, the electronic device receives a touch input of the user to the first control.
107e, the electronic device responds to the touch input and updates the target character recognition result displayed in the first interface to the third character recognition result.
Through the above optional implementation manner, the electronic device may further display the first control for indicating the third text recognition result in suspension on the first interface, and the user may trigger the electronic device to update the target text recognition result to the third text recognition result through the touch input to the first control, so that the user may change the displayed text recognition result after determining the displayed text recognition result, so that the man-machine interaction performance of the electronic device is more flexible.
The embodiment of the invention provides a character recognition method, which comprises the steps that an electronic device can acquire a first image comprising a written page; recognizing writing handwriting from the first image, and performing text association recognition on the writing handwriting by utilizing an OCR mode to recognize target text; splitting the target text according to the component structure to obtain a first splitting result; identifying the first splitting result to obtain a first character identification result; splitting the writing trace according to the component structure to obtain a second splitting result; identifying the second splitting result to obtain a second character identification result; and outputting the written characters corresponding to the written handwriting according to the first character recognition result and the second character recognition result. According to the scheme, the electronic equipment can output the written characters corresponding to the written handwriting according to the character recognition results recognized by two different recognition modes (one is recognition firstly, splitting and recognition secondly, the other is recognition firstly, splitting and recognition secondly), so that compared with the mode that the characters are automatically associated and corrected for improving the recognition rate in the process of recognizing the characters, the accuracy of the recognized characters can be improved in the mode that misprinted characters are corrected.
Example two
As shown in fig. 2, the text recognition method provided by the embodiment of the present invention may further include the following steps:
201. the electronic device captures a first image including a written page.
202. The electronic device recognizes the writing handwriting from the first image, and performs text associative recognition on the writing handwriting in an OCR mode to recognize the target text.
203. The electronic equipment splits the target text according to the component structure to obtain a first splitting result.
204. And the electronic equipment identifies the first splitting result to obtain a first character identification result.
205. The electronic equipment splits the handwriting according to the component structure to obtain a second splitting result.
206. And the electronic equipment identifies the second splitting result to obtain a second character identification result.
207. And the electronic equipment outputs the written characters corresponding to the written handwriting according to the first character recognition result and the second character recognition result.
In the embodiment of the present invention, for the descriptions of 201 to 207, reference may be made to the descriptions of 101 to 107 in the first embodiment, and the descriptions are not repeated here.
208. The electronic equipment compares the first character recognition result with the second character recognition result and outputs comparison information of the first character recognition result and the second character recognition result.
The comparison information comprises a first character recognition result, a second character recognition result and difference content of the first character recognition result and the second character recognition result.
Example III
As shown in fig. 3, the text recognition method provided by the embodiment of the present invention may further include the following steps:
301. the electronic device captures a first image including a written page.
302. The electronic device recognizes the writing handwriting from the first image, and performs text associative recognition on the writing handwriting in an OCR mode to recognize the target text.
303. The electronic equipment splits the target text according to the component structure to obtain a first splitting result.
304. And the electronic equipment identifies the first splitting result to obtain a first character identification result.
305. The electronic equipment splits the handwriting according to the component structure to obtain a second splitting result.
306. And the electronic equipment identifies the second splitting result to obtain a second character identification result.
307. And the electronic equipment outputs the written characters corresponding to the written handwriting according to the first character recognition result and the second character recognition result.
In the embodiment of the present invention, for the description of 301 to 307, reference may be made to the description of 101 to 107 in the first embodiment, which is not repeated here.
308. The electronic equipment acquires dictation content broadcasted in a learning environment where the electronic equipment is located.
309. And the electronic equipment corrects the written characters according to the dictation content to obtain correction results.
310. The electronic device displays the correction result.
In the embodiment, the electronic device can correct the written text according to the dictation content and display the correction result, so that whether the text dictated by the user is correct or not can be intuitively displayed in a dictation scene, and the user can conveniently know the dictation capability of the user.
Optionally, after 310, the following steps may be further included:
311. if the correction result shows that the wrongly written characters exist in the written characters, the electronic equipment determines a target area where the wrongly written characters are located from the written page.
312. The electronic device projects a hint cursor to the target area.
Optionally, when the correction result indicates that the wrongly written word exists in the written word, a prompting cursor is projected to a target area where the wrongly written word is located in the written page, so that the position where the wrongly written word is located can be prompted to a user, and the user can conveniently check the wrongly written word.
Example IV
As shown in fig. 4, the text recognition method provided by the embodiment of the present invention may further include the following steps:
401. the electronic device captures a first image including a written page.
402. The electronic device recognizes the writing handwriting from the first image, and performs text associative recognition on the writing handwriting in an OCR mode to recognize the target text.
403. The electronic equipment splits the target text according to the component structure to obtain a first splitting result.
404. And the electronic equipment identifies the first splitting result to obtain a first character identification result.
405. The electronic equipment splits the handwriting according to the component structure to obtain a second splitting result.
406. And the electronic equipment identifies the second splitting result to obtain a second character identification result.
407. And the electronic equipment outputs the written characters corresponding to the written handwriting according to the first character recognition result and the second character recognition result.
In the embodiment of the present invention, for the description of 401 to 407, reference may be made to the description of 101 to 107 in the first embodiment, which is not repeated here.
408. If the correction result shows that the wrongly written characters exist, the electronic equipment acquires exercise content associated with the wrongly written characters.
409. The electronic device displays the exercise content.
410. The electronic device receives user input for exercise content.
411. The electronic device displays an exercise result of the user for the exercise content in response to the input, and displays a score for the exercise result.
Through the scheme, the training result of the user can be displayed and scored, so that the student user can conveniently know the training result of the student user.
Further, as an optional implementation manner, after the score of the training result is displayed, the text recognition method provided by the embodiment of the present invention may further include the following a, b, c and d.
a. The electronic device determines whether the score is less than a preset score.
b. If the score is smaller than the preset score, the electronic equipment prompts the user to practice again.
c. And the electronic equipment outputs recommendation information corresponding to the score according to the score.
d. If the score is greater than or equal to the preset score, prompting the user that the exercise result is qualified.
Wherein the recommendation information comprises new exercise content recommended for the user.
Through the above optional implementation manner, after the score of the exercise result is displayed, when the score is smaller than the preset score, the electronic device to which the target device identifier belongs may output new exercise content recommended to the user according to the score, and the targeted exercise content may be recommended to the user according to the contact result and the score of the user.
Example five
As shown in fig. 5, an embodiment of the present invention provides an electronic device, including:
a capturing module 501 configured to capture a first image including a written page;
the recognition module 502 is configured to recognize writing handwriting from the first image, and perform text associative recognition on the writing handwriting by using an OCR manner, so as to recognize a target text;
a splitting module 503, configured to split the target text according to the component structure, so as to obtain a first splitting result;
the recognition module 502 is further configured to recognize the first splitting result to obtain a first text recognition result;
the splitting module 503 is further configured to split the writing trace according to the component structure, so as to obtain a second splitting result;
the recognition module 502 is further configured to recognize the second splitting result to obtain a second text recognition result;
and the output module 504 is configured to output writing characters corresponding to the writing script according to the first character recognition result and the second character recognition result.
As an alternative implementation manner, the above-mentioned output module 504 may specifically include the following sub-modules, which are not illustrated:
and the display sub-module is used for displaying the first character recognition result and the second character recognition result.
And the receiving sub-module is used for receiving the selection input of the user on the target character recognition result.
And the display sub-module is further used for responding to the selection input and displaying the target character recognition result as writing characters corresponding to writing handwriting in a first interface of the electronic equipment.
The first control is used for indicating a third character recognition result, and the third character recognition result is a character recognition result except the target character recognition result in the first character recognition result and the second character recognition result.
Through the optional implementation manner, the electronic device can display two character recognition results, and the user can select one of the character recognition results as the writing character corresponding to the writing handwriting to be displayed in the first interface of the electronic device through selection input, so that the user can determine the displayed character recognition result, and the man-machine interaction performance of the electronic device is improved.
Further, the display sub-module may further suspend and display a first control on the first interface, and the receiving sub-module is further configured to receive a touch input of a user to the first control. And the display sub-module is also used for responding to the touch input and updating the target character recognition result displayed in the first interface into the third character recognition result.
Through the above optional implementation manner, the electronic device may further display the first control for indicating the third text recognition result in suspension on the first interface, and the user may trigger the electronic device to update the target text recognition result to the third text recognition result through the touch input to the first control, so that the user may change the displayed text recognition result after determining the displayed text recognition result, so that the man-machine interaction performance of the electronic device is more flexible.
In an embodiment of the present invention,
the electronic device may acquire a first image including a written page; recognizing writing handwriting from the first image, and performing text association recognition on the writing handwriting by utilizing an OCR mode to recognize target text; splitting the target text according to the component structure to obtain a first splitting result; identifying the first splitting result to obtain a first character identification result; splitting the writing trace according to the component structure to obtain a second splitting result; identifying the second splitting result to obtain a second character identification result; and outputting the written characters corresponding to the written handwriting according to the first character recognition result and the second character recognition result. According to the scheme, the electronic equipment can output the written characters corresponding to the written handwriting according to the character recognition results recognized by two different recognition modes (one is recognition firstly, splitting and recognition secondly, the other is recognition firstly, splitting and recognition secondly), so that compared with the mode that the characters are automatically associated and corrected for improving the recognition rate in the process of recognizing the characters, the accuracy of the recognized characters can be improved in the mode that misprinted characters are corrected.
Optionally, in conjunction with fig. 5, as shown in fig. 6, the electronic device further includes:
the comparison module 505 is configured to compare the first text recognition result with the second text recognition result after the recognition module 502 obtains the first text recognition result and obtains the second text recognition result;
the output module 504 is further configured to output comparison information of the first text recognition result and the second text recognition result;
the comparison information comprises a first character recognition result, a second character recognition result and difference content of the first character recognition result and the second character recognition result.
Optionally, in conjunction with fig. 5, as shown in fig. 7, the electronic device further includes:
the obtaining module 506 is configured to obtain dictation content broadcasted in a learning environment where the electronic device is located after the output module 504 outputs the written text corresponding to the written handwriting;
the correction module 507 is used for correcting the written characters according to the dictation content to obtain correction results;
and the display module 508 is used for displaying the correction result.
Optionally, as shown in fig. 7, the electronic device further includes:
the determining module 509 is configured to determine, from the written page, a target area in which the wrongly written word is located if the correction result indicates that the wrongly written word exists after the correction result is displayed by the display module 508;
The projection module 510 is configured to project a hint cursor to the target area.
Alternatively, as shown in fig. 8 in conjunction with fig. 7,
the obtaining module 506 is further configured to obtain exercise content associated with the wrongly written word if the correction result indicates that the wrongly written word exists;
the display module 508 is further used for displaying exercise content;
the electronic device further includes:
a receiving module 511 for receiving an input of the user for the exercise content after the display module 508 displays the exercise content;
the display module 508 is further configured to display a training result of the user for training content in response to the input, and display a score for the training result.
Further, as an optional implementation manner, the electronic device provided in the embodiment of the present invention may further include the following modules not shown:
and the judging module is used for judging whether the score is smaller than a preset score after the score of the exercise result is displayed by the display module 508.
And the prompting module is used for prompting the user to practice again by the electronic equipment if the score is smaller than the preset score.
And the recommendation module is used for outputting recommendation information corresponding to the score according to the score.
The prompting module is further configured to prompt the user that the training result is qualified if the score is greater than or equal to a preset score.
Wherein the recommendation information comprises new exercise content recommended for the user.
Through the above optional implementation manner, after the score of the exercise result is displayed, when the score is smaller than the preset score, the electronic device to which the target device identifier belongs may output new exercise content recommended to the user according to the score, and the targeted exercise content may be recommended to the user according to the contact result and the score of the user.
As shown in fig. 9, an embodiment of the present invention further provides an electronic device, where the electronic device may include:
a memory 601 in which executable program codes are stored;
a processor 602 coupled to the memory 601;
the processor 602 invokes the executable program code stored in the memory 601 to execute the text recognition method executed by the electronic device in the above method embodiments.
It should be noted that, the electronic device shown in fig. 9 may further include components not shown, such as a battery, an input key, a speaker, a microphone, a screen, an RF circuit, a Wi-Fi module, a bluetooth module, and a sensor, which are not described in detail in this embodiment.
The present invention provides a computer-readable storage medium storing a computer program, wherein the computer program causes a computer to execute some or all of the steps of the method as in the above method embodiments.
Embodiments of the present invention also provide a computer program product, wherein the computer program product, when run on a computer, causes the computer to perform some or all of the steps of the method as in the method embodiments above.
The embodiment of the invention also provides an application publishing platform, wherein the application publishing platform is used for publishing a computer program product, and the computer program product, when running on a computer, causes the computer to execute part or all of the steps of the method as in the above method embodiments.
It should be appreciated that reference throughout this specification to "one embodiment" or "an embodiment" means that a particular feature, structure or characteristic described in connection with the embodiment is included in at least one embodiment of the present invention. Thus, the appearances of the phrases "in one embodiment" or "in an embodiment" in various places throughout this specification are not necessarily all referring to the same embodiment. Furthermore, the particular features, structures, or characteristics may be combined in any suitable manner in one or more embodiments. Those skilled in the art will also appreciate that the embodiments described in the specification are alternative embodiments and that the acts and modules referred to are not necessarily required for the present invention.
The electronic device provided by the embodiment of the invention can realize each process shown in the embodiment of the method, and the electronic device can achieve the technical effects achieved by each process in the embodiment of the method in the process of realizing each process shown in the embodiment of the method, so that repetition is avoided, and the description is omitted here.
In various embodiments of the present invention, it should be understood that the sequence numbers of the foregoing processes do not imply that the execution sequences of the processes should be determined by the functions and internal logic of the processes, and should not be construed as limiting the implementation of the embodiments of the present invention.
The units described above as separate components may or may not be physically separate, and components shown as units may or may not be physical units, may be located in one place, or may be distributed over a plurality of network units. Some or all of the units may be selected according to actual needs to achieve the purpose of the embodiment.
In addition, each functional unit in the embodiments of the present invention may be integrated in one processing unit, or each unit may exist alone physically, or two or more units may be integrated in one unit. The integrated units may be implemented in hardware or in software functional units.
The integrated units described above, if implemented in the form of software functional units and sold or used as stand-alone products, may be stored in a computer-accessible memory. Based on this understanding, the technical solution of the present invention, or a part contributing to the prior art or all or part of the technical solution, may be embodied in the form of a software product stored in a memory, comprising several requests for a computer device (which may be a personal computer, a server or a network device, etc., in particular may be a processor in a computer device) to execute some or all of the steps of the above-mentioned method of the various embodiments of the present invention.
Those of ordinary skill in the art will appreciate that all or part of the steps of the various methods of the above embodiments may be implemented by a program that instructs associated hardware, the program may be stored in a computer readable storage medium including Read-Only Memory (ROM), random access Memory (Random Access Memory, RAM), programmable Read-Only Memory (Programmable Read-Only Memory, PROM), erasable programmable Read-Only Memory (Erasable Programmable Read Only Memory, EPROM), one-time programmable Read-Only Memory (OTPROM), electrically erasable programmable Read-Only Memory (EEPROM), compact disc Read-Only Memory (Compact Disc Read-Only Memory, CD-ROM) or other optical disk Memory, magnetic disk Memory, tape Memory, or any other medium that can be used for carrying or storing data that is readable by a computer.
Claims (10)
1. A method of text recognition, comprising:
collecting a first image comprising a written page;
recognizing writing handwriting from the first image, and performing text association recognition on the writing handwriting in an OCR mode to recognize target text;
splitting the target text according to the component structure to obtain a first splitting result;
identifying the first splitting result to obtain a first character identification result;
splitting the writing trace according to the component structure to obtain a second splitting result;
identifying the second splitting result to obtain a second character identification result;
outputting writing characters corresponding to the writing handwriting according to the first character recognition result and the second character recognition result, wherein the writing characters are the second character recognition result, or a third character recognition result obtained according to the first character recognition result and the second character recognition result, or a first character recognition result determined according to the selection input of a user.
2. The method of claim 1, wherein after obtaining the first text recognition result and obtaining the second text recognition result, the method further comprises:
Comparing the first character recognition result with the second character recognition result, and outputting comparison information of the first character recognition result and the second character recognition result;
the comparison information comprises the first character recognition result, the second character recognition result and difference content of the first character recognition result and the second character recognition result.
3. The method of claim 1, wherein after being applied to an electronic device and outputting the written text corresponding to the writing trace, the method further comprises:
acquiring dictation content broadcasted in a learning environment where the electronic equipment is located;
correcting the written characters according to the dictation content to obtain correction results;
and the electronic equipment displays the correction result.
4. A method according to claim 3, wherein after the electronic device displays the correction result, the method further comprises:
if the correction result shows that the wrongly written characters exist in the written characters, the electronic equipment determines a target area where the wrongly written characters are located from the written page;
the electronic device projects a prompt cursor to the target area.
5. A method according to claim 3, wherein after the electronic device displays the correction result, the method further comprises:
if the correction result shows that the wrongly written characters exist in the written characters, acquiring exercise content associated with the wrongly written characters;
displaying the exercise content;
receiving user input for the exercise content, displaying exercise results of the user for the exercise content in response to the input, and displaying a score for the exercise results.
6. An electronic device, comprising:
the acquisition module is used for acquiring a first image comprising a writing page;
the recognition module is used for recognizing writing handwriting from the first image and carrying out word association recognition on the writing handwriting in an OCR mode so as to recognize target words;
the splitting module is used for splitting the target text according to the component structure so as to obtain a first splitting result;
the recognition module is further used for recognizing the first splitting result to obtain a first character recognition result;
the splitting module is further used for splitting the writing trace according to the component structure so as to obtain a second splitting result;
The recognition module is further used for recognizing the second splitting result to obtain a second character recognition result;
the output module is used for outputting the written characters corresponding to the written handwriting according to the first character recognition result and the second character recognition result, wherein the written characters are the second character recognition result, or a third character recognition result obtained according to the first character recognition result and the second character recognition result, or a first character recognition result determined according to the selection input of a user.
7. The electronic device of claim 6, wherein the electronic device further comprises:
the comparison module is used for comparing the first character recognition result with the second character recognition result after the recognition module obtains the first character recognition result and the second character recognition result;
the output module is further used for outputting comparison information of the first character recognition result and the second character recognition result;
the comparison information comprises the first character recognition result, the second character recognition result and difference content of the first character recognition result and the second character recognition result.
8. The electronic device of claim 6, wherein the electronic device further comprises:
the acquisition module is used for acquiring the dictation content broadcasted in the learning environment where the electronic equipment is located after the output module outputs the writing text corresponding to the writing handwriting;
the correcting module is used for correcting the written characters according to the dictation content to obtain correcting results;
and the display module is used for displaying the correction result.
9. The electronic device of claim 8, wherein the electronic device further comprises:
the determining module is used for determining a target area where the wrongly written characters are located from the writing page if the wrongly written characters exist in the writing characters after the display module displays the correction result;
and the projection module is used for projecting a prompt cursor to the target area.
10. The electronic device of claim 9, wherein the electronic device comprises a memory device,
the acquisition module is further used for acquiring exercise content associated with the wrongly written characters if the correction result indicates that the wrongly written characters exist in the written characters;
the display module is also used for displaying the exercise content;
The electronic device further includes: a receiving module for receiving user input for the exercise content;
the display module is further configured to display an exercise result of the user for the exercise content in response to the input, and display a score for the exercise result.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910716356.8A CN111079503B (en) | 2019-08-02 | 2019-08-02 | Character recognition method and electronic equipment |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910716356.8A CN111079503B (en) | 2019-08-02 | 2019-08-02 | Character recognition method and electronic equipment |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN111079503A CN111079503A (en) | 2020-04-28 |
| CN111079503B true CN111079503B (en) | 2023-08-25 |
Family
ID=70310169
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201910716356.8A Active CN111079503B (en) | 2019-08-02 | 2019-08-02 | Character recognition method and electronic equipment |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN111079503B (en) |
Families Citing this family (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN111814743A (en) * | 2020-07-30 | 2020-10-23 | 深圳壹账通智能科技有限公司 | Handwriting recognition method and device and computer readable storage medium |
| CN113835598A (en) * | 2021-09-03 | 2021-12-24 | 维沃移动通信（杭州）有限公司 | Information acquisition method and device and electronic equipment |
Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JPH09114929A (en) * | 1995-10-19 | 1997-05-02 | Matsushita Electric Ind Co Ltd | Method and device for recognizing character |
| CN101377854A (en) * | 2008-10-07 | 2009-03-04 | 浙江大学 | Method for simulating Chinese characters hand-written handwriting by a computer |
| CN102221976A (en) * | 2011-07-06 | 2011-10-19 | 上海驿创信息技术有限公司 | Method for quickly inputting words based on incomplete identification |
| CN102455867A (en) * | 2011-09-29 | 2012-05-16 | 北京壹人壹本信息科技有限公司 | Method and device for matching handwritten character information |
Family Cites Families (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN105988567B (en) * | 2015-02-12 | 2023-03-28 | 北京三星通信技术研究有限公司 | Handwritten information recognition method and device |
-
2019
- 2019-08-02 CN CN201910716356.8A patent/CN111079503B/en active Active
Patent Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JPH09114929A (en) * | 1995-10-19 | 1997-05-02 | Matsushita Electric Ind Co Ltd | Method and device for recognizing character |
| CN101377854A (en) * | 2008-10-07 | 2009-03-04 | 浙江大学 | Method for simulating Chinese characters hand-written handwriting by a computer |
| CN102221976A (en) * | 2011-07-06 | 2011-10-19 | 上海驿创信息技术有限公司 | Method for quickly inputting words based on incomplete identification |
| CN102455867A (en) * | 2011-09-29 | 2012-05-16 | 北京壹人壹本信息科技有限公司 | Method and device for matching handwritten character information |
Non-Patent Citations (1)
| Title |
|---|
| 高旭 ; 封筠 ; 段淑凤 ; .一个实用脱机手写汉字笔迹库的建立.微型电脑应用.2008,(09),第33-34页. * |
Also Published As
| Publication number | Publication date |
|---|---|
| CN111079503A (en) | 2020-04-28 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN109684980B (en) | Automatic scoring method and device | |
| KR102482850B1 (en) | Electronic device and method for providing handwriting calibration function thereof | |
| CN108345581B (en) | Information identification method and device and terminal equipment | |
| CN107835366B (en) | Multimedia playing method, device, storage medium and electronic equipment | |
| US20210248363A1 (en) | Posture detection method, apparatus and device, and storage medium | |
| CN111078829B (en) | Click-to-read control method and system | |
| CN110874145A (en) | Input method and device and electronic equipment | |
| CN107731020B (en) | Multimedia playing method, device, storage medium and electronic equipment | |
| EP3933552B1 (en) | Method and device for determining gaze position of user, storage medium, and electronic apparatus | |
| CN108877334B (en) | Voice question searching method and electronic equipment | |
| CN111079503B (en) | Character recognition method and electronic equipment | |
| CN111079499B (en) | Writing content identification method and system in learning environment | |
| CN111639158B (en) | Learning content display method and electronic equipment | |
| US20210158031A1 (en) | Gesture Recognition Method, and Electronic Device and Storage Medium | |
| JP6085067B2 (en) | User data update method, apparatus, program, and recording medium | |
| CN111639209B (en) | Book content searching method, terminal equipment and storage medium | |
| CN112309389A (en) | Information interaction method and device | |
| CN108197620B (en) | Photographing and question searching method and system based on eye positioning and handheld photographing equipment | |
| CN110942064A (en) | Image processing method and device and electronic equipment | |
| CN109725736B (en) | Candidate sorting method and device and electronic equipment | |
| CN113657173B (en) | Data processing method and device for data processing | |
| CN111027353A (en) | Search content extraction method and electronic equipment | |
| CN112560728B (en) | Target object identification method and device | |
| CN113485662A (en) | Anti-shake method and electronic device | |
| CN110174924B (en) | Friend making method based on wearable device and wearable device |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |