CN111079489B - Content identification method and electronic equipment - Google Patents
Content identification method and electronic equipment Download PDFInfo
- Publication number
- CN111079489B CN111079489B CN201910453238.2A CN201910453238A CN111079489B CN 111079489 B CN111079489 B CN 111079489B CN 201910453238 A CN201910453238 A CN 201910453238A CN 111079489 B CN111079489 B CN 111079489B
- Authority
- CN
- China
- Prior art keywords
- identified
- content
- target
- unit
- pinyin
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V20/00—Scenes; Scene-specific elements
- G06V20/20—Scenes; Scene-specific elements in augmented reality scenes
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V30/00—Character recognition; Recognising digital ink; Document-oriented image-based pattern recognition
- G06V30/10—Character recognition
- G06V30/24—Character recognition characterised by the processing or recognition method
- G06V30/242—Division of the character sequences into groups prior to recognition; Selection of dictionaries
- G06V30/244—Division of the character sequences into groups prior to recognition; Selection of dictionaries using graphical properties, e.g. alphabet type or font
- G06V30/2445—Alphabet recognition, e.g. Latin, Kanji or Katakana
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V30/00—Character recognition; Recognising digital ink; Document-oriented image-based pattern recognition
- G06V30/10—Character recognition
- G06V30/24—Character recognition characterised by the processing or recognition method
- G06V30/242—Division of the character sequences into groups prior to recognition; Selection of dictionaries
- G06V30/246—Division of the character sequences into groups prior to recognition; Selection of dictionaries using linguistic properties, e.g. specific for English or German language
-
- G—PHYSICS
- G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
- G09B—EDUCATIONAL OR DEMONSTRATION APPLIANCES; APPLIANCES FOR TEACHING, OR COMMUNICATING WITH, THE BLIND, DEAF OR MUTE; MODELS; PLANETARIA; GLOBES; MAPS; DIAGRAMS
- G09B7/00—Electrically-operated teaching apparatus or devices working with questions and answers
- G09B7/02—Electrically-operated teaching apparatus or devices working with questions and answers of the type wherein the student is expected to construct an answer to the question which is presented or wherein the machine gives an answer to the question presented by a student
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V30/00—Character recognition; Recognising digital ink; Document-oriented image-based pattern recognition
- G06V30/10—Character recognition
Abstract
The embodiment of the invention relates to the technical field of education, and discloses a content identification method and electronic equipment, wherein the method comprises the following steps: obtaining an answer image; extracting content to be identified from the answer image, and performing text segmentation on the content to be identified to obtain a plurality of units to be identified, wherein the units to be identified are English or Pinyin; sequentially inputting the plurality of units to be identified into a preset translation script, and counting the times of outputting Chinese by the preset translation script, wherein the preset translation script is used for translating English into Chinese; judging whether the target ratio is larger than or equal to a preset ratio, wherein the target ratio is the ratio between the number of times of outputting Chinese by a preset translation script and the total number of units to be identified; if yes, marking the content to be identified as English; if not, marking the content to be identified as pinyin. By implementing the embodiment of the invention, the accuracy of content identification can be improved.
Description
Technical Field
The invention relates to the technical field of education, in particular to a content identification method and electronic equipment.
Background
Along with the advancement of education informatization, many electronic devices on the market are equipped with dictation functions for assisting students in dictation exercises and correction. At present, when students use electronic equipment to carry out dictation correction, the shot answer images are required to be input into the electronic equipment, so that the electronic equipment carries out character recognition on the answer images to obtain dictation contents of the students, and correction results of the dictation contents are output. However, it is found in practice that some characters represent different meanings under different learning environments, for example, a generally represents pinyin a under a chinese learning environment, a generally represents english letter a under an english learning environment, and it is difficult for the existing technology to distinguish the meaning represented by the characters under the current learning environment, so that the accuracy of content recognition of the answer image is reduced.
Disclosure of Invention
The embodiment of the invention discloses a content identification method and electronic equipment, which can improve the accuracy of content identification.
The first aspect of the embodiment of the invention discloses a content identification method, which comprises the following steps:
obtaining an answer image;
extracting content to be identified from the answer image, and performing text segmentation on the content to be identified to obtain a plurality of units to be identified; the unit to be identified is English or Pinyin;
sequentially inputting the units to be identified into a preset translation script, and counting the times of outputting Chinese by the preset translation script; the preset translation script is used for translating English into Chinese;
judging whether the target ratio is larger than or equal to a preset ratio; the target ratio is the ratio between the number of times of outputting Chinese by the preset translation script and the total number of units to be identified;
if yes, marking the content to be identified as English; and if not, marking the content to be identified as pinyin.
In a first aspect of the embodiment of the present invention, the sequentially inputting the plurality of units to be identified into a preset translation script and counting the number of times that the preset translation script outputs chinese includes:
Judging whether a target unit containing tone symbols exists in the plurality of units to be identified;
if not, sequentially inputting the units to be identified into a preset translation script; if yes, sequentially inputting other units except the target unit in the units to be identified into a preset translation script;
and counting the times of outputting Chinese by the preset translation script.
As an optional implementation manner, in the first aspect of the embodiment of the present invention, after the marking the content to be identified as pinyin, the method further includes:
acquiring a correct answer corresponding to the content to be identified;
correcting the content to be identified according to the correct answer;
if the target tone symbol is wrong, determining the pinyin corresponding to the target tone symbol, and obtaining the target character corresponding to the pinyin; wherein the target tone symbol is a tone symbol contained in the content to be identified;
marking the target characters as phonetic notation error types, and outputting correct phonetic notation information of the target characters.
As an optional implementation manner, in the first aspect of the embodiment of the present invention, the method further includes:
when entering an unlocking page, generating a pinyin graph with tone to be complemented according to characters marked as the ZhuYin error type;
Displaying the characters marked as the phonetic transcription error type and the pinyin graph of the tone to be complemented on the unlocking page;
detecting whether a tone symbol input by a user is positioned above a correct character in the pinyin graph and whether the tone symbol input by the user is correct;
and if the tone symbol input by the user is positioned above the correct character in the pinyin graph and the tone symbol input by the user is correct, unlocking operation is carried out.
As an optional implementation manner, in the first aspect of the embodiment of the present invention, the method further includes:
determining target learning content according to the marked content to be identified;
opening an application program associated with the target learning content, and closing an application program not associated with the target learning content;
and displaying the target learning content in the opened application program.
A second aspect of an embodiment of the present invention discloses an electronic device, including:
a first acquisition unit configured to acquire an answer image;
the text segmentation unit is used for extracting content to be identified from the answer image and carrying out text segmentation on the content to be identified so as to obtain a plurality of units to be identified; the unit to be identified is English or Pinyin;
The statistics unit is used for sequentially inputting the plurality of units to be identified into a preset translation script and counting the times of outputting Chinese by the preset translation script; the preset translation script is used for translating English into Chinese;
the judging unit is used for judging whether the target ratio is larger than or equal to a preset ratio; the target ratio is the ratio between the number of times of outputting Chinese by the preset translation script and the total number of units to be identified;
the first marking unit is used for marking the content to be identified as English when the judging unit judges that the target ratio is larger than or equal to the preset ratio; and when the judging unit judges that the target ratio is smaller than the preset ratio, marking the content to be identified as pinyin.
As an optional implementation manner, in a second aspect of the embodiment of the present invention, the statistics unit includes:
a judging subunit, configured to judge whether a target unit containing a tone symbol exists in the plurality of units to be identified;
the input subunit is used for inputting the plurality of units to be identified into a preset translation script in sequence when the judging subunit judges that the target unit does not exist in the plurality of units to be identified; when the judging subunit judges that the target unit exists in the plurality of units to be identified, the other units except the target unit in the plurality of units to be identified are sequentially input with a preset translation script;
And the statistics subunit is used for counting the times of outputting Chinese by the preset translation script.
As an optional implementation manner, in the second aspect of the embodiment of the present invention, the electronic device further includes:
the second obtaining unit is used for obtaining a correct answer corresponding to the content to be identified after the first marking unit marks the content to be identified as pinyin;
the correcting unit is used for correcting the content to be identified according to the correct answer;
a third obtaining unit, configured to determine pinyin corresponding to a target tone symbol when the target tone symbol is in error, and obtain target text corresponding to the pinyin; wherein the target tone symbol is a tone symbol contained in the content to be identified;
the second marking unit is used for marking the target characters as phonetic transcription error classes;
and the output unit is used for outputting the correct phonetic notation information of the target characters.
As an optional implementation manner, in the second aspect of the embodiment of the present invention, the electronic device further includes:
the graphic generation unit is used for generating a pinyin graphic of the tone to be complemented according to the characters marked as the ZhuYin error type when entering the unlocking page;
The first display unit is used for displaying the characters marked as the ZhuYin error type and the pinyin graph of the tone to be complemented on the unlocking page;
the detecting unit is used for detecting whether the tone symbol input by the user is positioned above the correct character in the Pinyin graph and whether the tone symbol input by the user is correct;
and the unlocking unit is used for unlocking when the tone symbol input by the user is positioned above the correct character in the Pinyin graph and the tone symbol input by the user is correct.
As an optional implementation manner, in the second aspect of the embodiment of the present invention, the electronic device further includes:
a determining unit, configured to determine target learning content according to the marked content to be identified;
a control unit for starting an application program associated with the target learning content and closing an application program not associated with the target learning content;
and the second display unit is used for displaying the target learning content in the opened application program.
A third aspect of an embodiment of the present invention discloses an electronic device, including:
a memory storing executable program code;
A processor coupled to the memory;
the processor invokes the executable program code stored in the memory to execute a content identification method disclosed in the first aspect of the embodiment of the present invention.
A fourth aspect of the embodiments of the present invention discloses a computer-readable storage medium storing a computer program, wherein the computer program causes a computer to execute a content recognition method disclosed in the first aspect of the embodiments of the present invention.
A fifth aspect of the embodiments of the present invention discloses a computer program product which, when run on a computer, causes the computer to perform part or all of the steps of any one of the methods of the first aspect.
A sixth aspect of the embodiments of the present invention discloses an application publishing platform for publishing a computer program product, wherein the computer program product, when run on a computer, causes the computer to perform part or all of the steps of any one of the methods of the first aspect.
Compared with the prior art, the embodiment of the invention has the following beneficial effects:
in the embodiment of the invention, the content to be identified is extracted from the answer image, and text segmentation is carried out on the content to be identified to obtain a plurality of units to be identified, wherein the units to be identified are English or Pinyin; then, inputting a plurality of units to be identified into a preset translation script, so that the number of the units to be identified as English is obtained by counting the number of times of outputting Chinese by the preset translation script based on the characteristic that the preset translation script is used for translating English into Chinese; and when the ratio of the units to be identified as English in the plurality of units to be identified is greater than or equal to the preset ratio, marking the content to be identified as English, otherwise marking the content to be identified as pinyin, the limitation of single character identification can be solved, the meaning represented by the content to be identified in the current learning environment can be distinguished, the accuracy of content identification is improved, the accuracy of subsequent correction of answer content is further improved, and the learning experience of a user is improved.
Drawings
In order to more clearly illustrate the technical solutions of the embodiments of the present invention, the drawings that are needed in the embodiments will be briefly described below, and it is obvious that the drawings in the following description are only some embodiments of the present invention, and other drawings may be obtained according to these drawings without inventive effort for a person skilled in the art.
FIG. 1 is a schematic flow chart of a content identification method according to an embodiment of the present invention;
FIG. 2 is a schematic diagram of a scenario of answer detection disclosed in an embodiment of the present invention;
FIG. 3 is a flow chart of another content identification method disclosed in an embodiment of the present invention;
FIG. 4 is a schematic diagram of an unlock page disclosed in an embodiment of the present invention;
fig. 5 is a schematic structural diagram of an electronic device according to an embodiment of the present invention;
FIG. 6 is a schematic diagram of another electronic device according to an embodiment of the present invention;
fig. 7 is a schematic structural diagram of another electronic device according to an embodiment of the present invention.
Detailed Description
The following description of the embodiments of the present invention will be made clearly and completely with reference to the accompanying drawings, in which it is apparent that the embodiments described are only some embodiments of the present invention, but not all embodiments. All other embodiments, which can be made by those skilled in the art based on the embodiments of the invention without making any inventive effort, are intended to be within the scope of the invention.
It should be noted that the terms "first," "second," "third," "fourth," and the like in the description and in the claims of the present invention are used for distinguishing between different objects and not necessarily for describing a particular sequential or chronological order. The terms "comprises," "comprising," and "having," and any variations thereof, are intended to cover a non-exclusive inclusion, such that a process, method, system, article, or apparatus that comprises a list of steps or elements is not necessarily limited to those steps or elements expressly listed or inherent to such process, method, article, or apparatus.
The embodiment of the invention discloses a content identification method and electronic equipment, which can improve the accuracy of content identification. The following detailed description refers to the accompanying drawings.
Example 1
Referring to fig. 1, fig. 1 is a flow chart of a content identification method according to an embodiment of the invention. As shown in fig. 1, the content recognition method may include the following steps.
101. The electronic device obtains an answer image.
The content identification method disclosed by the embodiment of the invention is suitable for electronic equipment such as learning flat plates, learning mobile phones, learning machines, home education machines, click-to-read machines and the like used by users, and is particularly suitable for Web application, APP or special software in the electronic equipment. The shooting device for acquiring the answer image in the embodiment of the invention can be arranged on one side of the electronic equipment provided with the display screen.
Referring to fig. 2, fig. 2 is a schematic diagram of a scenario of answer detection according to an embodiment of the invention. In fig. 2, an electronic device is placed at a certain angle with a horizontal plane (such as a desktop), and the electronic device is provided with a photographing device and a light reflecting device, wherein the light reflecting device is used for changing a light path of the photographing device, so that the photographing device photographs an answer image of a paper page (such as a text, a homework book, etc.) placed on the horizontal plane, so as to detect answer contents written by a user on the paper page.
102. The electronic equipment extracts the content to be identified from the answer image, and performs text segmentation on the content to be identified to obtain a plurality of units to be identified; wherein the unit to be identified is English or Pinyin.
In the embodiment of the invention, the electronic equipment can convert the answer image into text information through OCR (Optical Character Recognition ) technology so as to obtain the content to be recognized. The electronic device uses space symbols and preset punctuation marks (such as commas, periods, ellipses and the like) as segmentors to segment the content to be identified into a plurality of units to be identified, wherein the units to be identified can be single letters or words. For example, if the content to be identified is "Nice to meet you, andy", the electronic device performs text segmentation on the content to be identified to obtain 5 units to be identified, including: "Nice", "to", "meet", "you" and "Andy".
103. The electronic equipment sequentially inputs the units to be identified into a preset translation script, and counts the times of outputting Chinese by the preset translation script; the preset translation script is used for translating English into Chinese.
In the embodiment of the present invention, it can be understood that, because the preset translation script is used for translating english into chinese, if the electronic device inputs any unit to be identified into the preset translation script and then the preset translation script outputs chinese, the unit to be identified can be identified as english. For example, assume that the electronic device sequentially inputs 5 units to be identified, "Nice", "to", "meet", "you" and "Andy" into preset translation scripts, and the preset translation scripts output translation results respectively: "nice", "to", "meet", "you" and "Andi", it can be seen that the preset translation script outputs 5 times of Chinese, so that it can be known that 5 units to be identified are all English.
104. The electronic device judges whether the target ratio is greater than or equal to a preset ratio, if yes, step 105 is executed; if not, go to step 106.
In the embodiment of the invention, the target ratio is the ratio between the number of times of outputting Chinese by the preset translation script and the total number of units to be identified. For example, assuming that the preset ratio is 0.6, if the electronic device sequentially inputs the 5 units to be identified, "Chinese", "character", "shan", "means" and "longevity" into the preset translation script, the preset translation script may output the Chinese language of "Chinese", "character", "means" and "longevity", but cannot translate the pinyin "shou", so that the preset translation script is obtained statistically and output 4 Chinese characters. At this time, the target ratio=the number of times the preset translation script outputs chinese ++the total number of units to be recognized=4++5=0.8. And because the target ratio 0.8 is larger than the preset ratio 0.6, the electronic equipment marks the content to be identified as English.
105. The electronic device marks the content to be identified as English.
106. The electronic device marks the content to be identified as pinyin.
As an optional implementation manner, the present solution may further include:
the electronic equipment adds the marked content to be identified into a learning task list corresponding to the marking type of the content to be identified, so as to sequentially execute learning tasks in the learning task list when entering a learning mode corresponding to the marking type; the learning task list is used for storing learning tasks to be processed by the electronic equipment according to the adding sequence.
Therefore, the electronic device adds the content to be identified marked as English into the learning task list of English subjects, or adds the content to be identified marked as pinyin into the learning task list of Chinese subjects, so that reasonable subjects classification can be performed on the content to be identified according to the mark type of the content to be identified, and the user can be assisted in targeted learning.
Further, as an alternative embodiment, the electronic device may also be a wearable device such as a smart watch, a smart bracelet, etc., and these wearable devices may generally be configured with a photographing device to photograph images. Therefore, before the electronic device adds the marked content to be identified to the learning task list corresponding to the marking type of the content to be identified, the scheme can further include:
The electronic equipment judges whether the current equipment end belongs to a learning equipment end preset by a user;
if yes, executing the step of adding the marked content to be identified into a learning task list corresponding to the marking type of the content to be identified;
if not, the electronic equipment uploads the content to be identified to the cloud server, so that the cloud server sends the marked content to be identified to a learning equipment end bound with the electronic equipment.
It can be appreciated that in some special learning scenarios, students may not necessarily carry special learning devices (such as a home education machine, a click-to-read machine, etc.) with them, and at this time, the students can also shoot an answer image to be identified by using a wearable device worn daily or a mobile device (such as a personal mobile phone) not belonging to a preset learning device end, so that the wearable device or the mobile device forwards the content to be identified obtained from the answer image to the bound learning device end through the cloud server, and thus, the students can obtain more learning resources related to the content to be identified on the specified learning device. It can be seen that implementing alternative embodiments is also not limited to the type of device, widening the learning scenario of the user.
It can be seen that, implementing the method described in fig. 1, the to-be-identified content is extracted from the answer image, and text segmentation is performed on the to-be-identified content to obtain a plurality of to-be-identified units, where the to-be-identified units are english or pinyin; then, inputting a plurality of units to be identified into a preset translation script, so that the number of the units to be identified as English is obtained by counting the number of times of outputting Chinese by the preset translation script based on the characteristic that the preset translation script is used for translating English into Chinese; and when the ratio of the units to be identified as English in the plurality of units to be identified is greater than or equal to the preset ratio, marking the content to be identified as English, otherwise marking the content to be identified as pinyin, the limitation of single character identification can be solved, the meaning represented by the content to be identified in the current learning environment can be distinguished, the accuracy of content identification is improved, the accuracy of subsequent correction of answer content is further improved, and the learning experience of a user is improved.
Example two
Referring to fig. 3, fig. 3 is a flow chart of another content recognition method according to an embodiment of the invention. As shown in fig. 3, the content recognition method may include the following steps.
301. The electronic device obtains an answer image.
302. The electronic equipment extracts the content to be identified from the answer image, and performs text segmentation on the content to be identified to obtain a plurality of units to be identified; wherein the unit to be identified is English or Pinyin.
303. The electronic device judges whether a target unit containing tone symbols exists in the plurality of units to be identified, if yes, step 304 is executed; if not, go to step 305.
In the embodiment of the present invention, tone marks are generally marked above the pinyin letters to indicate the tones corresponding to the pinyin letters, such as ā, mu, ě, mu, etc. Taking the unit to be identified "who" as an example, since the "who" does not include a tone symbol, the unit to be identified is not a target unit; taking the unit to be identified "shu ǐ" as an example, since the "shu ǐ" includes the tone symbol "ǐ", the unit to be identified is a target unit.
304. The electronic device sequentially inputs the other units except the target unit in the units to be identified into a preset translation script, counts the number of times that the preset translation script outputs Chinese, and executes step 306.
305. The electronic device sequentially inputs the plurality of units to be identified into a preset translation script, counts the number of times that the preset translation script outputs Chinese, and executes step 306.
It can be seen that, by implementing the steps 303, 304 and 305, based on the feature that the spelling is tone-marked and the english letters or the english words are not tone-marked, the target units including tone symbols are removed from the plurality of units to be identified, and the remaining units to be identified are input into the preset translation script, so that the units identified as the spellings can be screened, the identification step is simplified, and the effect of rapidly distinguishing the spellings from the english words is achieved.
306. The electronic device determines whether the target ratio is greater than or equal to a preset ratio, if so, step 307 is executed; if not, go to step 308; the target ratio is the ratio between the number of times of outputting Chinese by the preset translation script and the total number of units to be identified.
307. The electronic device marks the content to be identified as English.
308. The electronic device marks the content to be identified as pinyin and performs steps 309-312.
309. And the electronic equipment acquires a correct answer corresponding to the content to be identified.
310. And the electronic equipment corrects the content to be identified according to the correct answer.
311. If the target tone symbol is wrong, the electronic equipment determines the pinyin corresponding to the target tone symbol and obtains the target character corresponding to the pinyin; the target tone symbol is a tone symbol contained in the content to be identified.
312. The electronic equipment marks the target characters as phonetic transcription error classes and outputs correct phonetic transcription information of the target characters.
In the embodiment of the present invention, for example, the correct phonetic notation mode of the known word "fruit" is "shu ǐ gu ǒ", and if the electronic device detects that the pinyin in the content to be identified is "sh ǔ i gu ǒ", it is determined that the tone symbol is wrong. At this time, the electronic device may determine that the incorrect pinyin is "sh ǔ i" and the target text corresponding to the pinyin is "water", so the electronic device marks the "water" word as a Zhuyin error class and outputs the correct Zhuyin information "shu ǐ" of the "water" word. It can be seen that, after determining the meaning of the content to be identified in the current learning environment (such as english or pinyin), the steps 309-312 are implemented, so that the correction points of the content to be identified (such as focusing on word spelling, grammar, etc. in the english environment, focusing on text writing, pinyin spelling, pinyin tone, etc. in the chinese environment) can be adaptively adjusted, thereby improving the correction accuracy; in addition, when the tone symbol is wrong, the target character corresponding to the wrong tone symbol is determined, and correct phonetic notation information of the target character is output, so that the phonetic notation error of the user can be corrected in a targeted manner, and the target character can be marked as the phonetic notation error class for providing subsequent review content and examining the learning effect of the user.
As an alternative embodiment, the present solution may further include the following steps:
when the electronic equipment enters an unlocking page, generating a pinyin graph of a tone to be complemented according to characters marked as a phonetic notation error class;
the electronic equipment displays characters marked as phonetic transcription errors and pinyin graphs with tones to be complemented on the unlocking page;
the electronic equipment detects whether the tone symbol input by the user is positioned above the correct character in the pinyin graph and whether the tone symbol input by the user is correct;
if the tone symbol input by the user is positioned above the correct character in the pinyin graph and the tone symbol input by the user is correct, the electronic equipment performs unlocking operation.
Fig. 4 is a schematic diagram of an unlock page according to an embodiment of the present invention. In fig. 4, taking the target text "whisper" as an example, the unlocking page displays a prompt word (i.e., "whisper") containing the target text 401, and an unlocking prompt with a content of "make-up tone to unlock"; wherein the tone "r n" is marked above the non-target text "r", and the pinyin pattern 402 to be supplemented with tone is displayed above the target text 401. It can be seen that by detecting the sliding track of the user on the touch screen of the electronic device, the tone symbol 403 input by the user can be obtained. At this time, although the tone symbol 403 input by the user is located above the correct character "a" in the pinyin graphic 402, the tone symbol input by the user (i.e., yang level) is not the correct tone symbol (i.e., up sound), and the electronic device does not perform the unlocking operation.
Therefore, when the optional implementation mode is implemented, the pinyin graph of the tone to be complemented is generated based on the characters marked as the ZhuYin error type when the unlocking page is entered, and the tone correction effect of the user can be randomly checked by detecting the tone symbol input by the user for the pinyin graph, so that the flexibility and the interestingness of the ZhuYin exercise can be improved.
As another alternative embodiment, the present solution may further include the following steps:
when the electronic equipment enters an unlocking page, generating test contents according to the characters marked as the ZhuYin error class; the test content comprises characters marked as ZhuYin errors, and the test content can be single characters, words, idioms or phrases and the like;
the electronic equipment displays the test content on the unlocking page and is used for indicating the unlocking prompt information for the user to read the test content;
the electronic equipment detects voice information of a user and judges whether the user pronounces correctly according to the voice information;
if the unlocking operation is correct, the electronic equipment performs the unlocking operation; if the voice is incorrect, the electronic equipment outputs correct reading voice corresponding to the test content, and unlocking operation is carried out after correct pronunciation of the user is detected again. Therefore, the method can assist the user to consolidate the learning of the tone of the Chinese character in a voice interaction mode, and the learning interestingness is also increased.
Further, as an optional embodiment, the method may further include:
the electronic equipment determines target learning content according to the marked content to be identified;
the electronic equipment starts an application program associated with the target learning content and closes the application program not associated with the target learning content;
the electronic device displays the target learning content in the opened application program.
It will be appreciated that by analyzing the subject type, knowledge point, error prone point, etc. information of the content to be identified, the target learning content for the user to refer to and learn can be determined, for example, if the content to be identified marked as english is "Agood medicine tastes bitter (good medicine bitter)", the electronic device can determine the target learning content related to english subjects and english shoddy. Thus, the electronic device will open an application related to english disciplines, close an application unrelated to english disciplines (such as an application of another discipline, a non-learning game APP, a social APP, etc.), and push english phrases or english shores, etc., among the opened applications. Therefore, by implementing the above-mentioned alternative embodiment, by determining the target learning content matched with the content to be identified, opening the application program related to the target learning content, and closing the application program unrelated to the target learning content, the learning resource meeting the user requirement can be provided, the user can be prevented from being distracted by the application program unrelated to the learning content, and the learning efficiency of the user can be improved.
Therefore, the method described in fig. 3 can solve the limitation of single character recognition, so as to distinguish the meaning represented by the content to be recognized in the current learning environment, improve the accuracy of content recognition, adaptively adjust the correction points of the content to be recognized, improve the correction accuracy and improve the learning experience of users; in addition, the unit identified as pinyin can be screened, so that the identification step is simplified, and the effect of rapidly distinguishing pinyin from English is achieved; further, the method can pointedly correct the phonetic notation errors of the user, marks the target characters as phonetic notation error types, is used for providing subsequent review content and researching the learning effect of the user, and can also promote the flexibility and the interestingness of phonetic notation exercise by randomly checking the tone correction effect of the user; still further, learning resources meeting the demands of users can be provided, the users can be prevented from being distracted by application programs irrelevant to learning contents, and the learning efficiency of the users is improved.
Example III
Referring to fig. 5, fig. 5 is a schematic structural diagram of an electronic device according to an embodiment of the invention. As shown in fig. 5, the electronic device may include:
A first obtaining unit 501 configured to obtain an answer image;
the text segmentation unit 502 is configured to extract content to be identified from the answer image, and perform text segmentation on the content to be identified to obtain a plurality of units to be identified; the unit to be identified is English or Pinyin;
a statistics unit 503, configured to sequentially input the plurality of units to be identified into a preset translation script, and count the number of times that the preset translation script outputs chinese; the method comprises the steps of presetting a translation script for translating English into Chinese;
a judging unit 504, configured to judge whether the target ratio is greater than or equal to a preset ratio; the target ratio is the ratio between the number of times of outputting Chinese by the preset translation script and the total number of units to be identified;
a first marking unit 505, configured to mark the content to be identified as english when the determining unit 504 determines that the target ratio is greater than or equal to the preset ratio; and when the judging unit 504 judges that the target ratio is smaller than the preset ratio, marking the content to be identified as pinyin.
As an alternative embodiment, the electronic device may further include:
an adding unit, configured to add the marked content to be identified to a learning task list corresponding to a mark type of the content to be identified, so as to sequentially execute learning tasks in the learning task list when entering a learning mode corresponding to the mark type; the learning task list is used for storing learning tasks to be processed by the electronic equipment according to the adding sequence.
Therefore, the content to be identified marked as English is added into the learning task list of English subjects, or the content to be identified marked as Pinyin is added into the learning task list of Chinese subjects, so that reasonable subject classification can be performed on the content to be identified according to the mark type of the content to be identified, and the method is beneficial to assisting a user in targeted learning.
Further, as an alternative embodiment, the electronic device may also be a wearable device such as a smart watch, a smart bracelet, etc., and these wearable devices may generally be configured with a photographing device to photograph images. Therefore, the electronic device may further comprise an uploading unit, wherein:
the judging unit 504 is further configured to judge whether the current device side belongs to a learning device side preset by the user before the adding unit adds the marked content to be identified into the learning task list corresponding to the marking type of the content to be identified; if yes, triggering the adding unit to execute the addition of the marked content to be identified into a learning task list corresponding to the marking type of the content to be identified;
and the uploading unit is configured to upload the content to be identified to the cloud server when the determining unit 504 determines that the current device side does not belong to the learning device side preset by the user, so that the cloud server sends the marked content to be identified to the learning device side bound with the electronic device.
It can be appreciated that in some special learning scenarios, students may not necessarily carry special learning devices (such as a home education machine, a click-to-read machine, etc.) with them, and at this time, the students can also shoot an answer image to be identified by using a wearable device worn daily or a mobile device (such as a personal mobile phone) not belonging to a preset learning device end, so that the wearable device or the mobile device forwards the content to be identified obtained from the answer image to the bound learning device end through the cloud server, and thus, the students can obtain more learning resources related to the content to be identified on the specified learning device. It can be seen that implementing alternative embodiments is also not limited to the type of device, widening the learning scenario of the user.
As can be seen, implementing the electronic device described in fig. 5, by extracting the content to be identified from the answer image and performing text segmentation on the content to be identified, a plurality of units to be identified are obtained, where the units to be identified are english or pinyin; then, inputting a plurality of units to be identified into a preset translation script, so that the number of the units to be identified as English is obtained by counting the number of times of outputting Chinese by the preset translation script based on the characteristic that the preset translation script is used for translating English into Chinese; and when the ratio of the units to be identified as English in the plurality of units to be identified is greater than or equal to the preset ratio, marking the content to be identified as English, otherwise marking the content to be identified as pinyin, the limitation of single character identification can be solved, the meaning represented by the content to be identified in the current learning environment can be distinguished, the accuracy of content identification is improved, the accuracy of subsequent correction of answer content is further improved, and the learning experience of a user is improved.
Example IV
Referring to fig. 6, fig. 6 is a schematic structural diagram of another electronic device according to an embodiment of the invention. The electronic device shown in fig. 6 is obtained by optimizing the electronic device shown in fig. 5. Compared to the electronic device shown in fig. 5, the electronic device shown in fig. 6 may further include a second acquisition unit 506, a modification unit 507, a third acquisition unit 508, a second marking unit 509, and an output unit 510, wherein:
a statistics unit 503 includes:
a judging subunit 5031, configured to judge whether a target unit containing a tone symbol exists in the plurality of units to be identified;
an input subunit 5032, configured to, when the judging subunit 5031 determines that there is no target unit in the plurality of units to be identified, sequentially input the plurality of units to be identified into a preset translation script; when the judging subunit 5031 judges that the target unit exists in the plurality of units to be identified, sequentially inputting a preset translation script into other units except the target unit in the plurality of units to be identified;
the statistics subunit 5033 is configured to count the number of times that the preset translation script outputs chinese.
A second obtaining unit 506, configured to obtain a correct answer corresponding to the content to be identified after the first marking unit 505 marks the content to be identified as pinyin;
A correcting unit 507 for correcting the content to be identified according to the correct answer;
a third obtaining unit 508, configured to determine pinyin corresponding to the target tone symbol when the target tone symbol is in error, and obtain target text corresponding to the pinyin; wherein the target tone symbol is a tone symbol contained in the content to be identified;
a second marking unit 509, configured to mark the target text as a ZhuYin error class;
and an output unit 510 for outputting correct phonetic notation information of the target text.
As an alternative embodiment, the electronic device may further include:
the graphic generation unit is used for generating a pinyin graphic of the tone to be complemented according to the characters marked as the ZhuYin error type when entering the unlocking page;
the first display unit is used for displaying characters marked as ZhuYin errors and pinyin graphs with tones to be complemented on the unlocking page;
the first detection unit is used for detecting whether the tone symbol input by the user is positioned above the correct character in the pinyin graph and whether the tone symbol input by the user is correct;
and the unlocking unit is used for unlocking when the tone symbol input by the user is positioned above the correct character in the pinyin graph and the tone symbol input by the user is correct.
Further, the electronic device may further include:
a determining unit for determining target learning content according to the marked content to be identified;
the control unit is used for starting an application program associated with the target learning content and closing the application program not associated with the target learning content;
and the second display unit is used for displaying the target learning content in the opened application program.
Furthermore, as an alternative embodiment, the electronic device may further include:
the content generation unit is used for generating test content according to characters marked as ZhuYin errors when entering the unlocking page; the test content comprises characters marked as ZhuYin errors, and the test content can be single characters, words, idioms or phrases and the like;
the third display unit is used for displaying the test content on the unlocking page and indicating the unlocking prompt information for the user to read the test content;
the second detection unit is used for detecting voice information of the user and judging whether the user pronounces correctly or not according to the voice information;
the unlocking unit is also used for unlocking when the second detection unit judges that the pronunciation of the user is correct; and when the second detection unit judges that the user pronounces wrong, outputting correct reading voice corresponding to the test content, and performing unlocking operation after detecting the correct pronunciation of the user again. Therefore, the method can assist the user to consolidate the learning of the tone of the Chinese character in a voice interaction mode, and the learning interestingness is also increased.
Therefore, implementing the electronic device described in fig. 6 can solve the limitation of single character recognition, so as to distinguish the meaning represented by the content to be recognized in the current learning environment, improve the accuracy of content recognition, adaptively adjust the correction points of the content to be recognized, improve the correction accuracy, and improve the learning experience of the user; in addition, the unit identified as pinyin can be screened, so that the identification step is simplified, and the effect of rapidly distinguishing pinyin from English is achieved; further, the method can pointedly correct the phonetic notation errors of the user, marks the target characters as phonetic notation error types, is used for providing subsequent review content and researching the learning effect of the user, and can also promote the flexibility and the interestingness of phonetic notation exercise by randomly checking the tone correction effect of the user; still further, learning resources meeting the demands of users can be provided, the users can be prevented from being distracted by application programs irrelevant to learning contents, and the learning efficiency of the users is improved.
Example five
Referring to fig. 7, fig. 7 is a schematic structural diagram of another electronic device according to an embodiment of the invention. As shown in fig. 7, the electronic device may include:
A memory 701 storing executable program code;
a processor 702 coupled with the memory 701;
wherein the processor 702 invokes executable program code stored in the memory 701 to perform a content recognition method as shown in fig. 1 or 3.
The embodiment of the invention discloses a computer-readable storage medium storing a computer program, wherein the computer program causes a computer to execute a content identification method shown in fig. 1 or fig. 3.
The embodiments of the present invention also disclose a computer program product, wherein the computer program product, when run on a computer, causes the computer to perform some or all of the steps of the method as in the method embodiments above.
The embodiment of the invention also discloses an application release platform which is used for releasing a computer program product, wherein when the computer program product runs on a computer, the computer is enabled to execute part or all of the steps of the method in the method embodiments.
Those of ordinary skill in the art will appreciate that all or part of the steps of the various methods of the above embodiments may be implemented by a program that instructs associated hardware, the program may be stored in a computer readable storage medium including Read-Only Memory (ROM), random access Memory (Random Access Memory, RAM), programmable Read-Only Memory (Programmable Read-Only Memory, PROM), erasable programmable Read-Only Memory (Erasable Programmable Read Only Memory, EPROM), one-time programmable Read-Only Memory (OTPROM), electrically erasable programmable Read-Only Memory (EEPROM), compact disc Read-Only Memory (Compact Disc Read-Only Memory, CD-ROM) or other optical disk Memory, magnetic disk Memory, tape Memory, or any other medium that can be used for carrying or storing data that is readable by a computer.
The foregoing describes in detail a content recognition method and an electronic device disclosed in the embodiments of the present invention, and specific examples are applied to illustrate the principles and embodiments of the present invention, where the foregoing examples are only used to help understand the method and core ideas of the present invention; meanwhile, as those skilled in the art will have variations in the specific embodiments and application scope in accordance with the ideas of the present invention, the present description should not be construed as limiting the present invention in view of the above.
Claims (10)
1. A method of content identification, the method comprising:
obtaining an answer image;
extracting content to be identified from the answer image, and performing text segmentation on the content to be identified to obtain a plurality of units to be identified; the unit to be identified is English or Pinyin;
sequentially inputting the units to be identified into a preset translation script, and counting the times of outputting Chinese by the preset translation script; the preset translation script is used for translating English into Chinese;
judging whether the target ratio is larger than or equal to a preset ratio; the target ratio is the ratio between the number of times of outputting Chinese by the preset translation script and the total number of units to be identified;
If yes, marking the content to be identified as English; and if not, marking the content to be identified as pinyin.
2. The method according to claim 1, wherein sequentially inputting the plurality of units to be identified into a preset translation script and counting the number of times the preset translation script outputs chinese, comprises:
judging whether a target unit containing tone symbols exists in the plurality of units to be identified;
if not, sequentially inputting the units to be identified into a preset translation script; if yes, sequentially inputting other units except the target unit in the units to be identified into a preset translation script;
and counting the times of outputting Chinese by the preset translation script.
3. The method of claim 2, wherein after marking the content to be identified as pinyin, the method further comprises:
acquiring a correct answer corresponding to the content to be identified;
correcting the content to be identified according to the correct answer;
if the target tone symbol is wrong, determining the pinyin corresponding to the target tone symbol, and obtaining the target character corresponding to the pinyin; wherein the target tone symbol is a tone symbol contained in the content to be identified;
Marking the target characters as phonetic notation error types, and outputting correct phonetic notation information of the target characters.
4. A method according to claim 3, characterized in that the method further comprises:
when entering an unlocking page, generating a pinyin graph with tone to be complemented according to characters marked as the ZhuYin error type;
displaying the characters marked as the phonetic transcription error type and the pinyin graph of the tone to be complemented on the unlocking page;
detecting whether a tone symbol input by a user is positioned above a correct character in the pinyin graph and whether the tone symbol input by the user is correct;
and if the tone symbol input by the user is positioned above the correct character in the pinyin graph and the tone symbol input by the user is correct, unlocking operation is carried out.
5. The method according to any one of claims 1 to 4, further comprising:
determining target learning content according to the marked content to be identified;
opening an application program associated with the target learning content, and closing an application program not associated with the target learning content;
and displaying the target learning content in the opened application program.
6. An electronic device, the electronic device comprising:
a first acquisition unit configured to acquire an answer image;
the text segmentation unit is used for extracting content to be identified from the answer image and carrying out text segmentation on the content to be identified so as to obtain a plurality of units to be identified; the unit to be identified is English or Pinyin;
the statistics unit is used for sequentially inputting the plurality of units to be identified into a preset translation script and counting the times of outputting Chinese by the preset translation script; the preset translation script is used for translating English into Chinese;
the judging unit is used for judging whether the target ratio is larger than or equal to a preset ratio; the target ratio is the ratio between the number of times of outputting Chinese by the preset translation script and the total number of units to be identified;
the first marking unit is used for marking the content to be identified as English when the judging unit judges that the target ratio is larger than or equal to the preset ratio; and when the judging unit judges that the target ratio is smaller than the preset ratio, marking the content to be identified as pinyin.
7. The electronic device of claim 6, wherein the statistics unit comprises:
a judging subunit, configured to judge whether a target unit containing a tone symbol exists in the plurality of units to be identified;
the input subunit is used for inputting the plurality of units to be identified into a preset translation script in sequence when the judging subunit judges that the target unit does not exist in the plurality of units to be identified; when the judging subunit judges that the target unit exists in the plurality of units to be identified, the other units except the target unit in the plurality of units to be identified are sequentially input with a preset translation script;
and the statistics subunit is used for counting the times of outputting Chinese by the preset translation script.
8. The electronic device of claim 7, wherein the electronic device further comprises:
the second obtaining unit is used for obtaining a correct answer corresponding to the content to be identified after the first marking unit marks the content to be identified as pinyin;
the correcting unit is used for correcting the content to be identified according to the correct answer;
a third obtaining unit, configured to determine pinyin corresponding to a target tone symbol when the target tone symbol is in error, and obtain target text corresponding to the pinyin; wherein the target tone symbol is a tone symbol contained in the content to be identified;
The second marking unit is used for marking the target characters as phonetic transcription error classes;
and the output unit is used for outputting the correct phonetic notation information of the target characters.
9. The electronic device of claim 8, wherein the electronic device further comprises:
the graphic generation unit is used for generating a pinyin graphic of the tone to be complemented according to the characters marked as the ZhuYin error type when entering the unlocking page;
the first display unit is used for displaying the characters marked as the ZhuYin error type and the pinyin graph of the tone to be complemented on the unlocking page;
the detecting unit is used for detecting whether the tone symbol input by the user is positioned above the correct character in the Pinyin graph and whether the tone symbol input by the user is correct;
and the unlocking unit is used for unlocking when the tone symbol input by the user is positioned above the correct character in the Pinyin graph and the tone symbol input by the user is correct.
10. The electronic device according to any one of claims 6 to 9, characterized in that the electronic device further comprises:
a determining unit, configured to determine target learning content according to the marked content to be identified;
A control unit for starting an application program associated with the target learning content and closing an application program not associated with the target learning content;
and the second display unit is used for displaying the target learning content in the opened application program.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910453238.2A CN111079489B (en) | 2019-05-28 | 2019-05-28 | Content identification method and electronic equipment |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910453238.2A CN111079489B (en) | 2019-05-28 | 2019-05-28 | Content identification method and electronic equipment |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN111079489A CN111079489A (en) | 2020-04-28 |
| CN111079489B true CN111079489B (en) | 2023-04-28 |
Family
ID=70310345
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201910453238.2A Active CN111079489B (en) | 2019-05-28 | 2019-05-28 | Content identification method and electronic equipment |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN111079489B (en) |
Families Citing this family (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN112085090A (en) * | 2020-09-07 | 2020-12-15 | 百度在线网络技术（北京）有限公司 | Translation method and device and electronic equipment |
| CN112949381A (en) * | 2021-01-20 | 2021-06-11 | 涂益浪 | Image content identification method and system |
Citations (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101615180A (en) * | 2008-06-27 | 2009-12-30 | 国际商业机器公司 | Chinese phonetic alphabet recognition methods and device |
| CN103092838A (en) * | 2011-10-28 | 2013-05-08 | 腾讯科技（深圳）有限公司 | Method and device for obtaining English words |
| CN103745214A (en) * | 2014-01-08 | 2014-04-23 | 广东小天才科技有限公司 | Character identification method and identification equipment |
| CN107957994A (en) * | 2017-10-30 | 2018-04-24 | 努比亚技术有限公司 | A kind of interpretation method, terminal and computer-readable recording medium |
| CN109147769A (en) * | 2018-10-17 | 2019-01-04 | 北京猎户星空科技有限公司 | A kind of Language Identification, device, translator, medium and equipment |
| CN109190630A (en) * | 2018-08-29 | 2019-01-11 | 摩佰尔（天津）大数据科技有限公司 | Character identifying method |
| CN109545015A (en) * | 2019-01-23 | 2019-03-29 | 广东小天才科技有限公司 | A kind of recognition methods and private tutor's equipment of subject type |
| CN109766885A (en) * | 2018-12-29 | 2019-05-17 | 北京旷视科技有限公司 | A kind of character detecting method, device, electronic equipment and storage medium |
Family Cites Families (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20050010391A1 (en) * | 2003-07-10 | 2005-01-13 | International Business Machines Corporation | Chinese character / Pin Yin / English translator |
| US8965129B2 (en) * | 2013-03-15 | 2015-02-24 | Translate Abroad, Inc. | Systems and methods for determining and displaying multi-line foreign language translations in real time on mobile devices |
-
2019
- 2019-05-28 CN CN201910453238.2A patent/CN111079489B/en active Active
Patent Citations (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101615180A (en) * | 2008-06-27 | 2009-12-30 | 国际商业机器公司 | Chinese phonetic alphabet recognition methods and device |
| CN103092838A (en) * | 2011-10-28 | 2013-05-08 | 腾讯科技（深圳）有限公司 | Method and device for obtaining English words |
| CN103745214A (en) * | 2014-01-08 | 2014-04-23 | 广东小天才科技有限公司 | Character identification method and identification equipment |
| CN107957994A (en) * | 2017-10-30 | 2018-04-24 | 努比亚技术有限公司 | A kind of interpretation method, terminal and computer-readable recording medium |
| CN109190630A (en) * | 2018-08-29 | 2019-01-11 | 摩佰尔（天津）大数据科技有限公司 | Character identifying method |
| CN109147769A (en) * | 2018-10-17 | 2019-01-04 | 北京猎户星空科技有限公司 | A kind of Language Identification, device, translator, medium and equipment |
| CN109766885A (en) * | 2018-12-29 | 2019-05-17 | 北京旷视科技有限公司 | A kind of character detecting method, device, electronic equipment and storage medium |
| CN109545015A (en) * | 2019-01-23 | 2019-03-29 | 广东小天才科技有限公司 | A kind of recognition methods and private tutor's equipment of subject type |
Also Published As
| Publication number | Publication date |
|---|---|
| CN111079489A (en) | 2020-04-28 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN109817046B (en) | Learning auxiliary method based on family education equipment and family education equipment | |
| US10963760B2 (en) | Method and apparatus for processing information | |
| CN110348400B (en) | Score obtaining method and device and electronic equipment | |
| WO2016041423A1 (en) | Intelligent scoring method and system for text objective question | |
| CN111581367A (en) | Method and system for inputting questions | |
| CN111079489B (en) | Content identification method and electronic equipment | |
| JP6425493B2 (en) | Program, apparatus and method for estimating evaluation level for learning item based on human speech | |
| CN112149680A (en) | Wrong word detection and identification method and device, electronic equipment and storage medium | |
| Hwang et al. | A spelling based CAPTCHA system by using click | |
| CN109614623A (en) | A kind of composition processing method and system based on syntactic analysis | |
| CN111079501A (en) | Character recognition method and electronic equipment | |
| CN111026786A (en) | Dictation list generation method and family education equipment | |
| CN112163513A (en) | Information selection method, system, device, electronic equipment and storage medium | |
| US10971148B2 (en) | Information providing device, information providing method, and recording medium for presenting words extracted from different word groups | |
| CN112567440A (en) | Information processing apparatus, information processing method, and program | |
| CN111079504A (en) | Character recognition method and electronic equipment | |
| CN111091120B (en) | Dictation correction method and electronic equipment | |
| CN114297372A (en) | Personalized note generation method and system | |
| CN112307748A (en) | Method and device for processing text | |
| Mollá et al. | Named entity recognition in question answering of speech data | |
| CN109582971B (en) | Correction method and correction system based on syntactic analysis | |
| CN111079486A (en) | Method for starting dictation detection and electronic equipment | |
| CN111160347B (en) | Text recognition method based on similar character recognition and electronic equipment | |
| US11935425B2 (en) | Electronic device, pronunciation learning method, server apparatus, pronunciation learning processing system, and storage medium | |
| Marciano et al. | Japanese CALL web tools: identifying and evaluating their multimedia behaviour in android OS |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |