CN110209280B - Response method, response device and storage medium - Google Patents
Response method, response device and storage medium Download PDFInfo
- Publication number
- CN110209280B CN110209280B CN201910484868.6A CN201910484868A CN110209280B CN 110209280 B CN110209280 B CN 110209280B CN 201910484868 A CN201910484868 A CN 201910484868A CN 110209280 B CN110209280 B CN 110209280B
- Authority
- CN
- China
- Prior art keywords
- image data
- data
- paper
- information
- response
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F18/00—Pattern recognition
- G06F18/20—Analysing
- G06F18/21—Design or setup of recognition systems or techniques; Extraction of features in feature space; Blind source separation
- G06F18/214—Generating training patterns; Bootstrap methods, e.g. bagging or boosting
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
- G06F3/0487—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V30/00—Character recognition; Recognising digital ink; Document-oriented image-based pattern recognition
- G06V30/10—Character recognition
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- General Engineering & Computer Science (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Human Computer Interaction (AREA)
- Data Mining & Analysis (AREA)
- Artificial Intelligence (AREA)
- Life Sciences & Earth Sciences (AREA)
- Bioinformatics & Cheminformatics (AREA)
- Bioinformatics & Computational Biology (AREA)
- Computer Vision & Pattern Recognition (AREA)
- Evolutionary Biology (AREA)
- Evolutionary Computation (AREA)
- Controls And Circuits For Display Device (AREA)
- Character Input (AREA)
Abstract
The embodiment of the invention relates to the field of data processing, and discloses a response method, a response device and a storage medium. In some embodiments of the present application, the response method includes: acquiring and projecting data to be responded; acquiring first image data of the paper after detecting the end signal; and determining first response data of the data to be responded according to the first image data. In the implementation, the demand of answering on paper by a user is met, and a semi-electronic answering mode is realized.
Description
Technical Field
The embodiment of the invention relates to the field of data processing, in particular to a response method, a response device and a storage medium.
Background
Most current mobile devices are provided with a capacitive handwriting screen, and a user can directly write on the screen by hands. For more detailed writing, a thin-head capacitor pen can be used for writing, such as some current mobile phones or tablet products.
However, the inventors found that at least the following problems exist in the prior art: however, the hand feel of writing on a screen is far from that of writing on paper. For the requirement of writing in large quantity, such as writing a paper, the touch screen of the electronic product is a very painful thing.
It is to be noted that the information disclosed in the above background section is only for enhancement of understanding of the background of the present disclosure, and thus may include information that does not constitute prior art known to those of ordinary skill in the art.
Disclosure of Invention
An object of embodiments of the present invention is to provide a response method, a response apparatus, and a storage medium, which can meet the demand of a user for responding on paper and implement a semi-electronic response mode.
In order to solve the above technical problem, an embodiment of the present invention provides a response method, including the following steps: acquiring and projecting data to be responded; after detecting the end signal, acquiring first image data of the paper; and determining first response data of the data to be responded according to the first image data.
An embodiment of the present invention also provides a response apparatus, including: the device comprises a projection module, a shooting module and a processing module; the projection module is used for acquiring and projecting data to be responded; the shooting module is used for acquiring first image data of the paper after receiving the end signal; the processing module is used for determining first response data of the data to be responded according to the first image data.
An embodiment of the present invention also provides a response apparatus, including: at least one processor; and a memory communicatively coupled to the at least one processor; wherein the memory stores instructions executable by the at least one processor, the instructions being executable by the at least one processor to enable the at least one processor to perform the answering method mentioned in the above embodiments.
Embodiments of the present invention further provide a computer-readable storage medium, which stores a computer program, and when the computer program is executed by a processor, the computer program implements the answering method mentioned in the above embodiments.
Compared with the prior art, the answering device projects the questions to be answered to the user in a projection mode, determines answers written by the user based on the questions to be answered by acquiring image data of paper, and generates response data of electronic data to be answered, so that the user can answer through the paper without answering through an electronic screen, the answering device meets the requirements of answering on the paper and electronizing the content of the answering on the paper.
In addition, before projecting the data to be responded, the responding method further comprises the following steps: projecting an image of the paper positioning frame; the paper positioning frame is used for indicating an effective placement area of the paper. In the implementation, the condition that the user places the paper in the area where the answering device cannot collect the image is reduced, and the probability that the answering device successfully collects the first image data of the paper is improved.
In addition, before projecting the data to be responded, the responding method further comprises the following steps: acquiring information of paper; the information of the paper includes size information of the paper, and/or position information of the paper; determining an effective projection area according to the information of the paper; the projection of the data to be responded specifically comprises the following steps: and projecting the data to be responded to the effective projection area. In this implementation, it is convenient for the user to view the data to be answered.
In addition, according to the first image data, determining first response data of the data to be responded specifically comprises: inputting the first image data into a character recognition model, and determining character information of the first image data, wherein the character information comprises characters contained in the first image data; and determining the first response data according to the character information of the first image data. In the implementation, a data basis is provided for subsequent operations of selectively performing mechanical paper marking, reading the first response data aloud, changing character fonts in the first image data and the like.
In addition, inputting the first image data into the character recognition model, and determining the character information of the first image data specifically includes: inputting the first image data into a character recognition model to obtain a predicted character of the first image data; displaying the predicted characters in the first image data; and if the correction information is determined to be received, determining the character information of the first image data according to the correction information and the predicted characters of the first image data. In this implementation, the accuracy of the text information is improved.
In addition, after the character information of the first image data is determined based on the correction information and the predicted character of the first image data, the response method further includes: storing the first image data and the text information of the first image data to a training data set; and after the training data set is determined to accord with the preset training condition, the first image data is used as input data of the character recognition model, character information of the first image data is used as output data of the training data set, and the character recognition model is trained again. In the implementation, the updated character recognition model can more accurately recognize the font written by the user.
In addition, determining the first response data according to the characters contained in the first image data specifically includes: acquiring a target font type; setting a font type of a character contained in the first image data as a target font type; generating second image data according to characters contained in the first image data with the font type as the target font type; the second image data is used as the first response data. In the realization, the user can carry out personalized design according to self hobby, converts the characters written by the user into the favorite fonts, and improves the user experience.
In addition, acquiring first image data of the paper specifically includes: controlling a shooting module to shoot third image data, wherein the third image data comprises first image data and background image data; and cutting the third image data to obtain first image data. In this implementation, the interference information in the background image is reduced.
In addition, after determining the first answering data of the data to be answered according to the first image data, the answering method further comprises the following steps: and after the first response data are determined to meet the preset requirements, storing the first response data to a storage module. In this realization, save first answer data, be convenient for the later stage and look up first answer data.
In addition, save first answer data to the storage module, specifically include: judging whether second response data of the data to be responded exist in the stored response data; and if so, replacing the second response data with the first response data.
In addition, the acquiring of the data to be responded specifically includes: acquiring a document to be responded, wherein the document to be responded comprises N pages, and N is a positive integer; determining a page to be responded according to the document to be responded; the page to be responded comprises a page and a page identifier; and taking the page to be responded as data to be responded.
In addition, after determining the first answering data of the data to be answered according to the first image data, the answering method further comprises the following steps: and controlling the display module to display any one or any combination of the first response data of the responded page, the unresponsive page, the identification of the responded page and the identification of the unresponsive page. In the implementation, the user can conveniently know the completion progress of the document to be responded in time.
In addition, after the document to be responded is obtained, the responding method further comprises the following steps: acquiring operation information of a user, wherein the operation information indicates a pre-displayed page to be responded; and controlling a display module to display the pre-displayed page to be answered. In the implementation, the user can conveniently manage the document to be responded and the response data.
Drawings
One or more embodiments are illustrated by way of example in the accompanying drawings, which correspond to the figures in which like reference numerals refer to similar elements and which are not to scale unless otherwise specified.
Fig. 1 is a flowchart of a response method of a first embodiment of the present invention;
fig. 2 is a flowchart of a response method of a second embodiment of the present invention;
fig. 3 is a schematic structural view of a transponder according to a third embodiment of the present invention;
fig. 4 is another schematic structural view of a transponder according to a third embodiment of the present invention;
fig. 5 is a schematic configuration diagram of a transponder according to a fourth embodiment of the present invention.
Detailed Description
To make the objects, technical solutions and advantages of the embodiments of the present invention more apparent, embodiments of the present invention will be described in detail below with reference to the accompanying drawings. However, it will be appreciated by those of ordinary skill in the art that numerous technical details are set forth in order to provide a better understanding of the present application in various embodiments of the present invention. However, the technical solution claimed in the present application can be implemented without these technical details and various changes and modifications based on the following embodiments.
A first embodiment of the present invention relates to a response method applied to a response device. As shown in fig. 1, the answering method includes the following steps:
step 101: and acquiring and projecting data to be responded.
Specifically, the response device may obtain the data to be responded in any manner such as a wired or wireless network, a data line connection, or a flash disk, or the response device may obtain the document to be responded in any manner, and determine the data to be responded based on the document to be responded. After acquiring the data to be responded, the responding device projects the data to be responded so that the user can write the responding content on paper according to the data to be responded.
In one example, a response device acquires a document to be responded, wherein the document to be responded comprises N pages, and N is a positive integer; determining a page to be responded according to the document to be responded; the page to be responded comprises a page and a page identifier; and taking the page to be responded as data to be responded. For example, the document to be responded is a paged electronic document of the homework questions, the responding device adds the identifier "i" of the page to the ith page from the first page according to the sequence of the pages in the electronic document of the homework questions, the page with the added identifier is used as the data to be responded, and after the response is finished, the data to be responded in the next responding process is determined according to the (i + 1) th page.
In one example, the answering device projects an image of the paper positioning frame before projecting the data to be answered; the paper positioning frame is used for indicating an effective placement area of the paper.
It is worth mentioning that the effective placement area of the paper is informed to the user in a mode of projecting the image of the paper positioning frame, so that the situation that the user places the paper in the area where the answering device cannot collect the image can be reduced, and the probability that the answering device successfully collects the first image data of the paper is improved.
In one example, the answering device acquires information of paper before projecting the data to be answered; the information of the paper includes size information of the paper, and/or position information of the paper; determining an effective projection area according to the information of the paper; and in the process of projecting the data to be responded, the responding device projects the data to be responded to the effective projection area.
For example, the answering device projects a paper positioning frame; after the paper positioning frame is placed in the paper positioning frame is detected, automatically starting a shooting module, or starting the shooting module after a shooting button is detected to be pressed; shooting an image containing paper and a paper positioning frame through a shooting module; determining relative position information and relative size information of the paper and the paper positioning frame according to the image; the electronic device determines the position information of the paper according to the relative position information and the position information of the paper positioning frame, and determines the size information of the paper according to the relative size information and the size information of the paper positioning frame.
It should be noted that, as can be understood by those skilled in the art, the effective projection area may be an area where the paper is located, or may be a peripheral area of the area where the paper is located, such as an upper area of the area where the paper is located.
It is worth mentioning that when the effective projection area is in the area of the paper, when the first image data is shot, the questions in the data to be responded and the response contents written by the user for the questions can be shot on one image in a one-to-one correspondence manner, so that the subsequent reading is facilitated, the user does not need to copy the questions, and the unnecessary workload is reduced.
It is worth mentioning that the effective projection area is determined according to the information of the paper, so that the user can conveniently view the data to be responded.
In one example, the response device comprises a display module, and after acquiring the document to be responded, the response device acquires operation information of a user, wherein the operation information indicates a pre-displayed page to be responded; and controlling a display module to display the pre-displayed page to be answered.
Step 102: after detecting the end signal, first image data of the paper is acquired.
Specifically, the responding device can control the shooting module to shoot third image data after detecting the end signal, wherein the third image data comprises the first image data and the background image data; and cutting the third image data to obtain first image data.
It is worth mentioning that after the third image data is cut, the interference information in the background image is reduced.
In one example, the answering device is provided with an end button, or the answering device is in communication with the end button, and generates an end signal after the end button is pressed, and the answering device acquires the first image data after detecting the end signal.
In another example, the answering device monitors the content on the paper through the shooting module, and generates an end signal to acquire the first image data if the end mark on the paper is monitored.
Step 103: and determining first response data of the data to be responded according to the first image data.
Specifically, the user can compose the response content on paper based on the data to be responded. The answering device can determine first answering data of the user aiming at the data to be answered according to the first image data of the paper.
In one example, the answering device determines the first answer data in the following manner: the response device inputs the first image data into the character recognition model, and determines character information of the first image data, wherein the character information comprises characters contained in the first image data; and determining the first response data according to the character information of the first image data.
It is worth mentioning that the character of the first image data is recognized through the character recognition model, and a data basis is provided for subsequent operations of selectively mechanically reading the paper, reading the first response data, changing the character font in the first image data and the like.
In one example, the process of the response device determining the first response data according to the characters contained in the first image data is as follows: the response device acquires a target font type; setting a font type of a character contained in the first image data as a target font type; generating second image data according to characters contained in the first image data with the font type as the target font type; the second image data is used as the first response data.
It is worth mentioning that, because the answering device can convert the font type of the characters contained in the first image data into the target font type, the user can perform personalized design according to the preference of the user, and convert the characters written by the user into the preferred font of the user, thereby improving the user experience.
It should be noted that, in practical applications, after the characters included in the first image data are recognized, different operations may be performed according to needs of a user to obtain different response data, for example, the response device may also generate an audio file of the first image data according to the characters included in the first image data and a phonetic notation file, and use the audio file as the first response data, where the phonetic notation file includes pronunciation information of M characters. The present embodiment does not limit the manner in which the response means determines the first response data from the first image data, and the form of the first response data.
In one example, the response device may input the first image data into the character recognition model to obtain the predicted character of the first image data, and then display the predicted character of the first image data, because the character recognition model may have a false recognition or a missing recognition. The user views the displayed predicted characters, inputs correction information if the condition of false recognition or missing recognition exists, and confirms that the recognition is correct if the condition does not exist. If the response device determines that the correction information is received, the response device determines character information of the first image data according to the correction information and the predicted characters of the first image data. Specifically, the response device replaces the predicted character with the incorrect prediction with the correct character, adds the character with the incorrect prediction, and composes the character information of the first image data from the unmodified predicted character, the modified predicted character, and the added character.
It is worth mentioning that the predicted characters are corrected according to the correction information, so that the accuracy of the character information is improved.
In one example, since each person has different habits of writing the same text, in order to improve the accuracy of the text recognition model and make the text recognition model more suitable for the user using the response device, the response device may store the first image data and the text information of the first image data into the training data set after determining the text information of the first image data according to the correction information and the predicted text of the first image data; and after the training data set is determined to meet the preset training conditions, the first image data is used as input data of the character recognition model, character information of the first image data is used as output data of the training data set, and the character recognition model is trained again.
In one example, the training data set may include not only the first image data and text information of the first image data generated during use of the responder device, but also some predicted training data.
It should be noted that, as can be understood by those skilled in the art, the preset training condition may be that the data amount of the training data set is greater than a preset value, and the preset value may be set according to needs, for example, set to 1000M, and the specific content of the training condition is not limited in this embodiment.
It is worth mentioning that the character recognition model is updated according to the first image data and the character information of the first image data generated in the using process of the user, so that the updated character recognition model can more accurately recognize the font written by the user.
In one example, the data to be answered is a page to be answered. And after determining the first response data, the response device controls the display module to display any one or any combination of the responded page, the unresponsive page, the identification of the responded page and the identification of the unresponsive page.
Suppose that the document to be answered includes 10 pages, of which the 1 st page and the 2 nd page have been projected and corresponding first answer data has been captured. The response device can divide the display area of the display module into 2 parts, one part displays the first response data of the 1 st page, and the other part displays the first response data of the 2 nd page. Alternatively, the responding device can divide the display area of the display module into 8 parts, and respectively display the 3 rd page and the 4 th page … … as the 10 th page. Or, the responding device may divide the display area of the display module into 10 parts, and respectively display the first responding data of the 1 st page, the first responding data of the 2 nd page, the 3 rd page, and the 4 th page … … and the 10 th page. Alternatively, the response means controls the display module to display "1" and "2". Selectively, if the user is detected to select 1, the display module is controlled to display the first response data of the 1 st page, and if the user is detected to select 2, the display module is controlled to display the first response data of the 2 nd page. Alternatively, the response device controls the display module to display "3" and "4" … … "10".
The above description is only for illustrative purposes and does not limit the technical aspects of the present invention.
Compared with the prior art, in the response method provided in this embodiment, the response device may project the problem to be responded to the user in a projection manner, determine the answer written by the user based on the problem to be responded by acquiring the image data of the paper, and generate the response data of the electronic data to be responded, so that the user can respond through the paper without responding through an electronic screen, thereby satisfying the requirement of the user to respond on the paper and electronize the content answered on the paper.
A second embodiment of the present invention relates to a response method. The embodiment is further improved on the basis of the first embodiment, and the specific improvements are as follows: after the first response data of the data to be responded is determined according to the first image data, other relevant steps are added.
Specifically, as shown in fig. 2, the present embodiment includes steps 201 to 204, wherein steps 201 to 203 are substantially the same as steps 101 to 103 in the first embodiment, and are not repeated herein. The following mainly introduces the differences:
step 201: and acquiring and projecting data to be responded.
Step 202: after detecting the end signal, first image data of the paper is acquired.
Step 203: and determining first response data of the data to be responded according to the first image data.
Step 204: and after the first response data are determined to meet the preset requirements, storing the first response data in a storage module.
Specifically, the storage module may be a storage module of the answering machine, a storage module of another device that establishes a communication connection with the answering machine, or the like. And when the first data meets the requirement, the response device stores the first response data locally or sends the first response data to other equipment.
It should be noted that, as can be understood by those skilled in the art, the preset requirement may be set according to a need, for example, the type of the first response data is an image, the preset requirement may be any one or a combination of the requirements that the light reflection rate of the first response data is smaller than the first threshold, the font in the first response data is not blocked, and the like, and the specific content of the preset requirement is not limited in this embodiment.
In one example, whether second response data of the data to be responded exist in the saved response data is judged; and if so, replacing the second response data with the first response data.
The following takes the job title electronic file with the data to be responded as pages as an example, and the responding method is exemplified.
Specifically, the whole response flow comprises the following steps:
step 211: the user clicks the start button, and the answering device acquires the paged homework electronic files. The paging subject electronic file can be obtained by any mode such as a wired or wireless network, a data line or a USB flash disk, and can also be obtained before a user presses a key.
Step 212: the answering device controls the projection module to project the paper positioning frame on the desktop.
Step 213: the user puts the paper into the paper positioning frame.
Optionally, if the size of the paper is not consistent with the size of the projected paper positioning frame, the device may control the shooting module (e.g., a camera) to collect the area of the paper (automatically start the camera or manually start the camera by pressing a button by a user), and further zoom the paper positioning frame to the size of the paper. The user can move the paper into the zoomed paper positioning frame.
Step 214: the response device projects the content of the current page of the job question electronic file to the internal area of the paper positioning frame.
Optionally, the answering device controls the projection module to project an identifier of the current page, for example, the page number of the current page, and the user can mark the page number on paper with a pen, so that the user can quickly find corresponding paper when the user needs to modify the title of the previous page.
Step 215: the user writes an answer in a blank area below the projected question on the paper.
Step 216: after the user writes the question on the page, the user can manually press the end button and can also write an end mark on the paper to inform the answering device that the user finishes answering. For example, the user may draw a five-pointed star in the upper right corner of the page, draw a circle outside the page, etc., to cause the answering device to obtain an end signal.
Step 217: after the answering device captures the end signal, the shooting module is controlled to shoot an image, the shot image is cut, a paper part in the paper positioning frame is cut, and the cut image of the paper part is used as first answering data. If the first response data is qualified, for example, the non-text part is not blocked, the article does not reflect light, and the like, the first response data is sent to the target address; alternatively, stored locally; or, alternatively, to a specific storage medium.
Optionally, the response device prompts the user that the response data of the page is correctly submitted after the submission is completed. If the page is submitted before being shot, the original submitted page is covered; and if all the job pages are submitted, prompting the user and ending the process.
Optionally, the answering device is provided with a display module, such as a screen, and can display both pages that have been currently rendered and pages that have not been rendered.
Alternatively, the user can manually switch the upper and lower pages by operating the display module. If the page is switched to the page that has not been answered, the process may return to step 212 for a new round of answering.
As can be seen from the above, the response method provided in this embodiment can achieve the purpose of electronizing response data without writing on a touch panel by a user while maintaining convenience. And the user experience is greatly improved at lower cost.
The above description is only for illustrative purposes and does not limit the technical aspects of the present invention.
Compared with the prior art, in the response method provided in this embodiment, the response device may project the problem to be responded to the user in a projection manner, determine the answer written by the user based on the problem to be responded by acquiring the image data of the paper, and generate the response data of the electronic data to be responded, so that the user can respond through the paper without responding through an electronic screen, thereby satisfying the requirement of the user to respond on the paper and electronize the content answered on the paper. In addition, the response device stores the first response data, so that the user can look up and modify the first response data in the later period conveniently.
The steps of the above methods are divided for clarity, and the implementation may be combined into one step or split some steps, and the steps are divided into multiple steps, so long as the same logical relationship is included, which are all within the protection scope of the present patent; it is within the scope of the patent to add insignificant modifications to the algorithms or processes or to introduce insignificant design changes to the core design without changing the algorithms or processes.
A third embodiment of the present invention relates to a response device, as shown in fig. 3, including: a projection module 301, a shooting module 302 and a processing module 303; the projection module 301 is configured to acquire and project data to be responded; the shooting module 302 is configured to obtain first image data of a paper after receiving the end signal; the processing module 303 is configured to determine first response data of the data to be responded according to the first image data.
In one example, the transponder device is configured as shown in fig. 4, and is similar in form to a desk lamp. Optionally, the answering device is further provided with a display module 304 for displaying various data such as the data to be answered, the first answering data, etc.
In one example, before projecting the data to be responded, the method further comprises the following steps: projecting an image of the paper positioning frame; the paper positioning frame is used for indicating an effective placement area of the paper.
In one example, before projecting the data to be responded, the method further comprises the following steps: acquiring information of paper; the information of the paper includes size information of the paper, and/or position information of the paper; determining an effective projection area according to the information of the paper; the projection of the data to be responded specifically comprises the following steps: and projecting the data to be responded to the effective projection area.
In one example, determining first response data of the data to be responded according to the first image data specifically includes: inputting the first image data into a character recognition model, and determining character information of the first image data, wherein the character information comprises characters contained in the first image data; and determining the first response data according to the character information of the first image data.
In one example, when the first image data is input into the character recognition model, the determining the character information of the first image data specifically includes: inputting the first image data into a character recognition model to obtain a predicted character of the first image data; displaying the predicted characters of the first image data; and if the correction information is determined to be received, determining character information of the first image data according to the correction information and the predicted characters of the first image data.
In one example, after determining the text information of the first image data based on the correction information and the predicted text of the first image data, the method further includes: storing the first image data and the text information of the first image data to a training data set; and after the training data set is determined to meet the preset training conditions, the first image data is used as input data of the character recognition model, character information of the first image data is used as output data of the training data set, and the character recognition model is trained again.
In one example, determining the first response data according to the text included in the first image data specifically includes: acquiring a target font type; setting a font type of a character contained in the first image data as a target font type; generating second image data according to characters contained in the first image data with the font type as the target font type; the second image data is used as the first response data.
In one example, acquiring first image data of a sheet specifically includes: controlling a shooting module to shoot third image data, wherein the third image data comprises first image data and background image data; and cutting the third image data to obtain first image data.
In one example, after determining the first response data of the data to be responded according to the first image data, the method further includes: and after the first response data are determined to meet the preset requirements, storing the first response data in a storage module.
In one example, the storing the first response data in the storage module specifically includes: judging whether second response data of the data to be responded exist in the stored response data; and if so, replacing the second response data with the first response data.
In one example, the acquiring data to be responded specifically includes: acquiring a document to be responded, wherein the document to be responded comprises N pages, and N is a positive integer; determining a page to be responded according to the document to be responded; the page to be responded comprises a page and a page identifier; and taking the page to be responded as data to be responded.
In one example, after determining the first response data of the data to be responded according to the first image data, the method further includes: and controlling the display module to display any one or any combination of the first response data of the responded page, the unresponsive page, the identification of the responded page and the identification of the unresponsive page.
In one example, after obtaining the document to be answered, the method further includes: acquiring operation information of a user, wherein the operation information indicates a pre-displayed page to be responded; and controlling a display module to display the pre-displayed page to be answered.
It should be understood that this embodiment is a system example corresponding to the first embodiment, and may be implemented in cooperation with the first embodiment. The related technical details mentioned in the first embodiment are still valid in this embodiment, and are not described herein again in order to reduce repetition. Accordingly, the related-art details mentioned in the present embodiment can also be applied to the first embodiment.
It should be noted that each module referred to in this embodiment is a logical module, and in practical applications, one logical unit may be one physical unit, may be a part of one physical unit, and may be implemented by a combination of multiple physical units. In addition, in order to highlight the innovative part of the present invention, elements that are not so closely related to solving the technical problems proposed by the present invention are not introduced in the present embodiment, but this does not indicate that other elements are not present in the present embodiment.
A fourth embodiment of the present invention relates to a response device, as shown in fig. 5, including: at least one processor 501; and a memory 502 communicatively coupled to the at least one processor 501; the memory 502 stores instructions executable by the at least one processor 501, and the instructions are executed by the at least one processor 501, so that the at least one processor 501 can execute the response method according to the above embodiments.
The answering device comprises: one or more processors 501 and a memory 502, with one processor 501 being an example in fig. 5. The processor 501 and the memory 502 may be connected by a bus or other means, and fig. 5 illustrates the connection by the bus as an example. The memory 502, which is a non-volatile computer-readable storage medium, may be used to store non-volatile software programs, non-volatile computer-executable programs, and modules. The processor 501 executes various functional applications of the device and data processing by executing nonvolatile software programs, instructions, and modules stored in the memory 502, that is, implements the above-described answering method.
The memory 502 may include a storage program area and a storage data area, wherein the storage program area may store an operating system, an application program required for at least one function; the storage data area may store a list of options, etc. Further, the memory 502 may include high speed random access memory, and may also include non-volatile memory, such as at least one magnetic disk storage device, flash memory device, or other non-volatile solid state storage device. In some embodiments, memory 502 may optionally include memory located remotely from processor 501, which may be connected to an external device via a network. Examples of such networks include, but are not limited to, the internet, intranets, local area networks, mobile communication networks, and combinations thereof.
One or more modules are stored in the memory 502 and when executed by the one or more processors 501 perform the answering method of any of the method embodiments described above.
The product can execute the method provided by the embodiment of the application, has corresponding functional modules and beneficial effects of the execution method, and can refer to the method provided by the embodiment of the application without detailed technical details in the embodiment.
A fifth embodiment of the present invention relates to a computer-readable storage medium storing a computer program. The computer program realizes the above-described method embodiments when executed by a processor.
That is, as can be understood by those skilled in the art, all or part of the steps in the method for implementing the embodiments described above may be implemented by a program instructing related hardware, where the program is stored in a storage medium and includes several instructions to enable a device (which may be a single chip, a chip, or the like) or a processor (processor) to execute all or part of the steps of the method described in the embodiments of the present application. And the aforementioned storage medium includes: a U-disk, a removable hard disk, a Read-Only Memory (ROM), a Random Access Memory (RAM), a magnetic disk, or an optical disk, and various media capable of storing program codes.
It will be understood by those of ordinary skill in the art that the foregoing embodiments are specific examples for carrying out the invention, and that various changes in form and details may be made therein without departing from the spirit and scope of the invention in practice.
Claims (11)
1. A method of responding, comprising:
projecting an image of the paper positioning frame; the paper positioning frame is used for indicating an effective placement area of paper;
when the size of the paper is detected to be inconsistent with the size of the projected paper positioning frame, acquiring the information of the paper; the information of the paper includes size information of the paper and/or position information of the paper;
zooming a paper positioning frame to the size same as the paper size according to the paper information;
determining an effective projection area according to the information of the paper;
acquiring data to be responded and projecting the data to be responded to the effective projection area;
after detecting the end signal, acquiring first image data of the paper;
inputting the first image data into a character recognition model to obtain a predicted character of the first image data;
displaying a predicted text of the first image data;
if the correction information is determined to be received, determining character information of the first image data according to the correction information and the predicted characters; the text information includes text included in the first image data;
determining first response data according to the character information of the first image data;
after determining the text information of the first image data according to the correction information and the predicted text of the first image data, the response method further comprises:
storing the first image data and the text information of the first image data to a training data set;
after the training data set is determined to meet the preset training conditions, the first image data is used as input data of the character recognition model, character information of the first image data is used as output data of the training data set, and the character recognition model is trained again; wherein the text information of the first image data includes: the predicted character of the first image data, the character information of the first image data, and the correction information.
2. The response method according to claim 1, wherein the determining the first response data according to the text included in the first image data specifically includes:
acquiring a target font type;
setting a font type of a character contained in the first image data as the target font type;
generating second image data according to characters contained in the first image data with the font type being the target font type;
and taking the second image data as the first response data.
3. The response method according to any one of claims 1 to 2, wherein the acquiring first image data of a sheet specifically comprises:
controlling a shooting module to shoot third image data, wherein the third image data comprises the first image data and background image data;
and cutting the third image data to obtain the first image data.
4. The response method according to any one of claims 1 to 2, wherein after said determining the first response data from the text information of the first image data, the response method further comprises:
and after the first response data are determined to meet the preset requirements, storing the first response data in a storage module.
5. The response method according to claim 4, wherein the saving the first response data to a storage module specifically includes:
judging whether second response data of the data to be responded exist in the stored response data or not;
and if so, replacing the second response data with the first response data.
6. The response method according to any one of claims 1 to 2, wherein acquiring the data to be responded specifically comprises:
acquiring a document to be responded, wherein the document to be responded comprises N pages, and N is a positive integer;
determining a page to be responded according to the document to be responded; the page to be responded comprises the page and the identification of the page;
and taking the page to be responded as the data to be responded.
7. The response method according to claim 6, wherein after said determining the first response data based on the text information of the first image data, the response method further comprises:
and controlling a display module to display any one or any combination of the first response data of the responded page, the page which is not responded, the identification of the responded page and the identification of the page which is not responded.
8. The answering method according to claim 6, wherein after said obtaining the document to answer, the answering method further comprises:
acquiring operation information of a user, wherein the operation information indicates a pre-displayed page to be responded;
and controlling a display module to display the pre-displayed page to be responded.
9. A transponder apparatus, comprising: the device comprises a projection module, a shooting module and a processing module;
the projection module is used for projecting an image of the paper positioning frame; the paper positioning frame is used for indicating an effective placement area of paper; when the size of the paper is detected to be inconsistent with the size of the projected paper positioning frame, acquiring the information of the paper; the information of the paper comprises size information of the paper and/or position information of the paper; zooming a paper positioning frame to the size same as the paper size according to the paper information; determining an effective projection area according to the information of the paper; acquiring data to be responded and projecting the data to be responded to the effective projection area;
the shooting module is used for acquiring first image data of the paper after receiving the end signal;
the processing module is used for inputting the first image data into a character recognition model to obtain a predicted character of the first image data; displaying a predicted text of the first image data; if the correction information is determined to be received, determining character information of the first image data according to the correction information and the predicted characters; the text information includes text included in the first image data; determining first response data according to the character information of the first image data; after determining the text information of the first image data according to the correction information and the predicted text of the first image data, the response method further comprises: storing the first image data and the text information of the first image data to a training data set; after the training data set is determined to meet the preset training conditions, the first image data is used as input data of the character recognition model, character information of the first image data is used as output data of the training data set, and the character recognition model is trained again; wherein the text information of the first image data includes: the predicted character of the first image data, the character information of the first image data, and the correction information.
10. A transponder apparatus, comprising: at least one processor; and the number of the first and second groups,
a memory communicatively coupled to the at least one processor; wherein the memory stores instructions executable by the at least one processor to enable the at least one processor to perform the answering method according to any one of claims 1 to 8.
11. A computer-readable storage medium, in which a computer program is stored which, when being executed by a processor, carries out the answering method according to any one of claims 1 to 8.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910484868.6A CN110209280B (en) | 2019-06-05 | 2019-06-05 | Response method, response device and storage medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910484868.6A CN110209280B (en) | 2019-06-05 | 2019-06-05 | Response method, response device and storage medium |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN110209280A CN110209280A (en) | 2019-09-06 |
| CN110209280B true CN110209280B (en) | 2023-04-18 |
Family
ID=67790874
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201910484868.6A Active CN110209280B (en) | 2019-06-05 | 2019-06-05 | Response method, response device and storage medium |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN110209280B (en) |
Families Citing this family (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN111554134B (en) * | 2020-05-27 | 2022-08-02 | 重庆青年职业技术学院 | Online education and teaching method and system |
| CN111554133B (en) * | 2020-05-27 | 2022-08-02 | 重庆青年职业技术学院 | Teaching auxiliary device for online education |
Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP2010224404A (en) * | 2009-03-25 | 2010-10-07 | Seiko Epson Corp | Display device |
| JP2011248150A (en) * | 2010-05-27 | 2011-12-08 | Kyocera Corp | Portable electronic device and image projection unit |
| CN109788262A (en) * | 2017-11-15 | 2019-05-21 | 中强光电股份有限公司 | Optical projection system and its image projecting method |
| JP2019082572A (en) * | 2017-10-30 | 2019-05-30 | 株式会社リコー | Information processing system, information processing device, information processing method and program |
Family Cites Families (12)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP4389945B2 (en) * | 2007-02-07 | 2009-12-24 | コニカミノルタビジネステクノロジーズ株式会社 | Image forming apparatus, printing paper selection method, and printing paper selection program |
| US9117274B2 (en) * | 2011-08-01 | 2015-08-25 | Fuji Xerox Co., Ltd. | System and method for interactive markerless paper documents in 3D space with mobile cameras and projectors |
| US20160173840A1 (en) * | 2014-12-10 | 2016-06-16 | Casio Computer Co., Ltd. | Information output control device |
| CN105184329A (en) * | 2015-08-27 | 2015-12-23 | 鲁东大学 | Cloud-platform-based off-line handwriting recognition method |
| CN106407874A (en) * | 2016-03-25 | 2017-02-15 | 东南大学 | Handwriting recognition method based on handwriting coordinate sequence |
| CN107403130A (en) * | 2017-04-19 | 2017-11-28 | 北京粉笔未来科技有限公司 | A kind of character identifying method and character recognition device |
| CN107355702A (en) * | 2017-07-14 | 2017-11-17 | 华南理工大学 | A kind of projection desk lamp |
| CN207460391U (en) * | 2017-09-29 | 2018-06-05 | 北京优教互动教育科技有限公司 | Projector equipment with camera function |
| CN108174170B (en) * | 2017-12-29 | 2020-03-17 | 安徽慧视金瞳科技有限公司 | Camera-based projection area size self-detection method, system and equipment |
| CN108121987B (en) * | 2018-01-02 | 2022-04-22 | 联想(北京)有限公司 | Information processing method and electronic equipment |
| CN109101123A (en) * | 2018-08-23 | 2018-12-28 | 京东方科技集团股份有限公司 | A kind of writing display system |
| CN113537114B (en) * | 2021-07-27 | 2023-05-30 | 重庆国翔创新教学设备有限公司 | Paper surface operation auxiliary learning system, method, equipment and storage medium |
-
2019
- 2019-06-05 CN CN201910484868.6A patent/CN110209280B/en active Active
Patent Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP2010224404A (en) * | 2009-03-25 | 2010-10-07 | Seiko Epson Corp | Display device |
| JP2011248150A (en) * | 2010-05-27 | 2011-12-08 | Kyocera Corp | Portable electronic device and image projection unit |
| JP2019082572A (en) * | 2017-10-30 | 2019-05-30 | 株式会社リコー | Information processing system, information processing device, information processing method and program |
| CN109788262A (en) * | 2017-11-15 | 2019-05-21 | 中强光电股份有限公司 | Optical projection system and its image projecting method |
Non-Patent Citations (1)
| Title |
|---|
| 卢祥祥 等."互动式激光投影书法练习器设计".《大众文艺》.2016,(第2016年第23期),第53页. * |
Also Published As
| Publication number | Publication date |
|---|---|
| CN110209280A (en) | 2019-09-06 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN105975560B (en) | Question searching method and device of intelligent equipment | |
| CN103778818B (en) | Method and device for prompting writing errors | |
| CN111950463B (en) | Scanning method, scanning device, scanning pen and storage medium | |
| CN111027537B (en) | Question searching method and electronic equipment | |
| CN105975550B (en) | Question searching method and device of intelligent equipment | |
| CN111077996B (en) | Information recommendation method and learning device based on click-to-read | |
| CN103903491A (en) | Method and device for realizing writing check | |
| CN110209280B (en) | Response method, response device and storage medium | |
| CN114255470A (en) | Answering processing method based on handwriting track recognition, handwriting pen, system and terminal | |
| CN111079726B (en) | Image processing method and electronic equipment | |
| CN111078179B (en) | Dictation, newspaper and read progress control method and electronic equipment | |
| CN111639158B (en) | Learning content display method and electronic equipment | |
| US10911615B2 (en) | Scoring apparatus and non-transitory computer readable medium | |
| CN111079503B (en) | Character recognition method and electronic equipment | |
| CN112381689A (en) | Online correction operation method and device | |
| CN111077993B (en) | Learning scene switching method, electronic equipment and storage medium | |
| CN110955379A (en) | Control method of mobile terminal, mobile terminal and storage medium | |
| CN111078100B (en) | Point reading method and electronic equipment | |
| CN113709322A (en) | Scanning method and related equipment thereof | |
| CN111176525A (en) | Operation area prompting method, electronic equipment and storage medium | |
| CN111078082A (en) | Point reading method based on image recognition and electronic equipment | |
| CN111078099A (en) | Learning function switching method based on gesture recognition and learning equipment | |
| CN115547132B (en) | Job correcting method and device, storage medium and electronic equipment | |
| CN111077982B (en) | Man-machine interaction method under dictation environment and electronic equipment | |
| JP5983136B2 (en) | Electronic pen system and program |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |