CN110969152B - Exercise book content identification method - Google Patents

Abstract

A method for identifying the content of an exercise book is characterized in that the exercise book is formed by binding a plurality of answer sheets along the same side edge, and an answer area is printed on the other side of each answer sheet; comprises the following steps; acquiring image information of a plurality of staggered and stacked answer sheets, wherein the image information comprises all or part of the uppermost answer sheet and a non-covered area of the lower answer sheet which is not covered by the upper answer sheet; and identifying the contents of the non-shielded answer sheet and the residual contents of the non-covered area of the shielded answer sheet which are stacked in a staggered manner according to the image information. According to the scheme, after the user stacks the edge of one side of the exercise book in a staggered mode, the uppermost portion and the residual portion of the page can be identified. The content of the covered area and the non-covered area is identified as different pages. Meanwhile, the answer area is arranged on one side of the non-binding edge, and the technical effect of better content extraction of the answer area can be achieved by distinguishing the content and the residual content of the unshielded page. And the subsequent identification operation is convenient.

Description

Exercise book content identification method

Technical Field

The invention relates to the field of online teaching, in particular to an image-based answering content identification optimization technology.

Background

The existing answer sheet is a carrier for inputting information by an optical mark reader, and is a general name of various information recording forms matched with the optical mark reader. The information card converts the information needed by the user into selectable options for the user to write. And the OMR equipment restores the information according to the coating and non-coating of the information points and the setting of the format file.

The information card is designed in a format required by the design specifications of the cursor reader based on information input to the computer.

In practical application, the identification of the special answer sheet causes that the user needs to switch the filling-in on the test paper and the answer sheet back and forth when doing a question, which easily causes the occurrence of filling-in error and is not beneficial to identifying and correcting.

Disclosure of Invention

Therefore, a new method for identifying the content of the exercise book needs to be provided, so that the problem that the page content identification in the prior art is not convenient enough is solved.

In order to achieve the purpose, the inventor provides a method for identifying the content of an exercise book, wherein the exercise book is formed by binding a plurality of answer sheets along the same side edge, and an answer area is printed on the other side of each answer sheet; comprises the following steps; acquiring image information of a plurality of staggered and stacked answer sheets, wherein the image information comprises all or part of the uppermost answer sheet and a non-covered area of the lower answer sheet which is not covered by the upper answer sheet;

and identifying the contents of the non-shielded answer sheet and the residual contents of the non-covered area of the shielded answer sheet which are stacked in a staggered manner according to the image information.

Specifically, the staggered and stacked answer sheet comprises,

the upper page covers the left area of the lower page;

or the upper page covers the right area of the lower page;

or the upper page covers the upper side area of the lower page;

or the upper page covers the lower side area of the lower page;

or the upper page covers the upper left side area of the lower page;

or the upper page covers the upper right side area of the lower page;

or the upper page covers the lower left side area of the lower page;

or the upper page covers the lower right area of the lower page.

Further, the unoccluded page content or the residual content comprises an area mark, and the area mark is arranged in an answer area of the answer sheet.

Specifically, the method further comprises the step of identifying at least two area marks of the unoccluded page content or the residual content and correcting the distortion of the photographed image.

Specifically, the area marks are mark pairs, and when at least one mark is identified and at least one mark is not identified, the page is judged not to be placed according to the specified requirement.

Specifically, a certain desired area mark is not recognized in the video, and it is determined that the desired page is absent.

Specifically, the non-coverage area further includes page number information, and the method further includes the step of judging whether the multiple stacked pages are out of order by identifying the page number information.

Optionally, the method further comprises the step of sending a prompt signal when the page is judged to be not placed according to the specified requirement or lack of the expected page or out of order.

In particular, the area is marked as an AR code.

Different from the prior art, the scheme can identify the uppermost part and the residual part of the page after the user stacks one side edge of the exercise book in a staggered manner. The content of the covered area and the non-covered area is identified as different pages. Meanwhile, the answer area is arranged on one side of the non-binding edge, and the technical effect of better content extraction of the answer area can be achieved by distinguishing the content and the residual content of the unshielded page. And the subsequent identification operation is convenient.

Drawings

FIG. 1 is a block diagram of a system for identifying page content according to an embodiment;

FIG. 2 is a schematic view of a test paper layout according to an embodiment;

FIG. 3 is a flowchart of a page content identification method according to an embodiment;

FIG. 4 is a flowchart illustrating a method for identifying page content according to an embodiment;

fig. 5 is a flowchart of an answer sheet generation method according to an embodiment;

fig. 6 is a block diagram of an answer sheet generation system according to an embodiment.

Detailed Description

To explain technical contents, structural features, and objects and effects of the technical solutions in detail, the following detailed description is given with reference to the accompanying drawings in conjunction with the embodiments.

Referring to fig. 1, a page content identification system includes an image capturing unit 100, a processing unit 102, wherein the image capturing unit 100 is configured to obtain image information of a plurality of alternatively stacked pages, and the image information includes all or part of an uppermost page and a non-coverage area where a lower page is not covered by an upper page. The processing unit 102 is configured to identify content of non-covered pages and residual content of non-covered areas of the blocked pages, which are alternately stacked, according to the image information. The tabbed pages in our embodiment include the upper page overlying the lower page left area; or the upper page covers the right area of the lower page; or the upper page covers the upper side area of the lower page; or the upper page covers the lower side area of the lower page; or the upper page covers the upper left side area of the lower page; or the upper page covers the upper right side area of the lower page; or the upper page covers the lower left side area of the lower page; or the upper page covers the lower right area of the lower page. The page overlay results in both un-occluded and occluded portions of the remaining content. The technical effect of dividing the image into different pages can be achieved by recording and distinguishing the images. Specifically, the edge orientation of the page where the content is located can be determined by identifying the content position of the uppermost page, for example, the content on the page can be generally identified as a range of a rectangle, and the parallel extension of the sides of the rectangle to the periphery is generally the edge orientation of the page. Finding the content range touched first in the process of extending the rectangle edge outwards in parallel can be judged as the residual content of the lower page covered by the content range. The specific content association range determination process may be determined according to a connected domain algorithm in the image recognition field. By the content identification system, the effect of identifying the content of different pages among a plurality of staggered pages is achieved.

The following description is given by taking a page as test paper 104 or answering paper and an answering card as examples, wherein the test paper is divided into a question area and an answering area, page number information is arranged on the test paper, and an area mark is arranged on the answering area. Therefore, area markers may be included in either the unoccluded page content or the residual content. Firstly, compared with the scheme of arranging the special answer sheet, the separate arrangement of the question area and the answer area on the test paper can play a role of facilitating answering of the answerer, and meanwhile, wrong answer numbers are avoided. The answer area guides the user to concentrate the answers to a small area, and the shooting unit can shoot and record the answer information conveniently. If the user is guided to stack the test paper after answering the questions, the camera is arranged at the position above the desktop and the like to obtain the stacking sequence of the stacked test paper, the user can stack the test paper according to the prompt to expose the relevant area, if the part of the test paper with the page number information or the area mark is exposed, and under the condition, the processing unit can identify whether the placing relation of the test paper meets the requirement or not. If the placing relationship is correct, the system can perform back-end presentation on the part of the user answering through one-time image acquisition and image transmission, and the back end can be cloud storage or third-end correction presentation. The effects of saving time and saving data transmission bandwidth are achieved.

As an embodiment of the present solution, the page number information may be a number for the test paper, and numbers such as 1, 2, and 3 are printed on the test paper, and preferably designed near the answering area or near the edge of the paper. When the test paper is stacked, the corresponding positions of the test paper are staggered, and whether the test paper is out of order or not can be judged by identifying the page numbers at the specific positions. Fig. 2 shows an embodiment of a stacking method in a sequential manner, in which the basis for the determination is provided by means of exposed page number information. In order to avoid the problem that simple numbers are easy to be identified by mistake, the AR codes are used as area marks, and naturally, arrangement modes such as two-dimensional codes and bar codes can be selected. The area mark may be provided in the answering area or near the edge of the paper, and the cross and the hexagram positions in the embodiment of fig. 2 indicate examples of the design of the position of the area mark. The AR code records at least a corresponding test paper ID, which plays a role of page number information, the area mark is stored in the storage unit 104, and the storage unit may be set in the cloud or locally. The processing unit 102 is configured to identify the test paper ID to determine whether the multiple stacked test papers are out of order, and if the area marks are set in the answer area at the right edge of the test paper, the correct stacking sequence is from left to right in the spatial position of the area marks exposed from the front test paper to the back test paper, the processing unit is configured to identify whether the page number information corresponding to the area marks appearing in the drawing satisfies the preset sequence from left to right. By the scheme, the problem that the stacking position relation among multiple test papers is judged by setting page information is solved, and the collection of answer contents is better facilitated.

In other embodiments, the area markers may be set to two or more, and at least two area markers for identifying unoccluded page contents or residual contents correct distortion of the photographed image. The specific correction method can adjust the distortion of the image to be orthographic projection by the positional relationship of two or more area marks, or can correct the distortion of the whole image by recognizing the shape distortion of a single mark.

In other embodiments, the area marks are mark pairs set on a single test paper, or the area marks are AR codes, for example, that is, each answer area of each test paper includes two area marks, and each mark corresponds to one ID. The processing unit is configured to identify the mark pair through the image information, and when one mark of the mark pair is not set, the mark is identified as that the test paper is not placed according to requirements, if the answer area is not completely exposed. In some preferred embodiments, two area marks may be disposed near the subject area, and the line connecting the two area marks is used as a boundary line between the subject area and the subject area or parallel to the boundary line, so that once one of the area marks is not detected by the processing unit, it indicates that the answer paper covered thereon is not arranged properly, which may result in incomplete exposure of the subject area. Through the scheme, the problem that whether the multiple test paper is completely stacked or not is judged by setting the area marks is solved, and the collection of answer contents is better facilitated.

In other embodiments, taking the area label as the AR code as an example, the area label corresponds to one ID, the processing unit is configured to identify the content of the area label through the image information, and identify that a page is missing when the area label corresponding to a certain page of test paper is missing. The area marks can also be set as mark pairs on a single test paper, and when one group of mark pairs is missing, the test paper is judged to be missing. By the scheme, the problem that whether a plurality of test paper are missing or not is judged by setting the area marks is solved, and the collection of answer contents is facilitated better.

In a preferred embodiment, the question answering area is arranged on the right edge of the test paper, and the left and right part of the test paper are respectively arranged in the question area and the question answering area to better accord with the reading habit of a common person. The practicability of the technical scheme can be improved through the arrangement.

Further, as shown in fig. 1, the system further includes a prompting unit 106, wherein the prompting unit 106 is used for emitting an acoustic or optical signal, and can be configured as a plurality of prompting elements such as a speaker, a display screen, a flashlight, and the like. The prompting unit 106 is connected to the processing unit 102, and the processing unit may send an enable signal to the prompting unit or directly control the prompting unit. In order to achieve the effects of enhancing practicability and prompting a user, a processing unit is arranged to enable a prompting unit when judging that test paper is not completely exposed out of a question answering area or identifying that the test paper is missing or the test paper is out of order. Use the suggestion unit as the intelligent voice assistant in the system (can transplant prior art) for example, when judging that the relation of putting of examination question paper goes wrong, can report through voice assistant: "have missing pages, please put them in order", "please put the test papers in order in parallel", etc. And a preset animation picture can be played on the display screen at the same time, so that the user can understand how to correctly place the picture. Through above-mentioned scheme, can help the user to correctly use this system, guide the user to cooperate the test paper to carry out the exact and stack, carry out the collection of answer content better, can promote this technical scheme's practicality.

In other embodiments, the processing unit 102 is further configured to divide the content of the answer area in the image information and send the content to the modifying unit 108. Under the condition that the test paper is correctly placed, the extraction of the content of the answer area becomes very convenient, the scheme has great advantage in the extraction of the comprehensive content of a plurality of test papers, the answer area is positioned at the right edge of the test paper, and by combining the arrangement characteristics, only the area mark pair of the uppermost answer area needs to be identified, and the content of the right part of the connecting line of the mark pair can be extracted as the content of the answer area. Meanwhile, the normal response of the client in question making is not influenced. The correction unit can embed AI of intelligent character recognition in a back-end processor and a cloud server by using the prior art, and can also send the AI to a correction personnel end to receive correction and remark information and the like of the correction personnel. By being connected with the correction end, the technical effects of extracting answer information and correcting can be achieved.

As a preferred embodiment, the above-mentioned page identification system can also be used exclusively for the identification of book contents without additional modifications. Here, even when the image content is recognized, only the recognition algorithm in which the upper page covers the left area of the lower page and the upper page covers the right area of the lower page may be considered. Or the priority of the recognition algorithm of the upper page covering the left area of the lower page and the upper page covering the right area of the lower page is increased. Since it is most common in the field of content recognition of a booklet, to bind the upper or left edge of an answer sheet into a book, it is only necessary to guide the user or the book or the scroll exercise book to correctly expose the answer area and the area marks thereon. The technical effect of better extracting the content in the answer area can be achieved by distinguishing the content of the unoccluded page and the residual content. And the subsequent identification operation is facilitated. The user can also be prompted and recorded content can be identified based on the identified content of the area marker.

Accordingly, in the embodiment shown in fig. 3, we also introduce a page content identification method, comprising the steps of: s300, image information of a plurality of staggered and stacked pages is acquired. The image information comprises all or part of the top page and a non-covered area of the lower page which is not covered by the upper page;

s302, identifying the content of the non-covered page and the residual content of the non-covered area of the covered page which are overlapped in an interlaced mode according to the image information. The effect of identifying the contents belonging to different pages among a plurality of staggered pages is achieved.

In some further embodiments, the unoccluded page content or the residual content includes a region marker. We also proceed to step S304, judging the stacking relationship between the pages by the region mark. Through the steps, the problem of identifying whether the placing relation of the page meets the requirements can be solved. If the placing relationship is correct, the contents of a plurality of pages can be acquired and transmitted through one image. The effects of saving time and data transmission bandwidth are achieved. In a specific application example, when the page is an answer sheet, steps S300-S304 may be executed, and the content of the answer area of multiple answer sheets can be transmitted and identified in the result of one-time image acquisition through the steps. The above method may be changed to an exercise book content recognition method, and steps S300-S304 may be performed as well. Here, even when the image content is recognized, only the recognition algorithm in which the upper page covers the left area of the lower page and the upper page covers the right area of the lower page may be considered. Or the priority of the recognition algorithm of the upper page covering the left area of the lower page and the upper page covering the right area of the lower page is increased.

In some embodiments, we take the area label as AR code as an example. The areas are marked as mark pairs arranged on a single test paper,

as shown in fig. 4, we continue to take the page as an answer sheet as an example, the method further includes a step of S3041 identifying the mark pair through the image information, and identifying that the page is not placed according to the requirement when one of the marks of the mark pair is not placed, where the non-placement according to the requirement may be that the answer area is not completely exposed. Step S3042 may also be included, in which the content of the area mark is identified through the image information, and if the area mark corresponding to a certain page of test paper is missing, the page is identified as missing. The area mark may further include page number information, and step S3043 of determining whether the multiple stacked test papers are out of order by identifying the page number information through the image information.

In some specific embodiments, the method further includes a step of sending a prompt signal when the abnormal placement relationship of the test papers is identified in S306. Can help the user to correctly use this system through above-mentioned scheme, guide the user to cooperate the test paper to carry out the exact and stack, carry out the collection of answer content better, can promote this technical scheme's practicality.

Further, the method includes a step S308 of dividing the content of the answer area in the image information and sending the content to the correcting unit. By being connected with the correction end, the technical effects of extracting answer information and correcting can be achieved.

In order to better identify the content, a page generation method is also carried out, which comprises the following steps that a non-identification area and an identification area are divided on a page, an area mark is printed on the identification area, the non-identification area can be normally printed, the area mark is used for identifying the overlapping relation between the pages after being shot by a camera, and the area mark can be a page number, and can also be a feature code with each page ID information, such as a two-dimensional code, an AR code and the like. Specifically, the area marks are mark pairs, the mark pairs of different pages carry different information, the corresponding relation between the area marks and the related pages is recorded in the storage medium when being generated, and the mark pairs of different pages can also record the sequential relation between the pages and can also be recorded in the storage medium. By comparing the area markings in the storage medium, it can be recognized whether the stacking relationship between the pages is correct as described in the foregoing.

The technical solutions shown in fig. 3 and 4 can also be applied to a method for identifying the content of an exercise book, where the page is specifically a page of an answer sheet, the exercise book is formed by binding a plurality of answer sheets along the same side edge, and an answer area is printed on the other side of each answer sheet; comprises the following steps; acquiring image information of a plurality of staggered and stacked answer sheets, wherein the image information comprises all or part of the uppermost answer sheet and the non-coverage area of the lower answer sheet which is not covered by the upper answer sheet, and identifying the content of the staggered and stacked unblocked answer sheets and the residual content of the non-coverage area of the blocked answer sheet according to the image information. The user or the book or the volume exercise book needs to be guided to correctly expose the answering area and the area marks on the answering area. The technical effect of better extracting the content of the answer area can be achieved by distinguishing the content of the unoccluded page and the residual content. And the subsequent identification operation is facilitated. The user can also be prompted and recorded content can be identified based on the identified content of the area marker.

In other embodiments, in order to facilitate answering of test questions and subsequent identification and correction, taking the above-mentioned pages as answer sheets as examples, an answer sheet generation method is correspondingly designed, where please refer to fig. 5, which includes steps of S500 receiving user question selection information, S502 setting a question area and an answer area on each test sheet when a plurality of test sheets need to be printed on a selected test sheet, setting a test question selected by a user in the question area of the test sheet, and setting a corresponding answer reference in the answer area of the test sheet, where the answer reference includes a number represented by a number, a filling-in space of a cross line, a filling-in space of a square or circular shape, and so on. Each test question corresponds to the corresponding answer reference symbol in the horizontal direction; the answer area of each test paper is positioned at the same side of the test paper; the question answering area comprises area marks, wherein the area marks can be two-dimensional codes, bar codes or AR codes with ID information of each test paper. The test paper comprises page number information, and the page number information can be directly printed numbers or can be additionally represented by area marks. Through the steps, the test questions are arranged at the question area positions of the answer paper of different pages according to the test question selection of the user, and the answer areas are uniformly arranged on the left side or the right side, so that the answer data of a whole set of test questions can be correctly obtained only by identifying the area marks of the answer area part when the answer is recorded by a computer. Thereby facilitating the wholesale identification of the backend.

In some other further embodiments, the region is labeled as a label pair, and a line connecting the label pair divides the topic region and the answer region. Through the design, the computer can judge whether the answer area is shielded or not through the mark on the test paper when shooting and recording, so that the requirement of detecting whether the test paper is completely exposed or not is met.

In other embodiments, a page generation system is designed, and includes a page layout unit and a printing unit, where the page layout unit is configured to divide a non-identification area and an identification area on a page, the identification area is provided with an area tag, the printing unit is configured to print the page, and the area tag is used to identify a stacking relationship between the pages after being photographed by a camera. The page generation system also comprises a storage medium, the corresponding relation between the area mark and the related page is recorded in the storage medium when being generated, and the mark pairs of different pages can also record the sequence relation between the pages and can also be recorded in the storage medium. By comparing the area markings in the storage medium, it can be recognized whether the stacking relationship between the pages is correct as described in the foregoing.

In the embodiment shown in fig. 6, taking a page as an answer sheet as an example, the non-recognition area and the recognition area respectively correspond to the question area and the answer area, and the following design is further performed, and an answer sheet generating system includes a question bank unit 600, a test question typesetting unit 602, a printing unit 604,

the question bank unit receives test question selection of a user and sends the selected test question to the test question typesetting unit, the test question typesetting unit is used for setting a question area and a question answering area on each piece of test question paper when the test question needs to be printed into a plurality of pieces of test question paper, the question area of the test question paper is provided with the test question selected by the user, the question answering area of the test question paper is provided with corresponding question answering reference symbols, and each test question corresponds to the corresponding question answering reference symbol in the horizontal direction; the answer area of each test paper is positioned at the same side of the test paper; the printing unit is used for printing the setting result of the test question typesetting unit on the test question paper. The question bank unit can be a database module of the system, and the typesetting unit can adopt the existing typesetting script embedded in the system to realize typesetting for A4 paper, for example. The printing unit may be a printer and the answer reference characters may comprise numbers, transverse lines, squares or rings. By the system, a user can independently select test questions, the test questions are arranged at the question areas of the answer paper of different pages, and the answer areas are uniformly arranged on the left side or the right side, so that the efficiency of the user in answering the test questions is not influenced, and the answers do not need to be copied to special answer paper. Therefore, when the answering is finished and recorded by the computer, the answering data of a whole set of test questions can be correctly obtained only by identifying the area marks of the answering area part. Thereby facilitating the identification of the correction at the back end.

Specifically, the region is marked as a mark pair, and a line of the mark pair divides the topic area and the answer area. Through the design, the computer can judge whether the answer area is shielded or not through the mark on the test paper when shooting and recording, so that the requirement of detecting whether the test paper is completely exposed or not is met.

It should be noted that, although the above embodiments have been described herein, the invention is not limited thereto. Therefore, based on the innovative concepts of the present invention, the technical solutions of the present invention can be directly or indirectly applied to other related technical fields by making changes and modifications to the embodiments described herein, or by using equivalent structures or equivalent processes performed in the content of the present specification and the attached drawings, which are included in the scope of the present invention.

Claims (4)

1. A method for identifying the content of an exercise book is characterized in that the exercise book is formed by binding a plurality of answer sheets along the same side edge, and an answer area is printed on the other side of each answer sheet, and comprises the following steps; acquiring image information of a plurality of staggered and stacked answer sheets, wherein the image information comprises all or part of the uppermost answer sheet and a non-covered area of the lower answer sheet which is not covered by the upper answer sheet; the page is generated by: receiving user test question selection information, when a plurality of test question papers need to be printed on a selected test question, setting a question area and an answer area on each test question paper, setting the test question selected by the user in the question area of the test question paper, setting a corresponding answer reference symbol in the answer area of the test question paper, wherein the answer area of each test question paper is positioned at the same side of the test question paper, and the test question paper further comprises a regional mark, wherein the regional mark is an AR code mark pair, and a connecting line of the mark pair divides the question area and the answer area;

identifying the content of the non-shielded answer sheet and the residual content of the non-covered area of the shielded answer sheet which are stacked in a staggered mode according to the image information, identifying the content position of the uppermost page, judging the edge orientation of the page where the uppermost page is located, judging the content association range according to a connected domain algorithm in the image identification field, determining the rectangular range of the content on the page, parallelly expanding the side edge of the rectangular range to the periphery to obtain the edge orientation of the page, searching the content range which is firstly contacted in the process of parallelly expanding the side edge of the rectangular range to the outside to judge the residual content of the page below the page covered by the content, identifying the content of the area mark through the image information, and identifying the page as a missing page when the area mark corresponding to a certain page of test paper is missing; or identifying page number information through the image information to judge whether the multiple pieces of stacked test paper are out of order;

and dividing the content of the answer area in the image information and sending the content to the correction unit.

2. The method for recognizing exercise book contents according to claim 1, wherein the answer sheets stacked in a staggered manner include,

the upper page covers the left area of the lower page;

or the upper page covers the right area of the lower page;

or the upper page covers the upper side area of the lower page;

or the upper page covers the lower side area of the lower page;

or the upper page covers the upper left side area of the lower page;

or the upper page covers the upper right side area of the lower page;

or the upper page covers the lower left side area of the lower page;

or the upper page covers the lower right area of the lower page.

3. The content recognition method for exercise books according to claim 1, further comprising the step of recognizing at least two area marks of the unoccluded page content or the residual content, and correcting distortion of the photographed image.

4. The method for recognizing content of exercise books according to claim 1, further comprising a step of giving a prompt signal when it is determined that the page is not laid out as specified or that the expected page is absent or out of order.

Images