CN110619773A - Method and system for generating outline box, storage medium and electronic equipment - Google Patents
Method and system for generating outline box, storage medium and electronic equipment Download PDFInfo
- Publication number
- CN110619773A CN110619773A CN201910886968.1A CN201910886968A CN110619773A CN 110619773 A CN110619773 A CN 110619773A CN 201910886968 A CN201910886968 A CN 201910886968A CN 110619773 A CN110619773 A CN 110619773A
- Authority
- CN
- China
- Prior art keywords
- information
- frame
- user operation
- coordinate
- delineation
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
- G06F3/0484—Interaction techniques based on graphical user interfaces [GUI] for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range
- G06F3/04842—Selection of displayed objects or displayed text elements
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
- G06F3/0487—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser
- G06F3/0488—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures
- G06F3/04883—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures for inputting data by handwriting, e.g. gesture or text
-
- G—PHYSICS
- G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
- G09B—EDUCATIONAL OR DEMONSTRATION APPLIANCES; APPLIANCES FOR TEACHING, OR COMMUNICATING WITH, THE BLIND, DEAF OR MUTE; MODELS; PLANETARIA; GLOBES; MAPS; DIAGRAMS
- G09B7/00—Electrically-operated teaching apparatus or devices working with questions and answers
- G09B7/02—Electrically-operated teaching apparatus or devices working with questions and answers of the type wherein the student is expected to construct an answer to the question which is presented or wherein the machine gives an answer to the question presented by a student
Abstract
The invention provides a method, a system, a storage medium and electronic equipment for generating a delineation frame, wherein the method comprises the following steps: acquiring information to be sketched; identifying the information type of the information to be sketched; determining the information of the delineating frame of the information to be delineated according to the information type by combining a delineating frame standard table; generating coordinate information of the delineating frame according to the delineating frame information; and analyzing a user operation coordinate according to the user operation information, comparing the user operation coordinate with the coordinate information of the drawing frame, and determining the target drawing frame. According to the invention, the standard table of the drawing frames is used for carrying out standardized setting on the drawing frames, so that the problem of unstable accuracy of click identification caused by different sizes of the drawing frames is avoided.
Description
Technical Field
The present invention relates to the field of computer technologies, and in particular, to a method and a system for generating a sketch frame, a storage medium, and an electronic device.
Background
One point in the electrified education product is to acquire the coordinate information of the finger of the user through the graph searching technology and then compare the coordinate information with the coordinate information of the standard outline box so as to determine the actual intention of the user. The current standard sketching frame coordinate information is to scan each page of a teaching material page by using a scanner to obtain a scanned image of a book, then manually sketching the scanned image, and frame and select contents (generally characters or pictures) on the scanned image one by one according to actual requirements, wherein each frame selection area corresponds to one number, and a corresponding voice file is hung on each number, so that the effect of playing corresponding voice by clicking any position of the picture is achieved.
The current common method is that the region of each character or picture is manually selected one by one on a scanogram, the workload is large, the operation is complicated, the number of the drawing regions is large, the drawing regions need to be drawn one by one, the operation efficiency is low, and then the manual drawing of the frame causes the phenomenon that the drawing frame is not large or small, the condition of mistaken identification when the finger coordinate information is compared with the finger coordinate information is caused, and the fingertip searching accuracy is influenced one by one.
Disclosure of Invention
The invention aims to provide a method and a system for generating a drawing frame, a storage medium and electronic equipment, which realize the standardized setting of the drawing frame through a drawing frame standard table and avoid the problem of unstable accuracy of click recognition caused by different sizes of the drawing frame.
The technical scheme provided by the invention is as follows:
the invention provides a method for generating a delineation frame, which comprises the following steps:
acquiring information to be sketched;
identifying the information type of the information to be sketched;
determining the information of the delineating frame of the information to be delineated according to the information type by combining a delineating frame standard table;
generating coordinate information of the delineating frame according to the delineating frame information;
and analyzing a user operation coordinate according to the user operation information, comparing the user operation coordinate with the coordinate information of the drawing frame, and determining the target drawing frame.
Further, before obtaining the information to be outlined, the method further comprises:
acquiring character categories and corresponding character outline box information;
acquiring the size of a picture and corresponding information of a picture delineation frame;
generating the drawing frame standard table according to the character category, the character drawing frame information, the picture size and the picture drawing frame information
Further, analyzing a user operation coordinate according to the user operation information, comparing the user operation coordinate with the coordinate information of the drawing frame, and determining the target drawing frame specifically includes:
when the user operation is clicking, comparing the user operation coordinate corresponding to the clicking position with the coordinate information of the drawing frame, and determining a target drawing frame;
when the user operation is sliding or frame selection, comparing all corresponding user operation coordinates in the operation process with the coordinate information of the drawing frames to determine a plurality of matching drawing frames;
and determining a target delineation frame according to the plurality of matching delineation frames.
Further, when the user operation is sliding or frame selection, comparing all the corresponding user operation coordinates in the operation process with the coordinate information of the drawing frames, and determining a plurality of matching drawing frames specifically includes:
when the user operation is sliding or frame selection, comparing each corresponding user operation coordinate in the operation process with the coordinate information of the drawing frame;
analyzing a comparison result corresponding to each user operation coordinate;
and if the comparison ratio of any user operation coordinate to the coordinate information of the drawing frame is greater than or equal to a preset threshold value, determining the drawing frame corresponding to the coordinate information of the drawing frame as a matching drawing frame.
The invention also provides a system for generating the delineation frame, which comprises:
the information acquisition module is used for acquiring information to be sketched;
the type identification module is used for identifying the information type of the information to be sketched, which is acquired by the information acquisition module;
the processing module is used for determining the information of the delineating frame of the information to be delineated according to the information type identified by the type identification module by combining a delineating frame standard table;
the coordinate generating module is used for generating coordinate information of the delineating frame according to the delineating frame information determined by the processing module;
and the analysis module is used for analyzing a user operation coordinate according to the user operation information, comparing the user operation coordinate with the coordinate information of the drawing frame generated by the coordinate generation module and determining the target drawing frame.
Further, the method also comprises the following steps:
the information acquisition module acquires the character type and the corresponding character outline box information;
the information acquisition module acquires the size of the picture and the corresponding information of the picture delineation frame;
and the standard table generating module is used for generating the drawing frame standard table according to the character type, the character drawing frame information, the picture size and the picture drawing frame information acquired by the information acquiring module.
Further, the analysis module specifically includes:
the analysis unit is used for comparing a user operation coordinate corresponding to a click position with the coordinate information of the drawing frame to determine a target drawing frame when the user operation is clicking;
the comparison unit is used for comparing all corresponding user operation coordinates in the operation process with the coordinate information of the drawing frames when the user operation is sliding or frame selection, and determining a plurality of matching drawing frames;
the analysis unit determines a target delineation frame according to the plurality of matching delineation frames determined by the comparison unit.
Further, the alignment unit specifically includes:
the comparison subunit compares each corresponding user operation coordinate in the operation process with the coordinate information of the delineation box when the user operation is sliding or frame selection;
the analysis subunit analyzes the comparison result corresponding to each user operation coordinate obtained by the comparison subunit;
and the processing subunit determines the delineating frame corresponding to the delineating frame coordinate information as a matching delineating frame if the analysis subunit determines that the comparison ratio between any one user operation coordinate and the delineating frame coordinate information is greater than or equal to a preset threshold value.
The present invention also provides a storage medium having a computer program stored thereon, characterized in that: which when executed by a processor implements the method described above.
The present invention also provides an electronic device including a memory and a processor, the memory having stored thereon a computer program that runs on the processor, wherein: the processor, when executing the computer program, implements the method described above.
The method, the system, the storage medium and the electronic device for generating the outline frame provided by the invention can bring at least one of the following beneficial effects:
1. according to the invention, the drawing frames are subjected to standardized setting through the drawing frame standard table, and the drawing frames corresponding to the corresponding drawing frame information are respectively selected based on the information types of the information to be drawn, so that the problem of unstable accuracy of click recognition caused by different sizes of the drawing frames due to manual drawing is solved.
2. According to the method, various types of information such as characters, pictures and formulas are collected, the drawing frame information corresponding to different types of information is set according to the requirements of the user or the preference habits of most users to generate the drawing frame standard table, and then the drawing frame standard table is used for drawing when standard drawing frame coordinate information is calibrated on the teaching material, so that all the drawing frames are drawn according to a unified standard, and the problem that the search accuracy is reduced due to the fact that manual drawing standards are different is solved.
3. In the invention, when the user operation is clicking and non-clicking (sliding, frame selection and the like), the user operation coordinates with different numbers are corresponded, so that different modes are pertinently adopted for drawing, and the structure is ensured to have better adaptability.
4. In the invention, when a plurality of user operation coordinates are involved in the operation process, whether each user operation coordinate has a corresponding matching delineation frame is further judged, otherwise, the user operation coordinate is determined to be invalid, and misoperation in the user operation process is avoided.
Drawings
The above features, technical features, advantages and implementations of a method, a system, a storage medium, and an electronic device for generating a skeleton are described in detail below with reference to the accompanying drawings.
FIG. 1 is a flow diagram of one embodiment of a method of generating a delineation box of the present invention;
FIG. 2 is a flow chart of another embodiment of a method of generating a delineation box of the present invention;
FIG. 3 is a flow chart of another embodiment of a method of generating a delineation box of the present invention;
FIG. 4 is a flow chart of another embodiment of a method of generating a delineation box of the present invention;
FIG. 5 is a schematic diagram of an embodiment of a system for generating a sketch frame according to the present invention;
fig. 6 is a schematic structural diagram of another embodiment of a system for generating a delineation box according to the present invention.
The reference numbers illustrate:
1000 generating system of outline box
1100 information acquisition module 1200 type identification module
1300 processing module 1400 coordinate generation module
1500 analysis Module 1510 analysis Unit
1520 compare unit 1521 to sub-unit 1522 analysis sub-unit 1523 processing sub-unit
1600 standard table generating module
Detailed Description
In the following description, for purposes of explanation and not limitation, specific details are set forth, such as particular system structures, techniques, etc. in order to provide a thorough understanding of the embodiments of the present application. However, it will be apparent to one skilled in the art that the present application may be practiced in other embodiments that depart from these specific details. In other instances, detailed descriptions of well-known systems, devices, circuits, and methods are omitted so as not to obscure the description of the present application with unnecessary detail.
It will be understood that the terms "comprises" and/or "comprising," when used in this specification and the appended claims, specify the presence of stated features, integers, steps, operations, elements, and/or components, but do not preclude the presence or addition of one or more other features, integers, steps, operations, elements, components, and/or groups thereof.
For the sake of simplicity, the drawings only schematically show the parts relevant to the present invention, and they do not represent the actual structure as a product. In addition, in order to make the drawings concise and understandable, components having the same structure or function in some of the drawings are only schematically depicted, or only one of them is labeled. In this document, "one" means not only "only one" but also a case of "more than one".
It should be further understood that the term "and/or" as used in this specification and the appended claims refers to and includes any and all possible combinations of one or more of the associated listed items.
In particular implementations, the terminal devices described in embodiments of the present application include, but are not limited to, other portable devices such as mobile phones, laptop computers, family computers, or tablet computers having touch sensitive surfaces (e.g., touch screen displays and/or touch pads). It should also be understood that in some embodiments the terminal device is not a portable communication device, but is a desktop computer having a touch-sensitive surface (e.g., a touch screen display and/or touchpad).
In the discussion that follows, a terminal device that includes a display and a touch-sensitive surface is described. However, it should be understood that the terminal device may include one or more other physical user interface devices such as a physical keyboard, mouse, and/or joystick.
The terminal device supports various applications, such as one or more of the following: a drawing application, a presentation application, a network creation application, a word processing application, a disc burning application, a spreadsheet application, a gaming application, a telephone application, a video conferencing application, an email application, an instant messaging application, an exercise support application, a photo management application, a digital camera application, a digital video camera application, a Web browsing application, a digital music player application, and/or a digital video player application.
Various applications that may be executed on the terminal device may use at least one common physical user interface device, such as a touch-sensitive surface. One or more functions of the touch-sensitive surface and corresponding information displayed on the terminal can be adjusted and/or changed between applications and/or within respective applications. In this way, a common physical architecture (e.g., touch-sensitive surface) of the terminal can support various applications with user interfaces that are intuitive and transparent to the user.
In addition, in the description of the present application, the terms "first", "second", and the like are used only for distinguishing the description, and are not intended to indicate or imply relative importance.
In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the following description will be made with reference to the accompanying drawings. It is obvious that the drawings in the following description are only some examples of the invention, and that for a person skilled in the art, other drawings and embodiments can be derived from them without inventive effort.
In an embodiment of the present invention, as shown in fig. 1, a method for generating a delineation box includes:
s100, information to be sketched is obtained.
Specifically, information to be outlined of data such as book teaching materials is acquired. When the book teaching material is paper file material, scanning each page of the material page by page with scanner to obtain the scanned book drawing, i.e. the information to be sketched. In addition, if the data such as book teaching materials and the like has electronic file data, the electronic file can also be directly acquired as the information to be sketched.
S200, identifying the information type of the information to be sketched.
Specifically, the information types of the information to be outlined are identified, and the information types include various types of information which may appear in book teaching materials such as characters, formulas and pictures. In addition, for a word of english type or the like containing a plurality of letters, all information to be outlined needs to be recognized first and divided into words. Similarly, the formula is also included, and information belonging to the same formula is also required to be identified and then subjected to subsequent operations as a whole.
And S300, determining the information of the delineation frame of the information to be delineated according to the information type by combining the standard table of the delineation frame.
Specifically, the information of the drawing frame of the information to be drawn is determined according to the information type by combining with the standard table of the drawing frame, and the standard table of the drawing frame is provided with information such as the size of the drawing frame corresponding to each type of information to be drawn. For example, when the information to be outlined is a character, the corresponding outline box is in a range from the upper, lower, left, right and four boundaries to the threshold of the character. When the information to be sketched is a formula or a picture, firstly, a complete formula or picture is identified, and then, the distance formula of four boundary distances from the upper side, the lower side, the left side and the right side of a corresponding sketching frame or the threshold range of the picture edge is determined.
And S400, generating coordinate information of the delineation frame according to the delineation frame information.
Specifically, the coordinate information of the delineating frame corresponding to each piece of information to be delineated is generated according to the delineating frame information, because the content of the information to be delineated is different and the size of the corresponding delineating frame is different, the coordinate information of the delineating frame includes the coordinate information of all points in the corresponding delineating frame.
The threshold ranges of the four boundaries of the drawing frame, which are up, down, left, right, and left, away from the edge of the text information to be drawn can be adjusted as required, and when the threshold is large and the distance between the information to be drawn is short, the same part may exist between the coordinate information of the drawing frame corresponding to the adjacent information to be drawn.
S500, analyzing a user operation coordinate according to the user operation information, comparing the user operation coordinate with the coordinate information of the drawing frame, and determining a target drawing frame.
Specifically, user operation information is acquired, and then a user operation coordinate is analyzed according to the user operation information, that is, a position clicked by a finger of the user or other clicked objects is analyzed. And comparing the user operation coordinate with the coordinate information of the drawing frame, determining a target drawing frame if the comparison is in accordance with the comparison, identifying the intention of the user, and calling the corresponding learning material.
If the user operation information is acquired through the graph search technology, the operation picture of the user is acquired through the camera device, the contact point of the clicked object of the user and data such as book teaching materials is identified to serve as the user operation information, and the clicked object does not have special requirements and can be a finger of the user or an article such as a pen. If the user operation information is acquired through the sensing device, the clicked object is bound at first, so that the clicked position of the user can be sensed conveniently.
In this embodiment, through standardizing the setting to the drawing frame to drawing frame standard table, select the corresponding drawing frame that drawing frame information corresponds respectively based on the information type of waiting to draw the information, avoid the drawing frame size that artifical drawing leads to not uniform problem of the rate of accuracy of click discernment that leads to.
Another embodiment of the present invention is a preferable embodiment of the above-mentioned embodiment, as shown in fig. 2, including:
s010 obtains the character category and the corresponding character outline box information.
Specifically, character categories and corresponding character delineation box information are obtained, where the character categories include information that influences the size of the delineation box, such as the language type (chinese, english, etc.), the font (song style, regular style, etc.), and the size of the characters, and the corresponding character delineation box information is a threshold range between the upper, lower, left, and right boundaries of the delineation box and the character edges, for example, the distances between the upper, lower, left, and right boundaries of the delineation box corresponding to each chinese character in the song style are set to be 1 cm, where the distances between the upper, lower, left, and right boundaries and the character edges may be the same or different from each other.
The threshold range is set by a user, and different language types and font sizes can be the same or different. For example, the distance between the upper, lower, left, and right boundaries of the outline box corresponding to the english word and the edge of the character is set to 1 cm, and the distance between the upper, lower, left, and right boundaries of the outline box corresponding to the chinese character of the song style and the edge of the character is set to 1.5 cm.
In addition, for a word of english type or the like containing a plurality of letters, all information to be outlined needs to be recognized first and divided into words. Similarly, the formula is also included, and information belonging to the same formula is also required to be identified and then subjected to subsequent operations as a whole. For the convenience of analysis, the information to be outlined is divided by taking the minimum whole as a unit, such as a Chinese character, a word and the like.
S020 obtains the picture size and the corresponding picture drawing frame information.
Specifically, the picture size and the corresponding picture delineation frame information are obtained, that is, the threshold ranges of the four boundaries, upper, lower, left and right, between the picture edge and the delineation frame corresponding to the picture of each size are obtained. Similarly, the threshold ranges are set by the user, and the threshold ranges corresponding to different sizes of pictures may be the same or different. The distances from the upper, lower, left and right boundaries to the text edges may be the same or different.
In addition, the threshold ranges of the distance edges between the upper boundary, the lower boundary, the left boundary and the right boundary of the delineation frame can be set by a system and defined by a user, and the use habits of a target user group can be collected and analyzed to obtain the threshold range suitable for the corresponding group.
And S030 generating the drawing frame standard table according to the character category, the character drawing frame information, the picture size and the picture drawing frame information.
Specifically, a drawing frame standard table is generated according to the acquired character type, the character drawing frame information, the picture size and the picture drawing frame information, and a corresponding relation between each type of information to be drawn and the corresponding drawing frame information is established in the drawing frame standard table, so that the drawing frame corresponding to each type of information to be drawn is determined subsequently, and further the coordinate information of the drawing frame is determined.
S100, information to be sketched is obtained.
S200, identifying the information type of the information to be sketched.
And S300, determining the information of the delineation frame of the information to be delineated according to the information type by combining the standard table of the delineation frame.
And S400, generating coordinate information of the delineation frame according to the delineation frame information.
S500, analyzing a user operation coordinate according to the user operation information, comparing the user operation coordinate with the coordinate information of the drawing frame, and determining a target drawing frame.
In this embodiment, various types of information such as characters, pictures, formulas and the like of each category are collected, the drawing frame information corresponding to different types of information is set according to the needs of the user or the preference habits of most users to generate the drawing frame standard table, and then when standard drawing frame coordinate information is calibrated for the teaching material, drawing is performed according to the drawing frame standard table, so that all drawing frames are drawn according to a unified standard, and the problem that the search accuracy is reduced due to inconsistent manual drawing standards is solved.
Another embodiment of the present invention is a preferable embodiment of the above-mentioned embodiment, as shown in fig. 3, including:
s100, information to be sketched is obtained.
S200, identifying the information type of the information to be sketched.
And S300, determining the information of the delineation frame of the information to be delineated according to the information type by combining the standard table of the delineation frame.
And S400, generating coordinate information of the delineation frame according to the delineation frame information.
S500, analyzing a user operation coordinate according to user operation information, comparing the user operation coordinate with the coordinate information of the drawing frame, and determining a target drawing frame specifically comprises the following steps:
s510, when the user operation is clicking, comparing the user operation coordinate corresponding to the clicking position with the coordinate information of the drawing frame, and determining a target drawing frame.
Specifically, the user's operation may be various, such as clicking, sliding, frame selection, and the like. If the user operation is clicking, the user operation coordinate corresponding to the clicking position is unique, and therefore the user operation coordinate is compared with the drawing coordinate information, and the target drawing frame is determined.
S520, when the user operation is sliding or frame selection, all the corresponding user operation coordinates in the operation process are compared with the coordinate information of the drawing frames, and a plurality of matching drawing frames are determined.
S530, determining a target delineation box according to the plurality of matching delineation boxes.
Specifically, when the user operation is sliding or frame selection, a plurality of user operation coordinates are involved in the operation process, all the user operation coordinates are compared with the coordinate information of the delineation frame one by one, so that a plurality of matching delineation frames which are matched with each other are obtained, and the plurality of matching delineation frames are integrated to determine the target delineation frame.
In the embodiment, when the user operation is clicking and non-clicking (sliding, frame selection and the like), the user operation coordinates with different numbers are corresponding, so that different modes are pertinently adopted for drawing, and the structure is ensured to have better adaptability.
Another embodiment of the present invention is a preferable embodiment of the above-mentioned embodiment, as shown in fig. 4, including:
s100, information to be sketched is obtained.
S200, identifying the information type of the information to be sketched.
And S300, determining the information of the delineation frame of the information to be delineated according to the information type by combining the standard table of the delineation frame.
And S400, generating coordinate information of the delineation frame according to the delineation frame information.
S500, analyzing a user operation coordinate according to user operation information, comparing the user operation coordinate with the coordinate information of the drawing frame, and determining a target drawing frame specifically comprises the following steps:
s510, when the user operation is clicking, comparing the user operation coordinate corresponding to the clicking position with the coordinate information of the drawing frame, and determining a target drawing frame.
S520, when the user operation is sliding or box selection, comparing all the corresponding user operation coordinates in the operation process with the coordinate information of the delineation box, and determining a plurality of matching delineation boxes specifically includes:
and S521, when the user operation is sliding or frame selection, comparing the corresponding user operation coordinates in the operation process with the coordinate information of the drawing frame.
S522 analyzes the comparison result corresponding to each user operation coordinate.
Specifically, when the user operates in a sliding or frame selection mode, a plurality of user operation coordinates are involved in the operation process, all the user operation coordinates are compared with the coordinate information of the drawing frame one by one, and due to the fact that blank parts are reserved around the drawing frame, when the distance between adjacent information to be drawn is short and the threshold ranges of the upper boundary, the lower boundary, the left boundary and the right boundary of the drawing frame are large, the drawing frames corresponding to the adjacent information to be drawn possibly coincide, therefore, the same user operation coordinate may correspond to the coordinate information of the plurality of drawing frames, and the comparison result corresponding to each user operation coordinate needs to be further analyzed.
S523, if the comparison ratio between any one of the user operation coordinates and the coordinate information of the delineating frame is greater than or equal to the preset threshold, determining the delineating frame corresponding to the coordinate information of the delineating frame as a matching delineating frame.
S530, determining a target delineation box according to the plurality of matching delineation boxes.
Specifically, if the comparison ratio of any one user operation coordinate to the coordinate information of one of the drawing frames is greater than or equal to a preset threshold value, that is, the user operation coordinate is at the center position of one of the drawing frames or at a position closer to the center, the drawing frame corresponding to the coordinate information of the drawing frame is determined as a matching drawing frame. And if one user operation coordinate does not have a corresponding matching delineation box, the user operation coordinate is invalid. And finally, integrating all the matching delineation boxes to determine a target delineation box.
In this embodiment, when a plurality of user operation coordinates are involved in the operation process, whether each user operation coordinate has a corresponding matching delineation box is further determined, otherwise, the user operation coordinate is determined to be invalid, and misoperation in the user operation process is avoided.
One embodiment of the present invention, as shown in fig. 5, is a system 1000 for generating a delineation box, including:
the information acquisition module 1100 is used for acquiring information to be sketched;
specifically, information to be outlined of data such as book teaching materials is acquired. When the book teaching material is paper file material, scanning each page of the material page by page with scanner to obtain the scanned book drawing, i.e. the information to be sketched. In addition, if the data such as book teaching materials and the like has electronic file data, the electronic file can also be directly acquired as the information to be sketched.
A category identification module 1200, configured to identify an information category of the information to be sketched, which is acquired by the information acquisition module 1100;
specifically, the information types of the information to be outlined are identified, and the information types include various types of information which may appear in book teaching materials such as characters, formulas and pictures. In addition, for a word of english type or the like containing a plurality of letters, all information to be outlined needs to be recognized first and divided into words. Similarly, the formula is also included, and information belonging to the same formula is also required to be identified and then subjected to subsequent operations as a whole.
The processing module 1300, which determines the information of the delineating frame of the information to be delineated according to the information type identified by the type identification module 1200 by combining with the delineating frame standard table;
specifically, the information of the drawing frame of the information to be drawn is determined according to the information type by combining with the standard table of the drawing frame, and the standard table of the drawing frame is provided with information such as the size of the drawing frame corresponding to each type of information to be drawn. For example, when the information to be outlined is a character, the corresponding outline box is in a range from the upper, lower, left, right and four boundaries to the threshold of the character. When the information to be sketched is a formula or a picture, firstly, a complete formula or picture is identified, and then, the distance formula of four boundary distances from the upper side, the lower side, the left side and the right side of a corresponding sketching frame or the threshold range of the picture edge is determined.
The coordinate generating module 1400 is configured to generate coordinate information of the delineating frame according to the delineating frame information determined by the processing module 1300;
specifically, the coordinate information of the delineating frame corresponding to each piece of information to be delineated is generated according to the delineating frame information, because the content of the information to be delineated is different and the size of the corresponding delineating frame is different, the coordinate information of the delineating frame includes the coordinate information of all points in the corresponding delineating frame.
The threshold ranges of the four boundaries of the drawing frame, which are up, down, left, right, and left, away from the edge of the text information to be drawn can be adjusted as required, and when the threshold is large and the distance between the information to be drawn is short, the same part may exist between the coordinate information of the drawing frame corresponding to the adjacent information to be drawn.
The analysis module 1500 analyzes the user operation coordinates according to the user operation information, compares the user operation coordinates with the coordinate information of the delineation box generated by the coordinate generation module 1400, and determines a target delineation box.
Specifically, user operation information is acquired, and then a user operation coordinate is analyzed according to the user operation information, that is, a position clicked by a finger of the user or other clicked objects is analyzed. And comparing the user operation coordinate with the coordinate information of the drawing frame, determining a target drawing frame if the comparison is in accordance with the comparison, identifying the intention of the user, and calling the corresponding learning material.
If the user operation information is acquired through the graph search technology, the operation picture of the user is acquired through the camera device, the contact point of the clicked object of the user and data such as book teaching materials is identified to serve as the user operation information, and the clicked object does not have special requirements and can be a finger of the user or an article such as a pen. If the user operation information is acquired through the sensing device, the clicked object is bound at first, so that the clicked position of the user can be sensed conveniently.
In this embodiment, through standardizing the setting to the drawing frame to drawing frame standard table, select the corresponding drawing frame that drawing frame information corresponds respectively based on the information type of waiting to draw the information, avoid the drawing frame size that artifical drawing leads to not uniform problem of the rate of accuracy of click discernment that leads to.
Another embodiment of the present invention is a preferable embodiment of the above-mentioned embodiment, as shown in fig. 6, including:
the information acquisition module 1100 is used for acquiring the character type and the corresponding character delineation box information;
specifically, character categories and corresponding character delineation box information are obtained, where the character categories include information that influences the size of the delineation box, such as the language type (chinese, english, etc.), the font (song style, regular style, etc.), and the size of the characters, and the corresponding character delineation box information is a threshold range between the upper, lower, left, and right boundaries of the delineation box and the character edges, for example, the distances between the upper, lower, left, and right boundaries of the delineation box corresponding to each chinese character in the song style are set to be 1 cm, where the distances between the upper, lower, left, and right boundaries and the character edges may be the same or different from each other.
The threshold range is set by a user, and different language types and font sizes can be the same or different. For example, the distance between the upper, lower, left, and right boundaries of the outline box corresponding to the english word and the edge of the character is set to 1 cm, and the distance between the upper, lower, left, and right boundaries of the outline box corresponding to the chinese character of the song style and the edge of the character is set to 1.5 cm.
In addition, for a word of english type or the like containing a plurality of letters, all information to be outlined needs to be recognized first and divided into words. Similarly, the formula is also included, and information belonging to the same formula is also required to be identified and then subjected to subsequent operations as a whole. For the convenience of analysis, the information to be outlined is divided by taking the minimum whole as a unit, such as a Chinese character, a word and the like.
The information acquisition module 1100 is configured to acquire a picture size and corresponding picture delineation frame information;
specifically, the picture size and the corresponding picture delineation frame information are obtained, that is, the threshold ranges of the four boundaries, upper, lower, left and right, between the picture edge and the delineation frame corresponding to the picture of each size are obtained. Similarly, the threshold ranges are set by the user, and the threshold ranges corresponding to different sizes of pictures may be the same or different. The distances from the upper, lower, left and right boundaries to the text edges may be the same or different.
In addition, the threshold ranges of the distance edges between the upper boundary, the lower boundary, the left boundary and the right boundary of the delineation frame can be set by a system and defined by a user, and the use habits of a target user group can be collected and analyzed to obtain the threshold range suitable for the corresponding group.
The standard table generating module 1600 is configured to generate the drawing frame standard table according to the text type, the text drawing frame information, the picture size, and the picture drawing frame information acquired by the information acquiring module 1100;
specifically, a drawing frame standard table is generated according to the acquired character type, the character drawing frame information, the picture size and the picture drawing frame information, and a corresponding relation between each type of information to be drawn and the corresponding drawing frame information is established in the drawing frame standard table, so that the drawing frame corresponding to each type of information to be drawn is determined subsequently, and further the coordinate information of the drawing frame is determined.
In this embodiment, various types of information such as characters, pictures, formulas and the like of each category are collected, the drawing frame information corresponding to different types of information is set according to the needs of the user or the preference habits of most users to generate the drawing frame standard table, and then when standard drawing frame coordinate information is calibrated for the teaching material, drawing is performed according to the drawing frame standard table, so that all drawing frames are drawn according to a unified standard, and the problem that the search accuracy is reduced due to inconsistent manual drawing standards is solved.
The information acquisition module 1100 is used for acquiring information to be sketched;
a category identification module 1200, configured to identify an information category of the information to be sketched, which is acquired by the information acquisition module 1100;
the processing module 1300, which determines the information of the delineating frame of the information to be delineated according to the information type identified by the type identification module 1200 by combining with the delineating frame standard table;
the coordinate generating module 1400 is configured to generate coordinate information of the delineating frame according to the delineating frame information determined by the processing module 1300;
the analysis module 1500 analyzes the user operation coordinates according to the user operation information, compares the user operation coordinates with the coordinate information of the delineation box generated by the coordinate generation module 1400, and determines a target delineation box.
The analysis module 1500 specifically includes:
the analysis unit 1510 compares a user operation coordinate corresponding to a click position with the coordinate information of the drawing frame to determine a target drawing frame when the user operation is a click;
specifically, the user's operation may be various, such as clicking, sliding, frame selection, and the like. If the user operation is clicking, the user operation coordinate corresponding to the clicking position is unique, and therefore the user operation coordinate is compared with the drawing coordinate information, and the target drawing frame is determined.
A comparing unit 1520, when the user operation is sliding or frame selection, comparing all corresponding user operation coordinates in the operation process with the coordinate information of the drawing frames, and determining a plurality of matching drawing frames;
the alignment unit 1520 specifically includes:
comparing the sub-unit 1521, when the user operation is sliding or frame selection, comparing the corresponding user operation coordinates in the operation process with the coordinate information of the delineation frame;
the analysis subunit 1522 is configured to analyze a comparison result corresponding to each user operation coordinate obtained by the comparison subunit 1521;
specifically, when the user operates in a sliding or frame selection mode, a plurality of user operation coordinates are involved in the operation process, all the user operation coordinates are compared with the coordinate information of the drawing frame one by one, and due to the fact that blank parts are reserved around the drawing frame, when the distance between adjacent information to be drawn is short and the threshold ranges of the upper boundary, the lower boundary, the left boundary and the right boundary of the drawing frame are large, the drawing frames corresponding to the adjacent information to be drawn possibly coincide, therefore, the same user operation coordinate may correspond to the coordinate information of the plurality of drawing frames, and the comparison result corresponding to each user operation coordinate needs to be further analyzed.
The processing subunit 1523, if the analyzing subunit 1522 determines that the comparison ratio between any one of the user operation coordinates and the coordinate information of the drawing frame is greater than or equal to a preset threshold, determines the drawing frame corresponding to the coordinate information of the drawing frame as a matching drawing frame.
Specifically, if the comparison ratio of any one user operation coordinate to the coordinate information of one of the drawing frames is greater than or equal to a preset threshold value, that is, the user operation coordinate is at the center position of one of the drawing frames or at a position closer to the center, the drawing frame corresponding to the coordinate information of the drawing frame is determined as a matching drawing frame. And if one user operation coordinate does not have a corresponding matching delineation box, the user operation coordinate is invalid. And finally, integrating all the matching delineation boxes to determine a target delineation box.
In this embodiment, when a plurality of user operation coordinates are involved in the operation process, whether each user operation coordinate has a corresponding matching delineation box is further determined, otherwise, the user operation coordinate is determined to be invalid, and misoperation in the user operation process is avoided.
The analyzing unit 1510 determines a target delineation box according to the plurality of matching delineation boxes determined by the comparing unit 1520.
Specifically, when the user operation is sliding or frame selection, a plurality of user operation coordinates are involved in the operation process, all the user operation coordinates are compared with the coordinate information of the delineation frame one by one, so that a plurality of matching delineation frames which are matched with each other are obtained, and the plurality of matching delineation frames are integrated to determine the target delineation frame.
In the embodiment, when the user operation is clicking and non-clicking (sliding, frame selection and the like), the user operation coordinates with different numbers are corresponding, so that different modes are pertinently adopted for drawing, and the structure is ensured to have better adaptability.
An embodiment of the invention provides a computer-readable storage medium, on which a computer program is stored which, when being executed by a processor, carries out all or part of the method steps of the first embodiment.
The present invention can implement all or part of the flow in the method of the first embodiment, and can also be implemented by using a computer program to instruct related hardware, where the computer program can be stored in a computer-readable storage medium, and when the computer program is executed by a processor, the steps of the method embodiments can be implemented. Wherein the computer program comprises computer program code, which may be in the form of source code, object code, an executable file or some intermediate form, etc. The computer-readable medium may include: any entity or device capable of carrying the computer program code, recording medium, usb disk, removable hard disk, magnetic disk, optical disk, computer Memory, Read-only Memory (ROM), Random Access Memory (RAM), electrical carrier wave signals, telecommunications signals, software distribution medium, etc. It should be noted that the computer readable medium may contain content that is subject to appropriate increase or decrease as required by legislation and patent practice in jurisdictions, for example, in some jurisdictions, computer readable media does not include electrical carrier signals and telecommunications signals as is required by legislation and patent practice.
An embodiment of the present invention further provides an electronic device, which includes a memory and a processor, wherein the memory stores a computer program running on the processor, and the processor executes the computer program to implement all or part of the method steps in the first embodiment.
The Processor may be a Central Processing Unit (CPU), other general purpose Processor, a Digital Signal Processor (DSP), an Application Specific Integrated Circuit (ASIC), an off-the-shelf Programmable Gate Array (FPGA) or other Programmable logic device, discrete Gate or transistor logic, discrete hardware components, etc. The general purpose processor may be a microprocessor or the processor may be any conventional processor or the like which is the control center for the computer device and which connects the various parts of the overall computer device using various interfaces and lines.
The memory may be used to store the computer programs and/or modules, and the processor may implement various functions of the computer device by running or executing the computer programs and/or modules stored in the memory and invoking data stored in the memory. The memory may mainly include a storage program area and a storage data area, wherein the storage program area may store an operating system, an application program required by at least one function (such as a sound playing function, an image playing function, etc.), and the like; the storage data area may store data (such as audio data, video data, etc.) created according to the use of the cellular phone, etc. In addition, the memory may include high speed random access memory, and may also include non-volatile memory, such as a hard disk, a memory, a plug-in hard disk, a Smart Media Card (SMC), a Secure Digital (SD) Card, a Flash memory Card (Flash Card), at least one magnetic disk storage device, a Flash memory device, or other volatile solid state storage device.
It should be noted that the above embodiments can be freely combined as necessary. The foregoing is only a preferred embodiment of the present invention, and it should be noted that, for those skilled in the art, various modifications and decorations can be made without departing from the principle of the present invention, and these modifications and decorations should also be regarded as the protection scope of the present invention.
Claims (10)
1. A method for generating a delineation box is characterized by comprising the following steps:
acquiring information to be sketched;
identifying the information type of the information to be sketched;
determining the information of the delineating frame of the information to be delineated according to the information type by combining a delineating frame standard table;
generating coordinate information of the delineating frame according to the delineating frame information;
and analyzing a user operation coordinate according to the user operation information, comparing the user operation coordinate with the coordinate information of the drawing frame, and determining the target drawing frame.
2. The method for generating a delineation box according to claim 1, wherein before obtaining the information to be delineated, the method further comprises:
acquiring character categories and corresponding character outline box information;
acquiring the size of a picture and corresponding information of a picture delineation frame;
and generating the drawing frame standard table according to the character category, the character drawing frame information, the picture size and the picture drawing frame information.
3. The method for generating a drawing box according to claim 1, wherein analyzing a user operation coordinate according to user operation information, comparing the user operation coordinate with the drawing box coordinate information, and determining a target drawing box specifically includes:
when the user operation is clicking, comparing the user operation coordinate corresponding to the clicking position with the coordinate information of the drawing frame, and determining a target drawing frame;
when the user operation is sliding or frame selection, comparing all corresponding user operation coordinates in the operation process with the coordinate information of the drawing frames to determine a plurality of matching drawing frames;
and determining a target delineation frame according to the plurality of matching delineation frames.
4. The method for generating a delineation box according to claim 3, wherein when the user operation is sliding or box selection, comparing all corresponding user operation coordinates in an operation process with the delineation box coordinate information, and determining a plurality of matching delineation boxes specifically comprises:
when the user operation is sliding or frame selection, comparing each corresponding user operation coordinate in the operation process with the coordinate information of the drawing frame;
analyzing a comparison result corresponding to each user operation coordinate;
and if the comparison ratio of any user operation coordinate to the coordinate information of the drawing frame is greater than or equal to a preset threshold value, determining the drawing frame corresponding to the coordinate information of the drawing frame as a matching drawing frame.
5. A system for generating a delineation box, comprising:
the information acquisition module is used for acquiring information to be sketched;
the type identification module is used for identifying the information type of the information to be sketched, which is acquired by the information acquisition module;
the processing module is used for determining the information of the delineating frame of the information to be delineated according to the information type identified by the type identification module by combining a delineating frame standard table;
the coordinate generating module is used for generating coordinate information of the delineating frame according to the delineating frame information determined by the processing module;
and the analysis module is used for analyzing a user operation coordinate according to the user operation information, comparing the user operation coordinate with the coordinate information of the drawing frame generated by the coordinate generation module and determining the target drawing frame.
6. The system for generating a delineation box of claim 5, further comprising:
the information acquisition module acquires the character type and the corresponding character outline box information;
the information acquisition module acquires the size of the picture and the corresponding information of the picture delineation frame;
and the standard table generating module is used for generating the drawing frame standard table according to the character type, the character drawing frame information, the picture size and the picture drawing frame information acquired by the information acquiring module.
7. The system for generating a delineation box of claim 5, wherein the analysis module specifically comprises:
the analysis unit is used for comparing a user operation coordinate corresponding to a click position with the coordinate information of the drawing frame to determine a target drawing frame when the user operation is clicking;
the comparison unit is used for comparing all corresponding user operation coordinates in the operation process with the coordinate information of the drawing frames when the user operation is sliding or frame selection, and determining a plurality of matching drawing frames;
the analysis unit determines a target delineation frame according to the plurality of matching delineation frames determined by the comparison unit.
8. The system for generating a delineation box of claim 7, wherein the alignment unit comprises:
the comparison subunit compares each corresponding user operation coordinate in the operation process with the coordinate information of the delineation box when the user operation is sliding or frame selection;
the analysis subunit analyzes the comparison result corresponding to each user operation coordinate obtained by the comparison subunit;
and the processing subunit determines the delineating frame corresponding to the delineating frame coordinate information as a matching delineating frame if the analysis subunit determines that the comparison ratio between any one user operation coordinate and the delineating frame coordinate information is greater than or equal to a preset threshold value.
9. A storage medium having a computer program stored thereon, characterized in that: the computer program, when executed by a processor, implements the method of any of claims 1 to 4.
10. An electronic device comprising a memory and a processor, the memory having stored thereon a computer program that runs on the processor, characterized in that: the processor, when executing the computer program, implements the method of any of claims 1 to 4.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910886968.1A CN110619773A (en) | 2019-09-19 | 2019-09-19 | Method and system for generating outline box, storage medium and electronic equipment |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910886968.1A CN110619773A (en) | 2019-09-19 | 2019-09-19 | Method and system for generating outline box, storage medium and electronic equipment |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN110619773A true CN110619773A (en) | 2019-12-27 |
Family
ID=68923700
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201910886968.1A Pending CN110619773A (en) | 2019-09-19 | 2019-09-19 | Method and system for generating outline box, storage medium and electronic equipment |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN110619773A (en) |
Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN105446628A (en) * | 2015-12-31 | 2016-03-30 | 田雪松 | Electronic reading method |
| CN106462966A (en) * | 2014-05-13 | 2017-02-22 | 斯特林实验室有限公司 | Perimeter detection |
| CN107358226A (en) * | 2017-06-23 | 2017-11-17 | 联想(北京)有限公司 | The recognition methods of electronic equipment and electronic equipment |
| CN107885430A (en) * | 2017-11-07 | 2018-04-06 | 广东欧珀移动通信有限公司 | A kind of audio frequency playing method, device, storage medium and electronic equipment |
| EP3460750A1 (en) * | 2017-09-20 | 2019-03-27 | DKFZ Deutsches Krebsforschungszentrum | Method, system and computer program for computer-assisted evaluation of biomarkers in a tissue sample |
| CN109636782A (en) * | 2018-11-30 | 2019-04-16 | 苏州深析智能科技有限公司 | A kind of cell type analysis model training method, device and analysis method |
| CN110009643A (en) * | 2016-05-14 | 2019-07-12 | 谷歌有限责任公司 | The pixel of screenshotss image based on capture content will show content segmentation at region |
-
2019
- 2019-09-19 CN CN201910886968.1A patent/CN110619773A/en active Pending
Patent Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN106462966A (en) * | 2014-05-13 | 2017-02-22 | 斯特林实验室有限公司 | Perimeter detection |
| CN105446628A (en) * | 2015-12-31 | 2016-03-30 | 田雪松 | Electronic reading method |
| CN110009643A (en) * | 2016-05-14 | 2019-07-12 | 谷歌有限责任公司 | The pixel of screenshotss image based on capture content will show content segmentation at region |
| CN107358226A (en) * | 2017-06-23 | 2017-11-17 | 联想(北京)有限公司 | The recognition methods of electronic equipment and electronic equipment |
| EP3460750A1 (en) * | 2017-09-20 | 2019-03-27 | DKFZ Deutsches Krebsforschungszentrum | Method, system and computer program for computer-assisted evaluation of biomarkers in a tissue sample |
| CN107885430A (en) * | 2017-11-07 | 2018-04-06 | 广东欧珀移动通信有限公司 | A kind of audio frequency playing method, device, storage medium and electronic equipment |
| CN109636782A (en) * | 2018-11-30 | 2019-04-16 | 苏州深析智能科技有限公司 | A kind of cell type analysis model training method, device and analysis method |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN109461167B (en) | Training method, matting method, device, medium and terminal of image processing model | |
| CN106484266B (en) | Text processing method and device | |
| CN108319592B (en) | Translation method and device and intelligent terminal | |
| TWI595366B (en) | Detection and reconstruction of east asian layout features in a fixed format document | |
| KR102240279B1 (en) | Content processing method and electronic device thereof | |
| US10684771B2 (en) | User device and method for creating handwriting content | |
| US10614300B2 (en) | Formatting handwritten content | |
| CN107977155B (en) | Handwriting recognition method, device, equipment and storage medium | |
| US11341319B2 (en) | Visual data mapping | |
| US9710701B2 (en) | Handwriting data search | |
| US9031831B1 (en) | Method and system for looking up words on a display screen by OCR comprising a set of base forms of recognized inflected words | |
| CN114067797A (en) | Voice control method, device, equipment and computer storage medium | |
| CN111027533A (en) | Conversion method and system of point-to-read coordinates, terminal device and storage medium | |
| CN109492249B (en) | Rapid generation method and device of design drawing and terminal equipment | |
| US20220171528A1 (en) | Digital ink processing system, method, and program | |
| US10387721B2 (en) | Information handling device handwriting clean-up | |
| CN110619773A (en) | Method and system for generating outline box, storage medium and electronic equipment | |
| CN106776634A (en) | A kind of method for network access, device and terminal device | |
| CN111062377A (en) | Question number detection method, system, storage medium and electronic equipment | |
| CN108021648B (en) | Question searching method and device and intelligent terminal | |
| CN113378526A (en) | PDF paragraph processing method, device, storage medium and equipment | |
| CN113778595A (en) | Document generation method and device and electronic equipment | |
| CN111831848A (en) | Composition good word and sentence recommendation method and device and terminal equipment | |
| CN110634342A (en) | Identification method and system of outlining frame, storage medium and electronic equipment | |
| CN104007886A (en) | Information processing method and electronic device |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20191227 |
|
| RJ01 | Rejection of invention patent application after publication |