CN114882513A - Data identification method and intelligent interactive display equipment - Google Patents

Data identification method and intelligent interactive display equipment Download PDF

Info

Publication number
CN114882513A
CN114882513A CN202210461804.6A CN202210461804A CN114882513A CN 114882513 A CN114882513 A CN 114882513A CN 202210461804 A CN202210461804 A CN 202210461804A CN 114882513 A CN114882513 A CN 114882513A
Authority
CN
China
Prior art keywords
handwriting information
cell
cells
bound
handwriting
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN202210461804.6A
Other languages
Chinese (zh)
Inventor
卞甲慧
张阳阳
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
BOE Technology Group Co Ltd
Original Assignee
BOE Technology Group Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by BOE Technology Group Co Ltd filed Critical BOE Technology Group Co Ltd
Priority to CN202210461804.6A priority Critical patent/CN114882513A/en
Publication of CN114882513A publication Critical patent/CN114882513A/en
Pending legal-status Critical Current

Links

Images

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V30/00—Character recognition; Recognising digital ink; Document-oriented image-based pattern recognition
    • G06V30/10—Character recognition
    • G06V30/32—Digital ink
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N3/00—Computing arrangements based on biological models
    • G06N3/02—Neural networks
    • G06N3/04—Architecture, e.g. interconnection topology
    • G06N3/044—Recurrent networks, e.g. Hopfield networks
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N3/00—Computing arrangements based on biological models
    • G06N3/02—Neural networks
    • G06N3/04—Architecture, e.g. interconnection topology
    • G06N3/045—Combinations of networks
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V30/00—Character recognition; Recognising digital ink; Document-oriented image-based pattern recognition
    • G06V30/10—Character recognition
    • G06V30/19—Recognition using electronic means
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V30/00—Character recognition; Recognising digital ink; Document-oriented image-based pattern recognition
    • G06V30/40—Document-oriented image-based pattern recognition
    • G06V30/41—Analysis of document content
    • G06V30/412—Layout analysis of documents structured with printed lines or input boxes, e.g. business forms or tables

Landscapes

  • Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • Theoretical Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Multimedia (AREA)
  • Artificial Intelligence (AREA)
  • General Health & Medical Sciences (AREA)
  • Biophysics (AREA)
  • Evolutionary Computation (AREA)
  • Computational Linguistics (AREA)
  • Molecular Biology (AREA)
  • Computing Systems (AREA)
  • General Engineering & Computer Science (AREA)
  • Data Mining & Analysis (AREA)
  • Mathematical Physics (AREA)
  • Software Systems (AREA)
  • Biomedical Technology (AREA)
  • Life Sciences & Earth Sciences (AREA)
  • Health & Medical Sciences (AREA)
  • User Interface Of Digital Computer (AREA)

Abstract

The invention discloses a data identification method and intelligent interactive display equipment, which are used for distinguishing written contents of a user, avoiding identifying the whole content, supporting the user to partially modify scenes and improving the identification accuracy. The method comprises the following steps: receiving first handwriting information written by a user; determining second handwriting information bound with at least one cell from the first handwriting information according to the position relation between each cell in the generated table and the first handwriting information; and identifying the second handwriting information bound to at least one cell to obtain identification data corresponding to the at least one cell.

Description

Data identification method and intelligent interactive display equipment
Technical Field
The invention relates to the technical field of data processing, in particular to a data identification method and intelligent interactive display equipment.
Background
The intelligent conference is an office product integrating various devices such as an electronic whiteboard, a computer and a remote conference terminal, and has various functions such as an interactive intelligent whiteboard. With the progress of high-precision positioning technologies such as infrared, electromagnetic and capacitive touch, the electronic whiteboard can achieve touch writing, in the process of writing by using the electronic whiteboard, an array on the electronic whiteboard often needs to be presented in a chart form, and a chart corresponding to data is generated through data manually drawn on the electronic whiteboard by a user.
However, at present, there are many defects in the identification of data manually drawn by a user, and the identification is usually performed on the whole content written by the user on the electronic whiteboard, so that the identification accuracy is low, and the user experience is poor.
Disclosure of Invention
The invention provides a data identification method and intelligent interactive display equipment, which are used for distinguishing written contents of a user, avoiding identifying the whole content, supporting the user to locally modify scenes and improving the identification accuracy.
In a first aspect, an embodiment of the present invention provides a data identification method, where the method includes:
receiving first handwriting information written by a user;
determining second handwriting information bound with at least one cell from the first handwriting information according to the position relation between each cell in the generated table and the first handwriting information;
and identifying the second handwriting information bound to at least one cell to obtain identification data corresponding to the at least one cell.
According to the data identification method provided by the embodiment, the binding relationship between the cells in the generated table and the first handwriting information written by the user is utilized to identify the second handwriting information bound to the cells independently, so that the integral content written by the user is prevented from being identified once, the array written by the user is determined based on the binding relationship with each cell, the row-column relationship is determined according to the binding relationship, and the accurate table is drawn.
As an alternative to the above-described embodiment,
the form is generated according to first handwriting information written by the user; or the like, or, alternatively,
the table is generated according to preset row and column parameters.
As an alternative embodiment, the receiving the first handwriting information written by the user includes:
displaying the generated table in a display area;
receiving first handwriting information written by a user in the displayed cells of the form.
As an optional implementation manner, the determining, according to a position relationship between each cell in the generated table and the first handwriting information, second handwriting information bound to at least one cell from the first handwriting information includes:
when the first handwriting information is located in the cell, determining the first handwriting information as second handwriting information bound to the cell; or the like, or, alternatively,
when the pen-falling point of the first handwriting information is located in the cell, determining the first handwriting information as second handwriting information bound to the cell; or the like, or, alternatively,
and when the gravity center of the first handwriting information is positioned in the cell, determining the first handwriting information as second handwriting information bound by the cell.
As an optional implementation manner, the size of the table is adaptively adjusted according to the size of the second handwriting information bound by the cells.
As an optional implementation manner, the method further includes:
and when the second handwriting information bound to the cells exceeds the area covered by the cells, expanding the rows and columns where the cells are located so as to enable the second handwriting information to be located in the area covered by the cells.
As an optional implementation, the method further includes:
determining at least one cell offset in the table other than the expanded cell, wherein the cell offset is formed based on the expanded cells in the table;
and correspondingly offsetting the second handwriting information bound by the at least one offset cell according to the offset of the at least one offset cell.
As an optional implementation manner, after obtaining the identification data corresponding to the cell, the method further includes:
converting the identification data into standard data meeting preset specifications;
and scaling the standard data according to the size of the area covered by the cells so as to enable the standard data to be positioned in the area covered by the cells.
As an optional implementation, the method further includes:
and identifying the second handwriting information bound to the cells in the table at least twice.
As an optional implementation, the at least twice recognition of the second handwriting information of the cell binding in the table includes:
and after the second handwriting information bound to the cell is identified last time, identifying the second handwriting information bound to the cell at this time when the second handwriting information bound to the cell is determined to be changed.
As an optional implementation, the determining that the second handwriting information of the cell binding is changed includes:
comparing the second handwriting information bound by the cell before the current recognition with the second handwriting information bound by the cell during the last recognition;
and when the comparison result is inconsistent, determining that the second handwriting information bound by the cell changes.
As an optional implementation manner, when the comparison result is inconsistent, identifying the second handwriting information bound to the cell at this time includes:
when the comparison result is inconsistent, identifying second handwriting information bound to the cells in the table at the current time by using a second identification algorithm;
wherein, the last identification uses a first identification algorithm.
As an alternative to the above-described embodiment,
the first identification algorithm comprises a recurrent neural network algorithm; the second identification algorithm comprises a convolutional neural network algorithm.
As an alternative to the above-described embodiment,
and the changed second handwriting information is obtained by at least one of modifying, deleting and adding the second handwriting information bound to the cell after the user identifies the second handwriting information bound to the cell last time.
As an optional implementation manner, the recognizing the second handwriting information bound to the at least one cell to obtain recognition data corresponding to the at least one cell includes:
when a plurality of cells in the table are bound with second handwriting information, identifying the second handwriting information bound by the cells in parallel;
and determining the corresponding relation between the identification data obtained by identification and the plurality of cells according to the row and column information of the cells bound with the second handwriting information in the table to obtain the identification data corresponding to the plurality of cells respectively.
As an optional implementation, the method further includes:
and after the identification data corresponding to the plurality of cells are obtained, generating a chart according to the identification data corresponding to the plurality of cells and the row and column information of each cell in the table.
As an alternative embodiment, the transparency of the tabular display is adjustable.
As an alternative embodiment, the table is not displayed in the display area.
In a second aspect, an intelligent interactive display device provided in an embodiment of the present invention includes a display screen and a control circuit, where:
the display screen is used for displaying content;
the control circuit comprises a processor and a memory, wherein the memory is used for storing programs executable by the processor, and the processor is used for reading the programs in the memory and executing the following steps:
receiving first handwriting information written by a user;
determining second handwriting information bound with at least one cell from the first handwriting information according to the position relation between each cell in the generated table and the first handwriting information;
and identifying the second handwriting information bound to at least one cell to obtain identification data corresponding to the at least one cell.
As an alternative to the above-described embodiment,
the form is generated according to the first handwriting information written by the user; or the like, or, alternatively,
the table is generated according to preset row and column parameters.
As an alternative embodiment, the processor is configured to perform:
displaying the generated table in a display area;
receiving first handwriting information written by a user in the displayed cells of the form.
As an alternative embodiment, the processor is configured to perform:
when the first handwriting information is located in the cell, determining the first handwriting information as second handwriting information bound to the cell; or the like, or, alternatively,
when the pen-falling point of the first handwriting information is located in the cell, determining the first handwriting information as second handwriting information bound to the cell; or the like, or, alternatively,
and when the gravity center of the first handwriting information is positioned in the cell, determining the first handwriting information as second handwriting information bound by the cell.
As an optional implementation manner, the size of the table is adaptively adjusted according to the size of the second handwriting information bound by the cells.
As an optional implementation manner, the processor is specifically further configured to perform:
and when the second handwriting information bound to the cells exceeds the area covered by the cells, expanding the rows and columns where the cells are located so as to enable the second handwriting information to be located in the area covered by the cells.
As an optional implementation manner, the processor is specifically further configured to perform:
determining at least one cell offset in the table other than the expanded cell, wherein the cell offset is formed based on the expanded cells in the table;
and correspondingly offsetting the second handwriting information bound by the at least one offset cell according to the offset of the at least one offset cell.
As an optional implementation manner, after obtaining the identification data corresponding to the cell, the processor is further specifically configured to perform:
converting the identification data into standard data meeting preset specifications;
and scaling the standard data according to the size of the area covered by the cells so as to enable the standard data to be positioned in the area covered by the cells.
As an optional implementation manner, the processor is specifically further configured to perform:
and identifying the second handwriting information bound to the cells in the table at least twice.
As an alternative embodiment, the processor is configured to perform:
and after the second handwriting information bound to the cell is identified last time, identifying the second handwriting information bound to the cell at this time when the second handwriting information bound to the cell is determined to be changed.
As an alternative embodiment, the processor is configured to perform:
comparing the second handwriting information bound by the cell before the current recognition with the second handwriting information bound by the cell during the last recognition;
and when the comparison result is inconsistent, determining that the second handwriting information bound by the cell changes.
As an alternative embodiment, the processor is configured to perform:
when the comparison result is inconsistent, identifying second handwriting information bound to the cells in the table at the current time by using a second identification algorithm;
wherein, the last identification uses a first identification algorithm.
As an alternative to the above-described embodiment,
the first identification algorithm comprises a recurrent neural network algorithm; the second identification algorithm comprises a convolutional neural network algorithm.
As an alternative to the above-described embodiment,
and the changed second handwriting information is obtained by at least one of modifying, deleting and adding the second handwriting information bound to the cell after the user identifies the second handwriting information bound to the cell last time.
As an alternative embodiment, the processor is configured to perform:
when a plurality of cells in the table are bound with second handwriting information, identifying the second handwriting information bound by the cells in parallel;
and determining the corresponding relation between the identification data obtained by identification and the plurality of cells according to the row and column information of the cells bound with the second handwriting information in the table to obtain the identification data corresponding to the plurality of cells respectively.
As an optional implementation manner, the processor is specifically further configured to perform:
and after the identification data corresponding to the plurality of cells are obtained, generating a chart according to the identification data corresponding to the plurality of cells and the row and column information of each cell in the table.
As an alternative embodiment, the transparency of the tabular display is adjustable.
As an alternative embodiment, the table is not displayed in the display area.
In a third aspect, an embodiment of the present invention further provides a data identification apparatus, including:
the receiving unit is used for receiving first handwriting information written by a user;
the binding unit is used for determining second handwriting information bound with at least one cell from the first handwriting information according to the position relation between each cell in the generated table and the first handwriting information;
and the recognition unit is used for recognizing the second handwriting information bound to the at least one cell to obtain recognition data corresponding to the at least one cell.
As an alternative to the above-described embodiment,
the form is generated according to first handwriting information written by the user; or the like, or, alternatively,
the table is generated according to preset row and column parameters.
As an optional implementation manner, the receiving unit is specifically configured to:
displaying the generated table in a display area;
first handwriting information written by a user in the cells of the displayed form is received.
As an optional implementation manner, the binding unit is specifically configured to:
when the first handwriting information is located in the cell, determining the first handwriting information as second handwriting information bound to the cell; or the like, or, alternatively,
when the pen-falling point of the first handwriting information is located in the cell, determining the first handwriting information as second handwriting information bound to the cell; or the like, or, alternatively,
and when the gravity center of the first handwriting information is positioned in the cell, determining the first handwriting information as second handwriting information bound by the cell.
As an optional implementation manner, the size of the table is adaptively adjusted according to the size of the second handwriting information bound by the cells.
As an optional implementation, the system further includes an expansion unit specifically configured to:
and when the second handwriting information bound to the cells exceeds the area covered by the cells, expanding the rows and columns where the cells are located so as to enable the second handwriting information to be located in the area covered by the cells.
As an optional implementation manner, the apparatus further includes an offset unit specifically configured to:
determining at least one cell offset in the table other than the expanded cell, wherein the cell offset is formed based on the expanded cells in the table;
and correspondingly offsetting the second handwriting information bound by the at least one offset cell according to the offset of the at least one offset cell.
As an optional implementation manner, after obtaining the identification data corresponding to the cell, the method further includes a scaling unit specifically configured to:
converting the identification data into standard data meeting preset specifications;
and scaling the standard data according to the size of the area covered by the cells so as to enable the standard data to be positioned in the area covered by the cells.
As an optional implementation manner, the system further includes a re-identification unit specifically configured to:
and identifying the second handwriting information bound to the cells in the table at least twice.
As an optional implementation manner, the re-identifying unit is specifically configured to:
and after the second handwriting information bound to the cell is identified last time, identifying the second handwriting information bound to the cell at this time when the second handwriting information bound to the cell is determined to be changed.
As an optional implementation manner, the re-identifying unit is specifically configured to:
comparing the second handwriting information bound by the cell before the current recognition with the second handwriting information bound by the cell during the last recognition;
and when the comparison result is inconsistent, determining that the second handwriting information bound by the cell changes.
As an optional implementation manner, the re-identifying unit is specifically configured to:
when the comparison result is inconsistent, identifying second handwriting information bound to the cells in the table at the current time by using a second identification algorithm;
wherein, the last identification uses a first identification algorithm.
As an alternative to the above-described embodiment,
the first identification algorithm comprises a recurrent neural network algorithm; the second identification algorithm comprises a convolutional neural network algorithm.
As an alternative to the above-described embodiment,
and the changed second handwriting information is obtained by at least one of modifying, deleting and adding the second handwriting information bound to the cell after the user identifies the second handwriting information bound to the cell last time.
As an optional implementation manner, the identification unit is specifically configured to:
when a plurality of cells in the table are bound with second handwriting information, identifying the second handwriting information bound by the cells in parallel;
and determining the corresponding relation between the identification data obtained by identification and the plurality of cells according to the row and column information of the cells bound with the second handwriting information in the table to obtain the identification data corresponding to the plurality of cells respectively.
As an optional implementation manner, the method further includes the step of:
and after the identification data corresponding to the plurality of cells are obtained, generating a chart according to the identification data corresponding to the plurality of cells and the row and column information of each cell in the table.
As an alternative embodiment, the transparency of the tabular display is adjustable.
As an alternative embodiment, the table is not displayed in the display area.
In a fourth aspect, an embodiment of the present invention further provides a computer storage medium, on which a computer program is stored, where the computer program is used to implement the steps of the method in the first aspect when the computer program is executed by a processor.
These and other aspects of the present application will be more readily apparent from the following description of the embodiments.
Drawings
In order to more clearly illustrate the technical solutions in the embodiments of the present invention, the drawings needed to be used in the description of the embodiments will be briefly introduced below, and it is obvious that the drawings in the following description are only some embodiments of the present invention, and it is obvious for those skilled in the art to obtain other drawings based on these drawings without inventive exercise.
Fig. 1 is a flowchart of an embodiment of a data identification method;
FIG. 2 is a diagram illustrating adaptive expansion of a table according to an embodiment of the present invention;
FIG. 3 is a diagram illustrating handwriting offset after expanding a form according to an embodiment of the present invention;
fig. 4 is a schematic diagram of adaptive adjustment contents with fixed table size according to an embodiment of the present invention;
fig. 5 is a flowchart illustrating an implementation of an identification method based on charting data according to an embodiment of the present invention;
fig. 6 is a flowchart illustrating an implementation of an identification method based on charting data according to an embodiment of the present invention;
FIG. 7 is a schematic diagram of an intelligent interactive display device according to an embodiment of the present invention;
fig. 8 is a schematic diagram of a data recognition apparatus according to an embodiment of the present invention.
Detailed Description
In order to make the objects, technical solutions and advantages of the present invention more apparent, the present invention will be described in further detail with reference to the accompanying drawings. All other embodiments, which can be obtained by a person skilled in the art without making any creative effort based on the embodiments in the present invention, belong to the protection scope of the present invention.
The term "and/or" in the embodiments of the present invention describes an association relationship of associated objects, and indicates that three relationships may exist, for example, a and/or B may indicate: a exists alone, A and B exist simultaneously, and B exists alone. The character "/" generally indicates that the former and latter associated objects are in an "or" relationship.
The application scenario described in the embodiment of the present invention is for more clearly illustrating the technical solution of the embodiment of the present invention, and does not form a limitation on the technical solution provided in the embodiment of the present invention, and it can be known by a person skilled in the art that, with the occurrence of a new application scenario, the technical solution provided in the embodiment of the present invention is also applicable to similar technical problems. In the description of the present invention, the term "plurality" means two or more unless otherwise specified.
Embodiment 1, intelligent meeting is the office product that has integrated multiple equipment such as whiteboard, computer and teleconference terminal, possesses multiple functions such as interactive intelligent whiteboard. With the progress of high-precision positioning technologies such as infrared, electromagnetic and capacitive touch, the electronic whiteboard can achieve touch writing, in the process of writing by using the electronic whiteboard, an array on the electronic whiteboard often needs to be presented in a chart form, and a chart corresponding to data is generated by data hand-drawn on the electronic whiteboard by a user. However, at present, there are many defects in the identification of data hand-drawn by a user, and generally, the identification is performed on the whole content written by the user on an electronic whiteboard, and due to a handwriting error of the user, it is difficult to ensure that handwritten arrays are all aligned, when an array in the same row is not in the same row or an array in the same column is not in the same column, the identified array is easily misaligned, a finally drawn chart is inaccurate, so that the identification accuracy is low, and the user experience is poor. In addition, the current identification scheme does not support local modification or content addition before the original content, and if the user performs modification of a certain array after writing all arrays (for example, modifying 50 to 15, or modifying 50 to 150, etc.), the current scheme cannot identify the modified content of the array, which results in poor use effect and insufficient user experience.
In order to overcome the defect of recognition of the existing hand-drawn data of the user, the embodiment provides a data recognition method, a binding relationship between a cell in a generated form and first handwriting information written by the user is utilized, second handwriting information bound to the cell is separately recognized, so that the whole content written by the user is prevented from being recognized once, an array written by the user is determined based on the binding relationship with each cell, a row-column relationship is determined according to the binding relationship, and an accurate form is drawn.
It should be noted that the data identification method in this embodiment is applied to an intelligent interactive display device, where the intelligent interactive display device in this embodiment is a large-size (generally, more than 50 inches) display device with a touch and handwriting function; on this intelligent interactive Display device, install writing programs such as whiteboard, wherein, whiteboard is not traditional whiteboard who utilizes marker pen or chalk to write, and the user can utilize finger, active pen or passive pen etc. to write on this intelligent Display device, and this intelligent interactive Display device can include Display module such as Liquid Crystal Display (LCD), Organic light emitting semiconductor (OLED), electronic ink, can show in real time and write handwriting.
As shown in fig. 1, a specific implementation flow of the data identification method provided in this embodiment is as follows:
step 100, receiving first handwriting information written by a user;
step 101, determining second handwriting information bound with at least one cell from the first handwriting information according to the position relation between each cell in the generated table and the first handwriting information;
in some embodiments, the generated form in this embodiment is generated from the first handwriting information written by the user; or, the table generated in this embodiment is generated according to preset row and column parameters.
In implementation, after the first handwriting information is divided into lines and columns according to the position of the first handwriting information written by a user on a display screen, a table is generated according to boundary lines obtained by dividing the lines and columns; the table may also be generated according to preset row and column parameters (e.g., N rows and M columns), wherein the row and column parameters include, but are not limited to, row height, column width, row number, column number, and the like.
In some embodiments, the individual cells in the table are generated by any one or any number of means:
mode 1) determining column separation lines according to the wave trough positions of the first trace information in a first projection histogram of a first coordinate axis; determining a line separation line of any column according to a wave trough position of first trace information contained in any column in a second projection histogram of a second coordinate axis, and determining each cell according to the line separation line and the line separation line;
it should be noted that the first coordinate axis and the second coordinate axis in the present embodiment have a perpendicular relationship.
In practice, the column separation lines are determined by:
and determining column separation lines according to the positions of the wave troughs, with the width of the wave troughs larger than a threshold value, in the first projection histogram.
In practice, the line separation line is determined by:
and determining line separation lines according to the positions of the wave troughs, with the width of the wave troughs larger than the threshold value, in the second projection histogram.
In implementation, generating each cell of the table according to the column partition line and the row partition line specifically includes:
dividing the first handwriting information into multiple columns according to the column dividing lines, dividing the first handwriting information of each column into multiple rows according to the row dividing lines, finally determining the frame lines of the table according to the minimum value and the maximum value of the handwriting points in all the first handwriting information on the first coordinate axis and the second coordinate axis, and determining the table and the data content in the table according to the column dividing lines, the row dividing lines, the frame lines and the first handwriting information. It should be noted that, in the manner of generating the cells in this embodiment, dividing rows and columns first, then dividing each column and each row can solve the problem that the content of different columns in each row is not aligned due to non-standard writing of the user, and even if the content of different columns in each row of the user is not in the same horizontal line, the data content in each cell can still be accurately divided by using the method in this embodiment, so as to accurately realize the division of rows and columns. The implementation mode can solve the problem that the handwriting columns in the longitudinal table are wrong in rows so as to influence recognition aiming at the longitudinal table.
Mode 2) determining a line separation line according to the wave trough position of the first trace information in a second projection histogram of a second coordinate axis; determining column separation lines of any row according to the trough positions of first handwriting information contained in any row in a first projection histogram of a first coordinate axis, and generating each cell of a table according to the row separation lines and the column separation lines;
in practice, the column separation lines are determined by:
determining column separation lines according to the positions of wave troughs, with the width of the wave troughs larger than a threshold value, in the first projection histogram;
the line separation line is determined by:
and determining line separation lines according to the positions of the wave troughs, with the width of the wave troughs larger than the threshold value, in the second projection histogram.
In implementation, generating each cell of the table according to the column partition line and the row partition line specifically includes:
dividing the first handwriting information into a plurality of rows according to row dividing lines, dividing the first handwriting information of each row into a plurality of columns according to column dividing lines, finally determining frame lines of the table according to the minimum value and the maximum value of the handwriting points in all the first handwriting information on the first coordinate axis and the second coordinate axis, and determining the table and the data content in the table according to the column dividing lines, the row dividing lines, the frame lines and the first handwriting information. It should be noted that, in the manner of generating the cells in this embodiment, the division of the rows is implemented first, and then the division of the rows and the columns is implemented, so that the problem that the blank rows appear in the table due to the non-standard writing of the user can be solved.
Mode 3) determining column separation lines according to the wave trough positions of the first trace information in the first projection histogram of the first coordinate axis, determining row separation lines according to the wave trough positions of the first trace information in the second projection histogram of the second coordinate axis, and determining each cell according to the row separation lines and the column separation lines.
In practice, the column separation lines are determined by:
determining column separation lines according to the positions of wave troughs, with the width of the wave troughs larger than a threshold value, in the first projection histogram;
the line separation line is determined by:
and determining line separation lines according to the positions of the wave troughs, with the width of the wave troughs larger than the threshold value, in the second projection histogram.
In the implementation, determining each cell according to the column separation line and the row separation line specifically includes:
dividing the first handwriting information into multiple columns according to the column dividing lines, dividing the first handwriting information into multiple rows according to the row dividing lines, finally determining the frame lines of the table according to the minimum value and the maximum value of the handwriting points in all the first handwriting information on the first coordinate axis and the second coordinate axis, and determining the table and the data content in the table according to the column dividing lines, the row dividing lines, the frame lines and the first handwriting information. It should be noted that, in the manner of generating the cells in this embodiment, the division of rows and columns is simultaneously implemented, which can solve the problem that the empty cells appear in the table due to the irregular writing of the user.
In some implementations, the first projection histogram is obtained by performing reduction mapping on a projection histogram obtained by projecting the first handwriting information to a first coordinate axis; the reduction mapping is used for reducing the unit interval of a first coordinate axis of the projection histogram to a first preset interval, summing the number of trace points projected in the first preset interval, and taking the sum value as the number of trace points corresponding to the first preset interval; taking the first coordinate axis as an X axis as an example, the X axis coordinate of the projection histogram represents the position of the trace point in the first trace information in the X direction, the Y axis coordinate represents the number of trace points projected onto different X axis positions, for example, the number of trace points of the projection histogram in the 0-100 interval of the X axis is reduced and mapped into the new 0-10 interval, specifically, the sum of the number of trace points in the 0-10 sub-interval in the 0-100 interval is used as the number of trace points corresponding to the 0-1 sub-interval in the new 0-10 interval, the sum of the number of trace points in the 10-20 sub-interval in the 0-100 interval is used as the number of trace points corresponding to the 1-2 sub-interval in the new 0-10 interval, and so on. Further, the number of handwriting points in each subinterval from 0 to 10 can be normalized, taking a 0-1 subinterval from 0 to 10 as an example, the sum of the number of the handwriting points corresponding to the 0-1 subinterval is taken as the number of the handwriting points corresponding to the 0-1 subinterval, wherein the 0-1 subinterval corresponds to one number of the handwriting points, that is, the 0-1 subinterval corresponds to one numerical value.
The second projection histogram is obtained by performing reduction mapping on the projection histogram obtained by projecting the first handwriting information to a second coordinate axis; the reduction mapping is used for reducing the unit interval of a second coordinate axis of the projection histogram to a second preset interval, summing the number of the stroke points projected in the second preset interval, and taking the sum value as the number of the handwriting points corresponding to the first preset interval. Taking the second coordinate axis as the Y axis as an example, the Y axis coordinate of the projection histogram represents the position of the trace point in the first trace information in the Y direction, and the X axis coordinate represents the number of trace points mapped to different Y axis positions, for example, the number of trace points of the projection histogram in the range of 0-100 of the Y axis is reduced and mapped to a new range of 0-10.
The projection histogram in this embodiment is used to represent a statistical graph of the number of trace points of the first trace information projected on a preset coordinate axis.
Optionally, the generated table may be displayed in a display area, and first handwriting information written by a user in cells of the displayed table is received.
The transparency of the form display in the embodiment is adjustable, so that a user can adjust the transparency of the form according to needs, in some embodiments, the displayed form can be completely transparent, the user does not perceive the form, the user cannot perceive that the content is written in the form in the writing process, and the use experience of the user is improved.
In some embodiments, the present embodiment determines, from the first handwriting information, second handwriting information bound to at least one cell according to a position relationship between each cell in the generated table and the first handwriting information, by any one of the following manners:
mode 1) when the first handwriting information is located in the cell, determining the first handwriting information as second handwriting information bound to the cell;
in implementation, if the first handwriting information is located in the cell, the first handwriting information is determined as second handwriting information bound to the cell.
Mode 2) when the pen-drop point of the first handwriting information is located in the cell, determining the first handwriting information as second handwriting information bound to the cell.
In the implementation, the first stroke information includes one or more strokes, each stroke is completed by three actions of pen drop, writing and pen lift, and the stroke including the pen drop and which cell to bind can be determined according to the position of each pen drop in the first stroke information. For example, when a pen-drop point in the first handwriting information is located in the cell, a pen stroke containing the pen-drop point in the first handwriting information is determined as second handwriting information bound to the cell.
Mode 3) when the gravity center of the first handwriting information is located in the cell, determining the first handwriting information as second handwriting information bound to the cell.
In one embodiment, the first stroke information includes one or more strokes, each stroke having a center of gravity. Which cell the stroke is bound to can be judged according to the position of the gravity center of each stroke in the first stroke information. For example, when the center of gravity of a stroke in the first handwriting information is located in a cell, the stroke is determined as the second handwriting information bound to the cell.
Optionally, if the first handwriting information is partially located in the cell, partially exceeds the cell, but does not exceed the set area with the cell as the center area, the first handwriting information is determined as the second handwriting information bound to the cell.
Optionally, if part of the handwriting information, which is greater than the preset threshold, in the first handwriting information is located in the cell or in a set area with the cell as a central area, the first handwriting information is determined as second handwriting information bound to the cell.
And 102, identifying the second handwriting information bound to the at least one cell to obtain identification data corresponding to the at least one cell.
In some embodiments, the embodiment may recognize the second handwriting information bound to all the cells bound with the second handwriting information to obtain the recognition data corresponding to each cell, and in implementation, obtain the recognition data written in each cell by the user. The embodiment can separately identify the second handwriting information bound to each cell, and when a user modifies the content in a certain cell, the user separately identifies according to the modified second handwriting information to obtain the identification data identified by the modified bound second handwriting information of the cell.
In some embodiments, the size of the table in this embodiment is adaptively adjusted according to the size of the second handwriting information bound by the cells. In the implementation, the size of the cell can be adaptively adjusted according to the size of the content written by the user, so as to adjust the size of the table, it should be noted that if the size of one cell is adjusted, the height of the row where the cell is located and the width of the column where the cell is located are correspondingly adjusted.
In some embodiments, when the second handwriting information bound to a cell exceeds the area covered by the cell, the row and the column where the cell is located are expanded, so that the second handwriting information is located in the area covered by the cell. In practice, the row height and column width may be increased appropriately so that what the user writes in the cell just fits within the cell. As shown in fig. 2, this embodiment provides a schematic diagram of adaptive expansion of a table, and when the content written by a user in a cell exceeds the coverage of the current cell, the height and width of the row and column of the cell are expanded, so that the handwriting information written by the user is located in the cell where the pen-down point is located.
Optionally, the area covered by the cell in this embodiment may be an internal area of the cell, where the size of the area covered by the cell may be the same as the size of the cell, or may be a slightly smaller area. The size of the area covered by the cells is not limited too much in this embodiment.
When the area covered by the cell is the cell internal area slightly smaller than the cell size, when the second handwriting information exceeds the area covered by the cell and does not exceed the cell boundary, the cell is expanded, so that the content written by the user does not exceed the cell boundary.
In some embodiments, when the second handwriting information of a cell binding exceeds the area covered by the cell, after the row and the column of the cell are expanded, at least one cell offset except the expanded cell in the table is determined, wherein the offset of the cell is formed after the cell in the table is expanded; and correspondingly offsetting the second handwriting information bound by the at least one offset cell according to the offset of the at least one offset cell. As shown in fig. 3, this embodiment provides a schematic diagram of handwriting migration after table expansion, after a user writes "zhang san" in a cell, the line height and the column width of the column where the cell is located are expanded according to the size of "zhang san", a certain migration exists in each expanded cell relative to the position before expansion, and second handwriting information bound to each cell is correspondingly migrated according to the migration amount of the position of each cell, so that the migrated second handwriting information can fall at the central position or the preset position of the bound cell. The data identification method provided by the embodiment can ensure one-to-one correspondence between arrays no matter how large the content is and how far the interval is as long as the written content falls in the table, and ensure that the arrays positioned in the same row and the same column are not staggered, thereby ensuring the correctness of array division and further generating an accurate chart.
In some embodiments, the size of the table in this embodiment may also be fixed.
When the size of the table is fixed, the size of the content in each cell can be adjusted in a self-adaptive manner. In some embodiments, after obtaining the identification data corresponding to the cells, converting the identification data into standard data meeting a preset specification; and scaling the standard data according to the size of the area covered by the cells so as to enable the standard data to be positioned in the area covered by the cells.
As shown in fig. 4, this embodiment provides a schematic diagram of adaptive adjustment contents with fixed table size. In implementation, after the second handwriting information bound to any cell is recognized to obtain corresponding recognition data, the recognition data is converted into characters or numbers in formats of Song style, regular style, black body and the like, and the characters or numbers are scaled according to the size of the cell, wherein the more the content written in the table is, the smaller the font is, and therefore, each content is ensured to be located in the cell.
In some embodiments, the embodiment is further configured to recognize the second handwriting information bound to the cells in the table at least twice.
In some embodiments, the identifying is performed at least twice by:
and after the second handwriting information bound to the cell is identified last time, identifying the second handwriting information bound to the cell at this time when the second handwriting information bound to the cell is determined to be changed.
In some embodiments, it is determined that the second handwriting information of the cell binding changes by:
comparing the second handwriting information bound by the cell before the current recognition with the second handwriting information bound by the cell during the last recognition;
skipping the identification of the second handwriting information bound to the cell when the comparison result is consistent;
and when the comparison result is inconsistent, determining that the second handwriting information bound by the cell changes, and identifying the second handwriting information bound by the cell at this time.
In some embodiments, when the comparison result is inconsistent, identifying second handwriting information bound to the cells in the table at the current time by using a second identification algorithm; wherein, the last identification uses a first identification algorithm. The first recognition algorithm and the second recognition algorithm are different.
In some embodiments, when the comparison result is inconsistent, the second handwriting information bound to the cell is identified at the current time by using a different identification algorithm from the last identification. In some embodiments, the first recognition algorithm comprises a Recurrent Neural Network algorithm, such as Recurrent Neural Network (RNN), Long Short Term Memory Network (LSTM); the second recognition algorithm includes a Convolutional Neural Network algorithm, such as a Convolutional Neural Network (CNN).
In some embodiments, the changed second handwriting information is obtained by at least one of modifying, deleting and adding the second handwriting information bound to the cell after the user identifies the second handwriting information bound to the cell last time.
In some embodiments, when the comparison result is inconsistent, the second handwriting information bound to the cell before the current recognition is obtained by at least one of modifying, deleting and adding the second handwriting information bound to the cell during the last recognition by the user.
In implementation, after the user writes and recognizes the content in the form, the written content is modified, deleted, and added (including adding in front of the original content or adding in the middle of the original content), and then the modified second handwriting information bound to the cell can be recognized separately.
In some embodiments, when the plurality of cells in the table are all bound with the second handwriting information, the second handwriting information bound with the plurality of cells is identified in parallel; and determining the corresponding relation between the identification data obtained by identification and the plurality of cells according to the row and column information of the cells bound with the second handwriting information in the table to obtain the identification data corresponding to the plurality of cells respectively.
In implementation, after a user writes handwriting in a form, each handwriting written by the user is bound with the form corresponding to the handwriting, that is, each cell of the current form is bound with handwriting information, and each handwriting has only one bound cell, and each cell stores a current recognition bound handwriting set and a last recognition bound handwriting set, wherein the handwriting set comprises one or more pieces of second handwriting information.
In implementation, after the user stops writing, for example, a response time may be set, which is assumed to be 3 seconds, and after the user stops writing for 3 seconds, the second handwriting information bound to each cell in the entire table is submitted to the character recognition algorithm for recognition, where at the time of submission, the row and column information of each cell, such as an index value (a row index value, a column index value), is also submitted to the character recognition algorithm, so that the recognition result returned by the algorithm has a corresponding relationship with the index value, and the recognition results of different cells are distinguished by the index value.
In some embodiments, after the identification data corresponding to the plurality of cells is obtained, a chart is generated according to the identification data corresponding to the plurality of cells and the row and column information of each cell in the table, and the generated chart can be displayed.
Optionally, the chart type generated by the present embodiment includes, but is not limited to, at least one or more of a histogram, a pie chart, a radar chart, a line chart, and a histogram.
As shown in fig. 5, this embodiment further provides a recognition method based on chart drawing data, and the implementation flow of the method is as follows:
step 501, entering a chart drawing interface, and displaying a table in a display area;
step 502, receiving first handwriting information written in the cells of the displayed form by a user;
step 503, when the first handwriting information is located in the cell, determining the first handwriting information as second handwriting information bound to the cell;
step 504, when the second handwriting information bound to the cells exceeds the area covered by the cells, expanding the rows and columns where the cells are located, determining the offset of at least one cell in the table, and performing corresponding offset on the second handwriting information bound to the at least one offset cell according to the offset of the at least one offset cell;
step 505, when the plurality of cells in the table are bound with the second handwriting information, identifying the second handwriting information bound with the plurality of cells in parallel; determining the corresponding relation between the identification data obtained by identification and the multiple cells according to the row and column information of the cells bound with the second handwriting information in the table to obtain the identification data corresponding to the multiple cells respectively;
step 506, identifying the second handwriting information bound to the cells in the table at least twice, and comparing the second handwriting information bound to the cells before the current identification with the second handwriting information bound to the cells during the last identification before the second handwriting information bound to the cells is identified at the current time;
step 507, judging whether the comparison results are consistent, if so, executing step 508, otherwise, executing step 509;
step 508, skipping the recognition of the second handwriting information bound to the cell;
and 509, identifying the second handwriting information bound to the cell at this time.
As shown in fig. 6, this embodiment further provides a recognition method based on chart drawing data, and the implementation flow of the method is as follows:
step 601, entering a chart drawing interface, and displaying a table in a display area;
step 602, receiving first handwriting information written by a user in a cell of a displayed form;
step 603, when the pen drop point of the first handwriting information is located in the cell, determining the first handwriting information as second handwriting information bound to the cell;
step 604, when the plurality of cells in the table are bound with the second handwriting information, identifying the second handwriting information bound with the plurality of cells in parallel; determining the corresponding relation between the identification data obtained by identification and the multiple cells according to the row and column information of the cells bound with the second handwriting information in the table to obtain the identification data corresponding to the multiple cells respectively;
step 605, converting the identification data of each cell into standard data meeting a preset specification; scaling the standard data according to the size of the area covered by each cell;
606, identifying second handwriting information bound to cells in the table at least twice, and comparing the second handwriting information bound to the cells before the current identification with the second handwriting information bound to the cells during the last identification before the current identification is carried out on the second handwriting information bound to the cells in the table;
step 607, judging whether the comparison result is consistent, if so, executing step 608, otherwise, executing step 609;
step 608, skipping the identification of the second handwriting information bound to the cell;
and 609, identifying the second handwriting information bound to the cell at this time.
Embodiment 2 is based on the same inventive concept, and the embodiment of the present invention further provides an intelligent interactive display device, because the device is a device in the method in the embodiment of the present invention, and the principle of the device to solve the problem is similar to that of the method, the implementation of the device may refer to the implementation of the method, and repeated details are not repeated.
As shown in fig. 7, the apparatus comprises a display screen 700 and a control circuit 701, wherein:
the display screen 700 is used for displaying content;
the control circuit 701 includes a processor and a memory, the memory is used for storing programs executable by the processor, and the processor is used for reading the programs in the memory and executing the following steps:
receiving first handwriting information written by a user;
determining second handwriting information bound with at least one cell from the first handwriting information according to the position relation between each cell in the generated table and the first handwriting information;
and identifying the second handwriting information bound to at least one cell to obtain identification data corresponding to the at least one cell.
As an alternative to the above-described embodiment,
the form is generated according to first handwriting information written by the user; or the like, or, alternatively,
the table is generated according to preset row and column parameters.
As an alternative embodiment, the processor is configured to perform:
displaying the generated table in a display area;
receiving first handwriting information written by a user in the displayed cells of the form.
As an alternative embodiment, the processor is configured to perform:
when the first handwriting information is located in the cell, determining the first handwriting information as second handwriting information bound to the cell; or the like, or, alternatively,
when the pen-falling point of the first handwriting information is located in the cell, determining the first handwriting information as second handwriting information bound to the cell; or the like, or, alternatively,
and when the gravity center of the first handwriting information is positioned in the cell, determining the first handwriting information as second handwriting information bound by the cell.
As an optional implementation manner, the size of the table is adaptively adjusted according to the size of the second handwriting information bound by the cells.
As an optional implementation manner, the processor is specifically further configured to perform:
and when the second handwriting information bound to the cells exceeds the area covered by the cells, expanding the rows and columns where the cells are located so as to enable the second handwriting information to be located in the area covered by the cells.
As an optional implementation manner, the processor is specifically further configured to perform:
determining at least one cell offset in the table other than the expanded cell, wherein the cell offset is formed based on the expanded cells in the table;
and correspondingly offsetting the second handwriting information bound by the at least one offset cell according to the offset of the at least one offset cell.
As an optional implementation manner, after obtaining the identification data corresponding to the cell, the processor is further specifically configured to perform:
converting the identification data into standard data meeting preset specifications;
and scaling the standard data according to the size of the area covered by the cells so as to enable the standard data to be positioned in the area covered by the cells.
As an optional implementation manner, the processor is specifically further configured to perform:
and identifying the second handwriting information bound to the cells in the table at least twice.
As an alternative embodiment, the processor is configured to perform:
and after the second handwriting information bound to the cell is identified last time, identifying the second handwriting information bound to the cell at this time when the second handwriting information bound to the cell is determined to be changed.
As an alternative embodiment, the processor is configured to perform:
comparing the second handwriting information bound by the cell before the current recognition with the second handwriting information bound by the cell during the last recognition;
and when the comparison result is inconsistent, determining that the second handwriting information bound by the cells changes.
As an alternative embodiment, the processor is configured to perform:
when the comparison result is inconsistent, identifying second handwriting information bound to the cells in the table at the current time by using a second identification algorithm;
wherein, the last identification uses a first identification algorithm.
As an alternative to the above-described embodiment,
the first identification algorithm comprises a recurrent neural network algorithm; the second identification algorithm comprises a convolutional neural network algorithm.
As an alternative to the above-described embodiment,
and the changed second handwriting information is obtained by at least one of modifying, deleting and adding the second handwriting information bound to the cell after the user identifies the second handwriting information bound to the cell last time.
As an alternative embodiment, the processor is configured to perform:
when a plurality of cells in the table are bound with second handwriting information, identifying the second handwriting information bound by the cells in parallel;
and determining the corresponding relation between the identification data obtained by identification and the plurality of cells according to the row and column information of the cells bound with the second handwriting information in the table to obtain the identification data corresponding to the plurality of cells respectively.
As an optional implementation manner, the processor is specifically further configured to perform:
and after the identification data corresponding to the plurality of cells are obtained, generating a chart according to the identification data corresponding to the plurality of cells and the row and column information of each cell in the table.
As an alternative embodiment, the transparency of the tabular display is adjustable.
As an alternative embodiment, the table is not displayed in the display area.
Embodiment 3, based on the same inventive concept, an embodiment of the present invention further provides an intelligent interactive display device, and as the device is a device in the method in the embodiment of the present invention, and the principle of the device to solve the problem is similar to that of the method, the implementation of the device may refer to the implementation of the method, and repeated details are not repeated.
As shown in fig. 8, the apparatus includes:
a receiving unit 800 for receiving first handwriting information written by a user;
a binding unit 801, configured to determine, according to a position relationship between each cell in the generated table and the first handwriting information, second handwriting information bound to at least one cell from the first handwriting information;
the identifying unit 802 is configured to identify the second handwriting information bound to the at least one cell, so as to obtain identification data corresponding to the at least one cell.
As an alternative to the above-described embodiment,
the form is generated according to first handwriting information written by the user; or the like, or, alternatively,
the table is generated according to preset row and column parameters.
As an optional implementation manner, the receiving unit 800 is specifically configured to:
displaying the generated table in a display area;
receiving first handwriting information written by a user in the displayed cells of the form.
As an optional implementation manner, the binding unit 801 is specifically configured to:
when the first handwriting information is located in the cell, determining the first handwriting information as second handwriting information bound to the cell; or the like, or, alternatively,
when the pen-falling point of the first handwriting information is located in the cell, determining the first handwriting information as second handwriting information bound to the cell; or the like, or, alternatively,
and when the gravity center of the first handwriting information is positioned in the cell, determining the first handwriting information as second handwriting information bound by the cell.
As an optional implementation manner, the size of the table is adaptively adjusted according to the size of the second handwriting information bound by the cells.
As an optional implementation, the system further includes an expansion unit specifically configured to:
and when the second handwriting information bound to the cells exceeds the area covered by the cells, expanding the rows and columns where the cells are located so as to enable the second handwriting information to be located in the area covered by the cells.
As an optional implementation manner, the mobile terminal further includes an offset unit specifically configured to:
determining at least one cell offset in the table other than the expanded cell, wherein the cell offset is formed based on the expanded cells in the table;
and correspondingly offsetting the second handwriting information bound by the at least one offset cell according to the offset of the at least one offset cell.
As an optional implementation manner, after obtaining the identification data corresponding to the cell, the method further includes a scaling unit specifically configured to:
converting the identification data into standard data meeting preset specifications;
and scaling the standard data according to the size of the area covered by the cells so as to enable the standard data to be positioned in the area covered by the cells.
As an optional implementation manner, the system further includes a re-identification unit specifically configured to:
and identifying the second handwriting information bound to the cells in the table at least twice.
As an optional implementation manner, the re-identifying unit is specifically configured to:
and after the second handwriting information bound to the cell is identified last time, identifying the second handwriting information bound to the cell at this time when the second handwriting information bound to the cell is determined to be changed.
As an optional implementation manner, the re-identifying unit is specifically configured to:
comparing the second handwriting information bound by the cell before the current recognition with the second handwriting information bound by the cell during the last recognition;
and when the comparison result is inconsistent, determining that the second handwriting information bound by the cell changes.
As an optional implementation manner, the re-identification unit is specifically configured to:
when the comparison result is inconsistent, identifying second handwriting information bound to the cells in the table at the current time by using a second identification algorithm;
wherein, the last identification uses a first identification algorithm.
As an alternative to the above-described embodiment,
the first recognition algorithm comprises a recurrent neural network algorithm; the second identification algorithm comprises a convolutional neural network algorithm.
As an alternative to the above-described embodiment,
and the changed second handwriting information is obtained by at least one of modifying, deleting and adding the second handwriting information bound to the cell after the user identifies the second handwriting information bound to the cell last time.
As an optional implementation manner, the identifying unit 802 is specifically configured to:
when a plurality of cells in the table are bound with second handwriting information, identifying the second handwriting information bound by the cells in parallel;
and determining the corresponding relation between the identification data obtained by identification and the plurality of cells according to the row and column information of the cells bound with the second handwriting information in the table to obtain the identification data corresponding to the plurality of cells respectively.
As an optional implementation manner, the method further includes the step of:
and after the identification data corresponding to the plurality of cells are obtained, generating a chart according to the identification data corresponding to the plurality of cells and the row and column information of each cell in the table.
As an alternative embodiment, the transparency of the tabular display is adjustable.
As an alternative embodiment, the table is not displayed in the display area.
Based on the same inventive concept, an embodiment of the present invention further provides a computer storage medium, on which a computer program is stored, which when executed by a processor implements the following steps:
receiving first handwriting information written by a user;
determining second handwriting information bound with at least one cell from the first handwriting information according to the position relation between each cell in the generated table and the first handwriting information;
and identifying the second handwriting information bound to at least one cell to obtain identification data corresponding to the at least one cell.
As will be appreciated by one skilled in the art, embodiments of the present invention may be provided as a method, system, or computer program product. Accordingly, the present invention may take the form of an entirely hardware embodiment, an entirely software embodiment or an embodiment combining software and hardware aspects. Furthermore, the present invention may take the form of a computer program product embodied on one or more computer-usable storage media (including, but not limited to, disk storage, optical storage, and the like) having computer-usable program code embodied therein.
The present invention is described with reference to flowchart illustrations and/or block diagrams of methods, apparatus (systems), and computer program products according to embodiments of the invention. It will be understood that each flow and/or block of the flow diagrams and/or block diagrams, and combinations of flows and/or blocks in the flow diagrams and/or block diagrams, can be implemented by computer program instructions. These computer program instructions may be provided to a processor of a general purpose computer, special purpose computer, embedded processor, or other programmable data processing apparatus to produce a machine, such that the instructions, which execute via the processor of the computer or other programmable data processing apparatus, create means for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks.
These computer program instructions may also be stored in a computer-readable memory that can direct a computer or other programmable data processing apparatus to function in a particular manner, such that the instructions stored in the computer-readable memory produce an article of manufacture including instruction means which implement the function specified in the flowchart flow or flows and/or block diagram block or blocks.
These computer program instructions may also be loaded onto a computer or other programmable data processing apparatus to cause a series of operational steps to be performed on the computer or other programmable apparatus to produce a computer implemented process such that the instructions which execute on the computer or other programmable apparatus provide steps for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks.
It will be apparent to those skilled in the art that various changes and modifications may be made in the present invention without departing from the spirit and scope of the invention. Thus, if such modifications and variations of the present invention fall within the scope of the claims of the present invention and their equivalents, the present invention is also intended to include such modifications and variations.

Claims (20)

1. A data identification method is applied to intelligent interactive display equipment and comprises the following steps:
receiving first handwriting information written by a user;
determining second handwriting information bound with at least one cell from the first handwriting information according to the position relation between each cell in the generated table and the first handwriting information;
and identifying the second handwriting information bound to at least one cell to obtain identification data corresponding to the at least one cell.
2. The method of claim 1,
the form is generated according to first handwriting information written by the user; or the like, or, alternatively,
the table is generated according to preset row and column parameters.
3. The method of claim 1, wherein receiving first handwriting information written by a user comprises:
displaying the generated table in a display area;
receiving first handwriting information written by a user in the displayed cells of the form.
4. The method according to claim 1, wherein the determining second handwriting information bound to at least one cell from the first handwriting information according to a position relationship between each cell in the generated table and the first handwriting information comprises:
when the first handwriting information is located in the cell, determining the first handwriting information as second handwriting information bound to the cell; or the like, or, alternatively,
when the pen-falling point of the first handwriting information is located in the cell, determining the first handwriting information as second handwriting information bound to the cell; or the like, or, alternatively,
and when the gravity center of the first handwriting information is positioned in the cell, determining the first handwriting information as second handwriting information bound to the cell.
5. A method according to any one of claims 1 to 4, wherein the size of the table is adaptively adjusted according to the size of the second handwriting information bound by the cells.
6. The method of claim 5, further comprising:
and when the second handwriting information bound to the cells exceeds the area covered by the cells, expanding the rows and columns where the cells are located so as to enable the second handwriting information to be located in the area covered by the cells.
7. The method of claim 6, further comprising:
determining at least one cell offset in the table other than the expanded cell, wherein the cell offset is formed based on the expanded cells in the table;
and correspondingly offsetting the second handwriting information bound by the at least one offset cell according to the offset of the at least one offset cell.
8. The method according to any one of claims 1 to 4, further comprising, after obtaining the identification data corresponding to the cell:
converting the identification data into standard data meeting preset specifications;
and scaling the standard data according to the size of the area covered by the cells so as to enable the standard data to be positioned in the area covered by the cells.
9. The method of any one of claims 1 to 4, further comprising:
and identifying the second handwriting information bound to the cells in the table at least twice.
10. The method according to claim 9, wherein the at least two recognitions of the second handwriting information of the cell binding in the table comprise:
and after the second handwriting information bound to the cell is identified last time, identifying the second handwriting information bound to the cell at this time when the second handwriting information bound to the cell is determined to be changed.
11. The method of claim 10, wherein the determining that the second script information for the cell binding has changed comprises:
comparing the second handwriting information bound by the cell before the current recognition with the second handwriting information bound by the cell during the last recognition;
and when the comparison result is inconsistent, determining that the second handwriting information bound by the cell changes.
12. The method according to claim 10, wherein when the comparison result is inconsistent, identifying the second handwriting information bound to the cell at this time comprises:
when the comparison result is inconsistent, identifying second handwriting information bound to the cells in the table at the current time by using a second identification algorithm;
wherein, the last identification uses a first identification algorithm.
13. The method of claim 12,
the first identification algorithm comprises a recurrent neural network algorithm; the second recognition algorithm comprises a convolutional neural network algorithm.
14. The method of claim 10,
and the changed second handwriting information is obtained by at least one of modifying, deleting and adding the second handwriting information bound to the cell after the user identifies the second handwriting information bound to the cell last time.
15. The method according to any one of claims 1 to 4, wherein the recognizing the second handwriting information bound to the at least one cell to obtain recognition data corresponding to the at least one cell includes:
when a plurality of cells in the table are bound with second handwriting information, identifying the second handwriting information bound by the cells in parallel;
and determining the corresponding relation between the identification data obtained by identification and the plurality of cells according to the row and column information of the cells bound with the second handwriting information in the table to obtain the identification data corresponding to the plurality of cells respectively.
16. The method of any one of claims 1 to 4, further comprising:
and after the identification data corresponding to the plurality of cells are obtained, generating a chart according to the identification data corresponding to the plurality of cells and the row and column information of each cell in the table.
17. A method according to any of claims 1 to 4, wherein the transparency of the tabular display is adjustable.
18. A method according to claim 1 or 2, wherein the table is not displayed in a display area.
19. An intelligent interactive display device, comprising a display screen and a control circuit, wherein:
the display screen is used for displaying content;
the control circuit comprises a processor and a memory, the memory is used for storing programs executable by the processor, and the processor is used for reading the programs in the memory and executing the steps of the method of any one of claims 1 to 18.
20. A computer storage medium on which a computer program is stored, the program, when executed by a processor, performing the steps of the method according to any one of claims 1 to 18.
CN202210461804.6A 2022-04-28 2022-04-28 Data identification method and intelligent interactive display equipment Pending CN114882513A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202210461804.6A CN114882513A (en) 2022-04-28 2022-04-28 Data identification method and intelligent interactive display equipment

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202210461804.6A CN114882513A (en) 2022-04-28 2022-04-28 Data identification method and intelligent interactive display equipment

Publications (1)

Publication Number Publication Date
CN114882513A true CN114882513A (en) 2022-08-09

Family

ID=82671978

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202210461804.6A Pending CN114882513A (en) 2022-04-28 2022-04-28 Data identification method and intelligent interactive display equipment

Country Status (1)

Country Link
CN (1) CN114882513A (en)

Similar Documents

Publication Publication Date Title
CN102855082B (en) Character recognition for overlay text user input
CN110045840B (en) Writing track association method, device, terminal equipment and storage medium
US20180114059A1 (en) System and method for managing digital ink typesetting
US20170109917A1 (en) Method and device for erasing a writing path on an infrared electronic white board, and a system for writing on an infrared electronic white board
CN111507330B (en) Problem recognition method and device, electronic equipment and storage medium
JP2018524734A (en) System for recognizing input of multiple objects, method and product therefor
KR102463657B1 (en) Systems and methods for recognizing multi-object structures
CN110956674B (en) Graph adjusting method, device, equipment and storage medium
CN110674811B (en) Image recognition method and device
CN113283355A (en) Form image recognition method and device, computer equipment and storage medium
CN112711362B (en) Method and device for generating hand-drawn flow chart icon in standardized manner
CN111626238A (en) Text recognition method, electronic device and storage medium
KR102677200B1 (en) Gesture stroke recognition in touch-based user interface input
CN111259888A (en) Image-based information comparison method and device and computer-readable storage medium
US20230343125A1 (en) Handwriting Recognition Method and Apparatus, Handwriting Recognition System and Interactive Display
CN114882513A (en) Data identification method and intelligent interactive display equipment
CN116661618A (en) Touch mode switching method and device for touch screen
WO2022160330A1 (en) Handwriting recognition method and apparatus
CN106648171A (en) Interactive system and method based on writing pens
WO2023000960A1 (en) Electronic whiteboard and chart display method therefor
CN117492568B (en) Toy interaction identification method and system based on convolutional neural network
WO2024113271A1 (en) Intelligent handwriting display device, intelligent handwriting display method, and electronic device
JP3365538B2 (en) Online character recognition method and apparatus
CN114691009A (en) Method, system, device and medium for always forward displaying handwriting data
CN116363659A (en) Handwriting multi-line character segmentation method, device and equipment

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination