WO2022105005A1

WO2022105005A1 - Smart classroom information exchange method, apparatus, and electronic device

Info

Publication number: WO2022105005A1
Application number: PCT/CN2020/138431
Authority: WO
Inventors: 卢启伟; 张淮清; 陈方圆
Original assignee: 深圳市鹰硕教育服务有限公司
Priority date: 2020-11-19
Filing date: 2020-12-22
Publication date: 2022-05-27
Also published as: CN112507806B; CN112507806A

Abstract

Provided are a smart classroom information exchange method, apparatus, and electronic device, said method comprising: obtaining handwriting data formed by a smart pen in a preset writing area, said writing area having a sensing apparatus for generating said handwriting data (S101); on a cloud service platform, performing data processing of the handwriting received from said sensing apparatus to form a graphical document, character set, and parsed content corresponding to the handwriting data (S102); on the cloud service platform, receiving an interaction instruction formed by a user during an interaction operation on a display apparatus, so as to facilitate the parsing of said interaction instruction and form a parsing result (S103); on the basis of said parsing result, sending one or a plurality of the graphical file, character set, and parsed content to the display apparatus so as to be interactively displayed thereon (S104). The method can improve the efficiency of information interaction in a smart classroom.

Description

Smart classroom information interaction method, device and electronic device

technical field

The present disclosure relates to the technical field of data processing, and in particular, to a smart classroom information interaction method, device and electronic device.

Background technique

The dot matrix digital smart pen is a kind of invisible dot matrix pattern printed on ordinary paper. The high-speed camera at the front of the digital pen captures the movement trajectory of the pen tip at any time. At the same time, the pressure sensor transmits the pressure data back to the data processor. A new type of writing instrument that transmits information through bluetooth or USB cable.

Different from ordinary paper and pens, this information includes paper type, source, page number, position, handwriting coordinates, motion trajectory, nib pressure, stroke order, pen running time, pen running speed and other information. The handwriting recording process is synchronized with the writing process. When writing, the dot matrix digital pen stores the words or pictures written on the paper in the computer in the form of bitmaps to form a document, which can also be synchronously displayed by projection if necessary.

How to effectively interact with the handwriting content of the smart pen in the smart classroom based on the cloud platform and improve the processing efficiency of the information interaction in the smart classroom has become a problem that needs to be solved.

SUMMARY OF THE INVENTION

In view of this, the embodiments of the present disclosure provide a smart classroom information interaction method, device, and electronic device to at least partially solve the problems existing in the prior art.

In a first aspect, an embodiment of the present disclosure provides a smart classroom information interaction method, including:

acquiring handwriting data formed by the smart pen in a preset writing area, the writing area has a sensing device for generating the handwriting data, and the sensing device is connected to the display device by means of communication;

Perform data processing on the handwriting received from the sensing device on the cloud service platform to form a graphic file, character set and analytical content corresponding to the handwriting data;

In the cloud service platform, the interactive instructions formed by the user in the interactive operation process on the display device are received, so as to analyze the interactive instructions and form the analysis result;

Based on the parsing result, one or more of the graphical file, character set and parsing content are sent to the display device for interactive display.

According to a specific implementation manner of the embodiment of the present disclosure, the obtaining of the handwriting data formed by the smart pen in the preset writing area includes:

judging whether the pressure value generated by the pressure sensor of the smart pen is greater than a preset value;

If so, collect the handwriting data generated by the smart pen in the writing area, where the handwriting data includes the pressure value, position coordinates, time value and acceleration value generated by the smart pen.

According to a specific implementation manner of the embodiment of the present disclosure, the performing data processing on the handwriting received from the sensing device on the cloud service platform includes:

Based on the pressure value, position coordinate, time value and acceleration value contained in the handwriting data, restore the trajectory of the smart pen to form a graphical file;

Character recognition is performed on the graphical file to obtain a character set corresponding to the pen data;

Semantically parse the content in the character set to obtain the parsed content of the handwriting data.

According to a specific implementation manner of the embodiment of the present disclosure, the receiving, in the cloud service platform, the interaction instruction formed by the user during the interaction operation on the display device includes:

acquiring the user's interactive gestures on the display device;

The interaction gesture is parsed to determine the interaction instruction corresponding to the interaction gesture.

According to a specific implementation manner of the embodiment of the present disclosure, the sending one or more of the graphical file, the character set, and the parsed content based on the parsing result to the display device for interactive display, including: :

When the interactive instruction in the analysis result is a writing instruction, the graphic file is sent to the display device, so as to display the user's handwriting track in real time.

According to a specific implementation manner of the embodiment of the present disclosure, the one or more of the graphical file, the character set and the parsed content are sent to the display device for interactive display based on the parsing result, and further include:

When the interactive instruction in the analysis result is an input instruction, sending the graphical file and the character set together to the display device, so as to display the characters corresponding to the handwritten track while displaying the user's handwritten track;

When the interactive instruction in the parsing result is a content input instruction, the parsing content is sent to the display device.

According to a specific implementation manner of the embodiment of the present disclosure, after sending one or more of the graphical file, the character set, and the parsed content to the display device for interactive display based on the parsing result, The method also includes:

Find the target content corresponding to the handwriting data through the file identifier contained in the graphic file;

By judging the similarity between the parsed content and the target content, the evaluation content of the graphical file is determined.

In a second aspect, an embodiment of the present disclosure provides a smart classroom information interaction device, including:

an acquisition module, configured to acquire the handwriting data formed by the smart pen in a preset writing area, the writing area has a sensing device for generating the handwriting data, and the sensing device is connected to the display device by means of communication;

a forming module for performing data processing on the handwriting received from the sensing device on the cloud service platform to form a graphic file, character set and analytical content corresponding to the handwriting data;

a receiving module, configured to receive, in the cloud service platform, an interactive instruction formed by a user during an interactive operation on the display device, so as to parse the interactive instruction and form an analytical result;

A sending module, configured to send one or more of the graphical file, the character set and the parsed content to the display device for interactive display based on the parsing result.

In a third aspect, an embodiment of the present disclosure further provides an electronic device, the electronic device comprising:

at least one processor; and,

a memory communicatively coupled to the at least one processor; wherein,

The memory stores instructions executable by the at least one processor, the instructions being executed by the at least one processor to enable the at least one processor to perform the aforementioned first aspect or the wisdom of any implementation of the first aspect Classroom Information Interaction Methods.

In a fourth aspect, embodiments of the present disclosure further provide a non-transitory computer-readable storage medium, where the non-transitory computer-readable storage medium stores computer instructions, and the computer instructions are used to cause the computer to execute the foregoing first aspect or the first The smart classroom information interaction method in any implementation manner of one aspect.

In a fifth aspect, an embodiment of the present disclosure further provides a computer program product, the computer program product includes a computer program stored on a non-transitory computer-readable storage medium, the computer program includes program instructions, and when the program instructions are executed by a computer When executed, the computer is made to execute the smart classroom information interaction method in the first aspect or any implementation manner of the first aspect.

The smart classroom information interaction solution in the embodiment of the present disclosure includes acquiring handwriting data formed by a smart pen in a preset writing area, and the writing area has a sensing device for generating the handwriting data, and the sensing device communicates with the display device by means of communication. connection; data processing is performed on the handwriting received from the sensing device in the cloud service platform to form a graphic file, character set and analysis content corresponding to the handwriting data; in the cloud service platform, the user's display device is received The interactive instruction formed during the above interactive operation is convenient for parsing the interactive instruction to form the parsing result; based on the parsing result, send one or more of the graphical file, the character set and the parsing content to the Interactive display is performed on the display device. Through the processing solution of the present disclosure, the efficiency of smart classroom information interaction is improved.

Description of drawings

In order to explain the technical solutions of the embodiments of the present disclosure more clearly, the following briefly introduces the accompanying drawings that need to be used in the embodiments. Obviously, the accompanying drawings in the following description are only some embodiments of the present disclosure. For those of ordinary skill in the art, other drawings can also be obtained from these drawings without any creative effort.

1 is a flowchart of a smart classroom information interaction method provided by an embodiment of the present disclosure;

FIG. 2 is a flowchart of another smart classroom information interaction method provided by an embodiment of the present disclosure;

3 is a flowchart of another smart classroom information interaction method provided by an embodiment of the present disclosure;

4 is a flowchart of another smart classroom information interaction method provided by an embodiment of the present disclosure;

FIG. 5 is a schematic structural diagram of a smart classroom information interaction device according to an embodiment of the present disclosure;

FIG. 6 is a schematic diagram of an electronic device provided by an embodiment of the present disclosure.

Detailed ways

The embodiments of the present disclosure will be described in detail below with reference to the accompanying drawings.

The embodiments of the present disclosure are described below through specific specific examples, and those skilled in the art can easily understand other advantages and effects of the present disclosure from the contents disclosed in this specification. Obviously, the described embodiments are only some, but not all, embodiments of the present disclosure. The present disclosure can also be implemented or applied through other different specific embodiments, and various details in this specification can also be modified or changed based on different viewpoints and applications without departing from the spirit of the present disclosure. It should be noted that the following embodiments and features in the embodiments may be combined with each other under the condition of no conflict. Based on the embodiments in the present disclosure, all other embodiments obtained by those of ordinary skill in the art without creative efforts shall fall within the protection scope of the present disclosure.

It is noted that various aspects of embodiments within the scope of the appended claims are described below. It should be apparent that the aspects described herein may be embodied in a wide variety of forms and that any specific structure and/or function described herein is illustrative only. Based on this disclosure, those skilled in the art should appreciate that an aspect described herein may be implemented independently of any other aspects and that two or more of these aspects may be combined in various ways. For example, an apparatus may be implemented and/or a method may be practiced using any number of the aspects set forth herein. Additionally, such an apparatus may be implemented and/or such a method may be practiced using other structure and/or functionality in addition to one or more of the aspects set forth herein.

It should also be noted that the drawings provided in the following embodiments are only illustrative of the basic concept of the present disclosure, and the drawings only show the components related to the present disclosure rather than the number, shape and the number of components in actual implementation. For dimension drawing, the type, quantity and proportion of each component can be changed at will in actual implementation, and the component layout may also be more complicated.

Additionally, in the following description, specific details are provided to facilitate a thorough understanding of the examples. However, one skilled in the art will understand that the described aspects may be practiced without these specific details.

Embodiments of the present disclosure provide a smart classroom information interaction method. The smart classroom information interaction method provided in this embodiment may be executed by a computing device, which may be implemented as software, or implemented as a combination of software and hardware, and may be integrated in a server, a client, or the like.

Referring to FIG. 1, the smart classroom information interaction method in the embodiment of the present disclosure may include the following steps:

S101 , acquiring handwriting data formed by a smart pen in a preset writing area, where the writing area has a sensing device for generating the handwriting data, and the sensing device is connected to a display device by means of communication.

The smart pen can generate handwriting data by performing a writing operation in the writing area of the sensing device, and through the handwriting data, the content written by the user in the writing area can be described.

In the process of acquiring the user's writing content, it is possible to further monitor whether the pressure sensor on the smart pen generates a pressure signal. When the pressure value of the pressure signal is greater than the preset value, the handwriting data formed by the smart pen on the writing area can be collected.

S102: Perform data processing on the handwriting received from the sensing device on the cloud service platform to form a graphic file, a character set, and analysis content corresponding to the handwriting data.

The cloud service platform communicates and connects with the sensing device by means of communication, so as to obtain the handwriting data written by the smart pen, so as to perform data processing based on the handwriting data.

Specifically, in the cloud service platform, based on the pressure value, position coordinate, time value and acceleration value included in the handwriting data, the trajectory of the smart pen can be restored to form a graphical file; Perform character recognition to obtain a character set corresponding to the pen data; perform semantic analysis on the content in the character set to obtain the parsed content of the handwriting data, and the parsed content is content that conforms to the semantic grammar.

S103: Receive, in the cloud service platform, an interaction instruction formed by a user during an interaction operation on the display device, so as to parse the interaction instruction and form an analysis result.

The user will form interactive instructions on the display device by means of gestures, etc., so that the content displayed on the display device can be determined based on these interactive instructions.

The gestures defined on the display device can be command-defined in advance, so that after these gestures are acquired, the interaction gestures can be parsed to obtain interaction instructions.

S104, based on the analysis result, send one or more of the graphical file, the character set and the analysis content to the display device for interactive display.

As an example, when the interactive instruction in the analysis result is a writing instruction, the graphic file is sent to the display device, so as to display the user's handwriting track in real time. When the interactive instruction in the analysis result is an input instruction, sending the graphical file and the character set together to the display device, so as to display the characters corresponding to the handwritten track while displaying the user's handwritten track; When the interactive instruction in the parsing result is a content input instruction, the parsing content is sent to the display device.

In addition, the user can also define more interaction modes according to actual needs, which is not limited here.

Referring to FIG. 2 , according to a specific implementation manner of an embodiment of the present disclosure, the acquiring of handwriting data formed by a smart pen in a preset writing area includes:

S201, judging whether the pressure value generated by the pressure sensor of the smart pen is greater than a preset value;

S202, if yes, collect handwriting data generated by the smart pen in the writing area, where the handwriting data includes pressure values, position coordinates, time values, and acceleration values generated by the smart pen.

Referring to FIG. 3 , according to a specific implementation manner of an embodiment of the present disclosure, the data processing performed on the handwriting received from the sensing device on the cloud service platform includes:

S301, based on the pressure value, position coordinate, time value and acceleration value included in the handwriting data, restore the trajectory of the smart pen to form a graphical file;

S302, performing character recognition on the graphical file to obtain a character set corresponding to the pen data;

S303: Perform semantic analysis on the content in the character set to obtain the parsed content of the handwriting data.

Referring to FIG. 4 , according to a specific implementation manner of an embodiment of the present disclosure, the receiving, in the cloud service platform, an interaction instruction formed by a user during an interaction operation on a display device includes:

S401, acquiring user interaction gestures on the display device;

S402, parse the interaction gesture, and determine the interaction instruction corresponding to the interaction gesture.

According to a specific implementation manner of the embodiment of the present disclosure, the sending one or more of the graphical file, the character set, and the parsed content based on the parsing result to the display device for interactive display, including: : When the interactive instruction in the analysis result is a writing instruction, send the graphic file to the display device, so as to display the user's handwriting track in real time.

According to a specific implementation manner of the embodiment of the present disclosure, the one or more of the graphical file, the character set and the parsed content are sent to the display device for interactive display based on the parsing result, and further Including: when the interactive command in the analysis result is an input command, sending the graphic file and the character set to the display device together, so as to display the user's handwritten track and display the corresponding handwritten track at the same time. character; when the interactive instruction in the parsing result is a content input instruction, send the parsing content to the display device.

According to a specific implementation manner of the embodiment of the present disclosure, after sending one or more of the graphical file, the character set, and the parsed content to the display device for interactive display based on the parsing result, The method further includes: searching for the target content corresponding to the handwriting data by using the file identifier contained in the graphic file; determining the The evaluation content of the graphical file.

As an optional method, a graphical file corresponding to the handwriting data of the smart pen may be obtained, and the graphical file is generated from the handwriting data in a graphical manner.

After the writing of the smart pen is completed, the handwriting data written by the smart pen is uploaded to the cloud service platform, and the user's handwriting is graphically restored in the cloud service platform, thereby forming the graphical file.

As an optional manner, content recognition may be performed on the graphic characters in the graphic file to obtain the parsed content corresponding to the graphic file.

The graphical file contains the content written by the user. By performing text recognition and content recognition on the graphical file, the parsed content corresponding to the graphical file can be obtained. Through the parsed content, the content contained in the graphical file can be known. In this way, the graphical file may be the user's handwritten test answer, and the parsed content is to parse the user's handwritten test answer into standard computer-recognized textual content.

As an optional manner, the target content corresponding to the handwriting data may be searched for through the file identifier contained in the graphic file.

The graphic file may contain a file identifier, and the file identifier is used to indicate the content identifier in the graphic file, for example, the file identifier may be the test question number. By identifying the file identifier, the target content (for example, the answer to the test question) corresponding to the file identifier can be searched in the database preset in the cloud service platform.

As an optional manner, the evaluation content of the graphical file may be determined by judging the similarity between the parsed content and the target content.

By judging the similarity between the parsed content and the target content, the target content can be used to judge whether the parsed content handwritten by the user through the smart pen is correct, and then give a corresponding evaluation.

According to a specific implementation manner of the embodiment of the present disclosure, the obtaining the graphic file corresponding to the handwriting data of the smart pen includes: after the smart pen completes handwriting writing, performing a graphic operation on the handwriting of the smart pen in the cloud service platform ; After the graphicization is completed, obtain the graphic file corresponding to the handwriting data of the smart pen.

According to a specific implementation manner of the embodiment of the present disclosure, the performing content recognition on the graphic characters in the graphic file includes: performing character detection on the handwriting in the graphic file to obtain a character set; Semantic analysis is performed on the content in the character set, and the parsed content corresponding to the graphical file is determined based on the result of the semantic analysis.

According to a specific implementation manner of the embodiment of the present disclosure, the searching for the target content corresponding to the handwriting data according to the file identifier included in the graphic file includes: inputting the graphic in the cloud service platform The file identifier included in the conversion file; based on the file identifier, the target content corresponding to the handwriting data is searched in the database preset by the cloud service platform.

According to a specific implementation manner of the embodiment of the present disclosure, determining the evaluation content of the graphical file by judging the similarity between the parsed content and the target content includes: separately evaluating the parsed content Carry out vectorization calculation with the target content to obtain an analytical content vector and a target content vector; perform similarity calculation on the analytical content vector and the target content vector to obtain a similarity calculation result; based on the similarity calculation result, Determine the evaluation content corresponding to the graphical file.

According to a specific implementation manner of the embodiment of the present disclosure, after obtaining the graphic file corresponding to the handwriting data of the smart pen, the method further includes: performing target recognition on the graphic characters in the graphic file to obtain one or more Multiple graphical characters.

According to a specific implementation manner of the embodiment of the present disclosure, the method further includes: searching for a target graphic corresponding to the graphic character based on a standard character code corresponding to the graphic character; Similarity judgment with the target graphic is performed to determine the evaluation information of the graphic character.

Perform target recognition on the graphic characters in the graphic file to obtain one or more graphic characters.

The graphic file contains one or more characters written by the user through the smart pen. These characters can be Chinese and English symbols, numbers or graphics, etc. By performing target recognition on these graphic characters, one or more graphic characters can be obtained. , these graphical characters describe the user's writing trajectory in the form of images. For example, the graphical character may be a calligraphic font written by a user using a smart pen.

As an optional manner, the target graphic corresponding to the graphic character may be searched based on the standard character code corresponding to the graphic character.

The graphic character can be recognized by performing OCR recognition on the graphic character, so as to obtain the standard character code corresponding to the graphic character. Meanwhile, target graphics are stored in the cloud service platform, and the target image is a standard style corresponding to the standard character encoding. Through the standard character encoding, the target graphics corresponding to the graphical characters can be searched in the cloud service platform.

As an example, the graphic characters may be italic characters written by the user, and the target image is the corresponding standard italic fonts. By recognizing the italic characters written by the user, the standard italic fonts can be found.

As an optional manner, the evaluation information of the graphic character may be determined by judging the similarity between the graphic character and the target graphic.

Whether the graphical characters written by the user are standard can be determined by calculating the similarity between the graphical characters and the target graphics, for example, when the similarity between the graphical characters and the target graphics reaches 90% In the above case, it can be determined that the user's handwriting has reached an excellent level, and at this time, an excellent evaluation can be given in the evaluation information.

According to a specific implementation manner of the embodiment of the present disclosure, the obtaining of the graphic file corresponding to the handwriting data of the smart pen includes:

After the smart pen completes handwriting, perform a graphical operation on the smart pen handwriting in the cloud service platform;

After the graphing is completed, a graphing file corresponding to the handwriting data of the smart pen is obtained.

According to a specific implementation manner of the embodiment of the present disclosure, the target recognition is performed on the graphic characters in the graphic file to obtain one or more graphic characters, including:

performing edge detection on graphic characters in the graphic file;

Based on the results of the edge detection, the one or more graphical characters are determined.

According to a specific implementation manner of the embodiment of the present disclosure, the searching for the target graphic corresponding to the graphic character based on the standard character code corresponding to the graphic character includes:

Perform graphic recognition on the graphical characters to obtain standard character codes corresponding to the graphical characters;

Based on the standard character code, a target image corresponding to the standard character code is searched in a preset target image database.

According to a specific implementation manner of the embodiment of the present disclosure, determining the evaluation information of the graphic character by judging the similarity between the graphic character and the target graphic includes:

Carry out similarity calculation on the graphic character and the target graphic to obtain a calculation result;

Based on the calculation result, evaluation information for the graphic character is generated.

According to a specific implementation manner of the embodiment of the present disclosure, after determining the evaluation information of the graphic character by judging the similarity between the graphic character and the target graphic, the method further includes:

Calculate the first feature of the handwriting data based on the handwriting matrix and the stored value corresponding to the handwriting data of the smart pen;

The character set contained in the graphic file corresponding to the handwriting data is acquired, so as to determine the second feature of the handwriting data based on the character set.

According to a specific implementation of the embodiment of the present disclosure, the method further includes:

Perform feature extraction on the semantic recognition content corresponding to the character set to obtain the third feature of the handwriting data;

Based on the first feature, the second feature and the third feature, the writing behavior feature corresponding to the smart pen handwriting data is determined.

As an optional manner, the first feature of the handwriting data may be calculated based on the handwriting matrix and the stored value corresponding to the handwriting data of the smart pen.

The handwriting matrix is a feature matrix extracted from the elements that characterize the handwriting features, such as position coordinates, acceleration values, and pressure values contained in the handwriting after the user has finished writing the handwriting. It is used to identify the specific information and features of the user's handwriting. Ability to restore user's handwriting.

The stored value is the eigenvalue of the user's historical handwriting matrix that has been stored in the cloud service platform. The characters contained in the graphic file have a one-to-one correspondence with the handwriting matrix or the stored value. Therefore, you can directly search for the corresponding relationship based on this relationship. A handwriting matrix and stored values of the graphic file are generated.

When the handwriting matrix has a corresponding stored value in the cloud service platform, the stored value can be directly used to replace the handwriting matrix. When there is no corresponding stored value of the handwriting matrix in the cloud service platform, the eigenvalue of the handwriting matrix is calculated; the eigenvalue and the stored value are combined to form an eigenvector of the first feature.

As an optional manner, the character set contained in the graphic file corresponding to the handwriting data may be acquired, so as to determine the second feature of the handwriting data based on the character set.

The character set is the result of character recognition on the graphical file after the writing handwriting of the smart pen is graphed, and the second vector corresponding to the character set can be obtained by calculating the feature vector of the character set, and the second vector is used as the The second feature of the handwriting data.

As an optional method, feature extraction may be performed on the semantic recognition content corresponding to the character set to obtain the third feature of the handwriting data.

After the cloud service platform obtains the character set, it also needs to perform semantic analysis on the content in the character set by means of semantic analysis to obtain the semantically recognized content. as a third feature.

As an optional manner, the writing behavior feature corresponding to the smart pen handwriting data may be determined based on the first feature, the second feature, and the third feature.

As a method, the first feature, the second feature and the third feature can be used as feature vectors to form a writing behavior matrix; by calculating the eigenvalues of the writing behavior evidence, the eigenvalues of the writing behavior matrix can be determined as The writing behavior characteristics corresponding to the handwriting data of the smart pen are obtained, thereby obtaining the behavior characteristics corresponding to the handwriting data of the smart pen.

After the behavior feature is obtained, the behavior feature can be used as the signature value of the handwriting data to realize the user's handwriting identification. Every character written by the user with the smart pen can identify the writer, and can be used to verify the authenticity of the file signature and test imitation and cheating. etc. scene.

According to a specific implementation manner of the embodiment of the present disclosure, calculating the first feature of the handwriting data based on the handwriting matrix and the stored value corresponding to the handwriting data of the smart pen includes: calculating the feature value of the handwriting matrix; The values together with the stored values form a feature vector for the first feature.

According to a specific implementation manner of the embodiment of the present disclosure, the acquiring the character set included in the graphic file corresponding to the handwriting data, so as to determine the second feature of the handwriting data based on the character set, includes: Perform vector calculation on the characters in the character set to obtain a second vector; and use the second vector as a feature vector of the second feature.

According to a specific implementation manner of the embodiment of the present disclosure, the performing feature extraction on the semantic recognition content corresponding to the character set to obtain the third feature of the handwriting data includes: performing vector calculation on the semantic recognition content, A third vector is obtained; the third vector is used as the feature vector of the third feature.

According to a specific implementation manner of the embodiment of the present disclosure, determining the writing behavior feature corresponding to the smart pen handwriting data based on the first feature, the second feature, and the third feature includes:

constructing a writing behavior matrix based on the first feature, the second feature and the third feature;

The feature value of the writing behavior matrix is determined as the writing behavior feature corresponding to the handwriting data of the smart pen.

According to a specific implementation manner of the embodiment of the present disclosure, before the first feature of the handwriting data is calculated based on the handwriting matrix and the stored value corresponding to the handwriting data of the smart pen, the method further includes:

Obtaining a character set formed based on a graphical file formed based on smart pen handwriting;

Based on the handwriting matrix and the stored value corresponding to the graphical file, in the database preset in the cloud service platform, it is determined whether there is a personalized semantic database corresponding to the graphical file.

When there is a personalized semantic database corresponding to the graphical file, calling the personalized semantic database to parse the content in the character set to obtain a parsing result;

Based on the parsing result, the content in the character set is re-determined.

As an optional method, a character set formed based on a graphical file may be obtained, and the graphical file is formed based on the handwriting of the smart pen.

The graphical file displays the writing handwriting of the smart pen in a graphical way. In order to further obtain the content written by the user in the graphical file, character recognition can be performed on the user's handwriting in the graphical file, so as to obtain the corresponding handwriting of the graphical file. Character set, through the character set, the writing content of the smart pen in the graphic file can be determined.

However, in the process of characterizing the graphic file, there is a situation of recognition error, so it is necessary to perform content analysis and recognition here based on the recognized character set.

As an optional method, it may be determined whether there is a personalized semantic database corresponding to the graphical file in the database preset in the cloud service platform based on the handwriting matrix and the stored value corresponding to the graphical file.

In addition, the cloud service platform is also provided with a personalized semantic database. The personalized semantic database is generated based on the historical records for character recognition of graphical files, and can record the personalized semantic content corresponding to the handwriting matrix and the stored value.

As an optional manner, when there is a personalized semantic database corresponding to the graphical file, the personalized semantic database may be invoked to parse the content in the character set to obtain a parsing result.

Specifically, the characters in the character set may be subjected to word segmentation processing to obtain one or more word segmentation vectors; vector comparison between the word segmentation vectors and the semantic vectors in the personalized semantic database is performed; based on the vector comparison As a result, it is determined whether the word segmentation vector in the character set is correct.

As an optional manner, the content in the character set may be re-determined based on the parsing result.

When the word segmentation vector is inconsistent with the semantic vector in the personalized semantic database, use the semantic vector in the personalized semantic database to correct the character vector in the character set, and then re-determine the content in the character set.

According to a specific implementation manner of the embodiment of the present disclosure, the acquiring a character set formed based on a graphical file includes: judging whether a new graphical file is generated in the cloud service platform; if yes, then in the cloud service platform After completing character recognition on the graphical file, a character set obtained by the graphical file recognition is obtained.

According to a specific implementation manner of the embodiment of the present disclosure, based on the handwriting matrix and the stored value corresponding to the graphical file, it is determined whether there is a database corresponding to the graphical file in a preset database in the cloud service platform The personalized semantic database includes: inputting the handwriting matrix and the stored value into a database in the cloud platform; and querying whether there is a personalized semantic database corresponding to the handwriting matrix and the stored value.

According to a specific implementation manner of the embodiment of the present disclosure, the invoking the personalized semantic database to parse the content in the character set includes: performing word segmentation on the characters in the character set to obtain one or more A word segmentation vector; vector comparison is performed between the word segmentation vector and the semantic vector in the personalized semantic database; based on the result of the vector comparison, it is determined whether the word segmentation vector in the character set is correct.

According to a specific implementation manner of the embodiment of the present disclosure, the re-determining the content in the character set based on the parsing result includes: when the parsing result displays the word segmentation vector in the character set and the personalized When the semantic vectors in the semantic database are inconsistent, the content in the word segmentation vector is corrected based on the semantic vectors in the personalized semantic database.

According to a specific implementation manner of the embodiment of the present disclosure, before acquiring the character set formed based on the graphical file, the method further includes: acquiring a graphical file for which character recognition needs to be performed, and the graphical file is generated by a smart pen. Handwriting generation; find the handwriting matrix and the stored value for generating the graphic file in the cloud service platform.

According to a specific implementation of the embodiment of the present disclosure, the method further includes: in a preset character recognition database, judging whether there is a historical character corresponding to the handwriting matrix and the stored value; if so, directly using the The historical characters are used as the characters of the graphic to be recognized in the graphic file.

As an optional method, a graphical file that needs to be recognized can be obtained, and the graphical file is generated from the handwriting of the smart pen.

The graphic file is converted from the track written by the smart pen, and is used to display the writing track of the smart pen in a graphic manner, and the graphic file can be various types of graphic files.

Before character recognition, you can directly find the newly generated graphic file in the cloud service platform, and obtain the graphic file that needs to be recognized in real time.

As an optional method, the handwriting matrix and the stored value for generating the graphic file may be searched in the cloud service platform.

As an optional method, it can be determined whether there are historical characters corresponding to the handwriting matrix and the stored values in a preset character recognition database.

The character recognition database saves the characters that have been recognized before, and also saves the one-to-one correspondence between the recognized characters and the handwriting matrix or stored value. Describe the handwriting matrix and the historical characters corresponding to the stored values.

As an optional manner, if yes, the historical character is directly used as the character of the graphic to be recognized in the graphic file.

In this way, the characters of the graphics to be recognized can be directly recognized based on the historical identification records, without performing character recognition on each graphics in each graphic file, thereby greatly improving the efficiency of character recognition.

According to a specific implementation manner of the embodiment of the present disclosure, after judging whether there are historical characters corresponding to the handwriting matrix and the stored value in the preset character recognition database, the method further includes:

When there is no historical character corresponding to the handwriting matrix and the stored value in the preset character recognition database, the character on the graphic file is directly recognized;

The recognized characters and their corresponding handwriting matrices or stored values are stored in the character recognition database.

According to a specific implementation manner of the embodiment of the present disclosure, the obtaining a graphical file requiring character recognition includes: searching the cloud service platform for a newly generated graphical file;

The newly generated graphic file is used as a graphic file that needs to perform character recognition.

According to a specific implementation manner of the embodiment of the present disclosure, the searching for the handwriting matrix and the stored value for generating the graphical file in the cloud service platform includes: in the data collection module of the cloud service platform, querying the The handwriting matrix and stored values of the graphic file.

According to a specific implementation manner of the embodiment of the present disclosure, in the preset character recognition database, judging whether there are historical characters corresponding to the handwriting matrix and the stored value includes:

Inputting the handwriting matrix and the stored value into the character recognition database to perform a query operation;

Based on the result of the query operation, it is determined whether there is a historical character corresponding to the handwriting matrix and the stored value.

According to a specific implementation manner of the embodiment of the present disclosure, the directly using the historical characters as the characters of the graphic to be recognized in the graphic file includes:

Obtain the position coordinates of the to-be-recognized graphic in the graphic file;

The historical characters are set at the position coordinates of the graphic to be recognized in the graphic file, so as to obtain a character recognition result.

According to a specific implementation manner of the embodiment of the present disclosure, before the acquisition of the graphical file requiring character recognition, the method further includes:

Obtain the handwriting data that needs to be graphed, the handwriting data includes the paper surface information when the smart pen writes, the handwriting matrix and the stored value, the handwriting matrix is generated by the smart pen client based on the handwriting of the smart pen, and the stored value is provided by the cloud service. The platform is generated based on the user's historical handwriting data;

In the graphical module of the cloud service platform, find the handwriting matrix and stored value corresponding to the current paper information;

Based on the generation time corresponding to the handwriting matrix and the stored value, sorting the handwriting matrix and the stored value to form a graphical sorting result;

Based on the graphical sorting result, a graphical file of the handwriting data on the current page is formed in sequence according to the graphic style corresponding to the handwriting matrix and the stored value on the current page.

As an optional method, the handwriting data that needs to be graphed can be obtained, and the handwriting data includes paper surface information, a handwriting matrix and a stored value when the smart pen writes, and the handwriting matrix is generated by the smart pen client based on the handwriting of the smart pen , the stored value is generated by the cloud service platform based on the user's historical handwriting data.

After the handwriting data is generated on the smart pen, in order to improve the recognition efficiency of the handwriting of the smart pen, the handwriting data of the smart pen can be uploaded to the cloud service platform, and the handwriting data can be processed through the cloud service platform. Convert handwriting data into graphic files, and display the real shape of handwriting through graphic files.

For this purpose, the paper surface information, the handwriting matrix and the stored value formed by the smart pen during writing can be obtained from the handwriting data.

The paper surface information is used to describe the paper surface on which the smart pen writes handwriting. For example, if the user has written 10 pages of content through the smart pen, at this time, each page of 1-10 can be used to find the content written by the user.

The stored value is the eigenvalue of the user's historical handwriting matrix that has been stored in the cloud service platform. When the handwriting matrix generated when the smart pen writes is already stored in the historical handwriting matrix stored in the cloud service platform, the historical handwriting matrix Store the value to replace the newly generated handwriting matrix, thereby saving data processing and reducing system resources.

As an optional method, the handwriting matrix and the stored value corresponding to the current paper information can be searched in the graphic module of the cloud service platform.

The cloud service platform may include a graphical module. Through the graphical module, the handwriting matrix and the stored value corresponding to the current paper information stored in the database can be queried, so that the user can be restored based on the queried handwriting matrix and the stored value. 's handwriting.

As an optional manner, the handwriting matrix and the stored value may be sorted based on the generation time corresponding to the handwriting matrix and the stored value to form a graphical sorting result.

Specifically, the handwriting matrix and the handwriting corresponding to the stored value may be sorted in ascending or descending order, so that the handwriting on the current page can be sorted according to the actual generation order or reverse order of the handwriting.

As an optional method, based on the graphical sorting result, a graphical file of the handwriting data on the current page may be formed on the current page in sequence according to the graphic style corresponding to the handwriting matrix and the stored value. .

After sorting on the current page in sequence according to the graphic style corresponding to the handwriting matrix and the stored value, the pressure value or position coordinate corresponding to each handwriting matrix or the stored value can be further obtained, and determined by the pressure value The thickness feature of handwriting determines the position coordinates of handwriting on the current page through the position coordinates, and finally forms a graphical handwriting file.

Through the content of the above-mentioned embodiments, the handwriting can be quickly performed graphically, and the efficiency of information interaction in the smart classroom is improved.

According to a specific implementation manner of the embodiment of the present disclosure, the obtaining the handwriting data that needs to be graphed includes: querying the newly generated handwriting data in the cloud service platform; identifying the newly generated handwriting data as the Handwriting data that needs to be graphed.

According to a specific implementation manner of the embodiment of the present disclosure, in the graphic module of the cloud service platform, searching for the handwriting matrix and the stored value corresponding to the current paper information includes: based on the acquired identifier of the smart pen, A query operation is performed in the database of the cloud service platform; based on the query result, a handwriting matrix and a stored value corresponding to the current paper information are obtained.

According to a specific implementation manner of the embodiment of the present disclosure, the sorting of the handwriting matrix and the stored values based on the generation time corresponding to the handwriting matrix and the stored value includes: sorting the handwriting matrix Arrange in ascending order with the generation time of the stored value; and determine the arrangement order of the handwriting matrix and the stored value based on the result of the ascending order.

According to a specific implementation manner of the embodiment of the present disclosure, the handwriting data is formed on the current page in sequence according to the graphic style corresponding to the handwriting matrix and the stored value based on the graphical sorting result. The graphic file of the current page includes: searching the handwriting matrix or the handwriting position coordinates and pressure values corresponding to the stored values in chronological order; generating the handwriting matrix or the handwriting matrix based on the handwriting position coordinates and the pressure value The graphic handwriting corresponding to the stored value.

According to a specific implementation of the embodiment of the present disclosure, before acquiring the handwriting data that needs to be graphed, the method further includes: dividing the acquired handwriting data based on the pressure value and the acceleration value to form a plurality of handwriting data part.

According to a specific implementation manner of the embodiment of the present disclosure, after dividing the acquired handwriting data based on the pressure value and the acceleration value to form a plurality of handwriting data segments, the method further includes: dividing the handwriting data segments into The corresponding time sequence, pressure value sequence, position coordinate sequence and acceleration value sequence are encapsulated to form a handwriting matrix corresponding to the handwriting data segment; the eigenvalues corresponding to the handwriting matrix are sent to the data in the cloud service platform acquisition module, so that the data acquisition module can query whether there is a stored value similar to the feature value in the handwriting data that has been stored in the cloud service platform; When the value is set, the storage matrix corresponding to the stored value is directly called as the characteristic matrix corresponding to the characteristic value.

During the writing process of the smart pen, the writing track of the smart pen can be generated by means of a dot matrix. The writing track can include various data of the smart pen, such as the generation time of the handwriting, the pressure value of the pen tip during writing, and the writing process of the writing pen. Position coordinates on paper, acceleration value when writing, etc. By sampling and arranging these data according to time training, time series, pressure value series, position coordinate series and acceleration value series can be formed. Time series, pressure value series, position coordinate series and acceleration value series can be used to describe and restore User's handwriting.

As an optional manner, the handwriting data may be divided based on the pressure value and the acceleration value to form a plurality of handwriting data segments.

If the handwriting of the smart pen is directly uploaded to the server for data processing, the data processing speed will be slow due to the large amount of data. Therefore, the handwriting data of the smart pen needs to be processed.

As an approach, the first pressure value threshold and the second acceleration threshold may be set first. Based on the first pressure value threshold, the pressure value sequence is divided to form multiple pressure value sequences. For example, the pressure value sequence part greater than the first pressure value threshold may be divided to form one or more pressure value sequences, One or more handwriting strokes to represent the actual writing of the user.

After the pressure value sequence is determined, the acceleration value sequence corresponding to each pressure value sequence may be further searched, and based on the second acceleration value threshold, a clipping operation is performed on the acceleration value sequence to form multiple acceleration value sequences. Through the second acceleration threshold, the handwriting data in the paused state of the user can be filtered, thereby further simplifying the segmented handwriting data. Finally, the handwriting data is divided based on the time series corresponding to the acceleration value series.

As an optional method, the time series, pressure value series, position coordinate series and acceleration value series corresponding to the handwriting data segment may be packaged to form a handwriting matrix corresponding to the handwriting data segment.

The time series, the pressure value series, the position coordinate series, and the acceleration value series can be regarded as row vectors or column vectors respectively, thereby forming one or more handwriting matrices corresponding to the handwriting data segments.

As an optional method, the eigenvalues corresponding to the handwriting matrix can be sent to the data collection module in the cloud service platform, so that the data collection module can query whether there is a handwriting data stored in the cloud service platform with Stored values with similar eigenvalues; when a stored value similar to the eigenvalue already exists in the cloud service platform, directly call the storage matrix corresponding to the stored value as the eigenvalue corresponding to the eigenvalue, when When there is no stored value similar to the feature value in the cloud service platform, the smart pen client that generates the feature data is notified to upload the handwriting matrix to the data acquisition module.

The stored value is the writing eigenvalue formed based on the user's previous writing handwriting. By comparing whether there is similarity between the eigenvalue and the stored value, it can be determined whether to call the storage matrix that has been stored in the cloud service platform, and use the value in the storage matrix to directly It replaces the data in the handwriting matrix, thereby further reducing the amount of data transmission and calculation, and improving the efficiency of handwriting processing.

By uploading eigenvalues, the amount of data calculation can be further reduced, and the data calculation process can be simplified.

According to a specific implementation manner of the embodiment of the present disclosure, the acquiring the handwriting data of the smart pen includes: monitoring whether pressure data is generated by the smart pen; if there is, collecting the handwriting data generated by the smart pen operate.

According to a specific implementation manner of the embodiment of the present disclosure, dividing the handwriting data based on the pressure value and the acceleration value includes: dividing the pressure value sequence based on a first pressure value threshold to form a plurality of Sequence of pressure values. Based on the first pressure value threshold, the pressure value sequence is divided to form multiple pressure value sequences. For example, the pressure value sequence part greater than the first pressure value threshold may be divided to form one or more pressure value sequences, One or more handwriting strokes to represent the actual writing of the user.

The acceleration value sequence corresponding to each pressure value sequence is searched; based on the second acceleration value threshold, a clipping operation is performed on the acceleration value sequence to form multiple acceleration value sequences. Based on the second acceleration value threshold, a clipping operation is performed on the acceleration value sequence to form a plurality of acceleration value sequences. Through the second acceleration threshold, the handwriting data in the paused state of the user can be filtered, thereby further simplifying the segmented handwriting data. The handwriting data is divided based on the time series corresponding to the acceleration value series. Through the above-mentioned embodiments, the amount of data calculation can be further reduced by setting a threshold value.

According to a specific implementation manner of the embodiment of the present disclosure, the encapsulating the time sequence, pressure value sequence, position coordinate sequence, and acceleration value sequence corresponding to the handwriting data segment includes:

Taking the time series, the pressure value series, the position coordinate series and the acceleration value series as row vectors of the matrix, the handwriting matrix corresponding to the handwriting data segment is formed in time sequence.

According to a specific implementation manner of the embodiment of the present disclosure, before the eigenvalue corresponding to the handwriting matrix is sent to the data acquisition module in the cloud service platform, the method further includes:

The eigenvalues of the divided handwriting data are calculated respectively to form the eigenvalue sequence of the handwriting data.

Using the graphic module in the cloud service platform, graphic processing is performed on the handwriting data obtained by the data acquisition module to obtain the handwriting image data of the smart pen.

According to a specific implementation of the embodiment of the present disclosure, the method further includes: performing character recognition on the handwriting image data by using a character recognition module in a cloud service platform to obtain character data corresponding to the handwriting image data; Through the content analysis module in the cloud service platform, a content analysis service is performed on the character data to form writing content data corresponding to the handwriting data.

As an electronic device terminal, the smart pen can collect the user's writing data in the form of pressure and acceleration value under the use of the user, thereby forming the writing data. These writing data, as the user's handwriting data, are transmitted to the cloud wirelessly or wiredly. Service Platform.

The cloud service platform is a platform that communicates with the smart pen terminal through wired or wireless means. Multiple data processing modules can be set up in the cloud service platform. These processing modules can process and analyze the writing data generated by the smart pen, so that users can The recognition and identification of handwriting has become more accurate and efficient.

As a method, a data collection module is provided in the cloud service platform, and through the data collection module, the handwriting data written by the user can be collected and stored.

The data acquisition module can be set to have extremely high flexibility and scalability, and can adjust the resource allocation in time according to the needs of data acquisition to ensure the rapid response of the system and avoid data congestion caused by the rapid expansion of business volume.

The data acquisition module is provided with a data storage service unit, which is used to adopt the distributed data storage service in the big data architecture, support the high concurrent data storage service, and provide support for distributed computing.

The user's handwriting collected by the data acquisition module is usually stored in the form of time, position coordinates, pressure value, acceleration value, etc. For this reason, the collected handwriting data needs to be imaged and restored to the user's real handwriting.

To this end, various data such as time, configuration, movement, and pressure of the original handwriting data can be structured and processed. Through the graphical calculation module, the original handwriting data can be calculated as image and video data, and finally bitmap, Various output formats such as vector graphics and dynamic videos are output, and the handwriting of fixed-line users is displayed in the form of images.

After obtaining the handwriting image data corresponding to the writing, the character recognition module set in the cloud service platform can be used to recognize the graphical characters, so as to obtain the character data corresponding to the handwriting image.

The character recognition function of handwriting can be set in the character recognition module, and the data written by the user can be quickly converted into standard characters that can be recognized by the computer. For example, the recognition characters of Chinese characters, letters, symbols and formulas can be set.

As an optional method, a semantic understanding function based on natural language processing technology can be added to the character recognition module in the process of handwriting recognition, and the probability of character content can be calculated according to the text content of the context to improve the accuracy of character recognition. .

After the user's handwriting is recognized as standard characters, the content analysis module set on the cloud service platform can be used to perform natural language processing, machine learning, deep learning and other artificial intelligence technologies to parse the content, including entity recognition, relationship extraction, semantics of character content Services such as comprehension, abstract extraction, keyword extraction, and knowledge graph construction.

By analyzing the content, it is possible to comprehensively judge and analyze the user's writing content by synthesizing all the contextual content of the user's handwriting, which further improves the accuracy of the writing content data.

Through the content and solution of the above embodiments, the user's handwriting can be processed in the cloud, thereby improving the processing efficiency and accuracy of the smart pen's handwriting.

According to a specific implementation manner of the embodiment of the present disclosure, after the writing content data corresponding to the handwriting data is formed, the method further includes: based on the content data, performing feature analysis on the writing behavior of the user to form a User-corresponding writing feature font library. For example, the user's writing behavior can be extracted and analyzed, including the writing characteristics of a single character, specific and other painting writing characteristics, overall writing habits, writing speed and other writing characteristics, and a unique character feature library for a specific user can be generated to realize user handwriting identification. , each character written by the user with the smart pen can identify the writer, and can be used in scenarios such as document signature authenticity verification, exam imitation and cheating, etc.

According to a specific implementation manner of the embodiment of the present disclosure, after the writing content data corresponding to the handwriting data is formed, the method further includes: comparing the target feature of the handwriting image data with preset target handwriting data and analysis, and the analysis result of the handwriting image data is determined based on the result of the comparison and analysis. For example, the system can receive the preset writing/painting target characters/graphics, collect the content written by the user, and calculate the similarity between the target and the writing result by using the method of graphic hash value comparison, cosine similarity comparison, mutual information comparison, etc. Judging the similarity between the user's writing content and the target can be applied to scenarios such as calligraphy learning and painting learning.

According to a specific implementation manner of the embodiment of the present disclosure, after the writing content data corresponding to the handwriting data is formed, the method further includes:

First, the content data is compared with preset target data to form a content comparison result.

As an application scenario, the content data can be the answer data written by the user in the process of taking the test, and the target data is the answer data corresponding to the test content. By comparing the content data and the target data, a comparison result can be formed.

Next, based on the content comparison result, a similarity value between the content data and the target data is determined.

Through the comparison result formed by the above steps, the similarity value between the content data and the target data can be determined, so as to further determine the correct rate of the handwriting data answered by the user. Through the content of this embodiment, it can be further determined whether the content written by the user is correct based on the written data of the user.

According to a specific implementation manner of the embodiment of the present disclosure, after the writing content data corresponding to the handwriting data is formed, the method further includes: sending the handwriting image data and the content data to the client at the same time, So that the client can display the handwriting image data or the content data.

According to a specific implementation manner of the embodiment of the present disclosure, after the writing content data corresponding to the handwriting data is formed, the method further includes: identifying the content data, and judging whether there is a table in the content data content data; if so, display the table content data in a tabular form.

In this way, the data that needs to be displayed in the form of a table can be identified, and the part of the content can be displayed in the form of a table, thereby improving the processing function of the smart pen data.

According to a specific implementation manner of the embodiment of the present disclosure, after the writing content data corresponding to the handwriting data is formed, the method further includes: performing semantic analysis on the content data to determine whether there is a content data corresponding to the content data Recommendation data for the response. The recommendation data can be data corresponding to the content data. As an example, the content data is the case data of the user written by the doctor by handwriting, etc., then by analyzing the case data, the prescription data corresponding to the case data can be recommended (recommended data). ), so that it is convenient for doctors to select some recommended data according to actual needs. If it exists, the recommendation data corresponding to the content data is generated. Through this embodiment, the writing efficiency of the writing content data can be further improved.

Corresponding to the above embodiments, referring to FIG. 5 , an embodiment of the present application further discloses a smart classroom information interaction device 50, including:

an acquisition module 501, configured to acquire handwriting data formed by a smart pen in a preset writing area, the writing area having a sensing device for generating the handwriting data, and the sensing device is connected to a display device by means of communication;

A forming module 502 is configured to perform data processing on the handwriting received from the sensing device on the cloud service platform to form a graphic file, character set and analytical content corresponding to the handwriting data;

The receiving module 503 is configured to receive, in the cloud service platform, the interaction instruction formed by the user during the interactive operation on the display device, so as to parse the interaction instruction and form an analysis result;

The sending module 504 is configured to send one or more of the graphical file, the character set and the parsed content to the display device for interactive display based on the parsing result.

For parts that are not described in detail in this embodiment, reference is made to the content recorded in the foregoing method embodiments, and details are not described herein again.

Referring to FIG. 6, an embodiment of the present disclosure further provides an electronic device 60, the electronic device includes:

at least one processor; and,

a memory communicatively coupled to the at least one processor; wherein,

The memory stores instructions executable by the at least one processor, and the instructions are executed by the at least one processor, so that the at least one processor can execute the smart classroom information interaction method in the foregoing method embodiments.

Embodiments of the present disclosure also provide a computer program product, the computer program product includes a computer program stored on a non-transitory computer-readable storage medium, the computer program includes program instructions, when the program instructions are executed by a computer, make The computer executes the smart classroom information interaction method in the foregoing method embodiments.

Referring next to FIG. 6 , it shows a schematic structural diagram of an electronic device 60 suitable for implementing an embodiment of the present disclosure. The electronic devices in the embodiments of the present disclosure may include, but are not limited to, such as mobile phones, notebook computers, digital broadcast receivers, PDAs (personal digital assistants), PADs (tablets), PMPs (portable multimedia players), vehicle-mounted terminals (eg, mobile terminals such as in-vehicle navigation terminals), etc., and stationary terminals such as digital TVs, desktop computers, and the like. The electronic device shown in FIG. 6 is only an example, and should not impose any limitation on the function and scope of use of the embodiments of the present disclosure.

As shown in FIG. 6 , electronic device 60 may include processing means (eg, central processing unit, graphics processor, etc.) 601 that may be loaded into random access according to a program stored in read only memory (ROM) 602 or from storage means 608 Various appropriate actions and processes are executed by the programs in the memory (RAM) 603 . In the RAM 603, various programs and data necessary for the operation of the electronic device 60 are also stored. The processing device 601, the ROM 602, and the RAM 603 are connected to each other through a bus 604. An input/output (I/O) interface 605 is also connected to bus 604 .

Typically, the following devices can be connected to the I/O interface 605: input devices 606 including, for example, a touch screen, touchpad, keyboard, mouse, image sensor, microphone, accelerometer, gyroscope, etc.; including, for example, a liquid crystal display (LCD), speakers, An output device 607 of a vibrator or the like; a storage device 608 including, for example, a magnetic tape, a hard disk, etc.; and a communication device 609 . Communication means 609 may allow electronic device 60 to communicate wirelessly or by wire with other devices to exchange data. While the figures show the electronic device 60 having various means, it should be understood that not all of the illustrated means are required to be implemented or provided. More or fewer devices may alternatively be implemented or provided.

In particular, according to embodiments of the present disclosure, the processes described above with reference to the flowcharts may be implemented as computer software programs. For example, embodiments of the present disclosure include a computer program product comprising a computer program carried on a computer-readable medium, the computer program containing program code for performing the method illustrated in the flowchart. In such an embodiment, the computer program may be downloaded and installed from the network via the communication device 609 , or from the storage device 608 , or from the ROM 602 . When the computer program is executed by the processing apparatus 601, the above-mentioned functions defined in the methods of the embodiments of the present disclosure are executed.

It should be noted that the computer-readable medium mentioned above in the present disclosure may be a computer-readable signal medium or a computer-readable storage medium, or any combination of the above two. The computer-readable storage medium can be, for example, but not limited to, an electrical, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus or device, or a combination of any of the above. More specific examples of computer readable storage media may include, but are not limited to, electrical connections with one or more wires, portable computer disks, hard disks, random access memory (RAM), read only memory (ROM), erasable Programmable read only memory (EPROM or flash memory), fiber optics, portable compact disk read only memory (CD-ROM), optical storage devices, magnetic storage devices, or any suitable combination of the foregoing. In this disclosure, a computer-readable storage medium may be any tangible medium that contains or stores a program that can be used by or in conjunction with an instruction execution system, apparatus, or device. In the present disclosure, however, a computer-readable signal medium may include a data signal propagated in baseband or as part of a carrier wave with computer-readable program code embodied thereon. Such propagated data signals may take a variety of forms, including but not limited to electromagnetic signals, optical signals, or any suitable combination of the foregoing. A computer-readable signal medium can also be any computer-readable medium, other than a computer-readable storage medium, that can transmit, propagate, or transport a program for use by or in connection with the instruction execution system, apparatus, or device . Program code embodied on a computer readable medium may be transmitted using any suitable medium including, but not limited to, electrical wire, optical fiber cable, RF (radio frequency), etc., or any suitable combination of the foregoing.

The above-mentioned computer-readable medium may be included in the above-mentioned electronic device; or may exist alone without being assembled into the electronic device.

The above-mentioned computer-readable medium carries one or more programs, and when the above-mentioned one or more programs are executed by the electronic device, the electronic device: acquires at least two Internet Protocol addresses; A node evaluation request for an Internet Protocol address, wherein the node evaluation device selects an Internet Protocol address from the at least two Internet Protocol addresses and returns it; receives the Internet Protocol address returned by the node evaluation device; wherein the obtained The Internet Protocol address indicates an edge node in the content distribution network.

Alternatively, the above computer-readable medium carries one or more programs, and when the above one or more programs are executed by the electronic device, the electronic device: receives a node evaluation request including at least two Internet Protocol addresses; From the at least two Internet Protocol addresses, the Internet Protocol address is selected; the selected Internet Protocol address is returned; wherein, the received Internet Protocol address indicates an edge node in the content distribution network.

Computer program code for carrying out operations of the present disclosure may be written in one or more programming languages, including object-oriented programming languages—such as Java, Smalltalk, C++, but also conventional Procedural programming language - such as the "C" language or similar programming language. The program code may execute entirely on the user's computer, partly on the user's computer, as a stand-alone software package, partly on the user's computer and partly on a remote computer, or entirely on the remote computer or server. In the case of a remote computer, the remote computer may be connected to the user's computer through any kind of network, including a local area network (LAN) or a wide area network (WAN), or may be connected to an external computer (eg, using an Internet service provider through Internet connection).

The flowchart and block diagrams in the Figures illustrate the architecture, functionality, and operation of possible implementations of systems, methods and computer program products according to various embodiments of the present disclosure. In this regard, each block in the flowchart or block diagrams may represent a module, segment, or portion of code that contains one or more logical functions for implementing the specified functions executable instructions. It should also be noted that, in some alternative implementations, the functions noted in the blocks may occur out of the order noted in the figures. For example, two blocks shown in succession may, in fact, be executed substantially concurrently, or the blocks may sometimes be executed in the reverse order, depending upon the functionality involved. It is also noted that each block of the block diagrams and/or flowchart illustrations, and combinations of blocks in the block diagrams and/or flowchart illustrations, can be implemented in dedicated hardware-based systems that perform the specified functions or operations , or can be implemented in a combination of dedicated hardware and computer instructions.

The units involved in the embodiments of the present disclosure may be implemented in a software manner, and may also be implemented in a hardware manner. Wherein, the name of the unit does not constitute a limitation of the unit itself under certain circumstances, for example, the first obtaining unit may also be described as "a unit that obtains at least two Internet Protocol addresses".

It should be understood that portions of the present disclosure may be implemented in hardware, software, firmware, or a combination thereof.

The above are only specific embodiments of the present disclosure, but the protection scope of the present disclosure is not limited to this. Any person skilled in the art who is familiar with the technical scope of the present disclosure can easily think of changes or substitutions. All should be included within the protection scope of the present disclosure. Therefore, the protection scope of the present disclosure should be subject to the protection scope of the claims.

Industrial Applicability

Claims

A smart classroom information interaction method, characterized in that it includes:

acquiring handwriting data formed by the smart pen in a preset writing area, the writing area has a sensing device for generating the handwriting data, and the sensing device is connected to the display device by means of communication;

Perform data processing on the handwriting received from the sensing device on the cloud service platform to form a graphic file, character set and analytical content corresponding to the handwriting data;

receiving, in the cloud service platform, an interaction instruction formed by the user during the interactive operation on the display device, so as to parse the interaction instruction and form an analysis result;

Based on the parsing result, one or more of the graphical file, character set and parsing content are sent to the display device for interactive display.
The method according to claim 1, wherein the acquiring the handwriting data formed by the smart pen in the preset writing area comprises:

judging whether the pressure value generated by the pressure sensor of the smart pen is greater than a preset value;

If so, collect the handwriting data generated by the smart pen in the writing area, where the handwriting data includes the pressure value, position coordinates, time value and acceleration value generated by the smart pen.
The method according to claim 2, wherein the performing data processing on the handwriting received from the sensing device on the cloud service platform comprises:

Based on the pressure value, position coordinate, time value and acceleration value contained in the handwriting data, restore the trajectory of the smart pen to form a graphical file;

Character recognition is performed on the graphical file to obtain a character set corresponding to the pen data;

Semantically parse the content in the character set to obtain the parsed content of the handwriting data.
The method according to claim 1, wherein the receiving, in the cloud service platform, an interactive instruction formed by a user in an interactive operation process on the display device, comprises:

acquiring the user's interactive gestures on the display device;

The interaction gesture is parsed to determine the interaction instruction corresponding to the interaction gesture.
The method according to claim 1, wherein, based on the analysis result, sending one or more of the graphical file, the character set and the analysis content to the display device for interactive display, include:

When the interactive instruction in the analysis result is a writing instruction, the graphic file is sent to the display device, so as to display the user's handwriting track in real time.
The method according to claim 5, wherein, based on the parsing result, sending one or more of the graphical file, character set and parsing content to the display device for interactive display, Also includes:

When the interactive instruction in the analysis result is an input instruction, sending the graphical file and the character set together to the display device, so as to display the characters corresponding to the handwritten track while displaying the user's handwritten track;

When the interactive instruction in the parsing result is a content input instruction, the parsing content is sent to the display device.
The method according to claim 1, wherein, based on the parsing result, after sending one or more of the graphic file, character set and parsing content to the display device for interactive display , the method also includes:

Find the target content corresponding to the handwriting data through the file identifier contained in the graphic file;

By judging the similarity between the parsed content and the target content, the evaluation content of the graphical file is determined.
A smart classroom information interaction device, characterized in that it includes:

an acquisition module for acquiring handwriting data formed by the smart pen in a preset writing area, the writing area has a sensing device for generating the handwriting data, and the sensing device is connected to the display device by means of communication;

a forming module for performing data processing on the handwriting received from the sensing device on the cloud service platform to form a graphic file, character set and analytical content corresponding to the handwriting data;

a receiving module, configured to receive, in the cloud service platform, an interactive instruction formed by a user during an interactive operation on the display device, so as to parse the interactive instruction and form an analytical result;

A sending module, configured to send one or more of the graphical file, the character set and the parsed content to the display device for interactive display based on the parsing result.
An electronic device, characterized in that the electronic device comprises:

at least one processor; and,

a memory communicatively coupled to the at least one processor; wherein,

The memory stores instructions executable by the at least one processor, the instructions being executed by the at least one processor to enable the at least one processor to perform any of the preceding claims 1-7. The smart classroom information interaction method described above.
A non-transitory computer readable storage medium storing computer instructions for causing the computer to perform the method of any of the preceding claims 1-7.