CN109814787B

CN109814787B - Key information determination method, device, equipment and storage medium

Info

Publication number: CN109814787B
Application number: CN201910087616.XA
Authority: CN
Inventors: 吕毅
Original assignee: Guangzhou Shiyuan Electronics Thecnology Co Ltd; Guangzhou Shirui Electronics Co Ltd
Current assignee: Guangzhou Shiyuan Electronics Thecnology Co Ltd; Guangzhou Shirui Electronics Co Ltd
Priority date: 2019-01-29
Filing date: 2019-01-29
Publication date: 2021-04-06
Anticipated expiration: 2039-01-29
Also published as: CN109814787A; WO2020155816A1

Abstract

The invention discloses a method, a device, equipment and a storage medium for determining key information, wherein the method comprises the following steps: responding to the received touch operation, and displaying a touch identifier corresponding to the touch operation; determining an element set associated with the touch identifier in a current display page, and determining and storing elements in the element set as key information; responding to the received editing operation, and displaying an editing page containing the target key information; and when an editing completion instruction is received, saving the editing page. By adopting the mode, the key information of the key explanation in the teaching content can be rapidly identified and stored according to the gesture operation adopted by the teacher when the key explanation is carried out, so that the key information stored in the subsequent teaching can be used for realizing the centralized display of the key explanation content, the complex operation of the teacher when the key explanation content is displayed is avoided, the key explanation content is ensured to be reviewed without omission, and the user experience of intelligent teaching is better improved.

Description

Key information determination method, device, equipment and storage medium

Technical Field

The invention relates to the field of interactive intelligent panels, in particular to a method, a device, equipment and a storage medium for determining key information.

Background

In recent years, with the continuous improvement of education informatization degree of people, modern teaching based on electronic education equipment (such as an intelligent teaching whiteboard) becomes a development trend. For teaching based on electronic education equipment, a teacher can make teaching contents in a demonstration document form in advance and then show the teaching contents on an intelligent education whiteboard during teaching.

Generally, a teacher often has some teaching contents needing important explanation in the teaching contents displayed by the teacher during the teaching process, and the teaching contents of the important explanation are often mastered by the teacher who wants to listen to the instructor. In the process of implementing the invention, the inventor finds that the prior art has the following defects: the teacher can review the teaching contents of the key teaching in the follow-up teaching in the classroom, at the moment, the teacher can only manually search the teaching contents of the key teaching in the classroom, the mode of showing the key teaching contents to the student is complex in operation, and meanwhile, the teacher is not beneficial to realizing the effect that the teacher does not overlook all the key teaching contents, so that the user experience of intelligent teaching is reduced.

Disclosure of Invention

In view of this, embodiments of the present invention provide a method, an apparatus, a device, and a storage medium for determining key information, so as to solve the technical problem in the prior art that contents of key explanations during a course of teaching by a teacher cannot be effectively extracted.

In a first aspect, an embodiment of the present invention provides a method for determining key information, including:

responding to the received touch operation acted on the current display page, and displaying a touch identifier corresponding to the touch operation;

determining a set of elements associated with the touch identifier in a current display page, wherein the current display page comprises at least one element;

determining elements in the element set as key information and storing the key information;

responding to the received editing operation acting on the target key information, and displaying an editing page containing the target key information, wherein the target key information is any element in the element set as key information;

when an editing completion instruction is received, saving the editing page;

wherein the element comprises at least one of: text, graphical shapes, multimedia, and tables.

In a second aspect, an embodiment of the present invention further provides a device for determining key information, including:

the first response module is used for responding to the received touch operation acted on the current display page and displaying a touch identifier corresponding to the touch operation;

the element set determining module is used for determining an element set related to the gesture type in a current display page, wherein the current display page comprises at least one element;

the key information storage module is used for determining the elements in the element set as key information and storing the key information;

the second response module is used for responding to the received editing operation acting on the target key information and displaying an editing page containing the target key information, wherein the target key information is any element in the element set as key information;

the editing storage module is used for storing the editing page when receiving an editing completion instruction;

In a third aspect, an embodiment of the present invention further provides a device for determining key information, where the device includes: a memory, a display screen, and one or more processors;

the memory for storing one or more programs;

the display screen is used for displaying a current display page and a touch track corresponding to touch operation;

when the one or more programs are executed by the one or more processors, cause the one or more processors to implement the critical information determining method as described in the first aspect.

In a fourth aspect, embodiments of the present invention also provide a storage medium containing computer-executable instructions for performing the method for determining key information according to the first aspect when executed by a computer processor.

According to the key information determining method, the key information determining device, the key information determining equipment and the key information determining storage medium, firstly, in response to the received touch operation acting on the current display page, a touch identifier corresponding to the touch operation is displayed; then determining an element set associated with the touch identifier in a current display page; determining elements in the element set as key information and storing the key information, and finally, responding to the received editing operation acting on target key information, and displaying an editing page containing the target key information, wherein the target key information is any element in the element set as key information; and when an editing completion instruction is received, saving the editing page. Above-mentioned technical scheme, can be according to the touch operation that the teacher adopted when giving lessons the in-process and carrying out key explanation, the key information of key explanation in the content of giving lessons of discerning fast and save to guarantee just can realize the concentrated presentation of key explanation content through the key information of transferring the storage during follow-up teaching, not only avoided the teacher from this to carry out the loaded down with trivial details operation when the content of giving lessons shows, still guaranteed the nothing of giving lessons and neglected of key explanation content, better promotion intelligent teaching's user experience.

Drawings

Other features, objects and advantages of the invention will become more apparent upon reading of the detailed description of non-limiting embodiments made with reference to the following drawings:

fig. 1 is a flowchart of a method for determining key information according to an embodiment of the present invention;

fig. 2a is a flowchart of a method for determining key information according to a second embodiment of the present invention;

FIG. 2b is a diagram illustrating an example of determining a gesture-related element according to a second embodiment of the present invention;

fig. 3a is a flowchart of a method for determining key information according to a third embodiment of the present invention;

FIG. 3b is a flowchart illustrating an implementation of circle-shaped touch trajectory determination in the third embodiment of the present invention;

FIG. 3c is an exemplary diagram of a gesture type associated with a touch operation being circled;

fig. 4a is a flowchart of a method for determining key information according to a fourth embodiment of the present invention;

FIG. 4b is a flowchart illustrating an implementation of determining the linearity of the touch trajectory in the fourth embodiment of the present invention;

FIG. 4c is an exemplary diagram of determining a gesture-related element in the fourth embodiment of the present invention;

FIG. 4d illustrates an exemplary view of a storage folder for storing key information;

fig. 5 is a schematic structural diagram of a key information determining apparatus according to a fifth embodiment of the present invention;

fig. 6 is a schematic structural diagram of a key information determining device according to a sixth embodiment of the present invention.

Detailed Description

The present invention will be described in further detail with reference to the accompanying drawings and examples. It is to be understood that the specific embodiments described herein are merely illustrative of the invention and are not limiting of the invention. It should be further noted that, for the convenience of description, only some but not all of the relevant aspects of the present invention are shown in the drawings.

Example one

Fig. 1 is a flowchart of a method for determining key information according to an embodiment of the present invention. The key information determining method provided in the embodiment may be executed by a key information determining device, where the key information determining device may be implemented in a software and/or hardware manner, and the key information determining device may be formed by two or more physical entities or may be formed by one physical entity. In general, the key information determination device has an electronic whiteboard function, and may be a computer, a mobile phone, a tablet, an intelligent teaching tablet, or the like.

For the convenience of understanding, the intelligent teaching tablet is taken as a key information determination device in the embodiment for exemplary description. The intelligent teaching panel can be an integrated device which controls the content displayed on the display panel and realizes man-machine interaction operation through a touch technology, and integrates one or more functions of a projector, an electronic whiteboard, a curtain, a sound box, a television, a video conference terminal and the like. In general, the display screen of the intelligent teaching tablet can be a capacitive screen, a resistive screen or an electromagnetic screen. The user can carry out touch operation on the intelligent teaching tablet through a finger or a touch pen.

Furthermore, the intelligent teaching tablet is provided with application software of an operating system, and simultaneously is also provided with application software downloaded from a third-party device or a server, wherein the specific type and content of the application software can be set according to actual conditions, and generally, the application software has an electronic whiteboard function, and can be realized through the electronic whiteboard function: writing, drawing, commenting, courseware making, displaying and playing. In the embodiment, the electronic whiteboard function is set to have courseware making and display playing functions, wherein courseware making refers to element input or insertion operation performed in a courseware editing page by a user (the user can be a teacher) on an intelligent teaching tablet, in addition, display playing specifically refers to courseware demonstration performed by using the content in the courseware editing page as a demonstration playing page in a teaching mode, and display playing can be specifically realized by triggering a demonstration playing button by the user.

It can be understood that, in the embodiment, the execution timing of the key information determining method may specifically be when the user triggers the demonstration play button to show the teaching content in a demonstration play page form, at this time, the key information determining function may be activated by touching, so as to determine and store the key content of the important explanation in the teaching process of the teacher, and it should be noted that, in the embodiment, the demonstration play page currently shown to the student may be recorded as the current display page.

As shown in fig. 1, a method for determining key information according to an embodiment of the present invention includes the following operations:

s101, responding to the received touch operation acted on the current display page, and displaying a touch identifier corresponding to the touch operation.

In this embodiment, the intelligent interactive tablet executing the provided key information determination method has a touch function, so that a teacher can perform operations such as clicking and moving on the intelligent interactive tablet by using a finger or a stylus in a touch manner during a teaching process, so that the intelligent teaching tablet receives the touch operation of the teacher.

In this embodiment, the touch identifier may be specifically understood as an identifier that can be specifically displayed on the display screen when the user performs a touch operation, and the identifier may display different identifiers according to a difference in a gesture specifically adopted when the user performs the touch operation, for example, the user may perform the touch operation on the intelligent interactive tablet by using a tapping gesture, a circle-drawing gesture, or a line-drawing gesture, and the correspondingly formed identifier may be a circular area, a circle-shaped trajectory, or a linear trajectory. In this embodiment, it can be considered that when a teacher explains important content in a teaching process, the teacher may perform important labeling in an area where the important content is located through some gestures, and the process of the important labeling is equivalent to a process in which the teacher generates touch operation on an intelligent education tablet based on the gestures and displays corresponding touch association.

The embodiment can further determine which emphasis labels specifically correspond to the gesture type by recognizing the gesture type of the received touch operation.

The step can determine which gesture type is specifically identified by the touch operation through analysis of the touch operation received by the intelligent teaching platform, and exemplarily, the step can determine whether the gesture generated by the user when the touch operation is generated is a tap or not by analyzing a time interval and a position difference of receiving the touch operation each time and monitoring a time interval and a position difference of a press-down event and a lift-up event forming the touch operation; in addition, in this step, it may also be determined whether a gesture generated by the touch operation by the user is a drawing line or a circle by analyzing the display shape of the touch trajectory of the received touch operation.

S102, determining an element set associated with the touch identifier in the current display page.

In this embodiment, after the touch identifier of the touch operation is determined, it may be determined that the teacher specifically labels what teaching contents in the current display page are based on the touch identifier, and this step may determine the teaching contents that are mainly labeled by the teacher by determining the touch identifier associated element set. The current display page is equivalent to a presentation play page currently presented to an audience in a presentation mode, generally, the display content in the current display page may specifically be an element of multiple different element types added in a course editing stage, for example, the element type may include an image, an editable graph, a table, audio/video, a text box, multimedia, and the like, and thus the present embodiment may consider that at least one element is included in the current display page. The set of elements is understood to be a set that contains the associated elements of the currently displayed page that are relevant to the touch identification.

Specifically, the determination of the set of elements associated with the touch identifier may be described as: after the touch identifier displayed by the received touch operation is determined, the pre-stored associated element determination rule corresponding to the touch identifier association can be called, and then the element set associated with the touch identifier is determined according to different associated element determination rules corresponding to different touch identifiers.

For example, the cores in the different association element determination rules can be summarized as follows: determining a hit area based on the corresponding touch identification, then traversing each element in the current display page to present a dependent associated rectangle, and then if the traversed associated rectangle is overlapped with the hit area, adding the element corresponding to the associated rectangle as an associated element into the element set. To achieve seamless addition of associated elements, the present embodiment may use the associated rectangles with overlap as new hit regions, and then iteratively perform addition of associated elements until no more new elements can be added to the element set.

And S103, determining the elements in the element set as key information and storing the key information.

After the element set associated with the touch identifier is determined based on the steps, the key teaching content marked by a teacher through touch operation is equivalently determined, the elements in the element set are determined as key information, the determined elements are actually equivalent to the key teaching content marked by key explanation and key teaching in the teaching process of the teacher, and after the key information is determined, the key information can be stored in a serialized mode, so that the stored key information can be directly called and displayed when the key teaching content is reviewed subsequently.

It should be noted that, in this embodiment, the relevance of each element in the element set when displayed on the current display page may also be considered, so that when the key information is stored, the relevance of the elements when displayed is also stored at the same time, and thus, when the stored key information is called, each element as the key information may be displayed in the original display state. The advantage of displaying the original state of the key information in this embodiment is also shown in that the user can easily summarize and edit all the key information.

And S104, responding to the received editing operation acted on the target key information, and displaying an editing page containing the target key information.

In this embodiment, after the stored element set is acquired, the user may edit the key information summarized by the stored element set, in this step, after receiving an editing operation triggered by the user on any element serving as the key information in the element set, an editing page of the triggered element may be displayed on a display screen of the intelligent interactive tablet, and it may be understood that in this step, any element triggered and edited by the user from the element set is used as the target key information.

And S105, saving the editing page when receiving the editing completion instruction.

In this embodiment, after the edit page of the target key information is displayed, the user may edit the target key information in the displayed edit page, and may trigger generation of an edit instruction after the edit is completed.

In the method for determining key information provided by the embodiment of the invention, firstly, in response to a received touch operation acting on a current display page, a touch identifier corresponding to the touch operation is displayed; then determining an element set associated with the touch identifier in a current display page; determining elements in the element set as key information and storing the key information, and finally, responding to the received editing operation acting on target key information, and displaying an editing page containing the target key information, wherein the target key information is any element in the element set as key information; and when an editing completion instruction is received, saving the editing page. According to the technical scheme, the key information of the key explanation in the teaching content can be quickly identified and stored according to the touch operation adopted by the teacher when the teacher performs the key explanation in the teaching process, so that the key information stored in the teaching process can be ensured to be displayed in a concentrated mode, the complex operation of the teacher when the teacher performs the key explanation content exhibition is avoided, the key explanation content is ensured to be reviewed without loss, in addition, the technical scheme can also perform editing operation on the determined key information when needed, namely, the key explanation content is effectively summarized, the repeated editing and sorting of the key explanation content are realized, and the user experience of intelligent teaching is better improved.

In this embodiment, element screening operations of the determined element set are further optimized and added on the basis of the foregoing, and optionally, before determining elements in the element set as key information and storing, the method further includes: and screening the elements in the element set according to a preset element tag, and deleting the element tag as an element for temporarily generating the content.

It should be noted that, for the elements displayed in the current display page, some of the elements may be lesson preparation contents formed by the teacher before giving lessons based on the courseware editing mode, and some of the elements may also be contents on the temporary blackboard writing of the teacher during giving lessons, in this embodiment, it is preferable to consider that the key lecture contents in the teaching process are formed in the lesson preparation stage, and if the determined element set includes the content of the temporary blackboard writing, interference may be brought to the display of the key lecture contents, therefore, in this embodiment, after the element set is determined, in order to avoid the interference of the content of the temporary blackboard writing to the key lecture contents, the elements in the determined element set are screened again.

Specifically, for the teaching content formed in the course editing stage, when the teaching content is opened in the demonstration playing mode, this embodiment adds an element tag to the opened element to identify the element as the teaching content edited in advance, and may also add an element tag to a temporary element of a board book of a teacher during teaching to identify the element as the board book content generated temporarily. Based on the above operation, it can be ensured that the determined key information is only the elements edited in the lesson preparation stage.

Example two

Fig. 2a is a flowchart of a method for determining key information according to a second embodiment of the present invention, where the second embodiment of the present invention is optimized based on the above-mentioned embodiment, and in this embodiment, the operation performed in response to the received touch applied to the current display page is further specifically optimized as follows: and determining the gesture type associated with the received touch operation acted on the current display page, and displaying the touch identification corresponding to the gesture type.

For the optimization, in the course of teaching, the teacher may touch the current display page of the intelligent interactive tablet when needing to perform key content explanation.

Meanwhile, the embodiment can further determine which touch identifiers correspond to the gesture type by recognizing the gesture type associated with the received touch operation, and can determine which key labels in the content explained by the instructor are specifically identified by each touch identifier.

Specifically, the embodiment may determine which gesture type is specifically associated with the touch operation through analysis of the touch operation received by the intelligent teaching platform, and exemplarily, the embodiment may determine whether the gesture generated by the user when the touch operation is generated is a tap or the like by analyzing a time interval and a position difference of each touch operation received and monitoring a time interval and a position difference of a press-down event and a lift-up event forming the touch operation; in addition, in this step, it may also be determined whether a gesture generated by the touch operation by the user is a drawing line or a circle by analyzing the display shape of the touch trajectory of the received touch operation.

In addition, on the basis of the optimization, the embodiment further performs specific optimization on the gesture type associated with the touch operation which is determined to be applied to the current display page and displays the touch identifier corresponding to the gesture type, and the specific optimization can be performed from a plurality of angles such as the gesture type of tapping, circle drawing, line drawing and the like.

As shown in fig. 2a, a method for determining key information provided in the second embodiment of the present invention specifically includes the following operations:

it should be noted that the second embodiment specifically provides a key information determination process when the teacher marks the key explanation content by using a tapping gesture in the course of teaching. First, S201 to S203 of the present embodiment specifically describe how to determine that the gesture type associated with the received touch operation is a tap.

S201, when an event combination comprising a one-touch pressing event and a one-touch lifting event is monitored, determining that one-touch operation is received.

In this embodiment, the smart teaching tablet may be considered to have a monitoring function of each touch event in the touch operation, so that the touch event of the user on the smart teaching tablet may be monitored specifically.

S202, if at least three touch operations are received within a set time period, touch information of each touch operation is acquired.

When the touch operation is received based on S201, the receiving time of each touch operation may be monitored to determine whether at least three touch operations are received within a set time period, where a specific value of the set time period may be actually set based on an actual application, and the receiving time of one touch operation may be recorded according to the generation time of the touch down event or according to the generation time of the touch up event.

In order to distinguish whether the touch operation identifier acted on the intelligent teaching tablet by the user is a click, a double click or a tapping, the embodiment sets that the basic judgment of tapping is satisfied only when at least three touch operations are received in a set time period, therefore, when at least three touch operations are received in the set time period, the subsequent judgment of whether the touch operation identifier is the tapping is carried out, and otherwise, the gesture type associated with the touch operation is directly determined not to be the tapping.

In this embodiment, the touch information may specifically refer to attribute information indicating a time and a position of a touch operation (e.g., a time of generating each touch event in an event combination, and an action position of each touch event on the intelligent teaching tablet, etc.), and the touch information may be generated when the event combination is applied on the intelligent teaching tablet, and in this step, the touch information for the touch operation may be directly obtained.

S203, if the touch information of each touch operation meets the first judgment condition and the two adjacent touch operations meet the second judgment condition, determining that the gesture type associated with the at least three touch operations is a tap.

In this embodiment, it may be considered that the gesture type associated with at least three touch operations acting on the intelligent teaching whiteboard is determined to be a tap only after the touch information of each touch operation received within a set time period meets the first determination condition and the second determination condition is met between two adjacent touch operations; otherwise, the gesture type may be considered not to be a tap, and the subsequent operation of the embodiment may be terminated.

Further, the touch information of the touch operation includes: a first generation time and a first generation position of a touch down event and a second generation time and a second generation position of a touch up event;

the first determination condition is: the difference between the second generation time and the corresponding first generation time is less than a first time threshold and the position difference between the second generation position and the first generation position is less than a first distance threshold;

the second determination condition is: the time difference between the next touch operation and the previous touch operation is smaller than a second time threshold and the distance difference between the next touch operation and the previous touch operation is smaller than a second distance threshold.

It is understood that the position difference may specifically be: generating a maximum value of the horizontal coordinate difference value or the vertical coordinate difference value in the position; the time difference may specifically refer to: the first generation time difference or the second generation time difference of the two touch operations, or the difference value of the first generation time of the latter touch operation and the second generation time of the former touch operation; the distance difference may specifically refer to: the difference value of the first generation position of the latter touch operation and the first generation position of the former touch operation.

In addition, in order to make the determination process of the key information more fit with the natural gesture operation of the learner, before the implementation of this embodiment, a technician first samples touch operation data in the actual teaching of the learner, so as to perform test training on the first time threshold, the first distance threshold, the second time threshold, and the second distance threshold, thereby obtaining a value range more suitable for the actual operation, for example, both the first time threshold and the second time threshold may be preferred to be valued in the range of 0.5s to 1s, the first distance threshold may be preferred to be valued in the range of 2cm to 5cm or 16 pixels to 30 pixels, and the second distance threshold may be preferred to be valued in the range of 5cm to 8 cm.

And S204, when the gesture type is determined to be knocking, displaying the touch points corresponding to the touch operations as touch identifiers.

In this embodiment, when the gesture type is a tap, it may be considered that touch points corresponding to the touch operation are discrete, each touch point may be displayed in a touch area with a set size on the display screen, and each touch point displayed on the display screen is used as a corresponding touch identifier during the tap operation.

It should be noted that, in the following operations of S205 to S211 of this embodiment, a specific implementation process of determining the key information when the gesture type is a tap is described.

And S205, forming a circular area as a hit area based on the action points respectively acted on the current display page by at least three touch operations.

Specifically, a generation position corresponding to a touch down event or a touch up event in the touch operation may be used as an action point of the touch operation in the currently displayed page. For example, since the generation position of the touch-down event in the touch operation can best represent the initial intended position of the user operation, the present embodiment preferably takes the generation position of the touch-down event in each touch operation as the action point in the currently displayed page.

After determining the action points of each touch operation, a circumscribed circle including each action point may be formed, in this embodiment, a circular region corresponding to the circumscribed circle is determined as a hit region, and the size of the hit region may be determined by the size of the radius of the circumscribed circle.

S206, acquiring the associated rectangle of each element in the current display page.

Specifically, for each element in the current display page, a rectangle is correspondingly present in the editing stage as an editing frame, it can be considered that one rectangle is supported on the bottom layer of each element edited in the current display page, and one element corresponds to one rectangle, and rectangle information of the rectangle is already generated when the element is edited.

It should be noted that the associated rectangle may be a circumscribed rectangle of the corresponding element, or may be a set rectangle having a length and a width greater than that of the circumscribed rectangle, and the set rectangle may be regarded as a rectangle in which a certain margin value is added to the length and the width of the rectangle on the basis of the corresponding circumscribed rectangle.

S207, searching for overlapped associated rectangles overlapped with the hit area from the associated rectangles.

In this embodiment, whether there is an associated rectangle overlapping with the hit area may be determined by the rectangle information of each associated rectangle, and the associated rectangle satisfying the overlapping condition may be denoted as an overlapping associated rectangle, where the overlapping in this embodiment may include the following cases: the area corresponding to the association rectangle contains a hit area, or the area corresponding to the association rectangle is contained in the hit area, or the area corresponding to the association rectangle intersects with a partial area of the hit area.

And S208, adding the elements corresponding to the overlapped relevant rectangles into the element set by setting adding conditions.

In this embodiment, after determining each overlapping associated rectangle, it is equivalent to that the element corresponding to the overlapping associated rectangle is hit by the hit area, and this step may further determine whether the element meets a set adding condition, and if so, add the element to the element set, where the set adding condition may be: the element has not been added to the set of elements.

S209, determining whether the total number of elements in the element set is changed, if so, executing S210; if not, S211 is executed.

In this embodiment, it may be considered that the element set is initially empty, and after the determined element is added to the element set, the total number of elements included in the element set may be changed, at this time, S210 may be continuously performed, but as the element hit operation is continuously performed, there may be no element meeting the addition condition, and thereafter, the total number of elements in the element set will remain unchanged, at this time, S211 may be further performed.

S210, taking each overlapped relevant rectangle as a hit area, and returning to execute S207.

In this embodiment, when it is determined that the total number of elements changes, specifically, each determined overlapping associated rectangle may be used as a hit area, and the step returns to S206 to continue to iteratively perform the search operation of element hit.

And S211, determining the elements in the element set as key information and storing the key information.

In this embodiment, when it is determined that the total number of elements in the element set is no longer changed, which indicates that all the elements that may hit have been searched and determined, each element added to the element set may be used as key information, and stored with the original relevance of each element. It is understood that before being stored, elements can be filtered to screen out the teaching content temporarily added by the teacher during the course of teaching.

S212, in response to the received editing operation acting on the target key information, displaying an editing page containing the target key information.

For example, the formed key information may be edited, specifically, after receiving a trigger of a user to perform an editing operation on any element in the element set as the target key information, the editing operation may be responded to and an editing page associated with the target key information is formed, and the user may edit the target key information in the editing page.

And S213, saving the editing page when receiving the editing completion instruction.

It can be understood that, after the user finishes editing the target key information in the editing page, an editing finish instruction can be triggered to be generated, and the edited editing page can be saved based on the editing finish instruction in this step.

On the basis of the foregoing embodiment, fig. 2b shows an exemplary diagram of determining gesture associated elements in the second embodiment of the present invention, as shown in fig. 2b, a currently displayed page 20 includes text type elements, graphic type elements, and the like, based on the determination step of the associated elements corresponding to the tap gesture type, a circular area 21 may be used as an initial hit area, and associated rectangles of each element displayed in the currently displayed page 20 may be obtained at the same time, such as a first associated rectangle 22 corresponding to a text box (element) with "that is a text" as a display content, a second associated rectangle 23 corresponding to a line segment, a third associated rectangle 24 corresponding to a curve, and the like (associated rectangles of all elements are not shown in the figure).

The operation of making the association element determination from the circular region 21 as the initial hit region can be described as: finding out associated rectangles overlapping with the circular area 21 from the obtained associated rectangles of each element, wherein the associated rectangles comprise a first associated rectangle 22 and a second associated rectangle 23; therefore, the elements (text box and content contained in the text box) corresponding to the first association rectangle 22 and the elements (line segments) corresponding to the second association rectangle 23 can be added (at this time, the element set is empty, that is, the determined elements do not exist yet) to the element set, at this time, the total number of the elements is 2, the change is made, and the search can be continuously performed; therefore, the first associated rectangle 22 and the second associated rectangle 23 can be respectively used as new hit areas, the associated rectangle overlapped with the first associated rectangle 22 can be found to be the third associated rectangle 24, the associated rectangle overlapped with the second associated rectangle 23 can also be found to be the third associated rectangle 24, and it can be determined that the element corresponding to the third associated rectangle 24 is a curve, and the curve is not added in the element set, so that the curve can be added into the element set, at this time, the total number of elements is 3, the change occurs, and the search can be continuously performed; therefore, the third associated rectangle 24 can be used as a new hit area, the associated rectangles overlapping with the third associated rectangle 24 can be found to have the first associated rectangle 22 and the second associated rectangle 23, and because both the text box corresponding to the first associated rectangle 22 and the line segment corresponding to the second associated rectangle 23 already exist in the element set, the addition will not be repeated, at this time, the total number of elements is still 3, and is not changed, the search end condition is satisfied, and the search can be ended. Based on the above search, it is finally determined that the determined key information is the text box and the content, line segment and curve contained in the text box when the teacher taps the circular area 21.

The method for determining key information provided by the embodiment of the invention provides specific operation for determining key information when the gesture type associated with the touch operation is a tapping, firstly determines the judgment process of the tapping gesture, then provides the determination process of the tapping gesture for element set, and finally determines the key information. Based on the method, when the teacher adopts the tapped gesture to perform key explanation, the key explanation content serving as key information in the teaching content can be accurately and quickly identified and stored, so that the key explanation content can be intensively displayed only by calling the stored key information in the subsequent teaching, the complex operation of the teacher during the display of the key explanation content is avoided, the key explanation content is ensured to be uninterruptedly reviewed, and the user experience of intelligent teaching is better improved.

EXAMPLE III

Fig. 3a is a flowchart of a method for determining key information according to a second embodiment of the present invention, which is optimized based on the first and second embodiments of the present invention, as shown in fig. 3a, the method for determining key information according to a third embodiment of the present invention specifically includes the following operations:

it should be noted that the third embodiment specifically provides a key information determination process when the teacher marks the key explanation content by using a circling gesture in the course of teaching. First, S301 to S303 of this embodiment specifically describe how to determine that the gesture type associated with the received touch operation is a circling implementation process.

S301, sampling all touch points corresponding to the touch operation on the current display page, and acquiring a touch track formed on the basis of all the touch points.

In this embodiment, for an intelligent teaching tablet with a touch event monitoring function, the touch operation applied to a current display page may be monitored, where the current display page may be considered to be displayed through the intelligent teaching tablet, the touch operation may be composed of a touch down event, a touch up event, and a series of touch move events between the two touch events, and meanwhile, the touch event may be monitored to determine a touch point corresponding to each touch event in the current display page, and finally, a touch trajectory corresponding to the touch operation may be formed based on the series of touch points, and the formed touch trajectory may be obtained in this step.

In this embodiment, touch points corresponding to the touch events on the currently displayed page may be sequentially sampled according to the generation time of the touch events in the touch operation, so as to obtain coordinate information of the touch points. It can be understood that, in a group of touch events forming a touch operation, a first touch event corresponds to a touch down event, a corresponding touch point thereof can be referred to as a touch start point, a last touch event corresponds to a touch up event, a corresponding touch point thereof can be referred to as a touch end point, and the remaining touch events in the touch down event and the touch up event correspond to touch move events, and corresponding touch points thereof can be referred to as touch move points. In the case of one touch operation, a touch-down event and a touch-up event must exist in the event combination, but a touch-shift event may not exist, which corresponds to a touch operation for one position point.

S302, according to each touch point, whether the touch track comprises a circle-shaped track and whether the number of contained circles meets set conditions is determined.

In this embodiment, the position coordinates of each touch point in the currently displayed page, which are required to form the touch trajectory, may be obtained, and according to the position coordinates of each touch point, whether a circle trajectory appears in the touch trajectory may be determined by a set circle determination rule, and the number of turns of the presented circle trajectory may be determined. For example, the step may determine a distance value between each touch point and the designated coordinate point according to the position coordinates of the touch points, and then compare each distance value with a set distance threshold, if there is a circular track, it is necessary that the distance value of consecutive touch points is smaller than the set distance threshold, and the distance value of a subsequent touch point is larger than the set distance threshold.

It should be noted that, in order to determine the circular trajectory, the characteristics of the circular trajectory may be analyzed first, and it is found that the main characteristic is that a connection line of a group of touch points may form an arc-shaped closed or nearly closed curve, if a circle is drawn with one of the touch points as a center and a set value as a radius, there may exist some touch points whose distance value from the center is smaller than or equal to the radius, the touch points are located inside the drawn circle, and then there exist some touch points whose distance value from the center is larger than the radius, the touch points are located outside the drawn circle, and then there may exist some touch points located inside the drawn circle.

Based on the above features, the following implementation operations of the circle shape determination are set in this embodiment, specifically, fig. 3b is a flowchart illustrating an implementation process of the circle shape determination of the touch trajectory in the third embodiment of the present invention, and optionally, the determining whether the touch trajectory includes the circle shape trajectory and whether the number of circles included in the touch trajectory satisfies the setting condition according to each touch point may be implemented in a manner as shown in fig. 3b, and as shown in fig. 3b, the manner specifically includes:

s3021, a distance value from each touch point to the set reference point is determined as a judgment distance value for each touch point.

First, based on this step, the distance value from each touch point to a set reference point, which corresponds to the center of the circle drawn according to the above description, is determined, which may preferably be selected from the touch points and is generally preferred as the touch starting point. Therefore, this step is equivalent to determining the distance value from each touch point to the touch start point as the determination distance value of each touch point.

And S3022, sequentially selecting the judgment distance values of the touch points and comparing the judgment distance values with a third distance threshold value.

The step is equivalent to starting from the judgment distance value of the touch starting point, then sequentially selecting the judgment distance values of subsequent touch points clockwise, comparing each selected judgment distance value with a third distance threshold value, and recording the comparison result in real time, wherein according to the description of the drawn circle, the third distance threshold value is actually equivalent to the radius of the drawn circle, the setting of the third distance threshold value is also equivalent to an empirical value, and the value with the optimal judgment effect can be determined as the third distance threshold value through test comparison of different values in advance.

S3023, when the determination distance value for the set continuous amount of touch points is greater than the third distance threshold, determining whether the determination distance value for the subsequent one target touch point is less than or equal to the third distance threshold.

In this step, according to the recorded comparison result, it may be determined whether the determined distance value of the set continuous amount of touch points is greater than the third distance threshold, where the determination at this time is actually equivalent to determining whether the set continuous amount of touch points is outside the circle drawn, and the set continuous amount is also an empirical value and is selected according to the test training. If the above determination is established, it may be further determined whether or not a determination distance value for subsequently existing one of the target touch points is smaller than or equal to the third distance threshold, which is actually equivalent to whether or not there is subsequently existing one of the touch points lying inside the circle drawn after there is a touch point lying outside the circle drawn by a continuously set amount, and if the determination is established, S3024 described below may be executed.

It should be noted that if one of the two determinations in this step is not satisfied, the touch trajectory may be considered as not including the circle trajectory.

And S3024, if the touch trajectory exists, determining that the touch trajectory contains a circle-shaped trajectory, adding 1 to the number of turns containing the circle-shaped trajectory, and returning to execute S3023 until the touch point corresponding to the currently selected judgment distance value is the touch termination point.

This step is equivalent to that the determination condition in S3023 is satisfied, at this time, it may be determined that the touch trajectory formed by the touch operation includes a circle trajectory, and 1 may be added to the number of turns including the circle trajectory, and it may be subsequently determined whether the touch point corresponding to the selected determination distance value when the determination is achieved is the touch termination point, and if not, the circle determination operation in S3023 may be executed again to determine whether the touch point after the target touch point can further form a circle trajectory; if the touch point is the touch termination point, the following steps can be executed.

And S3025, if the determined number of turns is greater than or equal to the set value, determining that the number of turns meets the set condition.

Based on the operation of S3024, in addition to determining that the touch trajectory includes a circle trajectory, a specific number of turns included may also be determined, and when the determined specific number of turns is greater than or equal to a set value, the number of turns may be considered to satisfy a set condition, where the set value may preferably be 2, that is, the number of turns corresponding to the circle trajectory included in the touch trajectory needs to be greater than or equal to two turns, but the set value is also applicable when 1 is taken, that is, when the touch trajectory may also be considered to include a circle trajectory, the gesture type associated with the touch operation may also be considered to be a circle.

Fig. 3c shows an exemplary diagram of the gesture type associated with the touch operation being circled, as shown in fig. 3c, the touch trajectory 31 of the received touch operation is displayed in the currently displayed page 30, and through the determination of the determination process provided in fig. 3b, it can be determined that the touch trajectory 31 includes a circled trajectory, and the number of turns of the circled trajectory is 1 turn (2 nd turn is not completely formed), so that it can be determined that the gesture type associated with the touch operation forming the touch trajectory 31 is circled.

And S303, when the touch track comprises a circle-shaped track and the number of circles meets a set condition, determining that the gesture type associated with the touch operation is circling.

The step S302 and the step S of expanding implement the determination of whether the touch trajectory includes a circle trajectory and whether the number of circles meets the set condition, and in this step, when the two conditions are met at the same time, the gesture type associated with the received touch operation may be considered as a circle; otherwise, the gesture type is not considered to be circling, and the subsequent operation of the implementation can be terminated.

And S304, when the gesture type is determined to be circling, displaying the touch track corresponding to the touch operation as a touch identifier.

In this embodiment, when the gesture type associated with the touch operation is circling, it may be determined that the touch trajectory formed by the touch operation is displayed in a circle shape, and thus the touch trajectory may be displayed as a touch identifier of the touch operation.

It should be noted that, in the following operations of S305 to S311 in this embodiment, a specific implementation process of determining the key information when the gesture type is circling is described.

And S305, forming a closed polygonal graph based on the touch points of the touch track.

Specifically, the touch points forming the touch trajectory may be sequentially connected, and finally the touch start point and the touch end point may be connected to form a closed changeable graph; in addition, in the present embodiment, when the circle trajectory is determined as described above, the sub-polygon patterns may be formed by sequentially connecting the touch points to each other to form one sub-polygon pattern, which is equal to the number of circles of the circle trajectory. The polygon formed in this step can be used for subsequent element hit operations.

S306, acquiring the associated rectangle of each element in the current display page.

Specifically, the associated rectangle in this embodiment is also equivalent to a rectangle that is correspondingly present when the element is edited and is relied on as the bottom layer of the element. The rectangle information of the corresponding rectangle is also generated at the same time when each element in the current display page is edited and formed, so that the relevant rectangle information of the relevant rectangle can be directly obtained in this step.

S307, one edge is selected from the unselected edge set of the polygonal graph to serve as a hit edge.

Different from the second embodiment of performing the hit test operation, in this embodiment, specifically, the edges of the polygon are used as hit edges in this step, and the unselected edge set is used to limit each edge to be selected as a hit edge as soon as possible.

S308, searching a target associated rectangle which meets the inclusion relation with the hit edge from the associated rectangles.

In this embodiment, it may be determined whether there is an associated rectangle having an inclusion relationship with the currently selected hit side through the rectangle information of each associated rectangle, and the associated rectangle satisfying the inclusion relationship may be denoted as a target associated rectangle, where the inclusion relationship in this embodiment includes the following several cases: the area corresponding to the associated rectangle contains the hit side, or the hit side intersects with the associated rectangle, etc.

S309, adding the elements corresponding to the target associated rectangles to the element set according to set conditions.

In this embodiment, after determining each target associated rectangle, the step may further determine whether the element matches a set addition condition, and if yes, add the element to the element set, where the set addition condition may also be: the element has not been added to the set of elements.

S310, judging whether the hit termination condition is met, if yes, executing S311, and if not, executing returning to S307.

In this embodiment, the termination condition may be that the unselected edge set is empty, or that the total number of elements in the element set remains unchanged. The unselected edge set is empty, which is equivalent to all edges of the polygonal graph being used as hit edges; the total number of elements in the element set remains unchanged, and it can be considered that when the initially empty element set has no change in the total number of elements after a plurality of iterations, S311 can be further performed in both cases; otherwise, the search condition of the hit element may be considered to be still satisfied, and the loop execution is continued by returning to S307.

S311, determining the elements in the element set as key information and storing the key information.

In this embodiment, when the hit termination condition is satisfied, it indicates that all the hit elements have been searched and determined, and at this time, each element added to the element set may be used as key information, and stored with the original relevance of each element. It is understood that before being stored, elements can be filtered to screen out the teaching content temporarily added by the teacher during the course of teaching.

S312, in response to the received editing operation acting on the target key information, displaying an editing page containing the target key information.

And S313, saving the editing page when receiving the editing completion instruction.

The specific implementation of S312 and S313 in this embodiment is specifically described in the second embodiment, and is not described here again.

The third embodiment of the invention provides a method for determining key information, which provides specific operation for determining the key information when the gesture type represented by the touch operation is circling, firstly determines the judging process of the circling gesture, then provides the process for determining the element set by the circling gesture, and finally determines the key information. Based on the method, when the teacher adopts the circled gesture to perform key explanation on the content, the key explanation content serving as key information in the teaching content can be accurately and quickly identified and stored, so that the key explanation content can be intensively displayed only by calling the stored key information in the subsequent teaching, the complex operation of the teacher during the process of displaying the key explanation content is avoided, the key explanation content is ensured to be reviewed without omission, and the user experience of intelligent teaching is better improved.

Example four

Fig. 4a is a flowchart of a method for determining key information according to a fourth embodiment of the present invention. The embodiment of the present invention is optimized based on the first embodiment and the second embodiment, and as shown in fig. 4a, the method for determining key information provided by the fourth embodiment of the present invention specifically includes the following operations:

it should be noted that the fourth embodiment specifically provides a key information determination process when the teacher marks the key explanation content by using a line drawing gesture in the teaching process. First, S401 to S403 in this embodiment describe in detail how to determine that the gesture type associated with the received touch operation is a drawing line.

S401, sampling all touch points corresponding to the touch operation on the current display page, and acquiring a touch track formed on the basis of all the touch points.

For example, the step may monitor a touch operation that a user acts on the current display page, where the touch operation is also composed of a touch down event, a touch up event, and a series of touch move events between the two touch events, and the step may also determine a corresponding touch point of each touch event in the current display page through monitoring the series of touch events, and finally form a touch trajectory corresponding to the touch operation based on the series of touch points.

S402, obtaining a reference line segment formed by connecting lines of the starting point and the ending point in the touch track.

For example, in the touch event listening process of the touch operation, the action point of the touch down event may be determined as a start point in the formed touch trajectory, and the action point of the touch up event may be determined as an end point in the touch trajectory. In order to determine whether the currently formed touch trajectory is a linear trajectory, the present embodiment forms a line segment based on a connection line between the start point and the end point of the touch trajectory, and the line segment may be marked as a reference line segment. This step obtains the formed reference line segment.

And S403, determining whether the touch track is a linear track according to each touch point and the reference line segment.

In this embodiment, the position coordinates of each touch point required for forming the touch trajectory in the currently displayed page may be obtained, and the position coordinates of each touch point are combined with the obtained reference line segment, so as to determine whether the touch trajectory is presented as a linear trajectory according to a set linear determination rule. For example, the step may determine an included angle value between the acquired reference line segment and the horizontal direction to determine whether the reference line segment is a horizontal line segment or an approaching level, and at the same time, the step may determine a total variance value of the touch trajectory according to the position coordinates of the touch point and the coordinates of the start point and the end point of the reference line segment to determine the degree of coincidence between the touch trajectory and the reference line segment through determination of the total variance value.

Further, fig. 4b shows a flowchart of performing linear judgment on a touch trajectory in the fourth embodiment of the present invention, and optionally, determining whether the touch trajectory is a linear trajectory according to the touch points and the reference line segment constituting the touch trajectory may be implemented in a manner shown in fig. 4b, where as shown in fig. 4b, the manner specifically includes:

s4031, determining a horizontal included angle of the reference line segment.

For example, the value of the included angle between the reference line segment and the horizontal direction may be determined according to the coordinate values of the starting point and the ending point of the reference line segment, and recorded as the horizontal included angle.

S4032, determining the total variance value of the touch track according to the position information of the touch point on the touch track.

In this embodiment, the touch points corresponding to the touch events on the current display page may be sequentially sampled according to the generation time of the touch events in the touch operation, so as to obtain the position information of the touch points.

Further, the determining the total variance value of the touch trajectory according to the position information of the touch point on the touch trajectory specifically includes: sampling touch points on the touch track in a time sequence, determining the total sampling number and obtaining the horizontal and vertical coordinates of each touch point in the current display page; comparing the abscissa of each touch point with the abscissa of the starting point and the abscissa of the ending point of the reference line segment, and determining a variance variable value corresponding to each touch point based on the comparison result; formula for calculating based on total variance

Determining an overall variance value of the touch trajectory, wherein σ²Representing the total variance value of the touch trajectory, N representing the total number of samples, Y_iAnd the variance variable value corresponding to the ith touch point is represented, and mu represents the middle point ordinate of the reference line segment.

In this embodiment, the value of the variance variable is mainly determined by comparing the abscissa of the touch point with the abscissas of the starting point and the ending point of the reference line segment. Optionally, the determining a variance variable value corresponding to each touch point based on the comparison result includes:

if first touch points with the abscissa smaller than the abscissa of the starting point exist, determining the variance variable value corresponding to each first touch point as the ordinate of the starting point of the reference line segment; if a second touch point with the abscissa larger than the abscissa of the termination point exists, determining the variance variable value corresponding to each second touch point as the ordinate of the termination point of the reference line segment; and if third touch points with the abscissa larger than the abscissa of the starting point and smaller than the abscissa of the end point exist, determining the ordinate of each third touch point into a corresponding variance variable value.

It can be understood that, for the touch points of the formed touch trajectory, there are some touch points whose abscissa may be smaller than the origin abscissa, and at this time, the variance variable values corresponding to these touch points all correspond to the origin ordinate of the baseline segment; the abscissa of the touch points is possibly larger than the abscissa of the termination point, and at the moment, the variance variable values corresponding to the touch points are all equal to the ordinate of the termination point of the reference line segment; and for the touch point with the abscissa between the abscissa of the starting point and the abscissa of the ending point, the variance variable value is the ordinate of the touch point.

S4033, if the horizontal included angle is smaller than the set angle value and the total variance value is smaller than the set threshold value, determining that the touch track is a linear track.

It can be understood that the purpose of comparing the horizontal included angle with the set angle value in this step is to determine whether the reference line segment is horizontal or approximately horizontal, and the set angle value is generally close to 0; in this step, the comparison between the total variance value and the set threshold aims to determine whether the touch trajectory coincides with the reference line segment or approaches to coincide with the reference line segment.

In this embodiment, the selection of the set threshold is related to a sampling interval of the sampling touch point, the more dense the sampling is, the larger the required calculation amount is, and the larger the selection of the set threshold is, in this embodiment, a value for distinguishing a linear trajectory from other patterns may be obtained as the set threshold through repeated tests in advance, and in order to ensure accuracy of the value of the set threshold, a large amount of linear data may be selected for training, and an optimal value obtained through training may be used as the set threshold.

S404, when the touch track is a linear track, determining that the gesture type associated with the touch operation is a drawing line.

In the step S403 and the step S of expanding, it is specifically determined whether the touch trajectory is a linear trajectory, in this step, when the touch trajectory is determined to be a linear trajectory, the gesture type associated with the received touch operation may be considered as a drawn line, otherwise, the gesture type may not be considered as a drawn line, and at this time, the subsequent operation in this embodiment may be terminated.

And S405, when the gesture type is determined to be a drawn line, displaying the touch track corresponding to the touch operation as a touch mark.

In this embodiment, when the gesture type associated with the touch operation is a drawing line, it may be determined that a touch trajectory formed by the touch operation is displayed in a linear shape, and thus the touch trajectory may be displayed as a touch identifier of the touch operation.

It should be noted that, in the present embodiment, the following operations of S406 to S412 describe a specific implementation process of determining the key information when the gesture type is a drawing line. It can be seen that the implementation of the following steps in this embodiment is basically the same as the implementation of determining the key information when the gesture type is a tap in the second embodiment, and the difference is mainly that the determination of the initial hit area is performed.

S406, forming a rectangular area as a hit area based on the starting point and the end point of the reference line segment.

Specifically, in this step, the abscissa span of the starting point and the ending point of the reference line segment may be used as the width of the constructed rectangular region, and the ordinate span of the starting point and the ending point of the reference line segment may be used as the height of the constructed rectangular region. In addition, a circumscribed rectangle containing all touch points in the touch track can be formed in the step, and the circumscribed rectangle is used as a hit area.

It should be noted that, when a teacher explains important content in a teaching process, if a line drawing gesture is used to mark the important content, a repeated line drawing may be performed on the important content in the explanation process, so that if it is monitored that gesture types associated with touch operations received within a certain time period are drawn, touch trajectories formed within the time period can be simultaneously used as linear trajectories for determining key information, and subsequent key information determination operations are performed together.

For the case of having multiple linear tracks at the same time, the step may obtain the starting point and the ending point of the reference line segment corresponding to each linear track, then determine an external rectangle containing the starting points and the ending points of all the reference line segments, and determine the external rectangle as the hit area.

S407, acquiring the associated rectangle of each element in the current display page.

Illustratively, the associated rectangle in the present embodiment is also equivalent to a rectangle which is correspondingly existed when the element is edited and is used as the basis of the element bottom layer. The rectangle information of the corresponding rectangle is also generated at the same time when each element in the current display page is edited and formed, so that the relevant rectangle information of the relevant rectangle can be directly obtained in this step.

S408, searching for overlapped associated rectangles overlapped with the hit area from the associated rectangles.

For example, this step may also find an overlapping association rectangle overlapping with the hit area according to the rectangle information of each association rectangle, where the condition that the overlapping is satisfied also includes: the region corresponding to the association rectangle includes a hit region, or the region corresponding to the association rectangle is included in the hit region, or the region corresponding to the association rectangle intersects with a partial region of the hit region, or the like.

And S409, adding the elements corresponding to the overlapped relevant rectangles to the element set by setting adding conditions.

For example, this step may also determine whether an element corresponding to the overlapping association rectangle meets a set adding condition, and if so, add the element to the element set, where the set adding condition may also be: the element has not been added to the set of elements.

S410, determining whether the total number of elements in the element set is changed, if so, executing S411; if not, go to S412.

Similarly to the loop termination condition of the first embodiment, whether the total number of elements in the element set changes is considered, if so, it is considered that the loop condition is satisfied, and the following step S411 needs to be executed, and if not, it is considered that the loop termination condition is satisfied, and then S412 may be executed.

S411, each of the overlapping correlation rectangles is set as a hit area, and the process returns to the step S408.

For example, the determined overlapping association rectangles may be used as hit areas, and the process returns to S408 to continue to iteratively perform the search operation of element hit.

And S412, determining the elements in the element set as key information and storing the key information.

For example, in this step, the elements in the element set may be first screened, after the elements that do not meet the requirement are screened, the elements in the element set may be determined as the key information, and then the elements are stored and the original relevance of the elements is retained, so that when the key information is called, the original display relationship of the elements may be ensured.

And S413, responding to the received editing operation acted on the target key information, and displaying an editing page containing the target key information.

And S414, saving the editing page when receiving the editing completion instruction.

Fig. 4c shows an exemplary diagram of determining gesture associated elements in the fourth embodiment of the present invention, as shown in fig. 4c, a currently displayed page 40 includes elements of text types and graphic types, based on the step of determining associated elements corresponding to the case where the gesture type is a drawn line, a rectangular area 41 including each linear track may be determined first, and the rectangular area is used as an initial hit area, and associated rectangles of each element displayed in the currently displayed page 40 may be obtained at the same time, such as a first associated rectangle 42 corresponding to a text box (element) with "that is a text" as display content, a second associated rectangle 43 corresponding to a line segment, a third associated rectangle 44 corresponding to a curve, and the like (associated rectangles of all elements are not shown in the diagram).

The operation of making the association element determination from the rectangular area 41 as the initial hit area can be described as: the associated rectangles overlapped with the rectangular area 41 can be found to be a first associated rectangle 42 and a second associated rectangle 43 from the obtained associated rectangles of each element; therefore, the elements (text box and content contained in the text box) corresponding to the first association rectangle 42 and the elements (line segments) corresponding to the second association rectangle 43 can be added to the element set (at this time, the element set is empty, that is, the determined elements do not exist yet), at this time, the total number of the elements is 2, the change occurs, and the search can be continuously performed; therefore, the first associated rectangle 42 and the second associated rectangle 43 can be respectively used as new hit areas, the associated rectangle overlapped with the first associated rectangle 42 can be found to be the third associated rectangle 44, the associated rectangle overlapped with the second associated rectangle 43 can also be found to be the third associated rectangle 44, and it can be determined that the element corresponding to the third associated rectangle 44 is a curve, and the curve is not added in the element set, so that the curve can be added into the element set, at this time, the total number of elements is 3, the change occurs, and the search can be continuously performed; therefore, the third associated rectangle 44 can be used as a new hit area, the associated rectangles overlapping with the third associated rectangle 44 can be found to have the first associated rectangle 42 and the second associated rectangle 43, and because both the text box corresponding to the first associated rectangle 42 and the line segment corresponding to the second associated rectangle 43 already exist in the element set, the addition will not be repeated, at this time, the total number of elements is still 3, and is not changed, the search end condition is satisfied, and the search can be ended. Based on the search, it is finally determined that the determined key information is the text box and the content, line segment and curve contained in the text box when the teacher taps the rectangular area 41.

It can be understood that, after the determination of the associated element of the current display page provided in fig. 4c is completed, the determined associated element may be stored as key information, for example, the key information may be stored in the current display page as a basic unit to keep the original display relationship of the element in the current display page, fig. 4d shows an example of a storage folder for storing the key information, as shown in fig. 4d, in the storage folder 410, the key information in the current display page provided in fig. 4c is stored in the display form of the first storage page 420, and it can be found that, in the first storage page 420, the text box as the key information and the content, line segment, and curve included in the text box are presented in the original display relationship.

The stored key information can be directly edited by a teacher as a template, so that more flexibility is brought to the teacher when the teacher makes review course contents, and the error rate of information identification errors existing in the process of determining the key information is relieved to a certain extent by the aid of editable operation of the stored key information.

The method for determining key information provided by the fourth embodiment of the invention provides specific operation for determining key information when the gesture type associated with the touch operation is a drawn line, and firstly determines the judgment process of a tapping gesture, then provides the determination process of a drawn line gesture for carrying out element set, and finally determines the key information. Based on the method, when the teacher adopts the line-drawn gesture to perform key explanation, key explanation contents serving as key information in teaching contents can be accurately and quickly identified and stored, so that the key explanation contents can be intensively displayed only by calling the stored key information in the subsequent teaching, the complex operation of the teacher during the display of the key explanation contents is avoided, the key explanation contents can be ensured to be reviewed without omission, and the user experience of intelligent teaching is better improved.

EXAMPLE five

Fig. 5 is a schematic structural diagram of a key information determining apparatus according to a fifth embodiment of the present invention. As shown in fig. 5, the key information determination device includes: a first response module 51, an element set determination module 52, and a key information storage module 53, a second response module 54, and an edit storage module 55.

The first response module 51 is configured to, in response to a received touch operation acting on a current display page, display a touch identifier corresponding to the touch operation;

an element set determining module 52, configured to determine a set of elements associated with the gesture type in a currently displayed page, where the currently displayed page includes at least one element;

a key information storage module 53, configured to determine and store an element in the element set as key information;

a second response module 54, configured to display, in response to a received editing operation acting on target key information, an editing page including the target key information, where the target key information is an element in the element set, where any element is used as key information;

the editing storage module 55 is configured to store the editing page when receiving an editing completion instruction;

the elements include at least one of: text, graphical shapes, multimedia, and tables.

The technical scheme that this embodiment provided, can be according to the touch operation that the teacher adopted when giving lessons the in-process and carrying out key explanation, the key information of key explanation in the content of giving lessons of discernment fast and storage to guarantee that just can realize the concentrated presentation of key explanation content through the key information of calling the storage when follow-up giving lessons, loaded down with trivial details operation when not only having avoided the teacher to carry out the content of giving lessons and showing from this, still guaranteed the nothing of key explanation content and missed the review, better promotion intelligent teaching's user experience.

Further, the first response module 51 includes:

and the gesture type determining unit is used for determining the received gesture type associated with the touch operation acted on the current display page and displaying the touch identifier corresponding to the gesture type.

Further, the gesture type determination unit includes:

the operation monitoring subunit is used for determining that one touch operation is received when an event combination comprising a one-touch pressing event and a one-touch lifting event is monitored;

the information acquisition subunit is used for acquiring touch information of each touch operation if at least three touch operations are received within a set time period;

the first determining subunit is configured to determine that the gesture type associated with the at least three touch operations is a tap if the touch information of each touch operation satisfies a first determination condition and two adjacent touch operations satisfy a second determination condition;

and the identification display subunit is used for displaying the touch points corresponding to the touch operations as touch identifications when the gesture type is determined to be knocking.

On the basis of the optimization, the touch information of the touch operation comprises: a first generation time and a first generation position of a touch down event and a second generation time and a second generation position of a touch up event;

Further, the element set determining module 52 is specifically configured to:

forming a circular area as a hit area based on the touch points respectively acted on the current display page by the at least three touch operations; acquiring the association rectangle of each element in the current display page; searching for overlapped associated rectangles overlapped with the hit area from the associated rectangles; adding elements corresponding to the overlapped associated rectangles into an element set by setting adding conditions; and if the total number of elements of the element set is changed, taking each overlapping association rectangle as a hit area, and returning to execute the operations of overlapping search and element addition until the total number of elements is unchanged.

Optionally, the gesture type determining unit further includes:

the track acquisition subunit is used for sampling all touch points corresponding to the touch operation on the current display page and acquiring a touch track formed on the basis of each touch point;

the circle judging subunit is used for determining whether the touch track contains a circle track and whether the number of circles contained in the touch track meets a set condition according to each touch point;

the second determining subunit is used for determining that the gesture type associated with the touch operation is circling when the touch track comprises a circle-shaped track and the number of circles meets the set condition;

and the identifier display subunit is further configured to display, as the touch identifier, the touch trajectory corresponding to the touch operation when it is determined that the gesture type is circling.

On the basis of the above optimization, the circle shape determining subunit is specifically configured to:

determining a distance value from each touch point to a set reference point as a judgment distance value of each touch point; sequentially selecting the judgment distance value of each touch point and comparing the judgment distance value with a third distance threshold value; when the judgment distance value of the set continuous quantity of touch points is larger than a third distance threshold value, determining whether the judgment distance value of a target touch point exists subsequently or not, wherein the judgment distance value of the target touch point is smaller than or equal to the third distance threshold value; if the touch point corresponding to the currently selected judgment distance value is the touch termination point, determining that the touch track contains a circle-shaped track, adding 1 to the number of turns containing the circle-shaped track, and returning to execute the distance value judgment operation; and if the determined number of turns is greater than or equal to the set value, determining that the number of turns meets the set condition.

Optionally, the element set determining module 52 is specifically configured to:

forming a closed polygonal graph based on each touch point of the touch operation; acquiring the association rectangle of each element in the current display page; selecting one edge from the unselected edge set of the polygonal graph as a hit edge; searching a target associated rectangle which meets the inclusion relation with the hit edge from each associated rectangle; adding elements corresponding to each target associated rectangle into an element set according to a set condition, and returning to execute hit edge selection operation until a hit termination condition is met; wherein the termination condition is that the unselected edge set is empty, or the total number of elements in the element set remains unchanged.

Further, the gesture type determination unit includes:

the reference line segment determining subunit is used for obtaining a reference line segment formed on the basis of a connecting line of a starting point and an end point in the touch track;

the linear judging subunit is used for determining whether the touch track is a linear track according to each touch point and the reference line segment;

the third determining subunit is configured to determine, when the touch trajectory is a linear trajectory, that the gesture type associated with the touch operation is a drawn line;

and the mark display subunit is also used for displaying the touch track corresponding to the touch operation as the touch mark when the gesture type is determined to be a drawn line.

On the basis of the optimization, the linear judgment subunit includes:

the included angle determining subunit is used for determining the horizontal included angle of the reference line segment; the variance value determining subunit is configured to determine, according to the position information of the touch point on the touch trajectory, a total variance value of the touch trajectory; and the linear determining subunit is used for determining that the touch track is a linear track when the horizontal included angle is smaller than a set angle value and the total variance value is smaller than a set threshold value.

Further, the variance value determining subunit is specifically configured to:

sampling touch points on the touch track in a time sequence, determining the total sampling number and obtaining the horizontal and vertical coordinates of each touch point in the current display page; comparing the abscissa of each touch point with the abscissa of the starting point and the abscissa of the ending point of the reference line segment, and determining a variance variable value corresponding to each touch point based on the comparison result; formula for calculating based on total variance

Determining an overall variance value of the touch trajectory, wherein σ²Is the total variance value of the touch trajectory, N represents the total number of samples, Y_iAnd the variance variable value corresponding to the ith touch point is represented, and mu represents the middle point ordinate of the reference line segment.

On the basis of the optimization, the determining a variance variable value corresponding to the abscissa of each touch point based on the comparison result specifically includes: if first touch points with the abscissa smaller than the abscissa of the starting point exist, determining the variance variable value corresponding to each first touch point as the ordinate of the starting point of the reference line segment; if a second touch point with the abscissa larger than the abscissa of the termination point exists, determining the variance variable value corresponding to each second touch point as the ordinate of the termination point of the reference line segment; and if third touch points with the abscissa larger than the abscissa of the starting point and smaller than the abscissa of the end point exist, determining the ordinate of each third touch point into a corresponding variance variable value.

Further, the element set determining module 53 is specifically configured to: forming a rectangular area as a hit area based on the start point and the end point of the reference line segment; acquiring the association rectangle of each element in the current display page; searching for overlapped associated rectangles overlapped with the hit area from the associated rectangles; adding elements corresponding to the overlapped association rectangles to an element set; and if the total number of elements of the element set is changed, taking each overlapping association rectangle as a hit area, and returning to execute the operations of overlapping search and element addition until the total number of elements is unchanged.

Further, the apparatus further comprises:

and the element screening module is used for screening the elements in the element set according to preset element labels before determining the elements in the element set as the key information and storing the key information, and deleting the element labels as the elements for temporarily generating the content.

The key information determining apparatus provided in this embodiment may be configured to execute the key information determining method provided in any of the above embodiments, and has corresponding functions and advantages.

EXAMPLE six

Fig. 6 is a schematic structural diagram of a key information determining device according to a sixth embodiment of the present invention. The key information determination device includes: a processor 60, a memory 61, a display 62, an input device 63, and an output device 64. The number of processors 60 in the key information determination device may be one or more, and one processor 60 is taken as an example in fig. 6. The number of the memories 61 in the key information determination device may be one or more, and one memory 61 is taken as an example in fig. 6. The processor 60, the memory 61, the display 62, the input device 63 and the output device 64 of the key information determining apparatus may be connected by a bus or other means, as exemplified by the bus connection in fig. 6. In an embodiment, the key information determination device may be a computer, a mobile phone, a tablet, an intelligent teaching tablet, or the like.

The memory 61 is a computer-readable storage medium that can be used to store software programs, computer-executable programs, and modules, such as program instructions/modules corresponding to the key information determination device according to any embodiment of the present invention (for example, the first response module 51, the element set determination module 52, and the key information storage module 53, the second response module 54, and the edit storage module 55 in the key information determination device). The memory 61 may mainly include a program storage area and a data storage area, wherein the program storage area may store an operating system, an application program required for at least one function; the storage data area may store data created according to use of the device, and the like. Further, the memory 61 may include high speed random access memory, and may also include non-volatile memory, such as at least one magnetic disk storage device, flash memory device, or other non-volatile solid state storage device. In some examples, the memory 61 may further include memory located remotely from the processor 60, which may be connected to the device over a network. Examples of such networks include, but are not limited to, the internet, intranets, local area networks, mobile communication networks, and combinations thereof.

The display screen 62 may be a touch-enabled display screen 62, which may be a capacitive screen, an electromagnetic screen, or an infrared screen. In general, the display screen 62 is used for displaying data according to instructions from the processor 60, such as specific teaching contents of a currently displayed page, contents temporarily added during teaching by a teacher, and a touch trajectory formed by a touch operation of a gesture when the teacher gives a strong instruction, and is also used for receiving a touch operation applied to the display screen 62 and transmitting a corresponding signal to the processor 60 or other devices.

The input means 63 may be used for receiving input numeric or character information and generating key signal inputs related to user settings and function controls of the presentation apparatus, and may be a camera for acquiring images and a sound pickup apparatus for acquiring audio data. The output device 64 may include an audio device such as a speaker. It should be noted that the specific composition of the input device 63 and the output device 64 can be set according to actual conditions.

The processor 60 executes various functional applications of the device and data processing by executing software programs, instructions and modules stored in the memory 61, that is, implements the above-described key information determination method.

The key information determining apparatus provided above may be configured to execute the key information determining method provided in any of the above embodiments, and has corresponding functions and advantages.

EXAMPLE seven

An embodiment of the present invention further provides a storage medium containing computer-executable instructions, which when executed by a computer processor, are configured to perform a method for determining key information, including:

when an editing completion instruction is received, saving the editing page;

Of course, the storage medium provided by the embodiment of the present invention includes computer-executable instructions, and the computer-executable instructions are not limited to the operations of the key information determination method described above, and may also perform related operations in the key information determination method provided by any embodiment of the present invention, and have corresponding functions and advantages.

From the above description of the embodiments, it is obvious for those skilled in the art that the present invention can be implemented by software and necessary general hardware, and certainly, can also be implemented by hardware, but the former is a better embodiment in many cases. Based on such understanding, the technical solution of the present invention may be embodied in the form of a software product, which may be stored in a computer-readable storage medium, such as a floppy disk, a Read-Only Memory (ROM), a Random Access Memory (RAM), a FLASH Memory (FLASH), a hard disk or an optical disk of a computer, and includes several instructions to enable a computer device (which may be a robot, a personal computer, a server, or a network device) to execute the method for determining key information according to any embodiment of the present invention.

It should be noted that, in the above-mentioned key information determining apparatus, each unit and each module included in the apparatus are only divided according to functional logic, but are not limited to the above-mentioned division as long as the corresponding functions can be implemented; in addition, specific names of the functional units are only for convenience of distinguishing from each other, and are not used for limiting the protection scope of the present invention.

It should be understood that portions of the present invention may be implemented in hardware, software, firmware, or a combination thereof. In the above embodiments, the various steps or methods may be implemented in software or firmware stored in memory and executed by a suitable instruction execution system. For example, if implemented in hardware, as in another embodiment, any one or combination of the following techniques, which are known in the art, may be used: a discrete logic circuit having a logic gate circuit for implementing a logic function on a data signal, an application specific integrated circuit having an appropriate combinational logic gate circuit, a Programmable Gate Array (PGA), a Field Programmable Gate Array (FPGA), or the like.

In the description herein, references to the description of the term "one embodiment," "some embodiments," "an example," "a specific example," or "some examples," etc., mean that a particular feature, structure, material, or characteristic described in connection with the embodiment or example is included in at least one embodiment or example of the invention. In this specification, the schematic representations of the terms used above do not necessarily refer to the same embodiment or example. Furthermore, the particular features, structures, materials, or characteristics described may be combined in any suitable manner in any one or more embodiments or examples.

It is to be noted that the foregoing is only illustrative of the preferred embodiments of the present invention and the technical principles employed. It will be understood by those skilled in the art that the present invention is not limited to the particular embodiments described herein, but is capable of various obvious changes, rearrangements and substitutions as will now become apparent to those skilled in the art without departing from the scope of the invention. Therefore, although the present invention has been described in greater detail by the above embodiments, the present invention is not limited to the above embodiments, and may include other equivalent embodiments without departing from the spirit of the present invention, and the scope of the present invention is determined by the scope of the appended claims.

Claims

1. A method for determining key information, comprising:

responding to the received touch operation acted on the current display page, and displaying a touch identifier corresponding to the touch operation, wherein the touch operation is generated at the following moment: the teacher explains the key contents on the current display page and adopts the selected gesture to touch the area where the key contents are located; the touch identifier is used for identifying an area where important content is located;

when an editing completion instruction is received, saving the editing page;

wherein the element comprises at least one of: text, graphical shapes, multimedia, and tables;

the determining that the touch identifier is associated with a set of elements in a currently displayed page comprises:

determining a hit area through the touch identifier;

traversing the associated rectangle on which each element in the current display page is dependent;

if the traversed associated rectangles are overlapped with the hit areas, elements corresponding to the overlapped associated rectangles are used as associated elements to be added into the element set;

and taking the association rectangles with the overlaps as new hit areas, and returning to execute the association element adding operation until no new association elements are added to the element set.

2. The method according to claim 1, wherein the displaying, in response to the received touch operation acting on the currently displayed page, a touch identifier corresponding to the touch operation comprises:

and determining the gesture type associated with the received touch operation acted on the current display page, and displaying the touch identification corresponding to the gesture type.

3. The method of claim 2, wherein the determining a gesture type associated with the received touch operation acting on the currently displayed page, and displaying a touch identifier corresponding to the gesture type comprises:

when an event combination comprising a one-touch pressing event and a one-touch lifting event is monitored, determining that one-touch operation is received;

if at least three touch operations are received within a set time period, acquiring touch information of each touch operation;

if the touch information meets a first judgment condition and the two adjacent touch operations meet a second judgment condition, determining that the gesture type associated with the at least three touch operations is knocking;

and when the gesture type is determined to be knocking, displaying the touch points corresponding to the touch operations as touch identifiers.

4. The method of claim 3, wherein the touch information of the touch operation comprises: a first generation time and a first generation position of a touch down event and a second generation time and a second generation position of a touch up event;

5. The method of claim 3, wherein the determining a hit area is performed by the touch identifier; traversing the associated rectangle on which each element in the current display page is dependent; if the traversed associated rectangles are overlapped with the hit areas, elements corresponding to the overlapped associated rectangles are used as associated elements to be added into the element set; taking the association rectangles with the overlap as new hit areas, and returning to execute association element adding operation until no new association elements are added to the element set, wherein the method comprises the following steps:

forming a circular area as a hit area based on the touch points respectively acted on the current display page by the at least three touch operations;

acquiring the association rectangle of each element in the current display page;

searching for overlapped associated rectangles overlapped with the hit area from the associated rectangles;

adding elements corresponding to the overlapped associated rectangles into an element set by setting adding conditions;

and if the total number of elements of the element set is changed, taking each overlapping association rectangle as a hit area, and returning to execute the operations of overlapping search and element addition until the total number of elements is unchanged.

6. The method according to claim 2, wherein the determining a gesture type associated with the received touch operation acting on the current display page, and displaying a touch identifier corresponding to the gesture type comprises:

sampling all touch points corresponding to the touch operation on a current display page, and acquiring a touch track formed on the basis of each touch point;

determining whether the touch track comprises a circle-shaped track and whether the number of contained circles meets a set condition or not according to each touch point;

if so, determining that the gesture type associated with the touch operation is a circle drawing;

and when the gesture type is determined to be circling, displaying the touch track corresponding to the touch operation as a touch identifier.

7. The method according to claim 6, wherein the determining whether the touch trajectory includes a circle trajectory and whether the number of contained circles satisfies a set condition according to each touch point comprises:

determining a distance value from each touch point to a set reference point as a judgment distance value of each touch point;

sequentially selecting the judgment distance value of each touch point and comparing the judgment distance value with a third distance threshold value;

when the judgment distance value of the set continuous quantity of touch points is larger than a third distance threshold value, determining whether the judgment distance value of a target touch point exists subsequently or not, wherein the judgment distance value of the target touch point is smaller than or equal to the third distance threshold value;

if the touch point corresponding to the currently selected judgment distance value is the touch termination point, determining that the touch track contains a circle-shaped track, adding 1 to the number of turns containing the circle-shaped track, and returning to execute the distance value judgment operation;

and if the determined number of turns is greater than or equal to the set value, determining that the number of turns meets the set condition.

8. The method of claim 6, wherein the determining a hit area is performed by the touch identifier; traversing the associated rectangle on which each element in the current display page is dependent; if the traversed associated rectangles are overlapped with the hit areas, elements corresponding to the overlapped associated rectangles are used as associated elements to be added into the element set; taking the association rectangles with the overlap as new hit areas, and returning to execute association element adding operation until no new association elements are added to the element set, wherein the method comprises the following steps:

forming a closed polygonal graph based on each touch point of the touch operation;

selecting one edge from the unselected edge set of the polygonal graph as a hit edge;

searching a target associated rectangle which meets the inclusion relation with the hit edge from each associated rectangle;

adding elements corresponding to each target associated rectangle into an element set according to a set condition, and returning to execute hit edge selection operation until a hit termination condition is met;

wherein the termination condition is that the unselected edge set is empty, or the total number of elements in the element set remains unchanged.

9. The method according to claim 2, wherein the determining a gesture type associated with the received touch operation acting on the current display page, and displaying a touch identifier corresponding to the gesture type comprises:

obtaining a reference line segment formed on the basis of a connecting line of a starting point and an end point in the touch track;

determining whether the touch track is a linear track or not according to the touch points and the reference line segment;

if so, determining that the gesture type associated with the touch operation is a drawing line;

and when the gesture type is determined to be a drawing line, displaying the touch track corresponding to the touch operation as a touch mark.

10. The method of claim 9, wherein determining whether the touch trajectory is a linear trajectory according to each of the touch points and the reference line segment comprises:

determining a horizontal included angle of the reference line segment;

determining a total variance value of the touch track according to the position information of the touch points on the touch track;

and if the horizontal included angle is smaller than a set angle value and the total variance value is smaller than a set threshold value, determining that the touch track is a linear track.

11. The method of claim 9, the determining a hit area by the touch identification; traversing the associated rectangle on which each element in the current display page is dependent; if the traversed associated rectangles are overlapped with the hit areas, elements corresponding to the overlapped associated rectangles are used as associated elements to be added into the element set; taking the association rectangles with the overlap as new hit areas, and returning to execute association element adding operation until no new association elements are added to the element set, wherein the method comprises the following steps:

forming a rectangular area as a hit area based on the start point and the end point of the reference line segment;

adding elements corresponding to the overlapped association rectangles to an element set;

12. The method of any of claims 1-11, further comprising, prior to determining and storing elements of the set of elements as critical information:

and screening the elements in the element set according to a preset element tag, and deleting the element tag as an element for temporarily generating the content.

13. A key information determination apparatus, comprising:

an element set determining module, configured to determine an element set associated with the touch identifier in a current display page, where the current display page includes at least one element, and a generation timing of the touch operation is: the teacher explains the key contents on the current display page and adopts the selected gesture to touch the area where the key contents are located; the touch identifier is used for identifying an area where important content is located;

the element set determining module is specifically configured to:

determining a hit area through the touch identifier; traversing the associated rectangle on which each element in the current display page is dependent; if the traversed associated rectangles are overlapped with the hit areas, elements corresponding to the overlapped associated rectangles are used as associated elements to be added into the element set; and taking the association rectangles with the overlaps as new hit areas, and returning to execute the association element adding operation until no new association elements are added to the element set.

14. A key information determination device characterized by comprising: a memory, a display screen, and one or more processors;

the memory for storing one or more programs;

when executed by the one or more processors, cause the one or more processors to implement the critical information determining method of any of claims 1-12.

15. A storage medium containing computer-executable instructions for performing the method of determining key information according to any one of claims 1-12 when executed by a computer processor.