WO2020155816A1

WO2020155816A1 - Key information determining method, apparatus and device, and storage medium

Info

Publication number: WO2020155816A1
Application number: PCT/CN2019/120858
Authority: WO
Inventors: 吕毅
Original assignee: 广州视源电子科技股份有限公司; 广州视睿电子科技有限公司
Priority date: 2019-01-29
Filing date: 2019-11-26
Publication date: 2020-08-06
Also published as: CN109814787A; CN109814787B

Abstract

A key information determining method, apparatus and device, and a storage medium. The method comprises: in response to a received touch operation, displaying a touch identifier corresponding to the touch operation (S101); determining an element set associated with the touch identifier in the current display page (S102); determining an element in the element set as key information and storing the key information (S103); in response to the received editing operation, displaying an editing page containing target key information (S104); and when an editing completion instruction is received, storing the editing page (S105). By using the mode, key information in key explanation in the teaching content is quickly identified and stored according to a gesture operation adopted by a teacher during key explanation, so that centralized display of the key explanation content can be realized in a subsequent teaching process by only calling the stored key information, tedious operations for displaying the key explanation content by a teacher is avoided, the non-missing review of the key explanation content is ensured, and the user experience of intelligent teaching is better improved.

Description

Method, device, equipment and storage medium for determining key information

This application claims the priority of a Chinese patent application filed with the Chinese Patent Office with an application number of 201910087616.X on January 29, 2019. The entire content of the above application is incorporated into this application by reference.

Technical field

The present disclosure relates to the field of interactive smart tablets, for example, to methods, devices, devices, and storage media for determining key information.

Background technique

In recent years, with the continuous improvement of people's education informatization, modern teaching based on electronic education equipment (such as smart teaching whiteboard) has become a development trend. For teaching based on electronic educational equipment, teachers can prepare teaching content in the form of presentation documents in advance, and then display the teaching content on the smart education whiteboard during the teaching.

Generally, the teaching content displayed by the teacher during the teaching process often has some teaching content that needs to be explained, and the teaching content of these key explanations is often what the teacher wants the listener to master. In the process of realizing the present disclosure, it was discovered that the related technology has the following shortcomings: in subsequent lectures, the teacher will review the teaching content that was emphasized in the previous lecture. At this time, the teacher can only manually find the teaching content that was previously explained. This method of presenting important teaching content to the lecturers is cumbersome to operate, and at the same time it is not conducive to the realization of the teacher's complete review of all key teaching content, thereby reducing the user experience of intelligent teaching.

Summary of the invention

In view of this, the embodiments of the present invention provide a method, device, device, and storage medium for determining key information to solve the technical problem of the inability to effectively extract the content emphasized by the teacher in the course of teaching.

In the first aspect, an embodiment of the present invention provides a method for determining key information, including:

In response to the received touch operation acting on the currently displayed page, displaying the touch identifier corresponding to the touch operation;

Determining the set of elements associated with the touch identifier in the currently displayed page, and the currently displayed page contains at least one element;

Determine and store the elements in the element set as key information;

In response to the received editing operation acting on the target key information, displaying an editing page containing the target key information, where the target key information is any element in the set of elements that is used as key information;

When receiving the edit completion instruction, save the edit page;

Wherein, the element includes at least one of the following: text, graphic shape, multimedia, and table.

In the second aspect, an embodiment of the present invention also provides a key information determining device, including:

The first response module is configured to display a touch mark corresponding to the touch operation in response to the received touch operation on the currently displayed page;

An element set determining module, configured to determine a set of elements associated with the gesture type in the currently displayed page, and the currently displayed page contains at least one element;

The key information storage module is used to determine and store the elements in the element set as key information;

The second response module is configured to display an editing page containing the target key information in response to the received editing operation acting on the target key information, where the target key information is any element in the set of elements that is used as key information ；

The edit storage module is used to save the edit page when receiving the edit completion instruction;

In a third aspect, an embodiment of the present invention also provides a key information determining device, including: a memory, a display screen, and one or more processors;

The memory is used to store one or more programs;

The display screen is used to display the currently displayed page and the touch track corresponding to the touch operation;

When the one or more programs are executed by the one or more processors, the one or more processors implement the key information determination method as described in the first aspect.

In a fourth aspect, an embodiment of the present invention also provides a storage medium containing computer-executable instructions, which are used to execute the method for determining key information as described in the first aspect when executed by a computer processor.

The method, device, device, and storage medium for determining key information provided above firstly respond to a received touch operation acting on the currently displayed page and display the touch identifier corresponding to the touch operation; then determine that the touch identifier is The set of associated elements in the currently displayed page; then the elements in the set of elements are determined as key information and stored, and finally, in response to the received editing operation acting on the target key information, the edit containing the target key information is displayed Page, the target key information is any element in the set of elements that is used as key information; when an editing completion instruction is received, the editing page is saved. The above technical solution can quickly identify and store the key information that is emphasized in the teaching content according to the touch operation used by the teacher during the key explanation during the teaching process, so as to ensure that it can be achieved only by calling the stored key information during subsequent lectures The centralized presentation of the key explanation content not only avoids the cumbersome operation of the teacher when the key explanation content is displayed, but also ensures the complete review of the key explanation content, and better improves the user experience of intelligent teaching.

Description of the drawings

By reading the detailed description of the non-limiting embodiments with reference to the following drawings, other features, purposes and advantages of the present disclosure will become more apparent:

FIG. 1 is a flowchart of a method for determining key information according to Embodiment 1 of the present invention;

FIG. 2a is a flowchart of a method for determining key information according to Embodiment 2 of the present invention;

Figure 2b shows an example diagram of determining gesture-related elements in the second embodiment of the present invention;

FIG. 3a is a flowchart of a method for determining key information according to Embodiment 3 of the present invention;

Figure 3b shows a flow chart of the implementation of the circle shape determination of the touch track in the third embodiment of the present invention;

Figure 3c shows an example diagram of the gesture type associated with the touch operation as drawing a circle;

FIG. 4a is a flowchart of a method for determining key information according to Embodiment 4 of the present invention;

Figure 4b shows a flow chart of the implementation of the touch track line shape determination in the fourth embodiment of the present invention;

Figure 4c shows an example diagram of determining gesture-related elements in the fourth embodiment of the present invention;

Figure 4d shows an example diagram of storage folders for key information storage;

FIG. 5 is a schematic structural diagram of an apparatus for determining key information according to Embodiment 5 of the present invention;

FIG. 6 is a schematic structural diagram of a key information determining device provided by Embodiment 6 of the present invention.

detailed description

The present disclosure will be further described in detail below in conjunction with the drawings and embodiments. It can be understood that the specific embodiments described herein are only used to explain the present disclosure, but not to limit the present disclosure. In addition, it should be noted that, for ease of description, the drawings only show part of the content related to the present disclosure, but not all of the content.

Example one

FIG. 1 is a flowchart of a method for determining key information provided by Embodiment 1 of the present invention. The method for determining key information provided in the embodiments may be executed by a key information determining device, which may be implemented by software and/or hardware, and the key information determining device may be composed of two or more physical entities. It can be a physical entity. Generally speaking, the key information determining device has an electronic whiteboard function, and the key information determining device can be a computer, a mobile phone, a tablet, or a smart teaching tablet.

For ease of understanding, in the embodiments, a smart teaching tablet is used as a key information determining device for exemplary description. Among them, the smart teaching tablet can be an integrated device that controls the content displayed on the display tablet through touch technology and realizes human-computer interaction. It integrates a projector, an electronic whiteboard, a screen, a sound, a TV, and a video conference. One or more functions such as a terminal. Generally speaking, the display screen of the smart teaching tablet can be a capacitive screen, a resistive screen or an electromagnetic screen. Users can perform touch operations on the smart teaching tablet with fingers or a stylus.

In one embodiment, the application software that comes with the operating system is installed on the smart teaching tablet. At the same time, application software downloaded from a third-party device or server is also installed. The specific type and content of the application software can be based on actual conditions. Setting, usually, the application software has an electronic whiteboard function, which can be realized by the electronic whiteboard function: writing, drawing, annotation, courseware production, display and playback functions. In the embodiment, the electronic whiteboard function is set to have the function of courseware production and display and playback. Among them, the courseware production refers to the element input or insertion operation performed by the user (the user may be a teacher) on the courseware editing page on the smart teaching tablet. In addition, the display and playback can specifically refer to the courseware demonstration in which the content in the courseware editing page is used as the demonstration playback page in the teaching mode. The display and playback can be realized by triggering the demo playback button by the user.

It is understandable that the execution timing of the key information determination method in this embodiment can be when the user triggers the demo play button to display the teaching content in the form of a demo play page. At this time, it can be equivalent to the activation of the key information determination function by touching it to achieve For the determination and storage of the key content of the key explanation during the teaching process of the teacher, it should be noted that this embodiment may record the demo playback page currently displayed to the lecturer as the current display page.

As shown in FIG. 1, the method for determining key information provided by Embodiment 1 of the present invention includes the following operations:

S101: In response to a received touch operation acting on a currently displayed page, display a touch identifier corresponding to the touch operation.

In this embodiment, the smart interactive tablet that executes the provided key information determination method has a touch function. Therefore, the teacher can use a finger or a stylus to click and click on the smart interactive tablet through touch during the teaching process. Move and other operations, so that the smart teaching tablet receives the touch operation of the teacher.

In this embodiment, the touch logo can be understood as a logo that can be specifically displayed on the display screen when the user performs a touch operation. The logo can display different logos according to the specific gestures used by the user when the user performs a touch operation, for example, The user can use tap gestures, circle gestures, or line gestures to perform touch operations on the smart interactive tablet, and the corresponding identifiers can be circular areas, circular trajectories, or linear trajectories. In this embodiment, it can be considered that when the teacher explains the key content during the course, he will use some gestures to mark the area where the key content is located, and the key marking process is equivalent to the teacher based on the above gestures on the smart education tablet. Generate a touch operation and display the process of the corresponding touch association.

In this embodiment, by recognizing the gesture type of the received touch operation, it can further determine which key annotations the gesture type specifically corresponds to.

This step can determine which gesture type is specifically identified by the touch operation by analyzing the touch operation received by the intelligent teaching platform. For example, this step can analyze the time interval and position difference of each touch operation received, and monitor The time interval and position difference between the pressing event and the lifting event of the touch operation are formed, which determines whether the gesture when the user generates the touch operation is a tap, etc.; in addition, this step can also be used to display the touch track of the received touch operation The shape is analyzed to determine whether the gesture when the user generates a touch operation is drawing a line or drawing a circle.

S102: Determine the set of elements associated with the touch identifier in the currently displayed page.

In this embodiment, after the touch identification of the touch operation is determined, it can be determined that the teacher specifically marked which teaching content in the currently displayed page based on the touch identification. In this step, the teaching can be determined by determining the set of elements associated with the touch identification. The content of the lecture marked by the author. Wherein, the current display page is equivalent to the demo playback page currently displayed to the audience in the demo mode. Generally speaking, the display content in the current display page can be elements of a variety of different element types added during the course editing stage. , The element types can include images, editable graphics, tables, audio and video, text boxes, multimedia, etc. Therefore, in this embodiment, it can be considered that the currently displayed page contains at least one element. The element set can be understood as a set that includes the associated elements related to the touch identifier in the currently displayed page.

In one embodiment, the determination of the set of elements associated with the touch identification can be described as: after the touch identification displayed by the received touch operation is determined, the pre-stored corresponding touch-associated associated element determination rule can be called, and then according to different touches The identification rules corresponding to different associated elements determine the set of elements associated with the touch identification.

Exemplarily, the core of the rules for determining different associated elements can be summarized as follows: determine a hit area based on the corresponding touch identifier, and then traverse the associated associated rectangles that each element in the current display page depends on, and then, if the traversed associated rectangles and hits If the regions overlap, the element corresponding to the associated rectangle can be added to the element set as the associated element. In order to realize the complete addition of associated elements, this embodiment may use overlapping associated rectangles as new hit areas, and then iteratively perform the addition of associated elements until no new elements can be added to the element set.

S103: Determine and store an element in the element set as key information.

After determining the element set associated with the touch mark based on the above steps, it is equivalent to determining the key teaching content marked by the teacher through the touch operation. In this step, the elements in the element set are determined as key information, which is actually equivalent to the determined element As the key teaching content that is explained and marked by the teacher during the teaching process, after the key information is determined, the key information can also be serialized and stored, so that the stored key information can be directly retrieved when the key teaching content is reviewed later display.

It should be noted that this embodiment may also consider the relevance of each element in the element set when displayed in the currently displayed page, so that when key information is stored, the relevance of the element when displayed is also saved. Therefore, when the stored key information is retrieved, each element of the key information can be displayed in the original display state. In this embodiment, the advantage of displaying the original state of the key information is also manifested in the convenience for the user to summarize and edit all the key information.

S104: In response to the received editing operation acting on the target key information, display an editing page containing the target key information.

In this embodiment, after obtaining the stored element set, the user can edit the key information summarized in the stored element set. This step can edit any element in the element set that is the key information triggered by the user. After the operation, the edit page of the triggered element is displayed on the display screen of the smart interactive tablet. It can be understood that in this step, any element triggered by the user to edit from the set of elements is used as the target key information.

S105. When receiving the editing completion instruction, save the editing page.

In this embodiment, after the editing page of the target key information is displayed, the user can edit the target key information in the displayed editing page, and can trigger the generation of editing instructions after editing is completed. This step can receive the user The editing completion instruction is triggered, thereby responding to the editing completion instruction to execute the saving operation of the editing page.

In the method for determining key information provided in the first embodiment of the present invention, firstly, in response to a received touch operation acting on the currently displayed page, a touch indicator corresponding to the touch operation is displayed; then it is determined that the touch indicator is on the currently displayed page The set of associated elements in the set; then the elements in the set of elements are determined as key information and stored, and finally, in response to the received editing operation acting on the target key information, the editing page containing the target key information is displayed, so The target key information is any element in the set of elements as key information; when an editing completion instruction is received, the editing page is saved. The above technical solution can quickly identify and store the key information that is emphasized in the teaching content according to the touch operation used by the teacher during the key explanation during the teaching process, so as to ensure that it can be achieved only by calling the stored key information during subsequent lectures The centralized presentation of the key explanation content not only avoids the cumbersome operation of the teacher when the key explanation content is displayed, but also ensures the complete review of the key explanation content. In addition, this technical solution can also determine the key points when needed. The information editing operation not only realizes the effective summary of the key explanation content, but also realizes the repeated editing and collation of the key explanation content, which better improves the user experience of intelligent teaching.

This embodiment further optimizes and adds the element filtering operation of the determined element set based on the above. For example, before determining and storing the elements in the element set as key information, this embodiment further includes: according to preset elements The tag filters the elements in the element set, and deletes the element tag as an element that temporarily generates content.

It should be noted that for the elements displayed on the current display page, some may be the preparation content formed by the teacher based on the courseware editing mode before the lecture, and some may be the content on the temporary blackboard during the lecture. For example, this embodiment believes that the key explanation content in the teaching process has been formed during the lesson preparation stage. If the determined element set includes temporary blackboard content, it may interfere with the presentation of the key explanation content. Therefore, this embodiment is determining After the element collection, in order to avoid the interference of the temporary blackboard content on the key explanation content, the elements in the determined element collection are filtered again.

In one embodiment, for the teaching content formed in the courseware editing stage, when it is opened in the demo play mode, this embodiment adds an element tag to the opened element to identify the element as pre-edited teaching content, and also An element tag can be added to the temporary element of the teacher’s blackboard during the teaching process to identify the element as temporarily generated blackboard content. In this embodiment, the element tag of each element in the element set can be obtained. When it is determined that the element tag is temporarily generated content , The element corresponding to the element tag can be deleted from the element collection, or, when the element tag is determined to be the lesson preparation content, the element corresponding to the element tag can be kept in the element collection. Based on the above operations, it can be ensured that the determined key information is only the elements edited during the lesson preparation stage.

Example two

Fig. 2a is a flowchart of a method for determining key information provided in the second embodiment of the present invention. The embodiment of the present invention is optimized based on the foregoing embodiment. In this embodiment, the currently displayed page will be displayed in response to the received action The optimization of the above touch operation is: determining the received gesture type associated with the touch operation acting on the currently displayed page, and displaying the touch identifier corresponding to the gesture type.

For the above optimization, in the course of teaching, the teacher can touch on the current display page of the smart interactive tablet when it is necessary to explain the key content. In this embodiment, the smart teaching tablet can be considered to have a touch operation monitoring function. This embodiment can thus receive and respond to the generated touch operation.

At the same time, this embodiment can further determine which touch marks the gesture type specifically corresponds to by identifying the gesture type associated with the received touch operation, and can determine which touch marks specifically identify which key marks in the content explained by the teacher.

In one embodiment, this embodiment can determine which gesture type is specifically associated with the touch operation by analyzing the touch operation received by the intelligent teaching platform. Illustratively, this embodiment can analyze the touch operation received each time. The time interval and position difference, as well as the time interval and position difference of listening to the press event and lift event forming the touch operation, determine whether the gesture when the user generates the touch operation is a tap, etc.; in addition, this step can also be performed by The display shape of the touch track received by the touch operation is analyzed to determine whether the gesture when the user generates a touch operation is drawing a line or drawing a circle.

In addition, on the basis of the above optimization, this embodiment further optimizes the determination of the received gesture type associated with the touch operation on the currently displayed page, the display of the touch identifier corresponding to the gesture type, and the gesture type can be Multiple angles such as tapping, circle drawing and line drawing are optimized.

As shown in Fig. 2a, a method for determining key information provided in the second embodiment of the present invention includes the following operations:

It should be noted that the second embodiment provides a key information determination process when the teacher uses tapping gestures to mark the key explanation content during the teaching process. First, S201 to S203 of this embodiment describe the implementation process of how to determine that the gesture type associated with the received touch operation is tap.

S201: When an event combination including a touch down event and a touch up event is monitored, it is determined that a touch operation is received.

In this embodiment, it can be considered that the smart teaching tablet has a monitoring function for each touch event in the touch operation, so that it can specifically monitor the user's touch events on the smart teaching tablet. This embodiment can monitor a group of user-generated touch events. Touch events. If the group of touch events includes a touch down event and a touch up event, it can be considered that the user has performed a touch operation on the smart teaching tablet, and each touch operation generated by the user can be received in this step.

S202: If at least three touch operations are received within a set time period, acquire touch information of each touch operation.

When receiving a touch operation based on S201, the receiving time of each touch operation can be monitored to determine whether at least three touch operations are received within a set time period. The specific value of the set time period may be based on actual The actual setting is applied, and the receiving time of a touch operation can be recorded according to the generation time of the touch down event or the generation time of the touch up event.

In order to distinguish whether the user’s touch operation on the smart teaching tablet is a tap, a double-click, or a tap, this embodiment sets that only if at least three touch operations are received within a set time period, will it be considered that the basic determination of tap is satisfied. Therefore, when at least three touch operations are received within the set time period, the subsequent determination of whether the touch operation identifies a tap is performed, otherwise, it can be directly determined that the gesture type associated with the touch operation is not a tap.

In this embodiment, the touch information may specifically refer to attribute information representing the time and position of a touch operation (such as the time when each touch event is generated in an event combination, or the position where each touch event acts on a smart teaching tablet). Etc.), the touch information can be generated when the event combination acts on the smart teaching tablet. In this step, the touch information for the touch operation can be directly obtained.

S203: If the touch information of each touch operation meets the first determination condition and two adjacent touch operations meet the second determination condition, determine that the gesture type associated with the at least three touch operations is tap.

In this embodiment, it can be considered that after the touch information of each touch operation received within the set time period meets the first determination condition and two adjacent touch operations meet the second determination condition, at least three touch operations on the smart teaching whiteboard are determined The associated gesture type is tap; otherwise, it can be considered that the gesture type is not tap, and the subsequent operations of this embodiment can be terminated at this time.

In an embodiment, the touch information of the touch operation includes: the first generation time and the first generation position of the touch-down event, and the second generation time and the second generation position of the touch-up event;

The first determination condition is: the difference between the second generation time and the corresponding first generation time is less than a first time threshold, and the position difference between the second generation position and the first generation position is less than a first distance threshold;

The second determination condition is that the time difference between the next touch operation and the previous touch operation is less than the second time threshold, and the distance difference between the next touch operation and the previous touch operation is less than the second distance threshold.

It is understandable that the position difference may be: the maximum value of the abscissa difference or the ordinate difference in the generated position; the time difference may refer to: the first generation time difference or the second generation time difference of two touch operations, Or, the difference between the first generation time of the next touch operation and the second generation time of the previous touch operation; the distance difference may refer to: the first generation position of the next touch operation and the first generation time of the previous touch operation Generate the difference in position.

In addition, in order to make the process of determining key information more compatible with the natural gesture operation of the teacher, before performing this embodiment, the technician first samples the touch operation data of the teacher in the actual teaching to determine the first time threshold and the first time threshold. A distance threshold, a second time threshold, and a second distance threshold are tested and trained to obtain a value range that is more in line with the actual operation. For example, the first time threshold and the second time threshold can preferably be in the range of 0.5s to 1s Inner value, the first distance threshold value may preferably be in the range of 2 cm to 5 cm or 16 pixels to 30 pixels, and the second distance threshold value may preferably be in the range of 5 cm to 8 cm.

S204: When it is determined that the gesture type is tapping, display the touch points corresponding to each of the touch operations as touch indicators.

In this embodiment, when the gesture type is tapping, the touch points corresponding to the touch operation can be considered to be discrete, and each touch point can be displayed on the display screen with a touch area of a set size. This embodiment Use each touch point displayed on the display screen as the corresponding touch mark when tapping.

It should be noted that the following operations from S205 to S211 in this embodiment describe the specific implementation process of determining key information when the gesture type is tapping.

S205: Form a circular area as a hit area based on the points of action respectively acted on the currently displayed page based on the at least three touch operations.

In one embodiment, the generating position corresponding to the touch down event or the touch up event in the touch operation may be used as the point of action of the touch operation in the currently displayed page. Exemplarily, since the generating position of the touch down event in the touch operation can best represent the original intended position of the user operation, this embodiment preferably uses the generating position of the touch down event in each touch operation as the action point in the currently displayed page.

After determining the action points of each touch operation, a circumscribed circle containing each action point can be formed. In this embodiment, the circular area corresponding to the circumscribed circle is determined as the hit area, and the size of the hit area can pass through the radius of the circumscribed circle The size is ok.

S206: Obtain the associated rectangle of each element in the currently displayed page.

In one embodiment, for each element in the currently displayed page, there is a rectangle as the editing frame in the editing phase. It can be considered that the bottom layer of each element edited in the currently displayed page is supported by a rectangle, and one The element corresponds to a rectangle, and the rectangle information of the rectangle has been generated when the element is edited. In this embodiment, the rectangle is an associated rectangle. In this step, the rectangle information of the associated rectangle of each element can be directly obtained. The rectangle information may include rectangles. The coordinate value of the upper left corner, the length and width of the rectangle, etc. are used to identify the attribute information of the rectangle.

It should be noted that the associated rectangle can be the circumscribed rectangle of the corresponding element, or a set rectangle whose length and width are greater than the circumscribed rectangle, and the set rectangle can be regarded as the corresponding circumscribed rectangle. Rectangles with a certain margin value are added respectively. In this embodiment, the set rectangle is preferably used as the associated rectangle to ensure the accuracy of hitting elements based on the hit area and the associated rectangle.

S207: Search for overlapping associated rectangles that overlap with the hit area from the associated rectangles.

In this embodiment, the rectangle information of each associated rectangle can be used to determine whether there is an associated rectangle that overlaps the hit area, and an associated rectangle that meets the overlap condition can be recorded as an overlap associated rectangle, where the overlap in this embodiment can be It includes the following situations: the area corresponding to the associated rectangle contains the hit area, or the area corresponding to the associated rectangle is included in the hit area, or the area corresponding to the associated rectangle intersects a part of the hit area.

S208: Add the elements corresponding to the overlapping associated rectangles to the set of elements by setting adding conditions.

In this embodiment, after determining each overlapping associated rectangle, the element corresponding to the overlapping associated rectangle is hit by the hit area. In this step, it can be further determined whether the element meets the set adding condition, and if so, the element is added to the element In the set, the set addition condition may be: the element has not been added to the element set.

S209: Determine whether the total number of elements in the element set has changed, if yes, execute S210; if not, execute S211.

In this embodiment, it can be considered that the element set is initially empty. After the determined element is added to the element set, the total number of elements it contains may change. At this time, S210 can continue to be executed, but as the element hit operation Continue to execute, and there may no longer be any elements that meet the adding conditions. After that, the total number of elements in the element set will remain unchanged, and S211 may be further executed at this time.

S210: Use each overlapping associated rectangle as a hit area, and return to execution S207.

In this embodiment, when it is determined that the total number of elements has changed, specifically, each of the above-determined overlapping associated rectangles may be used as a hit area, and return to S206 to continue to iteratively perform the element hit search operation.

S211: Determine and store an element in the element set as key information.

In this embodiment, when it is determined that the total number of elements in the element set no longer changes, it indicates that all possible hit elements have been searched and determined. At this time, each element added to the element set can be used as key information, and The original correlation of each element is stored. It is understandable that the elements can be filtered before storing, so as to filter out the teaching content temporarily added by the teacher during the teaching process.

S212: In response to the received editing operation acting on the target key information, display an editing page containing the target key information.

Exemplarily, this embodiment can edit the formed key information. For example, after receiving a user's editing operation trigger on any element in the element set as the target key information, respond to the editing operation and form an association with the key information. The edit page of the target key information, in which the user can edit the target key information.

S213: When receiving the editing completion instruction, save the editing page.

It is understandable that after the user completes the editing of the target key information in the editing page, the generation of the editing completion instruction can be triggered. In this step, the edited editing page can be saved based on the editing completion instruction.

Based on the foregoing embodiment, Figure 2b shows an example diagram of determining gesture-related elements in the second embodiment of the present invention. As shown in Figure 2b, the currently displayed page 20 contains text-type elements and graphic-type elements. Based on the above-mentioned gesture type as the corresponding associated element determination step when tapping, the circular area 21 can be used as the initial hit area, and the associated rectangle of each element displayed in the currently displayed page 20 can be obtained, such as "this is the text" The first associated rectangle 22 corresponding to the text box (element) of the display content, the second associated rectangle 23 corresponding to the line segment, the third associated rectangle 24 corresponding to the curve, etc. (the associated rectangles of all elements are not shown in the figure).

The operation of determining the associated elements from the circular area 21 as the initial hit area can be described as: from the obtained associated rectangles of each element, it can be found that the associated rectangles that overlap the circular area 21 are the first associated rectangle 22 and the first associated rectangle 22. Two associative rectangles 23; from this, the elements corresponding to the first associative rectangle 22 (text box and its content) and the elements (line segments) corresponding to the second associative rectangle 23 can be added (the element set is empty at this time, that is, it is not yet There are the above-identified elements) into the element set. At this time, the total number of elements is 2, and the search can be continued; therefore, the first associated rectangle 22 and the second associated rectangle 23 can be used as new hits. Area, it can be found that the associated rectangle that overlaps the first associated rectangle 22 is the third associated rectangle 24, and the associated rectangle that overlaps the second associated rectangle 23 is also the third associated rectangle 24, and the third association can be determined The element corresponding to the rectangle 24 is a curve, and the curve has not been added to the element set, so the curve can be added to the element set. At this time, the total number of elements is 3, and the search can continue to be performed if the change occurs; therefore, you can Using the third associated rectangle 24 as the new hit area, it can be found that the associated rectangles overlapping the third associated rectangle 24 are the first associated rectangle 22 and the second associated rectangle 23, and because the first associated rectangle 22 corresponds to the text box and The line segments corresponding to the second associated rectangle 23 already exist in the element set, and will not be added repeatedly. At this time, the total number of elements is still 3, unchanged, and the search end condition is satisfied, and the search can be ended. Based on the above search, it is finally determined that when the teacher taps the circular area 21, the key information determined is the text box and its contained content, line segments and curves.

The second embodiment of the present invention provides a method for determining key information, which provides a specific operation for determining key information when the gesture type associated with a touch operation is a tap. It first determines the determination process of the tap gesture, and then gives The tap gesture is used to determine the element set, and finally realize the determination of key information. Based on this method, when the teacher uses tapping gestures for key explanations, it can accurately and quickly identify the key explanation content as the key information in the teaching content and store it, so as to ensure that only by calling the stored key information during subsequent lectures Realize the centralized presentation of the key explanation content, which not only avoids the cumbersome operation of the teacher when the key explanation content is displayed, but also ensures the complete review of the key explanation content, and better improves the user experience of intelligent teaching.

Example three

Fig. 3a is a flowchart of a method for determining key information provided in the second embodiment of the present invention. The embodiment of the present invention is optimized based on the above-mentioned first and second embodiments. As shown in Fig. 3a, the third embodiment of the present invention provides A method for determining key information of, including the following operations:

It should be noted that this third embodiment provides a process of determining key information when the teacher uses circled gestures to mark the key explanation content during the teaching process. First, S301 to S303 of this embodiment describe the implementation process of how to determine that the gesture type associated with the received touch operation is circle drawing.

S301: Sample all touch points corresponding to the touch operation on the currently displayed page, and obtain a touch track formed based on each touch point.

In this embodiment, for a smart teaching tablet with a touch event monitoring function, this step can monitor the touch operation acting on the current display page. Among them, it can be considered that the current display page is displayed through the smart teaching tablet, and the touch operation can be It consists of a touch down event, a touch up event, and a series of touch movement events between the above two touch events. At the same time, this step can determine that each touch event is in the currently displayed page by monitoring the above series of touch events. The corresponding touch points can finally form a touch trajectory corresponding to the touch operation based on a series of touch points, and the formed touch trajectory can be obtained in this step.

In this embodiment, the corresponding touch points of each touch event on the currently displayed page may be sequentially sampled according to the generation time of each touch event in the touch operation, so as to obtain coordinate information of each touch point. It is understandable that in a group of touch events that form a touch operation, the first touch event is equivalent to a touch down event, and its corresponding touch point can be recorded as the touch start point, and the last touch event is equivalent to a touch up event. The corresponding touch point can be recorded as the touch termination point, and the remaining touch events in the touch down event and touch up event are equivalent to touch movement events, and their corresponding touch points can be recorded as touch movement points. For a touch operation, there must be a touch down event and a touch up event in the event combination, but there may not be a touch movement event. This situation is equivalent to a touch operation on a location point.

S302: According to each of the touch points, determine whether the touch trajectory includes a circle-shaped trajectory and whether the included circle number meets a set condition.

In this embodiment, the position coordinates of each touch point in the current display page required to form the touch track can be obtained, and the position coordinates of each touch point can be used to determine whether there is a circle in the touch track according to the set circle determination rule. Shape trajectory, and can determine the number of turns of the loop-shaped trajectory presented. Exemplarily, in this step, the distance value between each touch point and the designated coordinate point can be determined according to the position coordinates of the touch point, and then each distance value is compared with the set distance threshold. If there is a circle-shaped trajectory, a continuous touch is required The distance value of the point is less than the set distance threshold, and the distance value of a subsequent touch point is greater than the set distance threshold.

It should be noted that, in order to determine the circle-shaped trajectory, the characteristics of the circle-shaped trajectory can be analyzed first, and it is found that the main feature is that the connection of a group of touch points can form an arc-shaped closed or close to closed curve. Take one of the touch points as the center of the circle and draw a circle with the set value as the radius. At first there will be some touch points whose distance from the center of the circle is less than or equal to the radius. These touch points are equivalent to being inside the drawn circle, and there is still a part afterwards. The distance value from the touch point to the center of the circle is greater than the radius. These touch points are equivalent to being outside the drawn circle, and then there are some points that are inside the drawn circle.

Based on the above characteristics, this embodiment sets the following circle shape determination operations. Figure 3b shows the implementation flow chart of the touch track circle shape determination in the third embodiment of the present invention. For example, according to each touch Point, determining whether the touch trajectory includes a circle-shaped trajectory and whether the number of laps included meets the set conditions can be achieved by the method shown in Fig. 3b, as shown in Fig. 3b, the method includes:

S3021. Determine the distance value from each touch point to the set reference point as the judgment distance value of each touch point.

Firstly, based on this step, determine the distance value from each touch point to the set reference point. According to the above description, the set reference point is equivalent to the center of the drawn circle. The set reference point can be preferably selected from the touch points, and generally preferred Is the starting point of the touch. Therefore, this step is equivalent to determining the distance value from each touch point to the touch start point as the judgment distance value of each touch point.

S3022, sequentially selecting the determined distance value of the touch point and comparing with the third distance threshold value.

This step is equivalent to starting from the judgment distance value of the touch starting point, and then selecting the judgment distance value of the subsequent touch points in a clockwise direction, and each selected judgment distance value can be compared with the third distance threshold, and recorded in real time According to the comparison result, according to the above description of the drawn circle, the third distance threshold is actually equivalent to the radius of the drawn circle, and the setting of the third distance threshold is also equivalent to an empirical value. The value is tested and compared, and the value with the best judgment effect is determined as the third distance threshold.

S3023: When the determined distance value of the set continuous touch points is greater than the third distance threshold, determine whether there is a subsequent target touch point and the determined distance value is less than or equal to the third distance threshold.

In this step, based on the comparison results recorded above, it can be determined whether there is a set continuous touch point with a judgment distance value greater than the third distance threshold. The judgment at this time is actually equivalent to determining whether there is a set continuous touch point at all. Outside of the circle, the set continuous amount is also an empirical value, which is also selected according to test training. If the above determination is true, it can be further determined whether there is a target touch point in the subsequent determination distance value is less than or equal to the third distance threshold, the determination at this time is actually equivalent to the existence of a continuous set amount of touch points outside the circle drawn Then, whether there is a touch point inside the drawn circle, if the determination is true, the following S3024 can be executed.

It should be noted that if one of the two determinations in this step is not established, it can be considered that the touch trajectory does not include a circle-shaped trajectory.

S3024. If it exists, determine that the touch trajectory includes a circle-shaped trajectory, add 1 to the number of circles including the circle-shaped trajectory, and return to execute S3023 until the touch point corresponding to the currently selected determination distance value is the touch termination point.

This step is equivalent to the establishment of the above-mentioned judgment condition of S3023. At this time, it can be determined that the touch trajectory formed by the touch operation includes a circle-shaped trajectory, and the number of laps including the circle-shaped trajectory can be increased by 1, and the above determination can be determined later Whether the touch point corresponding to the selected judgment distance value is the touch termination point, if it is not the touch termination point, the circle judgment operation of S3023 can be executed again to determine whether the touch point after the target touch point can form a circle trajectory again; If it is the touch end point, the following steps can be performed.

S3025. If the determined number of turns is greater than or equal to the set value, determine that the number of turns meets the set condition.

Based on the above S3024 operation, in addition to determining that the touch trajectory contains the circle-shaped trajectory, the specific number of laps included can also be determined. When the determined specific lap value is greater than or equal to the set value, the number of laps can be considered to meet the set value. The setting condition, wherein the set value can be preferably 2, that is, the number of turns equivalent to the circle track included in the touch track needs to be greater than or equal to two turns, but the same applies when the set value is 1, that is, When it is considered that the touch trajectory includes a circle-shaped trajectory, the gesture type associated with the touch operation can also be regarded as drawing a circle.

Figure 3c shows an example diagram of the gesture type associated with a touch operation as drawing a circle. As shown in Figure 3c, the current display page 30 displays the touch trajectory 31 of the received touch operation, which is determined by the determination process provided in Figure 3b. , It can be determined that the touch trajectory 31 includes a circle-shaped trajectory, and the number of circles including the circle-shaped trajectory is 1 circle (the second circle is not completely formed), and thus the type of gesture associated with the touch operation forming the touch trajectory 31 can be determined as Draw a circle.

S303: When the touch trajectory includes a circle-shaped trajectory and the number of included laps meets a set condition, determine that the gesture type associated with the touch operation is drawing a circle.

The above S302 and its extended steps realize the determination of whether the touch trajectory includes a circle-shaped trajectory and whether the number of laps meets the set conditions. In this step, when the above two conditions are met at the same time, it can be considered that the gesture type associated with the received touch operation is a picture. Circle; otherwise, it can be considered that the gesture type is not a circle, and the subsequent operations of this implementation can be terminated at this time.

S304: When it is determined that the gesture type is drawing a circle, display the touch track corresponding to the touch operation as a touch indicator.

In this embodiment, when the gesture type associated with the touch operation is drawing a circle, it can be determined that the touch track formed by the touch operation is displayed in a circle shape, and thus the touch track can be displayed as a touch indicator of the touch operation.

It should be noted that the following operations from S305 to S311 in this embodiment describe the implementation process of determining key information when the gesture type is drawing a circle.

S305: Form a closed polygonal figure based on the touch point of the touch track.

In one embodiment, the touch points constituting the touch track may be connected in sequence, and finally the touch start point and the touch end point may be connected to form a closed and changeable figure; in addition, the present embodiment may also perform circle shape according to the above When the trajectory is determined, the touch points of each circle-shaped trajectory are determined respectively based on the touch points of the circle-shaped trajectory, and a sub-polygonal figure is formed by sequentially connecting, thereby forming a sub-polygonal figure equal to the number of turns of the circle-shaped trajectory. The polygonal graphics formed in this step can be used for subsequent element hit operations.

S306. Obtain the associated rectangle of each element in the currently displayed page.

In one embodiment, the associated rectangle in this embodiment is also equivalent to the corresponding rectangle that exists as the bottom layer of the element when the element is edited. When editing and forming each element in the currently displayed page, the rectangle information of the corresponding rectangle is also generated. Therefore, the related rectangle information of the associated rectangle can be directly obtained in this step. It is also understandable that this embodiment can select the associated rectangle as The circumscribed rectangle of the element with the added margin value.

S307. Select an edge from the unselected edge set of the polygonal graphics as the hit edge.

The difference between the hit test operation performed in the second embodiment above is that the step of this embodiment uses the edges of the polygonal graphics as the hit edges, and the function of the unselected edge set is to limit that each edge can be selected as the hit edge only once. For example, the unselected edge set initially contains all the edges of the polygonal figure.

S308: Search for a target associated rectangle that satisfies the inclusion relationship with the hit edge from the associated rectangles.

In this embodiment, the rectangle information of each associated rectangle can be used to determine whether there is an associated rectangle that has an inclusion relationship with the currently selected hit edge, and the associated rectangle that satisfies the inclusion relationship can be recorded as the target associated rectangle. The containment relationship in includes the following situations: the area corresponding to the associated rectangle contains the hit edge, or the hit edge intersects the associated rectangle.

S309: Add the elements corresponding to the target associated rectangles to the element set under the set conditions.

In this embodiment, after determining each target associated rectangle, the element corresponding to the target associated rectangle is hit by the hit edge. In this step, it can be further determined whether the element meets the set addition condition, and if so, the element is added to the element In the set, the set addition condition may also be: the element has not been added to the element set.

S310: Determine whether the hit termination condition is met, if yes, execute S311, if not, execute return to S307.

In this embodiment, the termination condition may be that the unselected edge set is empty, or the total number of elements in the element set remains unchanged. The unselected edge set is empty, which is equivalent to that all edges of the polygonal graph have been used as hit edges; the total number of elements in the element set remains unchanged. It can be considered that when the initially empty element set has gone through multiple iterations The total number of contained elements no longer changes. In the above two cases, S311 can be further executed; otherwise, it can be considered that the search condition of the hit element is still met, and it is necessary to return to S307 to continue the loop execution.

S311. Determine and store an element in the element set as key information.

In this embodiment, when the above hit termination condition is met, it indicates that all possible hit elements have been found and determined. At this time, each element added to the element set can be used as key information, and the original correlation of each element Sexual storage. It is understandable that the elements can be filtered before storing, so as to filter out the teaching content temporarily added by the teacher during the teaching process.

S312: In response to the received editing operation acting on the target key information, display an editing page containing the target key information.

S313: When receiving the editing completion instruction, save the editing page.

The implementation of the foregoing S312 and S313 in this embodiment is specifically described in the foregoing embodiment 2, which will not be repeated here.

The method for determining key information provided by the third embodiment of the present invention provides the operation of determining key information when the gesture type indicated by the touch operation is circle drawing. It first determines the judgment process of the circle gesture, and then gives the picture Circle gestures are used to determine the set of elements, and finally realize the determination of key information. Based on this method, when the teacher uses circled gestures to explain the content, it can accurately and quickly identify the key explanation content as the key information in the teaching content and store it, so as to ensure that only by calling the stored key information during subsequent lectures It can realize the centralized presentation of the key explanation content, which not only avoids the cumbersome operation of the teacher when the key explanation content is displayed, but also ensures the complete review of the key explanation content, and better improves the user experience of intelligent teaching.

Example four

Fig. 4a is a flowchart of a method for determining key information according to Embodiment 4 of the present invention. The embodiment of the present invention is optimized on the basis of the above-mentioned Embodiment 1 and Embodiment 2. As shown in Fig. 4a, a method for determining key information provided by Embodiment 4 of the present invention includes the following operations:

It should be noted that the fourth embodiment provides a process for determining key information when the teacher uses line-drawing gestures to mark the key explanation content during the teaching process. First, S401 to S403 of this embodiment describe how to determine the implementation process of the gesture type associated with the received touch operation as drawing a line.

S401. Sample all touch points corresponding to the touch operation on the currently displayed page, and acquire a touch track formed based on each touch point.

Exemplarily, this step can monitor the user's touch operation on the currently displayed page. The touch operation is also composed of a touch down event, a touch up event, and a series of touch movement events between the above two touch events. At the same time, this step can also determine the touch points corresponding to each touch event in the currently displayed page by monitoring the series of touch events described above, and finally form a touch track corresponding to the touch operation based on the series of touch points.

S402: Obtain a reference line segment formed based on the connection between the start point and the end point in the touch track.

Exemplarily, in the touch event monitoring process of the above touch operation, the point of action of the touch down event may be determined as the starting point in the formed touch track, and the point of action of the touch up event may be determined as the end of the touch track. point. In order to determine whether the currently formed touch trajectory is a linear trajectory, this embodiment forms a line segment based on the connection between the start point and the end point of the touch trajectory, and this line segment can be recorded as a reference line segment. This step obtains the formed reference line segment.

S403: Determine whether the touch trajectory is a linear trajectory according to each of the touch points and the reference line segment.

In this embodiment, the position coordinates of each touch point in the current display page required to form the touch track can be obtained. The reference line segment obtained by combining the position coordinates of each touch point can be determined by the set line shape determination rule. Whether the trajectory is presented as a linear trajectory. Exemplarily, this step can determine the angle value between the acquired reference line segment and the horizontal direction to determine whether the reference line segment is horizontal or approaching horizontal. At the same time, this step can also be based on the position coordinates of the touch point and the start of the reference line segment. The coordinates of the start point and the end point are used to determine the overall variance value of the touch trajectory, and the degree of overlap between the touch trajectory and the reference line segment is judged by the judgment of the overall variance value. When the reference line segment approaches or is a horizontal line segment and the overlap degree of the touch trajectory When it is higher, the touch trajectory can be regarded as a horizontal trajectory.

In one embodiment, FIG. 4b shows a flow chart for implementing the linear determination of the touch trajectory in the fourth embodiment of the present invention. For example, the touch point is determined based on the touch point constituting the touch trajectory and the reference line segment. Whether the trajectory is a linear trajectory can be realized in the manner shown in Fig. 4b, as shown in Fig. 4b, which includes:

S4031. Determine the horizontal included angle of the reference line segment.

Exemplarily, the angle value between the reference line segment and the horizontal direction can be determined according to the coordinate values of the start point and the end point of the reference line segment, and it is recorded as the horizontal angle.

S4032. Determine the overall variance value of the touch trajectory according to the position information of the touch point on the touch trajectory.

In this embodiment, according to the generation time of each touch event in the touch operation, the corresponding touch points of each touch event on the currently displayed page can be sampled sequentially, so as to obtain the position information of each touch point. The coordinates are compared with the abscissas of the starting point and ending point in the reference line segment to determine the variance variable value required for the overall variance calculation. The variance variable value corresponds to each touch point one by one, and then the variance calculation formula is substituted into the above mentioned value. Knowing the information, the overall variance value of the touch trajectory can be determined.

In one embodiment, the determining the overall variance value of the touch trajectory according to the position information of the touch points on the touch trajectory includes: sampling the touch points on the touch trajectory in time sequence, determining the total number of samples and Obtain the horizontal and vertical coordinates of each touch point in the currently displayed page; compare the horizontal coordinate of each touch point with the horizontal coordinate of the starting point and the horizontal coordinate of the end point of the reference line segment, and determine each touch point based on the comparison result. The value of the variance variable corresponding to the touch point; based on the overall variance calculation formula

Determining the overall variance touch track, wherein, σ ² represents the variance value of the overall touch track, N represents the total number of samples, the variance of the Y _i represents the i-th variable value corresponding to the touch point, [mu] represents the reference line segment The ordinate of the midpoint.

In this embodiment, the value of the aforementioned variance variable is mainly determined by comparing the abscissa of the touch point with the abscissa of the starting point and the ending point of the reference line segment. In an embodiment, the determining the variance variable value corresponding to each touch point based on the comparison result includes:

If there is a first touch point whose abscissa is smaller than the abscissa of the starting point, the variance variable value corresponding to each of the first touch points is determined to be the ordinate of the starting point of the reference line segment; if there is an abscissa greater than the abscissa of the end point For the second touch point, it is determined that the variance variable value corresponding to each second touch point is the ordinate of the end point of the reference line segment; if there is a third touch point whose abscissa is greater than the abscissa of the starting point and less than the abscissa of the end point , The ordinate of each third touch point is used to determine the corresponding variance variable value.

It is understandable that for the touch points of the formed touch track, there are some touch points whose abscissa may be smaller than the abscissa of the starting point. At this time, the variance variable values corresponding to these touch points are equivalent to the ordinate of the starting point of the reference line segment. ; There are also some touch points whose abscissa may be greater than the abscissa of the end point. At this time, the variance variable values corresponding to these touch points are equivalent to the ordinate of the end point of the reference line segment; and for the abscissa where the abscissa is between the start point and the end point For the touch point between the abscissas, the variance variable value is its ordinate.

S4033: If the horizontal included angle is less than the set angle value and the overall variance value is less than the set threshold value, determine that the touch track is a linear track.

It can be understood that the purpose of comparing the horizontal included angle with the set angle value in this step is to determine whether the reference line segment is horizontal or a line segment approaching horizontal. The set angle value generally approaches 0; in this step , The purpose of comparing the overall variance value with the set threshold is to determine whether the touch trajectory overlaps or approaches the reference line segment.

In this embodiment, the selection of the set threshold is related to the sampling interval of sampling touch points. The denser the sampling, the greater the amount of calculation required, and the greater the selection of the set threshold. This embodiment can be repeated in advance In the test, a value used to distinguish the linear trajectory from other graphics is obtained as the set threshold. In order to ensure the accuracy of the set threshold, a large amount of linear data can be selected for training in this embodiment, and the best obtained by training The value is used as the set threshold.

S404: When the touch track is a linear track, determine that the gesture type associated with the touch operation is drawing a line.

The above S403 and its extended steps realize the determination of whether the touch trajectory is a linear trajectory. In this step, when it is determined that the touch trajectory is a linear trajectory, the gesture type associated with the received touch operation can be regarded as drawing a line; otherwise, the gesture type can be regarded as the gesture type. It is not a line drawing, and the subsequent operations of this embodiment can be terminated at this time.

S405. When it is determined that the gesture type is drawing a line, display the touch track corresponding to the touch operation as a touch indicator.

In this embodiment, when the type of gesture associated with the touch operation is drawing a line, it can be determined that the touch trajectory formed by the touch operation is displayed in a line shape, so that the touch trajectory can be displayed as a touch indicator of the touch operation.

It should be noted that the following operations from S406 to S412 in this embodiment describe the implementation process of determining key information when the gesture type is line drawing. It can be found that the implementation of the following steps in this embodiment is basically the same as the implementation of determining key information when the gesture type is tapping in the second embodiment above, and the main difference lies in the determination of the initial hit area.

S406: Based on the start point and the end point of the reference line segment, a rectangular area is formed as a hit area.

In one embodiment, in this step, the horizontal coordinate span of the starting point and ending point of the reference line segment can be used as the width of the constructed rectangular area, and the vertical coordinate span of the starting point and ending point of the reference line segment can be taken as the height of the constructed rectangular area. In addition, this step can also form a circumscribed rectangle containing all touch points in the touch track, and use the circumscribed rectangle as the hit area.

It should be noted that in the course of teaching, when the teacher explains the key content, if the key content is marked by the gesture of drawing a line, the key content part may be drawn repeatedly during the teaching process. Therefore, this implementation For example, if it is detected that the gesture types associated with the touch operation received within a certain period of time are all drawing lines, the touch trajectory formed in this period of time can be used as a linear trajectory for determining key information at the same time, and subsequent key information determination can be performed together operating.

For the case of multiple linear trajectories at the same time, this step can obtain the starting point and ending point of the reference line segment corresponding to each linear trajectory, and then determine a circumscribed rectangle containing the starting point and ending point of all reference line segments, and determine the circumscribed rectangle Is the hit area.

S407: Obtain the associated rectangle of each element in the currently displayed page.

Illustratively, the associated rectangle in this embodiment is also equivalent to the corresponding rectangle that exists as the bottom layer of the element when the element is edited. When editing and forming each element in the currently displayed page, the rectangle information of the corresponding rectangle is also generated. Therefore, the related rectangle information of the associated rectangle can be directly obtained in this step. It is also understandable that this embodiment can select the associated rectangle as The circumscribed rectangle of the element with the added margin value.

S408: Search for overlapping associated rectangles that overlap with the hit area from the associated rectangles.

Exemplarily, this step can also search for overlapping associated rectangles that overlap with the hit area according to the rectangle information of each associated rectangle, and the conditions for satisfying the overlap also include: the area corresponding to the associated rectangle contains the hit area, or the associated rectangle corresponds to The area of is included in the hit area, or the area corresponding to the associated rectangle intersects a part of the hit area, etc.

S409: Add the elements corresponding to the overlapping associated rectangles to the set of elements by setting adding conditions.

Exemplarily, this step can also determine whether the element corresponding to the overlapping associated rectangle meets the set adding condition, and if so, add the element to the element set, where the set adding condition may also be: the element Has not been added to the element collection.

S410: Determine whether the total number of elements in the element set has changed, if yes, execute S411; if not, execute S412.

The same as the loop termination condition of the first embodiment, the same consideration is given to whether the total number of elements in the element set has changed. If it changes, the loop condition is considered to be satisfied and the subsequent S411 needs to be performed. If there is no change, the loop termination condition is considered to be satisfied. S412 can be executed.

S411: Use each overlapping associated rectangle as a hit area, and return to execution S408.

Exemplarily, each of the overlapping associated rectangles determined above may be used as a hit area, and return to S408 to continue to iteratively perform the element hit search operation.

S412: Determine and store an element in the element set as key information.

Exemplarily, in this step, the elements in the element set can also be screened first, and after the elements that do not meet the requirements are screened out, the elements in the element set can be determined as key information, and then each element can be stored and the original elements of each element Relevance to ensure the original display relationship of elements when retrieving key information.

S413: In response to the received editing operation acting on the target key information, display an editing page containing the target key information.

S414: When receiving the editing completion instruction, save the editing page.

Figure 4c shows an example diagram of determining gesture-associated elements in the fourth embodiment of the present invention. As shown in Figure 4c, the currently displayed page 40 contains elements of text type and graphic type. Based on the above-mentioned gesture type corresponding to when drawing a line In the step of determining the associated elements, the rectangular area 41 containing each linear trajectory can be determined first, and the rectangular area can be used as the initial hit area. At the same time, the associated rectangle of each element displayed in the current display page 40 can be obtained, such as "this "Just text" is the first associated rectangle 42 corresponding to the text box (element) of the displayed content, the second associated rectangle 43 corresponding to the line segment, the third associated rectangle 44 corresponding to the curve, etc. (the associated rectangles of all elements are not shown in the figure) .

The operation of determining the associated elements from the rectangular area 41 as the initial hit area can be described as: from the obtained associated rectangles of each element, it can be found that the associated rectangles overlapping the rectangular area 41 have a first associated rectangle 42 and a second associated rectangle. Rectangle 43; this can add the element (text box and its content) corresponding to the first associated rectangle 42 and the element (line segment) corresponding to the second associated rectangle 43 (at this time the element set is empty, that is, there is no such The determined element) is added to the element set. At this time, the total number of elements is 2, and the search can be continued if the change occurs; therefore, the first associated rectangle 42 and the second associated rectangle 43 can be used as new hit areas, respectively, It can be found that the associated rectangle that overlaps the first associated rectangle 42 is the third associated rectangle 44, and the associated rectangle that overlaps the second associated rectangle 43 is also the third associated rectangle 44, and the third associated rectangle 44 can be determined. The corresponding element is a curve, and the curve has not been added to the element set, so the curve can be added to the element set. At this time, the total number of elements is 3, and the search can continue to be performed if the change occurs; therefore, the first The three associative rectangles 44 are used as the new hit area. The associated rectangles that overlap with the third associated rectangle 44 are the first associated rectangle 42 and the second associated rectangle 43, and because the first associated rectangle 42 corresponds to the text box and the second associated rectangle. The line segments corresponding to the associated rectangle 43 already exist in the element set and will not be added repeatedly. At this time, the total number of elements is still 3, unchanged, and the search end condition is satisfied, and the search can be ended. Based on the above search, it is finally determined that when the teacher taps the rectangular area 41, the key information determined is the text box and its contained content, line segments and curves.

It is understandable that after the determination of the associated elements of the currently displayed page provided in Figure 4c is completed, the determined associated elements can be stored as key information. For example, the key information can be stored with the current display page as the basic unit. , In order to retain the original display relationship of the element in the current display page, Figure 4d shows an example diagram of the storage folder for storing key information, as shown in Figure 4d, in the storage folder 410, the first save page 420 The display form saves the key information in the currently displayed page provided in FIG. 4c. It can be found that in the first saved page 420, the text box as the key information and its contained content, line segments and curves are presented in the original display relationship.

For the stored key information, it can be directly edited by the teacher as a template, so as to bring more flexibility when the teacher makes the review content. The editable operation of the stored key information is also relieved to a certain extent. There is an error rate of information recognition errors when determining key information.

The fourth embodiment of the present invention provides a method for determining key information, which provides an operation for determining key information when the gesture type associated with a touch operation is line drawing. It first determines the determination process of the tap gesture, and then gives the drawing Line gestures perform the process of determining the set of elements, and finally realize the determination of key information. Based on this method, when the teacher uses the gesture of drawing a line to explain the key, it can accurately and quickly identify the key explanation content as the key information in the teaching content and store it, so as to ensure that only by calling the stored key information during subsequent lectures Realize the centralized presentation of the key explanation content, which not only avoids the cumbersome operation of the teacher when the key explanation content is displayed, but also ensures the complete review of the key explanation content, and better improves the user experience of intelligent teaching.

Example five

FIG. 5 is a schematic structural diagram of an apparatus for determining key information according to Embodiment 5 of the present invention. As shown in FIG. 5, the device for determining key information includes: a first response module 51, an element set determining module 52, a key information storage module 53, a second response module 54, and an editing storage module 55.

Wherein, the first response module 51 is configured to display a touch identifier corresponding to the touch operation in response to the received touch operation acting on the currently displayed page;

The element set determining module 52 is configured to determine a set of elements associated with the gesture type in the currently displayed page, and the currently displayed page contains at least one element;

The key information storage module 53 is used to determine and store the elements in the element set as key information;

The second response module 54 is configured to display an editing page containing the target key information in response to the received editing operation acting on the target key information, where the target key information is any key information in the set of elements element;

The edit storage module 55 is configured to save the edit page when receiving an edit completion instruction;

The elements include at least one of the following: text, graphic shapes, multimedia, and tables.

The technical solution provided in this embodiment can quickly identify and store the key information that is emphasized in the lecture content according to the touch operation used by the teacher during the key explanation during the lecture, thereby ensuring that the key information stored in the subsequent lectures is only called The information can realize the centralized display of the key explanation content, which not only avoids the cumbersome operation of the teacher when the key explanation content is displayed, but also ensures the complete review of the key explanation content, and better improves the user experience of intelligent teaching.

In an embodiment, the first response module 51 includes:

The gesture type determining unit is configured to determine the received gesture type associated with the touch operation on the currently displayed page, and display the touch identifier corresponding to the gesture type.

In an embodiment, the gesture type determining unit includes:

The operation monitoring subunit is used to determine that a touch operation is received when an event combination including a touch down event and a touch up event is monitored;

The information acquisition subunit is configured to acquire touch information of each touch operation if at least three touch operations are received within a set time period;

The first determining subunit is configured to determine that the gesture type associated with the at least three touch operations is tapping if the touch information of each touch operation meets the first determination condition and two adjacent touch operations meet the second determination condition ；

The mark display subunit is used to display the touch points corresponding to each of the touch operations as touch marks when determining that the gesture type is tapping.

Based on the above optimization, the touch information of the touch operation includes: the first generation time and the first generation position of the touch-down event, and the second generation time and the second generation position of the touch-up event;

In an embodiment, the element set determining module 52 is specifically configured to:

Based on the at least three touch operations respectively acting on the touch points in the currently displayed page, a circular area is formed as a hit area; the associated rectangle of each element in the currently displayed page is obtained; and each associated rectangle is searched There are overlapping associated rectangles that overlap with the hit area; the elements corresponding to each of the overlapping associated rectangles are added to the element set according to the set adding conditions; if the total number of elements in the element set changes, each The overlapping associated rectangles are respectively used as hit areas, and the overlapping search and element addition operations are performed until the total number of elements does not change.

In an embodiment, the gesture type determining unit further includes:

A trajectory acquisition subunit, configured to sample all touch points corresponding to the touch operation on the currently displayed page, and acquire a touch trajectory formed based on each of the touch points;

The circle shape determination subunit is configured to determine, according to each of the touch points, whether the touch trajectory includes a circle trajectory and whether the number of circles included meets a set condition;

The second determining subunit is configured to determine that the gesture type associated with the touch operation is circle drawing when the touch trajectory includes a circle-shaped trajectory and the number of included circles meets a set condition;

The mark display subunit is further configured to display the touch track corresponding to the touch operation as a touch mark when it is determined that the gesture type is drawing a circle.

On the basis of the above optimization, the ring shape determination subunit is specifically used for:

Determine the distance value from each touch point to the set reference point as the judgment distance value of each touch point; select the judgment distance value of each touch point in turn to compare with the third distance threshold; when there is a continuous setting When the determined distance value of the touch point is greater than the third distance threshold, it is determined whether there is a target touch point subsequently and the determined distance value is less than or equal to the third distance threshold; if it exists, it is determined that the touch track includes a circle-shaped track, Add 1 to the number of laps containing the circle track, and return to perform the distance value judgment operation until the touch point corresponding to the currently selected judgment distance value is the touch end point; if the determined number of laps is greater than or equal to the set value, determine all The number of turns meets the set conditions.

Based on each of the touch points of the touch operation, a closed polygonal graphic is formed; obtaining the associated rectangle of each element in the currently displayed page; selecting an edge from the unselected edge set of the polygonal graphic as the hit edge; Search for a target associated rectangle that satisfies the inclusion relationship with the hit edge in each of the associated rectangles; add the element corresponding to each target associated rectangle to the element set under a set condition, and return to perform the hit edge selection operation until the hit is met Termination condition; wherein, the termination condition is that the unselected edge set is empty, or the total number of elements in the element set remains unchanged.

In an embodiment, the gesture type determining unit includes:

A reference line segment determining subunit for obtaining a reference line segment formed based on the connection between the starting point and the ending point in the touch track;

The linear determination subunit is used to determine whether the touch trajectory is a linear trajectory according to each of the touch points and the reference line segment;

The third determining subunit is configured to determine that the gesture type associated with the touch operation is drawing a line when the touch trajectory is a linear trajectory;

The mark display subunit can also be used to display the touch track corresponding to the touch operation as a touch mark when it is determined that the gesture type is drawing a line.

On the basis of the above optimization, the linear judging subunit includes:

The included angle determination subunit is used to determine the horizontal included angle of the reference line segment; the variance value determination subunit is used to determine the overall variance value of the touch track according to the position information of the touch point on the touch track; The linear determination subunit is configured to determine that the touch track is a linear track when the horizontal included angle is less than a set angle value and the overall variance value is less than a set threshold.

In an embodiment, the variance value determining subunit is specifically used for:

Sampling the touch points on the touch track in time sequence, determine the total number of samples, and obtain the horizontal and vertical coordinates of each touch point in the currently displayed page; compare the horizontal and vertical coordinates of each touch point with the starting point of the reference line segment The abscissa and the abscissa of the end point are compared, and the variance variable value corresponding to each touch point is determined based on the comparison result; based on the overall variance calculation formula

Determining the overall variance touch track, wherein, σ ² is the variance value of the overall touch track, N represents the total number of samples, the variance of the Y _i represents the i-th variable value corresponding to the touch point, [mu] represents the reference line segment The ordinate of the midpoint.

On the basis of the above optimization, the determination of the variance variable value corresponding to the abscissa of each touch point based on the comparison result specifically includes: if there is a first touch point whose abscissa is smaller than the abscissa of the starting point, determining each of the first touch points The variance variable value corresponding to the touch point is the ordinate of the starting point of the reference line segment; if there is a second touch point whose abscissa is greater than the abscissa of the end point, it is determined that the variance variable value corresponding to each second touch point is the The ordinate of the end point of the reference line segment; if there is a third touch point whose abscissa is greater than the abscissa of the start point and less than the abscissa of the end point, the ordinate of each third touch point is determined to the corresponding variance variable value.

In one embodiment, the element set determining module 53 is specifically configured to: form a rectangular area as a hit area based on the start point and end point of the reference line segment; obtain the associated rectangle of each element in the currently displayed page; In each of the associated rectangles, find overlapping associated rectangles that overlap with the hit area; add the elements corresponding to each of the overlapping associated rectangles to the element set; if the total number of elements in the element set changes, add each The overlapping associated rectangles are respectively used as hit areas, and the overlapping search and element addition operations are performed back until the total number of elements does not change.

In an embodiment, the device further includes:

The element screening module is configured to filter the elements in the element set according to preset element tags before determining the elements in the element set as key information and storing them, and delete the element tags as elements that temporarily generate content.

The key information determining device provided in this embodiment can be used to execute the key information determining method provided in any of the foregoing embodiments, and has corresponding functions and beneficial effects.

Example Six

FIG. 6 is a schematic structural diagram of a key information determining device provided by Embodiment 6 of the present invention. The key information determining device includes a processor 60, a memory 61, a display screen 62, an input device 63, and an output device 64. The key information determines that the number of processors 60 in the device may be one or more. One processor 60 is taken as an example in FIG. 6. The key information determining device may have one or more memories 61, and one memory 61 is taken as an example in FIG. 6. The key information determines that the processor 60, the memory 61, the display screen 62, the input device 63, and the output device 64 of the device may be connected by a bus or other methods. In FIG. 6, the connection by a bus is taken as an example. In the embodiment, the key information determining device may be a computer, a mobile phone, a tablet, or a smart teaching tablet.

As a computer-readable storage medium, the memory 61 can be used to store software programs, computer-executable programs, and modules, such as the program instructions/modules corresponding to the key information determining device according to any embodiment of the present invention (for example, the key information determining device). The first response module 51, the element set determination module 52, the key information storage module 53, the second response module 54 and the editing storage module 55) in the. The memory 61 may mainly include a program storage area and a data storage area. The program storage area may store an operating system and an application program required by at least one function; the data storage area may store data created according to the use of the device, and the like. In addition, the memory 61 may include a high-speed random access memory, and may also include a non-volatile memory, such as at least one magnetic disk storage device, a flash memory device, or other non-volatile solid-state storage devices. In some examples, the memory 61 may further include a memory remotely provided with respect to the processor 60, and these remote memories may be connected to the device through a network. Examples of the aforementioned networks include but are not limited to the Internet, corporate intranets, local area networks, mobile communication networks, and combinations thereof.

The display screen 62 may be a display screen 62 with a touch function, which may be a capacitive screen, an electromagnetic screen or an infrared screen. Generally speaking, the display screen 62 is used to display data according to the instructions of the processor 60, such as displaying the specific teaching content of the currently displayed page, the content temporarily added by the teacher during the teaching process, and the touch operation formed by the gesture when the teacher focuses on the explanation. The touch track, etc., are also used to receive touch operations on the display 62 and send corresponding signals to the processor 60 or other devices.

The input device 63 can be used to receive input digital or character information, and to generate key signal input related to user settings and function control of the display device. It can also be a camera for acquiring images and a pickup device for acquiring audio data. The output device 64 may include audio equipment such as speakers. It should be noted that the specific composition of the input device 63 and the output device 64 can be set according to actual conditions.

The processor 60 executes various functional applications and data processing of the device by running the software programs, instructions, and modules stored in the memory 61, that is, realizes the aforementioned method for determining key information.

The key information determining device provided above can be used to execute the key information determining method provided in any of the foregoing embodiments, and has corresponding functions and beneficial effects.

Example Seven

The seventh embodiment of the present invention also provides a storage medium containing computer-executable instructions. The computer-executable instructions are used to execute a method for determining key information when executed by a computer processor, including:

Determine and store the elements in the element set as key information;

When receiving the edit completion instruction, save the edit page;

Of course, a storage medium containing computer-executable instructions provided by an embodiment of the present invention is not limited to the operation of the key information determination method described above, and can also execute the key information provided by any embodiment of the present invention. Determine the relevant operations in the method, and have corresponding functions and beneficial effects.

Through the above description of the embodiments, those skilled in the art can clearly understand that the present invention can be implemented by software and necessary general-purpose hardware. Of course, it can also be implemented by hardware, but in many cases the former is a better implementation. . Based on this understanding, the technical solution of the present invention can be embodied in the form of a software product, which can be stored in a computer readable storage medium, such as a computer floppy disk. , Read-Only Memory (ROM), Random Access Memory (RAM), Flash memory (FLASH), hard disk or optical disk, etc., including several instructions to make a computer device (which can be a robot, A personal computer, a server, or a network device, etc.) execute the method for determining key information according to any embodiment of the present invention.

It is worth noting that the various units and modules included in the above key information determining device are only divided according to functional logic, but are not limited to the above division, as long as the corresponding function can be realized; in addition, each functional unit The specific names are only for the convenience of distinguishing each other, and are not used to limit the protection scope of the present invention.

It should be understood that each part of the present disclosure can be implemented by hardware, software, firmware or a combination thereof. In the above embodiments, multiple steps or methods can be implemented by software or firmware stored in a memory and executed by a suitable instruction execution system. For example, if it is implemented by hardware, as in another embodiment, it can be implemented by any one or a combination of the following technologies known in the art: a logic gate circuit for implementing logic functions on data signals Discrete logic circuits, application-specific integrated circuits with suitable combinational logic gates, programmable gate array (PGA), field programmable gate array (FPGA), etc.

In the description of this specification, descriptions with reference to the terms "one embodiment", "some embodiments", "examples", "specific examples", or "some examples" etc. mean specific features described in conjunction with the embodiment or example , Structure, materials or features are included in at least one embodiment or example of the present invention. In this specification, the schematic representation of the above-mentioned terms does not necessarily refer to the same embodiment or example. Moreover, the described specific features, structures, materials or characteristics may be combined in any one or more embodiments or examples in a suitable manner.

Claims

A method for determining key information, including:

In response to the received touch operation acting on the currently displayed page, displaying the touch identifier corresponding to the touch operation;

Determining the set of elements associated with the touch identifier in the currently displayed page, and the currently displayed page contains at least one element;

Determine and store the elements in the element set as key information;

In response to the received editing operation acting on the target key information, displaying an editing page containing the target key information, where the target key information is any element in the set of elements that is used as key information;

When receiving the edit completion instruction, save the edit page;

Wherein, the element includes at least one of the following: text, graphic shape, multimedia, and table.
The method according to claim 1, wherein, in response to a received touch operation acting on the currently displayed page, displaying the touch identifier corresponding to the touch operation comprises:

Determine the received gesture type associated with the touch operation on the currently displayed page, and display the touch identifier corresponding to the gesture type.
The method according to claim 2, wherein the determining the received gesture type associated with the touch operation acting on the currently displayed page and displaying the touch identifier corresponding to the gesture type comprises:

When an event combination including a touch down event and a touch up event is monitored, it is determined that a touch operation is received;

If at least three touch operations are received within the set time period, acquiring touch information of each of the touch operations;

If each of the touch information satisfies the first determination condition and two adjacent touch operations satisfy the second determination condition, determining that the gesture type associated with the at least three touch operations is tap;

When it is determined that the gesture type is tapping, a touch point corresponding to each touch operation is displayed as a touch indicator.
The method according to claim 3, wherein the touch information of the touch operation comprises: a first generation time and a first generation position of a touch-down event, and a second generation time and a second generation position of the touch-up event;

The first determination condition is: the difference between the second generation time and the corresponding first generation time is less than a first time threshold, and the position difference between the second generation position and the first generation position is less than a first distance threshold;

The second determination condition is that the time difference between the next touch operation and the previous touch operation is less than the second time threshold, and the distance difference between the next touch operation and the previous touch operation is less than the second distance threshold.
The method according to claim 3, wherein the determining the set of elements associated with the touch identifier in the currently displayed page comprises:

Forming a circular area as a hit area based on the touch points of the at least three touch operations respectively acting on the currently displayed page;

Acquiring the associated rectangle of each element in the currently displayed page;

Searching for overlapping associated rectangles that overlap with the hit area from each of the associated rectangles;

Adding the elements corresponding to each of the overlapping associated rectangles to the element set by setting adding conditions;

If the total number of elements in the element set changes, each of the overlapping associated rectangles is used as a hit area, and the overlap search and element addition operations are performed back until the total number of elements does not change.
The method according to claim 1, wherein the determining the received gesture type associated with the touch operation acting on the currently displayed page, displaying a touch identifier corresponding to the gesture type, and determining the gesture type associated with the received touch operation ,include:

Sample all touch points corresponding to the touch operation on the currently displayed page, and obtain a touch track formed based on each touch point;

According to each of the touch points, determine whether the touch trajectory includes a circle-shaped trajectory and whether the number of laps included meets a set condition;

If yes, determine that the gesture type associated with the touch operation is circle drawing;

When it is determined that the gesture type is drawing a circle, the touch track corresponding to the touch operation is displayed as a touch indicator.
The method according to claim 6, wherein the determining whether the touch trajectory includes a circle-shaped trajectory and whether the included circle number meets a set condition according to each of the touch points comprises:

Determine the distance value from each of the touch points to the set reference point as the judgment distance value of each of the touch points;

The judgment distance value of each touch point is selected in turn for comparison with the third distance threshold;

When the determined distance value for the presence of a set continuous touch point is greater than the third distance threshold, determining whether there is a subsequent target touch point for determining the distance value is less than or equal to the third distance threshold;

If it exists, it is determined that the touch trajectory includes a circle-shaped trajectory, the number of laps including the circle-shaped trajectory is increased by 1, and the distance value judgment operation is returned until the touch point corresponding to the currently selected judgment distance value is the touch end point;

If the determined number of turns is greater than or equal to the set value, it is determined that the number of turns meets the set condition.
The method according to claim 6, wherein the determining the set of elements associated with the touch identifier in the currently displayed page comprises:

Forming a closed polygonal figure based on each of the touch points of the touch operation;

Acquiring the associated rectangle of each element in the currently displayed page;

Selecting an edge from the unselected edge set of the multilateral graphics as a hit edge;

Searching, from each of the associated rectangles, a target associated rectangle that satisfies the inclusion relationship with the hit edge;

Adding the elements corresponding to each of the target associated rectangles to the element set according to the set conditions, and returning to perform the hit edge selection operation until the hit termination condition is met;

Wherein, the termination condition is that the unselected edge set is empty, or the total number of elements in the element set remains unchanged.
The method according to claim 2, wherein the determining the received gesture type associated with the touch operation acting on the currently displayed page and displaying the touch identifier corresponding to the gesture type comprises:

Sample all touch points corresponding to the touch operation on the currently displayed page, and obtain a touch track formed based on each touch point;

Obtaining a reference line segment formed based on the connection between the starting point and the ending point in the touch track;

Determine whether the touch trajectory is a linear trajectory according to each of the touch points and the reference line segment;

If yes, determine that the gesture type associated with the touch operation is line drawing;

When it is determined that the gesture type is drawing a line, the touch track corresponding to the touch operation is displayed as a touch indicator.
9. The method according to claim 9, wherein the determining whether the touch trajectory is a linear trajectory according to each of the touch points and the reference line segment comprises:

Determine the horizontal included angle of the reference line segment;

Determine the overall variance value of the touch trajectory according to the position information of the touch point on the touch trajectory;

If the horizontal included angle is less than the set angle value and the overall variance value is less than the set threshold value, it is determined that the touch trajectory is a linear trajectory.
The method according to claim 9, wherein the determining the set of elements associated with the touch identifier in the currently displayed page comprises:

Based on the start point and the end point of the reference line segment, a rectangular area is formed as a hit area;

Acquiring the associated rectangle of each element in the currently displayed page;

Searching for overlapping associated rectangles that overlap with the hit area from each of the associated rectangles;

Adding elements corresponding to the overlapping associated rectangles to the element set;

If the total number of elements in the element set changes, each of the overlapping associated rectangles is used as a hit area, and the overlap search and element addition operations are performed back until the total number of elements does not change.
The method according to any one of claims 1-11, before determining and storing the elements in the element set as key information, further comprising:

The elements in the element set are filtered according to the preset element tags, and the element tags are deleted as elements that temporarily generate content.
A key information determining device includes:

The first response module is configured to display a touch mark corresponding to the touch operation in response to the received touch operation on the currently displayed page;

An element set determining module, configured to determine a set of elements associated with the gesture type in the currently displayed page, and the currently displayed page contains at least one element;

The key information storage module is used to determine and store the elements in the element set as key information;

The second response module is configured to display an editing page containing the target key information in response to the received editing operation acting on the target key information, where the target key information is any element in the set of elements that is used as key information ；

The edit storage module is used to save the edit page when receiving the edit completion instruction;

Wherein, the element includes at least one of the following: text, graphic shape, multimedia, and table.
A key information determining device, including: a memory, a display screen, and one or more processors;

The memory is used to store one or more programs;

The display screen is used to display the currently displayed page and the touch track corresponding to the touch operation;

When the one or more programs are executed by the one or more processors, the one or more processors implement the key information determining method according to any one of claims 1-12.
A storage medium containing computer-executable instructions, wherein the computer-executable instructions are used to execute the method for determining key information according to any one of claims 1-12 when executed by a computer processor.