WO2019033658A1

WO2019033658A1 - Method and apparatus for determining associated annotation information, intelligent teaching device, and storage medium

Info

Publication number: WO2019033658A1
Application number: PCT/CN2017/116762
Authority: WO
Inventors: 刘伟
Original assignee: 广州视源电子科技股份有限公司; 广州视睿电子科技有限公司
Priority date: 2017-08-18
Filing date: 2017-12-17
Publication date: 2019-02-21
Also published as: CN107479791A

Abstract

Disclosed are a method and apparatus for determining associated annotation information, an intelligent teaching device, and a storage medium. The method comprises: determining whether there is an annotation trigger label in a currently captured teaching blackboard writing image; if the annotation trigger label exists, determining a target to be annotated corresponding to the annotation trigger label; and invoking associated annotation information about the target to be annotated, and displaying and storing the associated annotation information on a display terminal of an intelligent teaching device. By means of the method, associated annotation information about important blackboard writing content can be automatically determined, thus effectively improving the teaching quality of a teacher, and preventing a listener from recording dictation of the teacher or recording simple blackboard writing annotation content in a lesson listening phase; moreover, displaying and storing associated annotation information and important content in blackboard writing content in an associated manner also facilitates the looking up of teaching information for a listener during after-school review of same.

Description

Method, device, intelligent teaching device and storage medium for associating annotation information

Technical field

The present invention relates to the field of electronic teaching technology, and in particular, to a method and device for determining associated annotation information, an intelligent teaching device, and a storage medium.

Background technique

In the tide of improving the classroom teaching environment of electronic education equipment, the functions of the teaching display terminal and the teaching writing board, such as the electronic whiteboard and the traditional blackboard provided by the touch screen terminal, have not changed greatly. When teaching the teaching board on the teaching tablet, the teacher usually labels and highlights the important contents of the teaching board.

Generally, when the instructor explains the important content in the teaching board, it is usually only an oral form of explanation, or a dictation form combined with a simple blackboard comment. When the lecturer records the interpretation information of the important content, even if the lecturer quickly records the interpretation information dictated by the teacher, there is a case where the record is incorrect or the record is broken. In addition, the rapid recording during the lectures is not convenient for the audience to fully understand the key content. At the same time, the incompleteness of the recorded information also brings inconvenience to the lecturer's after-school review.

Summary of the invention

The embodiment of the invention provides a method, a device, an intelligent teaching device and a storage medium for determining associated annotation information, so as to realize an associated annotation of the content of the to-be-interpreted blackboard in real time during the teaching process.

In a first aspect, an embodiment of the present invention provides a method for determining associated annotation information, including:

Determining whether there is a comment trigger flag in the currently captured teaching board image;

If the annotation trigger flag is present, determining the target to be annotated corresponding to the annotation trigger flag;

Calling the associated annotation information of the target to be annotated, and saving the associated interpretation information display Intelligent display device on the display terminal.

In a second aspect, an embodiment of the present invention provides a device for controlling information display, including:

a trigger mark determining module, configured to determine whether a comment trigger flag exists in the currently captured teaching board image;

An annotation target determining module, configured to determine, when the annotation trigger flag is present, a target to be annotated corresponding to the annotation trigger flag;

The associated information calling module is configured to invoke the associated annotation information of the target to be annotated;

The associated information display module is configured to save the associated interpretation information display on the display terminal of the intelligent teaching device.

In a third aspect, an embodiment of the present invention provides an intelligent teaching device, including: a display terminal, a writing board, and a camera, and further includes:

One or more processors;

a storage device for storing one or more programs;

The one or more programs are executed by the one or more processors, such that the one or more processors implement the associated annotation information determining method provided by the embodiments of the present invention.

In a fourth aspect, an embodiment of the present invention provides a computer readable storage medium, where a computer program is stored, and when the program is executed by the processor, the method for determining associated annotation information provided by the embodiment of the present invention is implemented.

In the above-mentioned associated annotation information determining method, apparatus, intelligent teaching apparatus and storage medium, the method first determines whether a comment triggering flag exists in the currently captured teaching board image; and then when there is a comment triggering flag, determining that the annotation triggering flag corresponds to Annotating the target; finally calling the associated annotation information of the target to be annotated, and saving the associated annotation information display on the display end of the intelligent teaching device On the end. The above technical solution can capture the image of the teaching board in real time, and determine the annotation mark added by the teacher by analyzing the image of the teaching board, so that the annotation information corresponding to the annotation mark can be called in real time and called on the display terminal. Show save. Based on the above scheme, the identification of the related annotation information of the keyboard contents is automatically realized, which effectively improves the teaching quality of the teaching staff, and avoids the recording of the dictation by the lecturer or the simple annotation content of the lecturer during the lecture stage, and in addition, the associated annotation The association between the information and the key content in the content of the blackboard is displayed and saved, and it is also convenient for the lecturer to review the teaching information during the class review.

DRAWINGS

1 is a schematic flowchart of a method for determining associated annotation information according to Embodiment 1 of the present invention;

2a is a schematic flowchart of a method for determining associated annotation information according to Embodiment 2 of the present invention;

2b is a diagram showing an effect display of a method for determining associated annotation information according to Embodiment 2 of the present invention;

3 is a structural block diagram of an associated annotation information determining apparatus according to Embodiment 3 of the present invention;

FIG. 4 is a schematic structural diagram of hardware of an intelligent teaching device according to Embodiment 4 of the present invention.

Detailed ways

The present invention will be further described in detail below with reference to the accompanying drawings and embodiments. It is understood that the specific embodiments described herein are merely illustrative of the invention and are not intended to limit the invention. It should also be noted that, for ease of description, only some, but not all, of the structures related to the present invention are shown in the drawings.

Embodiment 1

FIG. 1 is a schematic flowchart of a method for determining associated annotation information according to Embodiment 1 of the present invention, where The method is applicable to the case where the associated annotation information is determined for the key content of the teaching board content, and the method can be performed by the associated annotation information determining device, wherein the device can be implemented by software and/or hardware, and is generally integrated on the intelligent teaching device.

As shown in FIG. 1 , a method for determining associated annotation information according to Embodiment 1 of the present invention includes the following operations:

S101. Determine whether a comment trigger flag exists in the currently captured teaching board image.

In this embodiment, the teaching board image may specifically refer to an image including the content of the teaching board on the writing board, and the image capturing may be performed based on a camera on the smart teaching device. In this embodiment, the capture of the teaching board image may be performed in real time, or the corresponding image capturing may be performed based on the set capture period. The annotation triggering flag may specifically refer to a marker added to the writing board to highlight the key content of the blackboard when the user (teacher) needs to focus on the teaching board content on the writing board.

Illustratively, when the user needs to focus on a noun such as a "smart tablet" on the tablet, the tag can be added on the tablet corresponding to the term "smart tablet", and the added tag can be understood as Comment trigger tag.

Specifically, in this step, by performing image feature recognition on the captured teaching board image, it is determined whether there is an image feature similar to the annotation trigger mark in the captured teaching board image, and further forms an image area composed of the image feature. It is determined whether the annotation trigger flag actually exists in the teaching board image.

S102. If the annotation trigger flag is present, determine the target to be annotated corresponding to the annotation trigger flag.

In this embodiment, the object to be annotated may specifically refer to the content of the teaching board book to be mainly explained on the writing board, and is usually marked based on the comment triggering mark. Generally, the target to be annotated is often A word, a word, or a sentence in the content of a teaching board. In this embodiment, there are many tags that can be used as annotation trigger tags, such as underline tags, wavy line markers, or circle markers. It can be known that when different tags are used as annotation trigger tags, the determination of the target to be annotated corresponding to the annotation trigger tag may be different.

Specifically, when determining that the annotation trigger flag exists, the embodiment may further determine the marker pattern that the annotation trigger marker actually has, thereby determining the target to be annotated corresponding to the annotation trigger marker of the different marker style. Illustratively, assuming that the marker style of the annotation trigger marker is an underline marker, the teaching board content that is located above the underline corresponding to the start point of the underline to the end point range may be determined as the target to be annotated.

S103. Call the associated annotation information of the target to be annotated, and save the associated interpretation information display on the display terminal of the intelligent teaching device.

In the present embodiment, the character information can be identified by the target to be annotated, thereby determining the character information (which may be a letter or a letter) contained in the object to be annotated. The step of determining whether the character information included in the target to be annotated exists in the preset information base, and determining the associated annotation information corresponding to the target to be annotated according to the determination result, and making a corresponding call, wherein the information base can be understood as including more A database of character information and associated annotation information. At the same time, the associated annotation information after the call can be displayed in real time on the display terminal of the intelligent teaching device.

It can be understood that the display terminal of the smart teaching device can be connected in parallel with the writing board by the connecting firmware, or can be connected in parallel up and down. When there is an important board content to be interpreted on the writing board, the associated annotation information provided by the embodiment is used. The determining method can determine the interpretation information corresponding to the important board content (ie, the associated annotation information), whereby the determined interpretation information can be saved as the teaching information and displayed on the display terminal for the audience to consult.

The method for determining the associated annotation information provided by the first embodiment of the present invention can capture the image of the teaching board in real time, and determine the annotation mark added by the teacher by analyzing the image of the teaching board book, thereby real-time realizing the content to be annotated corresponding to the annotation mark The associated annotation information is called and displayed and saved on the display terminal. By using this method, the identification of the related annotation information of the key board contents is automatically realized, which effectively improves the teaching quality of the teaching staff, and avoids the recording of the dictation by the lecturer or the simple annotation content of the board in the lecture stage, and in addition, the associated annotation The association between the information and the key content in the content of the blackboard is displayed and saved, and it is also convenient for the lecturer to review the teaching information during the class review.

Embodiment 2

FIG. 2 is a schematic flowchart of a method for determining associated annotation information according to Embodiment 2 of the present invention. The embodiment of the present invention is optimized based on the foregoing embodiment. In this embodiment, it is determined whether there is a comment triggering flag in the currently captured teaching board image, and the specific optimization is: searching whether there is a preset in the currently captured teaching board image. Triggering a mark image feature; if present, determining a set image area of the teaching board image that includes the trigger mark image feature; identifying a teaching board content included in the set image area, and determining a previous teaching board Whether the teaching board content is included in the corresponding image area of the image; if included, determining that the annotation triggering flag exists in the teaching board image.

Further, the present embodiment optimizes the annotation trigger flag to include a circle trigger flag and a line trigger flag. On the basis of the above optimization, the embodiment determines the target to be annotated corresponding to the annotation trigger flag, and the optimization is specifically: If the comment triggering flag is a circle trigger flag, determining, in the teaching board image, the teaching board content included in the circle trigger flag as a target to be annotated; if the comment triggering flag is a linear trigger flag And determining, in the teaching board graphic, a teaching target book content that is within a set distance corresponding to the linear trigger mark.

Further, the embodiment further calls the associated annotation information of the target to be annotated, as follows: if there is a standard board content matching the target to be annotated in the preset annotation information base, the standard is The standard comment information corresponding to the board book content is determined as the associated comment information of the target to be annotated and called.

In addition, the embodiment also calls the associated annotation information of the target to be annotated, and is embodied as: if there is a standard board content matching the target to be annotated in the preset annotation information base, Searching for the target to be annotated, and determining the received search information as the associated interpretation information of the target to be annotated and calling.

As shown in FIG. 2a, a method for determining associated annotation information according to Embodiment 2 of the present invention specifically includes the following operations:

S201. Search for a preset trigger mark image feature in the currently captured teaching board image.

Specifically, in this embodiment, at least one marker pattern that can be used as a comment trigger marker can be selected in advance, and corresponding image features are set in advance for each marker pattern graphic, and the set image features are collectively recorded as trigger markers. Image features.

In this step, the image feature extraction may be performed on the currently captured teaching board image, and then the similarity calculation is performed on each of the triggering marker image features and the extracted image features. If it is determined that there is a portion in the extracted image features that has a similarity value greater than a set threshold. Image features, it can be considered that there is a trigger mark image feature in the currently captured teaching board image.

It can be understood that since there are size differences or slight shape differences when the user adds the same marker on the writing board, it is known that the image features of the graphics formed by the same marker in different teaching board images may be different. Therefore, when the trigger flag image feature determination is performed in this embodiment, the set threshold of the similarity value is set in advance to ensure accurate determination of whether the teaching board image exists. Trigger tag image features.

S202. If yes, determine a set image area in the teaching board image that includes the trigger mark image feature.

In this step, after determining that the trigger mark image feature is present, the set image area is further determined in the teaching board image according to the trigger mark image feature. The set image area may be specifically viewed as a marker pattern forming image area having a trigger mark image feature.

It can be known that the embodiment defines a large range of the area of the image area to be determined, thereby ensuring that the determined set image area can include, besides the marker pattern formed by the feature of the trigger mark image. Part of the board content in the image of the teaching board.

S203. Identify the teaching board content included in the set image area, and determine whether the teaching board content is included in a corresponding image area of the previous teaching board image.

Specifically, the step may identify the content of the teaching board book included in the determined setting image area; and determine the position of the image area in the currently captured teaching board image at the same position of the previous teaching board image. Corresponding to the image area; and whether or not the corresponding board content is included in the corresponding image area.

In this embodiment, the image of the last teaching board is specifically related to the currently captured teaching board image, and can be regarded as a teaching board image captured at a previous moment of capturing the current teaching board image. Generally, the content of the teaching board included in the image of the last teaching board often has a small difference from the content of the currently captured teaching board image.

S204. If included, determining that a comment trigger flag exists in the teaching board image.

Specifically, in this step, when the content of the above-mentioned recognized teaching board is included in the corresponding image area of the previous teaching board image, it is determined that the annotation triggering flag exists in the currently captured teaching board image.

It can be understood that the comment trigger flag is specifically used for marking the content of the key book to be interpreted. Generally, only the content of the key book to be interpreted is pre-existing, and then the mark is triggered by the comment trigger mark. It can be seen that, compared with the currently captured teaching board image, the content of the keyboard book to be explained must exist in the image of the teaching board book. If it does not exist, the marker formed by the triggering marker image feature may not be considered as the annotation triggering marker. conditions of.

S205. If the comment triggering flag is a circle trigger flag, determine, in the teaching board image, the teaching board content included in the circle trigger flag as a target to be annotated.

It can be known that the marker format corresponding to the trigger mark image feature in this embodiment may have a linear (wavy line or straight line, etc.) graphic, and may also have a circle shape (circle and elliptical circle, etc.), thereby implementing the present embodiment. The annotation trigger is marked as a circle trigger marker or a line trigger marker.

Specifically, if the marker corresponding to the trigger marker image feature is in the form of a circle in the teaching template image, the annotation trigger marker may be determined to be a circle trigger marker. At this time, this step can determine the specific position of the circle trigger mark in the teaching board image, whereby the teaching board content included in the circle trigger mark can be determined as the target to be annotated.

S206. If the comment triggering mark is a linear trigger mark, determine a target to be annotated in the teaching board book graphic that corresponds to the teaching board content within the set distance above the linear trigger mark.

Specifically, if the marker corresponding to the trigger marker image feature is in the form of a line in the teaching template image, the annotation trigger marker may be determined to be a linear trigger marker, such as a straight line or a downward wavy line. At this time, this step may determine an image area formed by the linear trigger mark in the teaching board image from the linear starting point to the linear end point, and may determine the content of the teaching board within the set distance within the image area corresponding to the linear trigger mark. To be annotated.

It can be understood that the embodiment sets the set distance to ensure that the linear trigger is positively matched. The content of a line of teaching materials on the mark from the starting point of the line to the end point of the line is determined as the target to be annotated, thereby ensuring the accuracy of the target to be annotated.

After the embodiment determines the target to be annotated based on the above steps, the call and display of the associated annotation information can be implemented by the operations of S207 to S210 described below.

S207. Determine whether there is a standard version of the book content that matches the target to be annotated in the preset comment information database, and if yes, execute S208; if not, execute S209.

In this embodiment, the annotation information base is preset, and the annotation information base may be specifically regarded as a database corresponding to the standard board content and the standard annotation information, wherein the standard board content may be a noun, a word or a sentence. The standard comment information is equivalent to a specific interpretation of a noun, word or sentence. In this step, the content of the teaching board included in the target to be annotated may be matched with the content of the standard blackboard in the annotation information base, and S208 is performed when the matching is successful or S209 is performed when the matching fails.

S208. Determine standard annotation information corresponding to the content of the standard blackboard book as the associated annotation information of the target to be annotated and call, and subsequently execute S210.

Specifically, the standard annotation information corresponding to the standard blackboard content matching the teaching board content included in the target to be annotated may be determined as the associated annotation information, and related calls may be made, and the associated annotation information may be subsequently displayed through S210.

S209. Search for the to-be-annotated target from the set network link, and determine the received search information as the associated interpretation information of the target to be annotated and invoke, and subsequently perform S210.

Specifically, when there is no matching standard blackboard content, the network search can be directly performed, thereby entering the setting network link, and searching for the target to be annotated as a keyword in the webpage corresponding to the setting network link. Generally, at least one search information corresponding to the target to be annotated can be obtained. The first search information received is determined as the associated interpretation information of the target to be annotated and the related call is made, and the associated annotation information may be subsequently displayed through S210.

S210. The related interpretation information display is saved on a display terminal of the intelligent teaching device.

Exemplarily, the related explanation information may be displayed on the display terminal based on the setting form, such as first highlighting the target to be annotated on the display terminal with a larger font, and then changing the line to display the target to be annotated in a smaller font. Associate annotation information.

It should be noted that, when there is no standard blackboard content matching the content of the teaching board book included in the object to be annotated in the annotation information base, after the related annotation information of the object to be annotated is determined based on the above S209, the to-be-annotated The content of the teaching board included in the target is added to the annotation information base as a new standard blackboard content, and the associated annotation information determined based on S209 is updated to the annotation information base to implement the update of the annotation information base.

FIG. 2b is a diagram showing an effect display of a method for determining associated annotation information according to Embodiment 2 of the present invention. As shown in FIG. 2b, the smart teaching device 200 includes a display terminal 21, a tablet 22, and a camera 23. Based on the method provided by the embodiment of the present invention, it can be determined that the annotation trigger flag 221 is currently present on the tablet 22, wherein the annotation trigger marker 221 is a circle trigger marker; the embodiment identifies the teaching board content included in the circle trigger marker. a "smart whiteboard" is determined as the target to be annotated 222; the associated annotation information 211 of the target to be annotated 222 can be further invoked, and the associated annotation information 211 is displayed on the display terminal 21, thereby realizing the associated annotation information in teaching Automatic synchronization display during the process.

A method for determining associated annotation information provided by the second embodiment of the present invention specifically describes the determining operation of the annotation triggering flag, and specifically describes the determining operation of the target to be annotated when different annotation triggering markers are performed, and specifically describes the target to be annotated. The determination operation of the associated annotation information. Based on the above operation, realizing the operation of associating the annotation information with the key content of the teaching board book content in real time, using the The method effectively improves the teaching quality of the instructor, and at the same time avoids the recording of the oral content of the lecturer or the simple annotation content of the lecturer during the lecture stage. In addition, the association between the associated annotation information and the key content in the content of the blackboard is saved and convenient. The lecturer reviews the teaching information during the class review.

Embodiment 3

FIG. 3 is a structural block diagram of an apparatus for determining associated annotation information according to Embodiment 3 of the present invention. The device is suitable for determining the related annotation information of the key content of the teaching board book, and the device can be implemented by software and/or hardware, and is generally integrated into the intelligent teaching device. As shown in FIG. 3, the apparatus includes: a trigger flag determining module 31, an annotation target determining module 32, an associated information calling module 33, and an associated information display module 34.

The triggering flag determining module 31 is configured to determine whether a comment triggering flag exists in the currently captured teaching board image;

An annotation target determining module 32, configured to determine, when the annotation triggering flag is present, a target to be annotated corresponding to the annotation triggering flag;

The association information invoking module 33 is configured to invoke the associated annotation information of the target to be annotated;

The associated information display module 34 is configured to save the associated interpretation information display on the display terminal of the smart teaching device.

In this embodiment, the device first determines whether the annotation trigger flag exists in the currently captured teaching board image by the trigger flag determining module 31; and then determines the annotation trigger by the annotation target determining module 32 when the annotation trigger flag is present. Marking the corresponding target to be annotated; then, the associated annotation information of the target to be annotated is invoked by the associated information invoking module 33; finally, the associated interpretation information display is saved by the associated information display module 34 on the display terminal of the intelligent teaching device.

The associated annotation information determining apparatus provided in the third embodiment of the present invention can automatically realize the determination of the associated annotation information of the keyboard contents, thereby effectively improving the teaching quality of the teacher, and avoiding the dictation or simpleness of the lecturer to the teacher during the lecture stage. In addition, the association between the annotation information and the key content in the content of the blackboard is displayed, and the teaching information of the lecturer during the class review is facilitated.

Further, the trigger flag determining module 31 is specifically configured to:

Finding whether there is a preset trigger mark image feature in the currently captured teaching board image; if yes, determining a set image area of the teaching board image that includes the trigger mark image feature; identifying the set image area And including the teaching board content, and determining whether the teaching board content is included in the corresponding image area of the previous teaching board image; if included, determining that the annotation triggering flag exists in the teaching board image.

Further, the annotation triggering flag includes a circle triggering flag and a line triggering flag; on the basis of the above optimization, the annotation target determining module 32 is specifically configured to:

When the annotation trigger flag is present, if the annotation trigger flag is a circle trigger flag, the teaching board content included in the circle trigger flag is determined as the target to be annotated in the teaching board image; The annotation triggering flag is a linear triggering flag, and the teaching board content corresponding to the set distance above the linear triggering marker is determined in the teaching board graphic to determine the target to be annotated.

In the embodiment, the associated information invoking module 33 is specifically configured to:

When there is a standard blackboard content matching the target to be annotated in the preset annotation information base, the standard annotation information corresponding to the standard blackboard content is determined as the associated annotation information of the target to be annotated and called.

In addition, the association information invoking the module 33 in this embodiment may be specifically used to:

When there is a standard blackboard content matching the target to be annotated in the preset annotation information base, the target to be annotated is searched from the set network link, and the received search information is determined as the target to be annotated. Associate the interpretation information and call it.

Embodiment 4

Embodiment 4 of the present invention provides an intelligent teaching device. FIG. 4 is a schematic diagram of a hardware structure of an intelligent teaching device according to Embodiment 4 of the present invention. As shown in FIG. 4, the intelligent teaching device provided by Embodiment 4 of the present invention, The display terminal 401, the writing board 402, and the camera 403 further include: a processor 404 and a storage device 405. The processor in the smart teaching device may be one or more, and one processor 404 is taken as an example in FIG. The display terminal, the writing board and the camera in the intelligent teaching device may be respectively connected to the processor and the storage device through a bus or other manner, and the processor and the storage device are also connected by a bus or other manner, and the bus is connected in FIG. For example.

It can be understood that the display terminal 401 and the tablet 402 can be two parts on a single unit, or two separate structures based on the splicing. In this embodiment, the display terminal 401 and the tablet 402 can be vertically divided or spliced. It can also be divided into left and right parallel or parallel stitching. In addition, in this embodiment, the camera 403 is disposed on the edge of the tablet, and the orientation of the camera 403 is mainly focused on the surface of the tablet 402 for capturing the content of the teaching board on the tablet 402 to form a teaching board image.

It should be noted that the teaching board image captured based on the camera 403 can be displayed on the display terminal 401 in real time by the control of the processor 404. It is also known that the associated annotation information of the target to be annotated determined in the teaching process of the embodiment can also be displayed on the display terminal 401 in real time, so that the teacher can perform the teaching on the tablet 402 during the teaching process. At the same time, the display of the associated annotation information is performed on the display terminal 401 for the key content in the board content.

The storage device 405 in the teaching device is used as a computer readable storage medium for storing one or more programs, and the program may be a software program, a computer executable program, and a module, such as an associated annotation provided by an embodiment of the present invention. Corresponding program instructions/modules in the information determining apparatus (for example, the modules shown in FIG. 3 include: a trigger flag determining module 31, an annotation target determining module 32, an associated information calling module 33, and an associated information display module 34). The processor 404 executes various functional applications and data processing of the teaching device by executing software programs, instructions, and modules stored in the storage device 405, that is, implementing the associated annotation information determining method in the above method embodiments.

The storage device 405 may include a storage program area and an storage data area, wherein the storage program area may store an operating system, an application required for at least one function; the storage data area may store data created according to usage of the device, and the like. Moreover, storage device 405 can include high speed random access memory, and can also include non-volatile memory, such as at least one magnetic disk storage device, flash memory device, or other non-volatile solid state storage device. In some examples, storage device 405 can further include memory remotely located relative to processor 404, which can be connected to the device over a network. Examples of such networks include, but are not limited to, the Internet, intranets, local area networks, mobile communication networks, and combinations thereof.

And, when one or more programs included in the teaching device are executed by the one or more processors 404, one of the programs can perform the following operations:

Determining whether there is a comment triggering mark in the currently captured teaching board image; if the comment triggering flag is present, determining the target to be annotated corresponding to the comment triggering mark; calling the associated annotation information of the target to be annotated, and The associated interpretation information display is saved on the display terminal of the intelligent teaching device.

In addition, an embodiment of the present invention further provides a computer readable storage medium, where a computer program is stored, and when the program is executed by the processor, the associated annotation provided by Embodiment 1 and Embodiment 2 of the present invention is implemented. The information determining method, wherein the method provided in the first embodiment includes: determining whether a comment triggering flag is present in the currently captured teaching board image; and if the annotation triggering flag is present, determining the annotation target corresponding to the annotation triggering flag; Invoking the associated annotation information of the target to be annotated, and saving the associated interpretation information display on the display terminal of the intelligent teaching device.

Through the above description of the embodiments, those skilled in the art can clearly understand that the present invention can be implemented by software and necessary general hardware, and can also be implemented by hardware, but in many cases, the former is a better implementation. . Based on such understanding, the technical solution of the present invention, which is essential or contributes to the prior art, may be embodied in the form of a software product, which may be stored in a computer readable storage medium, such as a floppy disk of a computer. , Read-Only Memory (ROM), Random Access Memory (RAM), Flash (FLASH), hard disk or optical disk, etc., including a number of instructions to make a computer device (can be a personal computer) The server, or network device, etc.) performs the methods described in various embodiments of the present invention.

It should be noted that, in the embodiment of the foregoing associated annotation information determining apparatus, each unit and module included is only divided according to functional logic, but is not limited to the above division, as long as the corresponding function can be implemented; The specific names of the functional units are also only for convenience of distinguishing from each other, and are not intended to limit the scope of protection of the present invention.

It should be noted that those skilled in the art can combine and combine the different embodiments or examples described in the specification and the features of the different embodiments or examples, without contradicting each other.

Note that the above are only the preferred embodiments of the present invention and the technical principles applied thereto. Those skilled in the art will appreciate that the present invention is not limited to the specific embodiments described herein, and that various modifications, changes and substitutions may be made without departing from the scope of the invention. Therefore, though The present invention is described in detail by the above embodiments, but the present invention is not limited to the above embodiments, and other equivalent embodiments may be included without departing from the scope of the present invention. It is determined by the scope of the appended claims.

Claims

A method for determining associated annotation information, comprising:

Determining whether there is a comment trigger flag in the currently captured teaching board image;

If the annotation trigger flag is present, determining the target to be annotated corresponding to the annotation trigger flag;

Invoking the associated annotation information of the target to be annotated, and saving the associated interpretation information display on the display terminal of the intelligent teaching device.
The method according to claim 1, wherein the determining whether the annotation trigger flag is present in the currently captured teaching board image comprises:

Finding whether there is a preset trigger mark image feature in the currently captured teaching board image;

If yes, determining a set image area of the teaching board image that includes the trigger mark image feature;

Identifying the teaching board content included in the set image area, and determining whether the teaching board content is included in a corresponding image area of the previous teaching board image;

If included, it is determined that there is a comment trigger flag in the teaching board image.
The method according to claim 1, wherein the annotation trigger flag comprises a circle trigger flag and a line trigger flag;

Correspondingly, the determining the target to be annotated corresponding to the annotation trigger flag comprises:

If the comment triggering flag is a circle trigger flag, determining, in the teaching board image, the teaching board content included in the circle trigger flag as a target to be annotated;

If the annotation trigger is marked as a linear trigger marker, the target to be annotated is determined in the teaching template graphic corresponding to the teaching board content within the set distance above the linear trigger marker.
The method according to claim 1, wherein the invoking the associated annotation information of the target to be annotated comprises:

If there is a standard blackboard content matching the target to be annotated in the preset annotation information base, the standard annotation information corresponding to the standard blackboard content is determined as the associated annotation information of the target to be annotated and called.
The method according to claim 1, wherein the invoking the associated annotation information of the target to be annotated comprises:

If there is a standard blackboard content matching the target to be annotated in the preset annotation information base, searching for the target to be annotated from the setting network link, and determining the received search information as the target to be annotated Associate the interpretation information and call it.
An associated annotation information determining apparatus, comprising:

a trigger mark determining module, configured to determine whether a comment trigger flag exists in the currently captured teaching board image;

An annotation target determining module, configured to determine, when the annotation trigger flag is present, a target to be annotated corresponding to the annotation trigger flag;

The associated information calling module is configured to invoke the associated annotation information of the target to be annotated;

The associated information display module is configured to save the associated interpretation information display on the display terminal of the intelligent teaching device.
The device according to claim 6, wherein the trigger flag determining module is specifically configured to:

Finding whether there is a preset trigger mark image feature in the currently captured teaching board image;

If yes, determining a set image area of the teaching board image that includes the trigger mark image feature;

Identifying the contents of the teaching board included in the set image area, and determining the image of the previous teaching board Whether the teaching board content is included in the corresponding image area;

If included, it is determined that there is a comment trigger flag in the teaching board image.
The apparatus according to claim 6, wherein said annotation trigger flag comprises a circle trigger flag and a line trigger flag;

Correspondingly, the annotation target determining module is specifically configured to:

When the annotation trigger flag is present, if the annotation trigger flag is a circle trigger flag, the teaching board content included in the circle trigger flag is determined as the target to be annotated in the teaching board image;

If the annotation trigger is marked as a linear trigger marker, the target to be annotated is determined in the teaching template graphic corresponding to the teaching board content within the set distance above the linear trigger marker.
An intelligent teaching device, comprising: a display terminal, a writing board and a camera, wherein the method further comprises:

One or more processors;

a storage device for storing one or more programs;

The one or more programs are executed by the one or more processors, such that the one or more processors implement the associated annotation information determining method of any one of claims 1-5.
A computer readable storage medium having stored thereon a computer program, wherein the program is executed by a processor to implement the associated annotation information determining method according to any one of claims 1-5.