WO2020015269A1

WO2020015269A1 - Annotation display method and apparatus, and intelligent interactive tablet

Info

Publication number: WO2020015269A1
Application number: PCT/CN2018/118233
Authority: WO
Inventors: 邱伟波
Original assignee: 广州视源电子科技股份有限公司; 广州视睿电子科技有限公司
Priority date: 2018-07-16
Filing date: 2018-11-29
Publication date: 2020-01-23
Also published as: CN108874292B; CN108874292A

Abstract

Disclosed are an annotation display method and apparatus, and an intelligent interactive tablet. The method comprises: detecting an annotation operation under an annotation state (S102), wherein the annotation operation is an operation received by an annotation layer, and the annotation layer is a transparent layer covering a content layer; displaying an annotation trajectory corresponding to the annotation operation (S104); determining a target area in the content layer according to the annotation trajectory (S106); extracting image information of the target area in the content layer (S108); determining, according to the annotation trajectory and the extracted image information, a target object corresponding to the annotation trajectory (S110); clearing the annotation trajectory (S112); and displaying the target object (S114). By means of the method, the effect of intelligently displaying an annotation is achieved.

Description

Annotation display method, device and intelligent interactive tablet

This application claims the priority of a Chinese patent application filed on July 16, 2018 with the Chinese Patent Office, application number 201810779592X, and application name "Annotation Display Method, Device, and Smart Interactive Tablet", the entire contents of which are incorporated herein by reference. in.

Technical field

The present application relates to the field of intelligent interactive tablets, and in particular, to an annotation display method and device, and an intelligent interactive tablet.

Background technique

An intelligent interactive tablet, also known as an interactive intelligent tablet, is an integrated device that uses touch technology to control the content displayed on the display tablet (display screen) and realize human-computer interaction. This device integrates multiple functions of projector, electronic whiteboard, curtain, sound, TV, video conference terminal, suitable for group communication occasions, centralized solution to remote audio and video communication during the meeting, and high-resolution display of conference documents in various formats , Video file playback, live audio, screen writing, file marking, saving, printing and distribution, and other systematic meeting requirements; meanwhile, it also has a built-in TV receiving function and surround sound, which can also meet the audio-visual entertainment needs after work. This kind of equipment is widely used in education and teaching, corporate meetings, commercial exhibitions and other fields, which can effectively improve the communication environment and enhance the efficiency of group communication.

After the intelligent interactive tablet triggers the annotation mode, a new annotation layer is created, the annotation layer is overlaid on the content layer, the annotation layer receives the user's annotation operation, and the display screen displays the annotation track corresponding to the annotation operation. However, there is a problem. For example, the user wants to make an annotation, so he touches the display screen with his hand or a pen and slides it. The annotation layer receives the user's annotation operation. The display screen shows the annotation track corresponding to the annotation operation, as shown in Figure 1. Seeing that the user wants to annotate a few words in the fourth line, he draws a triangle-like track. However, part of the track in the annotation track is displayed on the annotation layer corresponding to the third line of text. However, the third line of text is not the part that the user wants to annotate, which causes the annotation display to be unintelligent.

Summary of the invention

The main purpose of this application is to provide a method and device for displaying annotations and an intelligent interactive tablet, so as to solve the problem that annotations cannot be displayed intelligently in the prior art.

In order to achieve the above object, according to an aspect of one embodiment of the present application, a method for displaying an annotation is provided. The method includes: detecting an annotation operation in an annotation state, where the annotation operation is an operation received by an annotation layer. The annotation layer is a transparent layer overlaid on the content layer; displaying the annotation track corresponding to the annotation operation; determining a target area in the content layer according to the annotation track; extracting the content layer Image information of the target area in the above; determining a target object corresponding to the annotation trajectory according to the annotation trajectory and the extracted image information; clearing the annotation trajectory; and displaying the target object.

Optionally, determining a target area in the content layer according to the annotation track includes: determining position coordinates of pixels constituting the annotation track; and determining the location coordinates of pixel points constituting the annotation track target area.

Optionally, determining the target area according to the position coordinates of the pixel points constituting the annotation track includes: determining the position coordinates of the pixel points at the edges of the target area according to the position coordinates of the pixel points constituting the annotation track; Position coordinates of a pixel point at an edge of the target area determine the target area.

Optionally, determining the position coordinates of the pixel points at the edge of the target area according to the position coordinates of the pixel points constituting the annotation track includes: selecting edge position coordinates from the position coordinates of all the pixel points constituting the annotation track , The value of the abscissa or ordinate of the edge position coordinate is the largest or smallest coordinate value among the position coordinates of all the pixel points constituting the annotation track; the edge position coordinate is added to or subtracted from a preset value to obtain A position coordinate of a pixel point at an edge of the target region.

Optionally, before displaying the target object, the display position of the target object is determined according to the positions of the pixel points constituting the annotation track.

In order to achieve the above object, according to an aspect of one embodiment of the present application, an annotation display device is provided. The device includes: a detection unit configured to detect an annotation operation in an annotation state, and the annotation operation is an annotation map. The operation received by the layer, the annotation layer is a transparent layer overlaid on the content layer; the first display unit is configured to display the annotation track corresponding to the annotation operation; the first determination unit is configured to be based on the The annotation track determines the target area in the content layer; the extraction unit is configured to extract the image information of the target area in the content layer; the second determination unit is configured to be based on the annotation track and the extracted image information Determining a target object corresponding to the annotation track; a clearing unit configured to clear the annotation track; and a second display unit configured to display the target object.

Optionally, the first determining unit includes: a first determining sub-unit configured to determine position coordinates of pixels constituting the annotation trajectory; and a second determining sub-unit configured to determine according to the pixels constituting the annotation trajectory The position coordinates of the target area are determined.

Optionally, the second determining subunit includes: a first determining module configured to determine position coordinates of pixels on the edge of the target area according to position coordinates of pixels constituting the annotation track; a second determining module, It is set to determine the target area according to the position coordinates of the pixel points at the edges of the target area.

Optionally, the first determining module includes: a screening submodule configured to filter edge position coordinates from the position coordinates of all pixel points constituting the annotation track, and the horizontal position or vertical position of the edge position coordinates is The value is the largest or smallest coordinate value among the position coordinates of all pixels constituting the annotation track; the calculation sub-module is set to add or subtract the edge position coordinates and a preset value to obtain pixels at the edge of the target area The position coordinates of the point.

Optionally, the apparatus further includes: a third determining unit configured to determine, before the second display unit displays the target object, a position where the target object is displayed according to the positions of the pixel points constituting the annotation track .

In order to achieve the above object, according to an aspect of one embodiment of the present application, an intelligent interactive tablet is provided. The intelligent interactive tablet includes a bezel, a cover, a controller, and a display screen, and the controller is set to an annotation state. Next, an annotation operation is detected, the annotation operation is an operation received by the annotation layer, the annotation layer is a transparent layer overlaid on the content layer, and the display screen is set to display the annotation corresponding to the annotation operation Trajectory; the controller is further configured to determine a target area in the content layer according to the annotation trajectory; the controller is further configured to extract image information of the target area in the content layer; the control The controller is further configured to determine a target object corresponding to the annotation track according to the annotation track and the extracted image information; the controller is further configured to clear the annotation track; and the display screen is further configured to display the target object.

Optionally, the controller is configured to: determine position coordinates of pixels constituting the annotation track; and determine the target area according to position coordinates of pixels constituting the annotation track.

Optionally, the controller is configured to determine the position coordinates of the pixel points at the edge of the target area according to the position coordinates of the pixel points constituting the annotation track; and determine the position coordinates according to the position coordinates of the pixel points at the edge of the target area. The target area is described.

Optionally, the controller is configured to filter edge position coordinates from the position coordinates of all the pixel points constituting the annotation trajectory, and the value of the abscissa or ordinate of the edge position coordinates constitutes the annotation trajectory. The largest or smallest coordinate value among the position coordinates of all the pixel points of the pixel; adding or subtracting the edge position coordinates with a preset value to obtain the position coordinates of the pixel points at the edge of the target region.

Optionally, the controller is configured to: before displaying the target object, determine a display position of the target object according to a position of a pixel point constituting the annotation track.

In order to achieve the foregoing object, according to an aspect of one embodiment of the present application, a storage medium is provided, where the storage medium includes a stored program, and when the program runs, a device where the storage medium is located is controlled to execute the foregoing. Annotation display method.

In order to achieve the above object, according to one aspect of the present application, an intelligent interactive tablet is provided, which includes a memory and a processor, the memory is configured to store information including program instructions, and the processor is configured to control execution of the program instructions, When the program instructions are loaded and executed by the processor, the steps of the above-mentioned annotation display method are implemented.

In at least some embodiments of the present application, after entering the annotation mode, a new annotation layer is created. The annotation layer is a transparent layer and is overlaid on the content layer. The annotation layer receives the annotation operation, and the display screen displays the annotation corresponding to the annotation operation. Track, determine the target area in the content layer according to the annotation track, extract the image information of the target area in the content layer, determine the target object corresponding to the annotation track based on the annotation track and the extracted image information, clear the annotation track, display the target object, target Objects may be standardized graphics such as triangles, rectangles, circles, ellipses, or standardized lines such as straight lines and wavy lines. Because the image information of the content layer is considered in the process of determining the target object corresponding to the annotation track, the target object Accurately display the place where the user wants to make an annotation, and achieve the effect of intelligently displaying the annotation.

BRIEF DESCRIPTION OF THE DRAWINGS

The drawings constituting a part of the application are used to provide further understanding of the application. The schematic embodiments of the application and the description thereof are used to explain the application, and do not constitute an improper limitation on the application. In the drawings:

FIG. 1 is a schematic diagram showing an annotation according to the prior art; FIG.

2 is a flowchart of an optional annotation display method according to an embodiment of the present application;

3 is a schematic diagram showing an annotation according to an embodiment of the present application;

4 is a flowchart of another optional annotation display method according to an embodiment of the present application;

FIG. 5 is a schematic diagram showing an annotation according to the prior art; FIG.

6 is a schematic diagram showing a comment according to an embodiment of the present application;

FIG. 7 is a flowchart of another optional annotation display method according to an embodiment of the present application; FIG.

FIG. 8 is a schematic diagram of an optional annotation display device according to an embodiment of the present application.

detailed description

It should be noted that, in the case of no conflict, the embodiments in the present application and the features in the embodiments can be combined with each other. The application will be described in detail below with reference to the drawings and embodiments.

In order to enable those skilled in the art to better understand the solutions of the present application, the technical solutions in the embodiments of the present application will be described clearly and completely in combination with the drawings in the embodiments of the present application. Obviously, the described embodiments are only Examples are part of this application, but not all examples. Based on the embodiments in this application, all other embodiments obtained by a person of ordinary skill in the art without creative efforts should fall within the protection scope of this application.

It should be noted that the terms “first” and “second” in the specification and claims of the present application and the above-mentioned drawings are used to distinguish similar objects, and are not necessarily used to describe a specific order or sequence. It should be understood that the data used in this way may be interchanged where appropriate, so that the embodiments of the present application described herein. Furthermore, the terms "including" and "having" and any of their variations are intended to cover non-exclusive inclusions, for example, a process, method, system, product, or device that includes a series of steps or units need not be limited to those explicitly listed Those steps or units may instead include other steps or units not explicitly listed or inherent to these processes, methods, products or equipment.

FIG. 2 is a flowchart of an optional annotation display method according to an embodiment of the present application. As shown in FIG. 2, the method includes the following steps:

Step S102: In the annotation state, an annotation operation is detected. The annotation operation is an operation received by the annotation layer, and the annotation layer is a transparent layer overlaid on the content layer.

The comment status can be in comment mode. In the annotation state, there are an annotation layer and a content layer. The annotation layer is a transparent layer overlaid on the content layer. The size of the annotation layer and the content layer can be equal. The annotation operation may be an operation in which the user touches the display screen with a hand or a pen.

Step S104: Display the annotation track corresponding to the annotation operation.

After an annotation operation is detected, the annotation track corresponding to the annotation operation is displayed on the display. The annotation track corresponding to the annotation operation may be an irregular figure or a line type.

Step S106: Determine a target area in the content layer according to the annotation track.

Step S106 may specifically be: determining a target area in the content layer according to the position of the annotation track.

Step S108: Extract the image information of the target area in the content layer.

Step S110: Determine a target object corresponding to the annotation track according to the annotation track and the extracted image information.

The target object may be a standardized graphic, such as a triangle, a rectangle, a circle, an oval, or the like, and the target object may also be a standardized line, such as a straight line or a wavy line.

The target object corresponding to the annotation track is determined according to the annotation track and the extracted image information, and at least includes determining whether the type of the target object is a graphic or a line. If it is determined that the type of the target object is a graphic, the size of the target object also needs to be determined.

Step S112: Clear the annotation track.

Step S114: Display the target object.

The annotation trajectory is shown in Figure 1. The target object corresponding to the annotation trajectory is determined by the fitting method as a triangle. The size of the triangle is determined based on the extracted image information. The size of the triangle can ensure that the triangle is displayed in the fourth line of text. Annotation layer, but not on the annotation layer corresponding to the third line of text, as shown in Figure 3.

As an optional embodiment, before step S114, determining the position where the target object is displayed in the annotation layer may be: determining the position where the target object is displayed in the annotation layer according to the positions of the pixels constituting the annotation track, Specifically, there are multiple methods, for example, method one: establishing a coordinate system in the annotation layer, determining the position coordinates of the pixels constituting the annotation track, and taking the mean value of the abscissa and the ordinate of the pixels constituting the annotation track, respectively, Get X0 and Y0, and use X0 and Y0 as the coordinates of the geometric center of the target object in the annotation layer; Method 2: Establish a coordinate system on the annotation layer, determine the position coordinates of the pixels that make up the annotation track, and filter out all pixels Among the points, the pixel with the largest abscissa (assuming the abscissa is X1), the pixel with the smallest abscissa (assuming the abscissa is X2), the pixel with the largest ordinate (assuming the ordinate is Y1), and the pixel with the smallest ordinate (Assuming the ordinate is Y2), find the average of X1 and X2 to get X3; find the average of Y1 and Y2 to get Y3, and use X3 and Y3 as the geometric center of the target object in the annotation layer coordinate of.

In the embodiment of the present application, after entering the annotation mode, a new annotation layer is created. The annotation layer is a transparent layer and is overlaid on the content layer. The annotation layer receives the annotation operation, and the display screen displays the annotation track corresponding to the annotation operation. Determine the target area in the content layer according to the annotation track, extract the image information of the target area in the content layer, determine the target object corresponding to the annotation track based on the annotation track and the extracted image information, clear the annotation track, display the target object, and the target object may be It is a standardized figure such as a triangle, rectangle, circle, ellipse, or a standard line such as a straight line or a wavy line. Because the image information of the content layer is considered in the process of determining the target object corresponding to the annotation trajectory, the target object is accurately It is displayed in the place where the user wants to make an annotation, and the effect of intelligently displaying the annotation is achieved. In addition, because the target object is a standardized graphic or standardized line, the display effect of the annotation is very beautiful.

Optionally, determining the target area in the content layer according to the annotation track includes: determining position coordinates of pixels constituting the annotation track; and determining the target area according to the position coordinates of pixels constituting the annotation track.

There are many ways to determine the target area based on the position coordinates of the pixels that make up the annotation track. For example, the position coordinates of the pixels at the edges of the target area can be determined first, and then the target area is determined according to the position coordinates of the pixels at the edges of the target area. Specifically, for example, the position coordinates of all the pixels constituting the annotation trajectory are filtered out. The value of the edge position coordinate, the abscissa or the ordinate value of the edge position coordinate is the largest or smallest coordinate value among the position coordinates of all the pixels constituting the annotation track; the edge position coordinates are added to or subtracted from a preset value to obtain the target Position coordinates of pixels at the edge of the area.

FIG. 4 is a flowchart of another optional annotation display method according to an embodiment of the present application. As shown in FIG. 4, the method includes the following steps:

Step S200: Enter the comment mode.

Step S201: Create a new annotation layer, and the original display screen is the background layer.

The annotation layer is a transparent layer overlaid on the content layer.

Step S202: A touch point Down event is detected.

The moment the user touches the display with his hand or pen, a touch point Down event is generated. The user touches the display screen with a hand or a pen, and moves from one position of the display screen to another position of the display screen, and generates a touch point Move event. When the user's hand or pen leaves the display, a touch point Up event is generated.

Step S203: A touch event is detected, and the current track is displayed in real time.

For example, when it is detected that the user's hand or pen is sliding on the display screen, the current trajectory is displayed in real time, as shown in FIG. 5.

Step S204: A touch point Up event is detected.

Step S205: Determine the line or image to be generated according to the input track and the background layer information.

The input trajectory is fitted to obtain a standardized figure or line corresponding to the input trajectory. If the fitting results indicate that the input trajectory is a graph, you also need to calculate the size of the graph.

Step S206: In the annotation layer, delete the newly input original track.

Step S207: In the annotation layer, a new standardized graphic or line is generated, as shown in FIG.

Step S208 may be that the user continues to perform other operations, such as writing on the display screen, drawing, and the like.

Step S209: Exit the annotation mode.

7 is a flowchart of another annotation display method according to an embodiment of the present application. As shown in FIG. 7, after entering the annotation mode, a new annotation layer is created, the annotation layer is a transparent layer, and the annotation layer is overlaid on the content map. On layers, the annotation layer receives annotation operations. In the annotation layer, the cutout is centered on the original touch track, and the horizontal and vertical coordinates of the pixels on the original touch track are increased by 100 units, respectively, to obtain the area Zoom1. The OpenCV correlation fitting algorithm is used to fit the original touch trajectory, and the fitting result is obtained. The fit results may be line types, triangles, quadrilaterals, circles, or unrecognizable graphics or lines. If the fitting result is a line type, according to the coordinates of the area where Zoom1 is located, the area Zoom2 is extracted from the background layer, and the areas of the areas Zoom2 and Zoom1 may be equal. According to the distribution of the pixels constituting the original touch trajectory, the line is determined to be a sliding straight line, a sliding wavy line, or a straight line is deleted, and the determined line is output. If the fitting result is a triangle, it is judged as an equilateral triangle or an ordinary triangle according to the length of the three sides, and the determined triangle is output. If the fitting result is a quadrangle, it is judged as a square or a rectangle according to the length of the four sides, and the determined square or rectangle is output. If the fitting result is a circle, it is judged as a circle or an ellipse according to the length of the long axis and the short axis, and the determined circle or ellipse is output. If the fitting result is an unrecognizable figure or line, the original figure or line is output.

In the embodiment of the present application, after entering the annotation mode, a new annotation layer is created. The annotation layer is a transparent layer and is overlaid on the content layer. The annotation layer receives the annotation operation, and the display screen displays the annotation track corresponding to the annotation operation. Determine the target area in the content layer according to the annotation track, extract the image information of the target area in the content layer, determine the target object corresponding to the annotation track based on the annotation track and the extracted image information, clear the annotation track, display the target object, and the target object may be It is a standardized figure such as a triangle, rectangle, circle, ellipse, or a standard line such as a straight line or a wavy line. Because the image information of the content layer is considered in the process of determining the target object corresponding to the annotation trajectory, the target object is accurately It is displayed in the place where the user wants to make an annotation, and the effect of intelligently displaying the annotation is achieved.

FIG. 8 is a schematic diagram of an optional annotation display device according to an embodiment of the present application. As shown in FIG. 8, the device includes: a detection unit 10, a first display unit 20, a first determination unit 30, an extraction unit 40, The second determination unit 50, the clearing unit 60, and the second display unit 70.

The detection unit 10 is configured to detect an annotation operation in an annotation state. The annotation operation is an operation received by the annotation layer, and the annotation layer is a transparent layer overlaid on the content layer.

The first display unit 20 is configured to display an annotation track corresponding to the annotation operation.

The first determining unit 30 is configured to determine a target area in the content layer according to the annotation track.

The extraction unit 40 is configured to extract image information of a target area in the content layer.

The second determining unit 50 is configured to determine a target object corresponding to the annotation track according to the annotation track and the extracted image information.

The clearing unit 60 is configured to clear the annotation track.

The second display unit 70 is configured to display a target object.

Optionally, the first determining unit 30 includes: a first determining subunit and a second determining subunit. The first determining subunit is configured to determine position coordinates of the pixel points constituting the annotation track. The second determining subunit is configured to determine the target area according to the position coordinates of the pixels constituting the annotation track.

Optionally, the second determination subunit includes: a first determination module and a second determination module. The first determining module is configured to determine the position coordinates of the pixel points at the edges of the target area according to the position coordinates of the pixel points constituting the annotation track. The second determining module is configured to determine the target area according to the position coordinates of the pixel points at the edges of the target area.

Optionally, the first determining module includes a screening submodule and a calculation submodule. The screening submodule is configured to filter edge position coordinates from the position coordinates of all pixels constituting the annotation track, and the value of the abscissa or ordinate of the edge position coordinates is the largest or smallest position coordinates of all pixels constituting the annotation track Coordinate value. The calculation sub-module is configured to add or subtract the edge position coordinates and a preset value to obtain the position coordinates of the pixel points at the edges of the target area.

Optionally, the device further includes: a third determining unit configured to determine the display position of the target object according to the positions of the pixel points constituting the annotation track before the second display unit displays the target object.

It should be noted that, in order to avoid repetition, some technical features that have been explained in the foregoing embodiments are not repeatedly described. For technical features not described in detail in this embodiment, see other embodiments.

It should be noted that due to space limitations, not all implementations are exhaustively included in this application. As long as the features do not contradict each other, they can be freely combined to become optional implementations of this application.

An embodiment of the present application provides a storage medium, and the storage medium includes a stored program, wherein, when the program runs, the device where the storage medium is located is controlled to execute the foregoing annotation display method of the smart interactive tablet.

The device where the storage medium is located may be a smart interactive tablet.

An embodiment of the present application provides a processor, and the processor is configured to run a program, wherein the program executes the foregoing annotation display method of the smart interactive tablet when the program is run.

The embodiment of the present application provides an intelligent interactive tablet. The smart interactive tablet includes a bezel, a cover, a controller, and a display.

The controller is set to detect the annotation operation in the annotation state, the annotation operation is the operation received by the annotation layer, and the annotation layer is a transparent layer overlaid on the content layer.

The display is set to show the annotation track corresponding to the annotation operation.

The controller is also set to determine the target area in the content layer based on the annotation track.

The controller is also set to extract image information of the target area in the content layer.

The controller is further configured to determine a target object corresponding to the annotation track according to the annotation track and the extracted image information.

The controller is also set to clear the annotation track.

The display is also set to show the target object.

Optionally, the controller is configured to determine position coordinates of pixels constituting the annotation track; and determine a target area according to position coordinates of pixels constituting the annotation track.

Optionally, the controller is configured to determine the position coordinates of the pixel points at the edge of the target area according to the position coordinates of the pixels constituting the annotation track; and determine the target area according to the position coordinates of the pixels at the edge of the target area.

Optionally, the controller is configured to filter edge position coordinates from the position coordinates of all pixels constituting the annotation track, and the value of the abscissa or ordinate of the edge position coordinates is the position coordinates of all pixels constituting the annotation track The maximum or minimum coordinate value; the edge position coordinates are added to or subtracted from a preset value to obtain the position coordinates of the pixel points at the edges of the target area.

Optionally, the controller is configured to: before displaying the target object, determine the display position of the target object according to the positions of the pixel points constituting the annotation track.

It should be noted that the terms “first”, “second”, and “third” in the specification and claims of the present application and the foregoing drawings are used to distinguish similar objects, and are not necessarily used to describe specific Sequential or sequential.

Those skilled in the art should understand that the embodiments of the present application may be provided as a method, a system, or a computer program product. Therefore, this application may take the form of an entirely hardware embodiment, an entirely software embodiment, or an embodiment combining software and hardware aspects. Moreover, this application may take the form of a computer program product implemented on one or more computer-usable storage media (including, but not limited to, disk storage, CD-ROM, optical storage, etc.) containing computer-usable program code.

This application is described with reference to flowcharts and / or block diagrams of methods, devices (systems), and computer program products according to embodiments of the present application. It should be understood that each process and / or block in the flowcharts and / or block diagrams, and combinations of processes and / or blocks in the flowcharts and / or block diagrams can be implemented by computer program instructions. These computer program instructions may be provided to a processor of a general-purpose computer, special-purpose computer, embedded processor, or other programmable data processing device to produce a machine, so that the instructions generated by the processor of the computer or other programmable data processing device are used to generate instructions Means for implementing the functions specified in one or more flowcharts and / or one or more blocks of the block diagrams.

These computer program instructions may also be stored in a computer-readable memory capable of directing a computer or other programmable data processing device to work in a particular manner such that the instructions stored in the computer-readable memory produce a manufactured article including an instruction device, the instructions The device implements the functions specified in one or more flowcharts and / or one or more blocks of the block diagram.

These computer program instructions can also be loaded on a computer or other programmable data processing device, so that a series of steps can be performed on the computer or other programmable device to produce a computer-implemented process, which can be executed on the computer or other programmable device. The instructions provide steps for implementing the functions specified in one or more flowcharts and / or one or more blocks of the block diagrams.

In a typical configuration, a computing device includes one or more processors (CPUs), input / output interfaces, network interfaces, and memory.

The memory may include non-persistent memory, random access memory (RAM), and / or non-volatile memory in computer-readable media, such as read-only memory (ROM) or flash memory (flash RAM). Memory is an example of a computer-readable medium.

Computer-readable media includes both permanent and non-persistent, removable and non-removable media. Information can be stored by any method or technology. Information may be computer-readable instructions, data structures, modules of a program, or other data. Examples of computer storage media include, but are not limited to, phase change memory (PRAM), static random access memory (SRAM), dynamic random access memory (DRAM), other types of random access memory (RAM), and read-only memory (ROM), electrically erasable programmable read-only memory (EEPROM), flash memory or other memory technologies, read-only disc read-only memory (CD-ROM), digital versatile disc (DVD) or other optical storage, Magnetic tape cartridges, magnetic tape magnetic disk storage or other magnetic storage devices or any other non-transmission media may be used to store information that can be accessed by computing devices. As defined herein, computer-readable media does not include temporary computer-readable media, such as modulated data signals and carrier waves.

It should also be noted that the terms "including," "including," or any other variation thereof are intended to encompass non-exclusive inclusion, so that a process, method, product, or device that includes a range of elements includes not only those elements, but also Other elements not explicitly listed, or those that are inherent to such a process, method, product, or device. Without more restrictions, the elements defined by the sentence "including a ..." do not exclude the existence of other identical elements in the process, method, product or equipment including the elements.

The above are only examples of the present application and are not intended to limit the present application. For those skilled in the art, this application may have various modifications and changes. Any modification, equivalent replacement, and improvement made within the spirit and principle of this application shall be included in the scope of claims of this application.

Industrial applicability

As described above, the annotation display method, device and smart interactive tablet provided by at least some embodiments of the present application have the following beneficial effects: After entering the annotation mode, a new annotation layer is created, the annotation layer is a transparent layer, and the content layer is overlaid. On the annotation layer, the annotation operation is accepted. The display shows the annotation track corresponding to the annotation operation. The target area in the content layer is determined according to the annotation track. The image information of the target area in the content layer is extracted. According to the annotation track and the extracted image information, Determine the target object corresponding to the annotation trajectory, clear the annotation trajectory, and display the target object. The target object may be standardized graphics such as triangles, rectangles, circles, ellipses, or standardized lines such as straight lines and wavy lines. In the process of the target object, the image information of the content layer is considered, and the target object is accurately displayed at the place where the user wants to make an annotation, and the effect of intelligently displaying the annotation is achieved.

Claims

An annotation display method, the method includes:

In the annotation state, an annotation operation is detected, the annotation operation is an operation received by the annotation layer, and the annotation layer is a transparent layer overlaid on the content layer;

Displaying an annotation track corresponding to the annotation operation;

Determining a target area in the content layer according to the annotation track;

Extracting image information of the target area in the content layer;

Determining a target object corresponding to the annotation trajectory according to the annotation trajectory and the extracted image information;

Clearing the annotation track;

The target object is displayed.
The method according to claim 1, wherein determining a target area in the content layer according to the annotation track comprises:

Determining position coordinates of pixels constituting the annotation track;

The target area is determined according to the position coordinates of the pixel points constituting the annotation track.
The method according to claim 2, wherein determining the target area according to the position coordinates of the pixel points constituting the annotation track comprises:

Determining the position coordinates of the pixel points at the edges of the target area according to the position coordinates of the pixel points constituting the annotation track;

The target area is determined according to position coordinates of a pixel point at an edge of the target area.
The method according to claim 3, wherein determining the position coordinates of the pixel points at the edges of the target area according to the position coordinates of the pixel points constituting the annotation track comprises:

The edge position coordinates are selected from the position coordinates of all pixels constituting the annotation trajectory, and the value of the abscissa or ordinate of the edge position coordinates is the largest or smallest of the position coordinates of all the pixels constituting the annotation trajectory Coordinate value

Adding or subtracting the edge position coordinates with a preset value to obtain the position coordinates of the pixel points at the edges of the target area.
The method according to claim 1, wherein before displaying the target object, the method further comprises:

The display position of the target object is determined according to the positions of the pixel points constituting the annotation track.
An annotation display device, the device includes:

The detection unit is configured to detect an annotation operation in an annotation state, the annotation operation is an operation received by the annotation layer, and the annotation layer is a transparent layer overlaid on the content layer;

A first display unit configured to display an annotation track corresponding to the annotation operation;

A first determining unit configured to determine a target area in the content layer according to the annotation track;

An extraction unit configured to extract image information of the target area in the content layer;

A second determining unit, configured to determine a target object corresponding to the annotation track according to the annotation track and the extracted image information;

A clearing unit configured to clear the annotation track;

The second display unit is configured to display the target object.
The apparatus according to claim 6, wherein the first determining unit comprises:

A first determining subunit, configured to determine position coordinates of pixels constituting the annotation track;

The second determining subunit is configured to determine the target area according to the position coordinates of the pixel points constituting the annotation track.
An intelligent interactive tablet, which includes a frame, a cover, a controller, and a display screen.

The controller is configured to detect an annotation operation in an annotation state, the annotation operation is an operation received by the annotation layer, and the annotation layer is a transparent layer overlaid on the content layer;

The display screen is configured to display an annotation track corresponding to the annotation operation;

The controller is further configured to determine a target area in the content layer according to the annotation track;

The controller is further configured to extract image information of the target area in the content layer;

The controller is further configured to determine a target object corresponding to the annotation track according to the annotation track and the extracted image information;

The controller is further configured to clear the annotation track;

The display screen is further configured to display the target object.
The smart interactive tablet according to claim 8, wherein the controller is configured to:

Determining position coordinates of pixels constituting the annotation track;

The target area is determined according to the position coordinates of the pixel points constituting the annotation track.
The smart interactive tablet according to claim 9, wherein the controller is configured to:

Determining the position coordinates of the pixel points at the edges of the target area according to the position coordinates of the pixel points constituting the annotation track;

The target area is determined according to position coordinates of a pixel point at an edge of the target area.
The smart interactive tablet according to claim 10, wherein the controller is configured to:

The edge position coordinates are selected from the position coordinates of all pixels constituting the annotation trajectory, and the value of the abscissa or ordinate of the edge position coordinates is the largest or smallest of the position coordinates of all the pixels constituting the annotation trajectory. Coordinate value

Adding or subtracting the edge position coordinates with a preset value to obtain the position coordinates of the pixel points at the edges of the target area.
The smart interactive tablet according to claim 8, wherein the controller is configured to:

Before displaying the target object, the display position of the target object is determined according to the positions of the pixel points constituting the annotation track.
A storage medium includes a stored program, and when the program is running, a device where the storage medium is located is controlled to execute the annotation display method according to any one of claims 1 to 5.
An intelligent interactive tablet includes a memory and a processor, the memory is configured to store information including program instructions, the processor is configured to control the execution of the program instructions, and the program instructions are implemented when the program instructions are loaded and executed by the processor Steps of the annotation display method according to any one of 1 to 5.