WO2021244367A1

WO2021244367A1 - Graph drawing method, electronic device and computer storage medium

Info

Publication number: WO2021244367A1
Application number: PCT/CN2021/096036
Authority: WO
Inventors: 郑瑞
Original assignee: 京东方科技集团股份有限公司
Priority date: 2020-06-02
Filing date: 2021-05-26
Publication date: 2021-12-09
Also published as: CN111625179B; CN111625179A

Abstract

The present disclosure relates to a graph drawing method, an electronic device and a computer storage medium. The method can comprise: acquiring a plurality of trajectory points which are input on a touch screen; according to the input moments and coordinates of the various trajectory points, determining trajectory points that belong to the same graph; according to the coordinates of the trajectory points that belong to the same graph, determining a coordinate system angle interval corresponding to a trajectory offset included in a trajectory formed by the trajectory points that belong to the same graph; and when the coordinate system angle interval corresponding to the trajectory offset included in the trajectory is in accordance with a preset rule, determining a recommended graph.

Description

Graphic drawing method, electronic equipment and computer storage medium

Cross-references to related applications

This application claims the priority of the Chinese Patent Application No. 202010489740.1 with the title of "Graphic Drawing Method, Electronic Equipment and Computer Storage Medium" filed on June 2, 2020, the disclosure of which is incorporated herein by reference in its entirety.

Technical field

This application relates to the field of computer technology. More specifically, it relates to a graphics drawing method, an electronic device and a computer storage medium.

Background technique

With the progress of paperless office and intelligent office related equipment and solutions, many meeting scenarios are using intelligent interactive whiteboard equipment to replace traditional whiteboards, which can greatly improve the efficiency of work and meetings. The user can use the touch screen of the electronic whiteboard device to perform operations such as writing and drawing on the interface of the electronic whiteboard application. Among them, for the shortcut drawing of standard graphics, the template graphics control is usually provided in the sidebar on the interface of the electronic whiteboard application. In response to the user's touch operation on the template graphics control in the sidebar, the expansion includes, for example, a straight line. , Rectangle, triangle, trapezoid, circle and other standard graphic logo menu list for users to choose, but this method displays all standard graphic logos in a fixed position and in a fixed order every time, which is inconvenient and efficient. not tall.

Summary of the invention

The first aspect of the present application provides a graphics drawing method, which is applied to a terminal with a touch screen, and the method includes:

Obtain multiple track points entered on the touch screen;

Determine the trajectory points belonging to the same graph according to the input time and coordinates of each trajectory point;

According to the coordinates of the track points belonging to the same graph, determine the coordinate system angle interval corresponding to the track offset included in the track formed by the track points belonging to the same graph;

The recommended figure is determined when the angle interval of the coordinate system corresponding to the trajectory offset included in the trajectory meets a preset rule.

Through the graphic drawing method provided in this application, the terminal can recognize the graphic drawn by the user touch in real time based on the angle interval of the coordinate system corresponding to the offset included in the trajectory, so that standard graphics that meet the user’s drawing intention can be recommended in real time. It has the advantages of convenient operation, strong real-time performance, and high drawing efficiency, which improves the interactive experience of drawing. Among them, based on the coordinate system angle interval corresponding to the offset contained in the trajectory, the user touches and draws the figure to be recognized, which can realize the drawing trajectory without user input is very standardized and strictly continuous, and can also accurately identify the drawn figure. The validity and applicability of the graphics drawing method provided in this application are guaranteed.

In a possible implementation manner, the determining the trajectory points belonging to the same graph according to the input time and coordinates of each trajectory point includes:

Determine the consecutive multiple trajectory points as belonging to the same graph; and set the coordinate distance to any one of the multiple consecutive trajectory points to be less than the preset first distance threshold, and to the consecutive multiple trajectories A track point whose time interval between the input moment of the last track point in the points is less than a preset time threshold is determined to belong to the same graph as the multiple consecutive track points.

As a result, when the user draws a figure with two or even multiple pens, the corresponding drawing track can also be correctly identified whether it belongs to the same figure, or the image drawing method provided in this application is suitable for the user to draw with two or even multiple pens. In the case of a graph, there is a certain degree of discontinuous deviation of the track coordinates when drawing a graph.

In a possible implementation manner, according to the coordinates of the trajectory points belonging to the same graphic, determining the coordinate system angle interval corresponding to the trajectory offset included in the trajectory formed by the trajectory points belonging to the same graphic includes:

Determine the offset of adjacent track points according to the coordinates of the adjacent track points in the track points belonging to the same graph, and determine the track offset included in the track formed by the track points belonging to the same graph according to the offset of the adjacent track points. Shift amount.

In a possible implementation manner, before the determining the offset of adjacent track points according to the coordinates of adjacent track points among the track points belonging to the same graph, the method further includes:

For the adjacent trajectory point formed by the N+1th trajectory point and the Nth trajectory point, if the distance between the N+1th trajectory point and the Nth trajectory point is less than the second distance threshold, replace it with the N+2th trajectory point The N+1th trajectory point is regarded as the adjacent trajectory point of the Nth trajectory point.

As a result, by filtering out track points with dense coordinates, without affecting the accuracy of the offset calculation, unnecessary calculations can be reduced, and the efficiency of pattern recognition can be improved.

In a possible implementation manner, the determining, according to the offset of adjacent track points, the track offset included in the track formed by the track points belonging to the same graph includes:

Combine consecutive adjacent track point offsets in the same coordinate system angle interval into one track offset in the coordinate system angle interval.

As a result, it is possible to achieve de-redundancy of continuous offsets that are in the same angular interval of the same coordinate system, and improve the efficiency of pattern recognition.

In a possible implementation manner, the angle interval of the coordinate system includes:

The first angle interval within ±45° with the positive half axis of the X axis, the second angle interval within ±45° with the positive half axis of the Y axis, and the first angle interval within ±45° of the included angle with the negative half axis of the X axis The third angle interval and the fourth angle interval within ±45° of the negative half axis of the Y axis.

This method of dividing the angle interval of the coordinate system can ensure the accuracy of the recognition of the graphics drawn by the user touch based on the angle interval of the coordinate system corresponding to the offset contained in the trajectory, while ensuring that a certain amount of trace appears in the drawn trajectory input by the user. The validity and applicability of the graphics drawing method provided in this application when deviations or discontinuities occur.

In a possible implementation manner, the determining the recommended graphics when the angle interval of the coordinate system corresponding to the track offset included in the track meets a preset rule includes:

When the trajectory only includes the trajectory offset in an angular interval of the coordinate system, determining that the recommended figure is a straight line;

When the trajectory includes two trajectory offsets in two adjacent angle intervals of the coordinate system, determining that the recommended figure includes at least one of a rectangle, a triangle, and a trapezoid;

When the trajectory includes two or three trajectory offsets in the angle interval of two opposite coordinate systems, determining that the recommended figure is a triangle;

When the trajectory includes three trajectory offsets of three adjacent coordinate system angle intervals sorted in a clockwise or counterclockwise direction, it is determined that the recommended graphics include a circle, an ellipse, a rectangle, a triangle, and a trapezoid. At least one of them.

Therefore, the graphics drawing method provided in this application covers a variety of commonly used standard graphics, and can accurately and real-time recommend standard graphics that meet the user's drawing intention before the user completes the complete drawing.

In a possible implementation manner, after the template control is displayed, the method further includes:

In response to the first operation on the mark, the coordinate of the first track point among the track points belonging to the same graph is used as the reference coordinate, and the graph corresponding to the mark is displayed.

In a possible implementation manner, the display template control includes:

The template control is displayed at the position corresponding to the trajectory formed by the trajectory points belonging to the same graph.

As a result, the display position of the identification of the recommended graphic can be adjusted corresponding to the position of the user input to draw the trajectory, making user operations more convenient, especially for large-screen terminals such as electronic whiteboard devices with a touch screen of 55 inches or more.

If the length of the trajectory formed by the trajectory points belonging to the same graph is greater than the preset length threshold, then stop displaying the template control.

A second aspect of the present application provides an electronic device, including: a processor, a memory, and a touch screen, the memory, the touch screen are coupled with the processor, and the memory is used to store computer program code, the computer program code It includes computer instructions that, when executed by the processor, cause the electronic device to execute the graphics drawing method as described above.

A third aspect of the present application provides a computer storage medium, including computer instructions, which, when the computer instructions run on a terminal, cause the terminal to execute the above-mentioned graphics drawing method.

Description of the drawings

The specific implementation of the present application will be described in further detail below in conjunction with the accompanying drawings.

FIG. 1 shows a first structural diagram of an electronic device provided by an embodiment of the present application.

FIG. 2 shows a second structural diagram of an electronic device provided by an embodiment of the present application.

FIG. 3 shows a schematic flowchart of a graph drawing method provided by an embodiment of the present application.

Fig. 4 shows a schematic diagram of a user interface of an electronic device provided by an embodiment of the present application.

Fig. 5 shows a schematic diagram of a division method of the angle interval of the coordinate system.

FIG. 6 shows a schematic diagram of a user interface of another electronic device provided by an embodiment of the present application.

FIG. 7 shows a schematic diagram of a user interface of another electronic device provided by an embodiment of the present application.

FIG. 8 shows a schematic diagram of a user interface of another electronic device provided by an embodiment of the present application.

FIG. 9 shows a schematic diagram of a user interface of another electronic device provided by an embodiment of the present application.

FIG. 10 shows a schematic diagram of a user interface of another electronic device provided by an embodiment of the present application.

FIG. 11 shows a schematic diagram of a user interface of another electronic device provided by an embodiment of the present application.

FIG. 12 shows a third structural diagram of an electronic device provided by an embodiment of the present application.

detailed description

In order to explain the application more clearly, the application will be further explained below in conjunction with embodiments and drawings. Similar components in the drawings are denoted by the same reference numerals. Those skilled in the art should understand that the content specifically described below is illustrative rather than restrictive, and should not be used to limit the scope of protection of this application.

In the description of the embodiments of the present application, unless otherwise specified, "/" means or, for example, A/B can mean A or B; "and/or" in this document is only an association describing the associated object Relationship, which means that there can be three kinds of relationships, for example, A and/or B, which can mean: A alone exists, A and B exist at the same time, and B exists alone.

Hereinafter, the terms "first" and "second" are only used for descriptive purposes, and cannot be understood as indicating or implying relative importance or implicitly indicating the number of indicated technical features. Therefore, the features defined with "first" and "second" may explicitly or implicitly include one or more of these features. In the description of the embodiments of the present application, unless otherwise specified, "plurality" means two or more.

In the embodiments of the present application, words such as "exemplary" or "for example" are used as examples, illustrations, or illustrations. Any embodiment or design solution described as "exemplary" or "for example" in the embodiments of the present application should not be construed as being more preferable or advantageous than other embodiments or design solutions. To be precise, words such as "exemplary" or "for example" are used to present related concepts in a specific manner.

Exemplarily, the electronic device in this application may be an electronic whiteboard device, a smart TV, a mobile phone, a tablet computer, a personal computer (PC), a personal digital assistant (PDA), a smart watch, a netbook, a computer Wearable electronic devices, augmented reality (AR) devices, virtual reality (VR) devices, in-vehicle devices, smart cars, robots, etc., this application does not impose special restrictions on the specific forms of the electronic devices.

FIG. 1 shows a schematic diagram of the structure of an electronic device 100.

The electronic device 100 includes a memory 110 and a processor 120. It should be understood that the components of the electronic device 100 shown in FIG. 1 are only exemplary and not restrictive. According to actual application requirements, the electronic device 100 may also have other components. For example, the handwriting processing device 100 may use operating systems such as Windows and Android.

For example, the memory 110 is used for non-transitory storage of computer readable instructions; the processor 120 is used for running computer readable instructions.

For example, as shown in FIG. 1, the electronic device 100 may further include a touch device 130. The touch device 130 is configured to obtain a touch operation corresponding to the work surface of the touch device 130. For example, the touch device 130 may include any input device with a touch function, such as an electronic pen, a touch screen, a mouse, a touch pad, and an interactive whiteboard. For example, the touch screen may be a capacitive touch screen, such as a self-capacitive touch screen or a mutual-capacitive touch screen, and may also be a resistive touch screen, a surface acoustic wave touch screen, an infrared touch screen, and the like.

For example, the touch device 130 may include a touch sensor and a controller (for example, a driver IC). The controller receives the electrical signal collected by the touch sensor, processes the electrical signal to obtain a touch signal, and provides the touch signal to the processor for further processing. . The embodiment of the present application does not limit the type, structure, and communication mode of the touch device 130. The touch device 130 includes a working surface with a certain area. The user can draw/write directly on the working surface of the touch device 130 with a finger, or use an active stylus or a passive stylus on the work surface of the touch device 130. Drawing/writing on the work surface is not limited in the embodiment of the present application. Here, the working surface refers to a surface used to detect a user's touch operation, such as the touch surface of the touch device 130.

For example, as shown in FIG. 1, the handwriting processing device 100 may further include a display device 140. The display device 140 is configured to display various interactive interfaces. For example, the display device 140 may include a display device such as a display screen and a projector. The display screen of the display device 140 is, for example, an LCD display screen, an OLED display screen, a QLED display screen, a projection component, a VR head-mounted display device (such as a VR helmet, VR glasses), an AR display device, etc. This is not restricted.

For example, in some embodiments, the touch device 130 and the display device 140 may be integrated into, for example, a touch screen, so as to have both touch function and display function.

For example, the memory 110 and the processor 120 may be integrated in a touch display screen. For another example, the memory 110 and the processor 120 may also be integrated in a cloud server.

For example, the electronic device 100 may also include a communication module. The communication module is used to implement communication between the electronic device 100 and other electronic devices. For example, when the electronic device 100 is used in a conference room, the communication module may transmit an interactive interface to a remote participant. In the mobile phone or tablet computer of the user of the meeting, the user's mobile phone or tablet computer can display and store the interactive interface.

For example, the processor 120 may control other components in the electronic device 100 to perform desired functions. The processor 120 may be a central processing unit (CPU), a tensor processor (TPU), or other devices with data processing capabilities and/or program execution capabilities. The central processing unit (CPU) can be an X86 or ARM architecture.

For example, the memory 110 may include any combination of one or more computer program products, and the computer program products may include various forms of computer-readable storage media, such as volatile memory and/or non-volatile memory. Volatile memory may include random access memory (RAM) and/or cache memory (cache), for example. Non-volatile memory may include, for example, read only memory (ROM), hard disk, erasable programmable read only memory (EPROM), portable compact disk read only memory (CD-ROM), USB memory, flash memory, etc. One or more computer-readable instructions may be stored on the computer-readable storage medium, and the processor 120 may execute the computer-readable instructions to implement various functions of the electronic device 100.

For example, components such as the storage 110, the storage 120, the touch device 130, and the display device 140 may communicate through a network. The network may include a wireless network, a wired network, and/or any combination of a wireless network and a wired network. The network may include a local area network, the Internet, a telecommunications network, the Internet of Things (Internet of Things) based on the Internet and/or a telecommunications network, and/or any combination of the above networks, and so on. The wired network may, for example, use twisted pair, coaxial cable, or optical fiber transmission for communication, and the wireless network may use, for example, a 3G/4G/5G mobile communication network, Bluetooth, Zigbee, or WiFi. This application does not limit the types and functions of the network.

The software system of the electronic device 100 may adopt a layered architecture, an event-driven architecture, a microkernel architecture, a microservice architecture, or a cloud architecture. The embodiment of the present application takes an Android system with a layered architecture as an example to illustrate the software structure of the electronic device 100 by way of example.

FIG. 2 shows a block diagram of the software structure of the electronic device 100 according to an embodiment of the present application.

The layered architecture divides the software into several layers, and each layer has a clear role and division of labor. Communication between layers through software interface. In some embodiments, the Android system is divided into four layers, from top to bottom, the application layer, the application framework layer, the Android runtime, the system library, and the kernel layer.

The application layer can include a series of application packages. As shown in Figure 2, the application package can include an electronic whiteboard application, a gallery, a video player, and can also include applications such as camera, calendar, call, map, navigation, WLAN, Bluetooth, and music.

In some embodiments of the present application, the electronic whiteboard application may provide an interface for the electronic device to interact with the user, for example, allowing the user to set the type of standard graphics, set the initial size of the standard graphics, and set the type of logo displayed by the template control.

The application framework layer provides an application programming interface (application programming interface, API) and a programming framework for applications in the application layer. The application framework layer includes some predefined functions.

As shown in Figure 2, the application framework layer can include a window manager, a content provider, a view system, a resource manager, a notification manager, and so on.

The window manager is used to manage window programs. The window manager can obtain the size of the display screen, determine whether there is a status bar, lock the screen, take a screenshot, etc.

In some embodiments of the present application, the window manager may specifically be a window management service (WindowManagerService, WMS), and the WMS stores information of each application window displayed on the current screen, for example: the number of application windows displayed on the current screen And other information.

The content provider is used to store and retrieve data and make these data accessible to applications. The data may include videos, images, audios, phone calls made and received, browsing history and bookmarks, phone book, etc.

The view system includes visual controls, such as controls that display text, controls that display pictures, and so on. The view system can be used to build applications. The display interface can be composed of one or more views. For example, a display interface that includes a short message notification icon may include a view that displays text and a view that displays pictures.

The resource manager provides various resources for the application, such as localized strings, icons, pictures, layout files, video files, and so on.

The notification manager enables the application to display notification information in the status bar, which can be used to convey notification-type messages, and it can automatically disappear after a short stay without user interaction. For example, the notification manager is used to notify that the download is complete, message reminders, and so on. The notification manager can also be a notification that appears in the status bar at the top of the system in the form of a chart or a scroll bar text, such as a notification of an application running in the background, or a notification that appears on the screen in the form of a dialog window. For example, text messages are prompted in the status bar, prompt sounds, electronic devices vibrate, and indicator lights flash.

Android Runtime includes core libraries and virtual machines. Android runtime is responsible for the scheduling and management of the Android system.

The core library consists of two parts: one part is the function function that the java language needs to call, and the other part is the core library of Android.

The application layer and the application framework layer run in a virtual machine. The virtual machine executes the java files of the application layer and the application framework layer as binary files. The virtual machine is used to perform functions such as object life cycle management, stack management, thread management, security and exception management, and garbage collection.

The system library can include multiple functional modules. For example: surface manager (surface manager), media library (MediaLibraries), two-dimensional graphics engine (for example: SGL), three-dimensional graphics processing library (for example: OpenGL ES), etc.

The surface manager is used to manage the display subsystem and provides a combination of 2D and 3D layers for multiple applications.

The media library supports playback and recording of a variety of commonly used audio and video formats, as well as still image files. The media library can support a variety of audio and video encoding formats, such as: MPEG4, H.264, MP3, AAC, AMR, JPG, PNG, etc.

The 3D graphics processing library is used to realize 3D graphics drawing, image rendering, synthesis and layer processing.

The two-dimensional graphics engine is a graphics engine for two-dimensional graphics.

The kernel layer is the layer between hardware and software. The kernel layer includes display driver, camera driver, audio driver, sensor driver, etc.

The technical solutions involved in the following embodiments can all be implemented in the electronic device 100 having the above-mentioned hardware architecture and software architecture.

Hereinafter, taking the electronic device 100 as an electronic whiteboard device as an example, the technical solutions provided by the embodiments of the present application will be described in detail with reference to the accompanying drawings. The electronic whiteboard device can have various sizes of touch screens. For example, an electronic whiteboard device has a touch screen of more than 55 inches.

In the graphics drawing method provided in this application, after entering the electronic whiteboard of the electronic whiteboard device, the user can input the graphics he wants to draw on the touch screen with a finger or active pen on the touch screen. During the input process, the electronic whiteboard device The acquired trajectory points are displayed in real time for the recommended graphics for the user to choose. Among them, the main function of the electronic whiteboard application is to respond to the user's input operations through devices such as fingers or active pens, drawing graphics, presenting text, and displaying them on the screen, and is generally used as conference software. It is understandable that the electronic whiteboard application is only used to illustrate and explain this application, and is not used to limit this application. The graphics drawing method provided in this application can also be applied to other applications with graphics drawing functions.

As shown in FIG. 3, the graph drawing method provided by the embodiment of the present application is applied to a terminal with a touch screen, and the method includes the following steps:

S10. Acquire multiple track points input on the touch screen.

Exemplarily, after the electronic whiteboard device 100 is turned on, its displayed desktop interface displays icons of various applications. In response to the user's touch operation of the electronic whiteboard application icons, such as a finger tap, the electronic whiteboard device 100 displays as shown in the figure 4 shows the interface of the electronic whiteboard application. The interface of the electronic whiteboard application shown in Figure 4 includes an operation bar in the upper left corner and a navigation bar in the lower right corner. The operation bar includes pointers, pens, erasers and other controls for drawing/writing, and the navigation bar includes the back button. And the home screen key, the back key is used to return to the previous interface or cancel the last operation, the home screen key is used to return to the desktop interface. Except for the operation bar and the navigation bar, most areas of the interface are drawing/writing input areas. When the user draws/writes with a finger or active pen on the touch screen, the electronic whiteboard device 100 obtains the track points.

In some embodiments, the touch screen itself can obtain the track points input by the user with a finger or active pen on the touch screen based on hardware (for example, touch circuit, sampling circuit, etc.) and software (for example, related program algorithms). Applications include but are not limited to this.

S20: Determine the trajectory points belonging to the same graph according to the input time and coordinates of each trajectory point.

In some embodiments, step S20 includes:

Exemplarily, in the interface of the electronic whiteboard application program shown in Fig. 4, the trajectory formed by the trajectory points input by the user is two trajectories formed by successive trajectory points, including a rough line drawn from top to bottom. A vertical trajectory and a roughly horizontal trajectory drawn from left to right.

When judging whether each track point belongs to the same graph:

First, since the track points in the roughly vertical trajectory are continuous, it is determined that the trajectory points in the roughly vertical trajectory belong to the same graph, and set it as pattern A;

Then, when the first trajectory point (the leftmost trajectory point) in the roughly horizontal trajectory is obtained, the following two conditions are judged: (1) Whether each trajectory point in the roughly vertical trajectory exists and roughly The coordinate distance of the first trajectory point in the horizontal trajectory is smaller than the trajectory point whose first distance threshold is set as 200 pixels distance; input track points in time t _N-2,1 track points substantially vertical trajectory (i.e., the last track point substantially vertical trajectory) an input time between time t _{1, N} spacing △ T =t _2,1 -t _1, whether N is less than a time threshold set between, for example, 1 second (s) to 3 seconds (s). If the above two conditions (1) and (2) are both true, the first track point in the roughly horizontal trajectory and the trajectory point in the roughly vertical trajectory are judged to belong to the same graph, that is, the first trajectory point in the roughly horizontal trajectory The trajectory points also belong to graph A; if at least one of the above two conditions (1) and (2) is not true, the first trajectory point in the roughly horizontal trajectory and the trajectory point in the roughly vertical trajectory are judged as not Belong to the same graph, that is, the first track point in the roughly horizontal track belongs to the new graph B;

Next, take the first trajectory point in the roughly horizontal trajectory as an example. Since the trajectory points in the roughly horizontal trajectory are continuous, it is determined that the trajectory points in the roughly horizontal trajectory belong to the same figure, that is, roughly horizontal trajectory. The track points in all belong to graph A;

Finally, it is determined that in the interface shown in FIG. 4, all the track points included in the roughly vertical trajectory and roughly horizontal trajectory input by the user belong to the same figure (all belong to figure A).

It can be seen that the method for drawing graphics provided by the embodiments of the present application enables the corresponding drawing trajectory to be correctly identified as belonging to the same graphic when the user draws a graphic with two strokes or even multiple pens, or the drawing graphics provided by the embodiments of the present application The method can be applied to the situation where the user draws a figure with two or even multiple strokes, that is, a certain degree of discontinuous deviation of the track coordinates when drawing a figure can be accepted, thus greatly improving the drawing method provided by the embodiment of the application Validity and applicability.

S30: According to the coordinates of the track points belonging to the same graph, determine the coordinate system angle interval corresponding to the track offset included in the track formed by the track points belonging to the same graph.

As shown in FIG. 5, in some embodiments, the angle interval of the coordinate system includes:

The first angle interval 51 within ±45° with the positive half axis of the X axis, the second angle interval 52 within ±45° with the positive half axis of the Y axis, and within ±45° the included angle with the negative half axis of the X axis The third angle interval 53 and the fourth angle interval 54 within ±45° of the negative half axis of the Y axis.

This method of dividing the angle interval of the coordinate system can ensure the accuracy of recognizing the graphics drawn by the user touch based on the angle interval of the coordinate system corresponding to the offset contained in the trajectory. The validity and applicability of the graphic drawing method provided by this application when the deviation or discontinuity occurs.

In addition to the foregoing coordinate system angle interval division method in which the 360° angle interval is equally divided into four angle intervals, in this embodiment, other methods may also be used to divide the coordinate system angle interval:

For example, a coordinate system angle interval division method that divides the 360° angle interval into eight angle intervals is adopted, that is, the coordinate system angle interval includes: the angle interval A within ±22.5° of the positive half axis of the X axis, and X The included angle between the positive semi-axis of the axis is +22.5° to +67.5°, the angle interval B within the included angle of the positive axis of the Y axis is ±22.5°, and the included angle of the negative axis of the X axis is within +22.5° to +67.5 The angle interval D within °, the angle interval E within ±22.5° with the negative half axis of the X axis, the angle interval F within the negative half axis of the X axis from -67.5° to -22.5°, and the negative half of the Y axis The angle interval F within ±22.5° of the axis included angle and the angle interval G within the range of -67.5° to -22.5° with the positive half axis of the X axis.

For another example, it is also possible to divide the 360° angular interval in an unequal division manner.

The above-mentioned division method of the angle interval of the coordinate system cannot be regarded as a limitation of the present application, and an appropriate division method can be set based on the requirements for accuracy and effectiveness. Among them, the finer the division of the coordinate system angle interval, that is, the smaller the angle range covered by each coordinate system angle interval, the subsequent recognition of the graphics drawn by the user based on the coordinate system angle interval corresponding to the offset included in the trajectory The higher the accuracy, the more complex graphics can be adapted, but the smaller the deviation of the trajectory drawn by the acceptable user input.

In some embodiments, step S30 includes:

Determine the offset of adjacent track points according to the coordinates of the adjacent track points in the track points belonging to the same graph, and determine the track offset included in the track formed by the track points belonging to the same graph according to the offset of the adjacent track points. Shift amount. The offset of the adjacent track points may include an offset in the first direction (for example, the X-axis direction shown in FIG. 5) and an offset in the second direction (for example, the Y-axis direction shown in FIG. 5). The amount of displacement (for example, the positive and negative offset values in the corresponding direction), where the first direction is orthogonal to the second direction.

Further, in some embodiments, before determining the offset of adjacent track points according to the coordinates of adjacent track points among the track points belonging to the same graph, the method further includes:

Exemplarily, whether the track points are dense can be determined by the Euclidean distance between adjacent track points. For example, for the adjacent track points formed by the N+1th track point and the Nth track point, if the coordinates are (x _{N+ 1} , the distance between the _{N+1th trajectory point of y N+1} ) and the Nth trajectory point with coordinates (x _N , y _N)

If it is less than the second distance threshold set as 5 pixels distance, for example, the N+1th trajectory point is ignored or discarded, and the N+1th trajectory point is replaced by the N+2th trajectory point as the adjacent trajectory of the Nth trajectory point point. It is understandable that for the adjacent trajectory points formed by the N+2th trajectory point and the Nth trajectory point appearing at this time, the judgment can also be continued based on the second distance threshold, and so on until there is a difference between the Nth trajectory point and the Nth trajectory point. The distance between the trajectory points is greater than or equal to the second distance threshold, that is, starting from the N+1 trajectory point, it is determined whether the distance between each trajectory point and the Nth trajectory point is greater than or equal to the second distance threshold, and the first The trajectory point that meets the condition is regarded as the adjacent trajectory point of the Nth trajectory point, and the trajectory point between the Nth trajectory point and the first trajectory point that meets the condition is discarded.

Further, in some embodiments, the determining the track offset included in the track formed by the track points belonging to the same graph according to the offset of the adjacent track points includes:

In a specific example, determining the coordinate system angle interval corresponding to the trajectory offset included in the trajectory formed by the trajectory points belonging to the same graph includes:

First of all, for at least one continuous trajectory formed by continuous trajectory points among trajectories formed by trajectory points belonging to the same pattern (for example, the trajectory of pattern A shown in FIG. 4 includes two continuous trajectories, which are roughly vertical in FIG. Trajectory and roughly horizontal trajectory), calculate the offset between each pair of adjacent trajectory points included in the continuous trajectory, for example, for the adjacent trajectory point formed by the N+1th trajectory point and the Nth trajectory point, the coordinates are ( The offset between the N+1th trajectory point of x _N+1 , y _N+1 ) and the Nth trajectory point with coordinates (x _N , y _N _{) is (d x} , d _y ), where X The offset in the axis direction d _x =(x _N+1 -x _N ), the offset in the Y axis direction d _y =(y _N+1 -y _N ).

Then, the offset between adjacent track points is re-assigned and the offset is mapped to the angle interval of the coordinate system.

Continuing the previous example, taking the coordinate system angle interval division method that divides the 360° angle interval into four angle intervals as shown in Figure 5 as an example, the obtained offset between adjacent track points can be compared The magnitudes of d _x and d _y and the positive and negative values are used for the coordinate system angle interval mapping and re-assignment mark, as shown in Table 1.

Table 1

The offset after re-assignment can represent the angle interval of the coordinate system corresponding to the deviation between adjacent track points (or the angle interval of the coordinate system where the slope of the deviation between adjacent track points is located), which can be Reflects the trend of the drawn trajectory input by the user. Considering that the drawn trajectory of the user's handwriting input is usually not absolutely standardized. Take a straight line as an example. When the user draws a straight line, the drawn trajectory is usually not completely straight. Therefore, a small segment of continuous coordinates is offset. The value of the measurement can not be exactly the same, but from the perspective of practical application, not every adjacent track point offset is necessary to be calculated and counted in the subsequent graphic recognition, so it can be used for continuous and same coordinate system angles. The slope of the interval is de-redundant, so that it indicates that the trajectory remains in an angle interval of the coordinate system during this period, and it is only calculated once. The strategy of de-redundancy is to calculate sequentially. As long as the offset value of 0 is the same as d _x or d _y , and the other offset is the same positive or negative number, then d _x and d _y can be corresponded to each other. Plus, if the next offset is 0 or different from the current offset, the current offset is saved, and the similar offset is calculated from the next offset. Before different offsets, record and save the offsets that have been added, and then the simplified offsets can be obtained as a track offset. Based on the 0 value and the positive and negative values of the simplified offset, the change in the slope of the drawing trajectory input by the user, that is, the trend or characteristic of the graph, can be judged, so that the graph can be identified. The foregoing process of merging the offsets of adjacent track points based on re-assignment to eliminate redundancy is an implementation manner, and should not be regarded as a limitation of this embodiment.

S40: Determine a recommended graph when the angle interval of the coordinate system corresponding to the track offset included in the track meets a preset rule.

The method may further include displaying a template control, the template control including an identification of the recommended graphic.

In a possible implementation manner, when the coordinate system angle interval is divided as shown in FIG. 5, the coordinate system angle interval corresponding to the trajectory offset included in the trajectory conforms to a preset rule When determining the recommended graphics include:

When the trajectory includes two trajectory offsets in the angular intervals of two adjacent coordinate systems, it is determined that the recommended figure includes at least one of a rectangle, a triangle, and a trapezoid;

It is understandable that the graphics that can be recognized by the graphics drawing method provided in the embodiments of the present application are not limited to the straight lines, circles, ellipses, rectangles, triangles, and trapezoids listed above, but also include parallelograms, pentagons, and hexagons. , I will not list them one by one here, only the recognition rules of commonly used graphics are given. In addition, in the case where the division method of the angle interval of the coordinate system is changed, the design of the preset rules can be used to enable the graph drawing method provided in the embodiment of the present application to recognize the graph. Among them, the angle interval of the coordinate system is more finely divided. In the case of, it can also identify more subdivided graphics such as right-angled triangles and isosceles triangles.

In a possible implementation manner, the display template control includes:

In a specific example, after obtaining the coordinate system angle interval corresponding to the track offset included in the track formed by the track points belonging to the same pattern through step S30, pattern recognition is performed to determine the recommended pattern, and the recommended process is performed, for example :

For example, in the interface of the electronic whiteboard application program as shown in FIG. 6, the user first draws a roughly vertical track from top to bottom, and the electronic whiteboard device 100 obtains the drawing track input by the user and determines the trajectory through steps S10-S30. The trajectory contains only one trajectory offset corresponding to the fourth angle interval. At this time, based on the aforementioned "when the trajectory only contains the trajectory offset in one coordinate system angle interval, determine the recommended figure as a straight line", the recommendation is determined The graphic is a straight line. As shown in Fig. 6, the template control 61 is displayed, and the text logo "straight line" is displayed in the template control 61. Or display the graphic logo and text logo at the same time).

after:

Example situation 1: If the user applies a touch operation such as a finger touch to the text mark "straight line" in the interface shown in FIG. 6, the electronic whiteboard device 100 responds to the operation and displays the interface as shown in FIG. 7, that is, Close the display template control and display a standard straight line starting from the first trajectory point of the above "a section of roughly vertical trajectory drawn by the user from top to bottom". The user can adjust the length of the standard straight line by dragging and other operations. Other parameters;

Example case 2: If the user draws a roughly horizontal trace from left to right within a time interval defined by a time threshold of, for example, 1 second (s) after drawing a roughly vertical trace from top to bottom, where roughly The distance between the first trajectory point of the horizontal trajectory and one or more of the first few trajectory points of the roughly vertical trajectory drawn first is less than the first distance threshold, such as a distance of 200 pixels, and the electronic whiteboard device 100 obtains the user After the input drawn trajectory has gone through steps S10-S30, after it is determined that the roughly horizontal trajectory and the roughly vertical trajectory acquired first belong to the same figure, it is determined that the two trajectories of the figure type include the corresponding fourth angle interval and the first angle interval. Two trajectory offsets. At this time, based on the aforementioned "when the trajectory includes two trajectory offsets in the angle intervals of two adjacent coordinate systems, it is determined that the recommended graphics include at least one of a rectangle, a triangle, and a trapezoid. One", it is determined that the recommended graphic is at least one of a rectangle, a triangle, and a trapezoid. The interface shown in FIG. 8 displays a template control 81, and the template control 81 displays the text labels "rectangle" and "triangle". If the user applies a touch operation such as a finger touch click to the text mark "rectangle" in the interface shown in FIG. 8, the electronic whiteboard device 100 displays the interface shown in FIG. 9 in response to the operation, that is, closes the display template control And with the first track point of the above "the user draws a roughly vertical track from top to bottom" as the upper left vertex, a standard rectangle is displayed, and the user can adjust the length and width of the standard rectangle through drag operations and other operations. ；

Example situation 3: If the user first draws a substantially vertical track from top to bottom and then continues to draw the track until the track length is greater than the length threshold of, for example, a distance of 1000 pixels, the template control 61 is closed.

For another example, in the interface of the electronic whiteboard application program shown in FIG. 10, the user draws an arc-shaped trajectory counterclockwise, and the electronic whiteboard device 100 obtains the drawing trajectory input by the user and determines that the trajectory contains successive steps S10-S30. The three trajectory offsets corresponding to the third angle interval, the fourth angle interval, and the first angle interval are arranged. At this time, based on the aforementioned "the trajectory includes three phases ordered in a clockwise or counterclockwise direction. When determining the trajectory offset of the three adjacent coordinate system angle intervals, determine that the recommended graphics include at least one of a circle, an ellipse, a rectangle, a triangle, and a trapezoid", and determine that the recommended graphics are a circle, an ellipse, a rectangle, At least one of triangle and trapezoid", as shown in Figure 10, the template control 101 is displayed, and the text logo "circle" is displayed in the template control 101. It can be seen that the user can recommend it only when the user draws an arc corresponding to a roughly semicircle. After that, if the user applies a touch operation such as a finger touch to the text mark "circle" in the interface shown in FIG. 10, the electronic whiteboard device 100 responds to the operation and displays the interface as shown in FIG. 11 , That is, close the display template control and display a standard circle with the first trajectory point of the above "a segment of arc trajectory drawn by the user from top to bottom" as the upper tangent point, which can be adjusted by the user through drag operations and other operations The diameter of the standard circle and other parameters.

In summary, in the graphics drawing method provided by the embodiments of the present application, the electronic whiteboard device 100 can recognize the graphics drawn by the user's touch in real time based on the angle interval of the coordinate system corresponding to the offset included in the trajectory. Recommend standard graphics that meet the user's drawing intention, which has the advantages of convenient operation, strong real-time performance, and high drawing efficiency, which improves the interactive experience of drawing. Among them, based on the coordinate system angle interval corresponding to the offset contained in the trajectory, the user touches and draws the figure to be recognized, which can realize the drawing trajectory without user input is very standardized and strictly continuous, and can also accurately identify the drawn figure. The validity and applicability of the graphics drawing method provided in the embodiments of the present application are guaranteed.

An embodiment of the present application also provides a chip system. As shown in FIG. 12, the chip system includes at least one processor 1201 and at least one interface circuit 1202. The processor 1201 and the interface circuit 1202 may be interconnected by wires. For example, the interface circuit 1202 may be used to receive signals from other devices (such as the memory of the mobile terminal 100). For another example, the interface circuit 1202 may be used to send signals to other devices (such as the processor 1201). Exemplarily, the interface circuit 1202 can read instructions stored in the memory, and send the instructions to the processor 1201. When the instructions are executed by the processor 1201, the electronic device can be made to execute the various steps executed by the electronic device 100 (for example, an electronic whiteboard device) in the foregoing embodiment. Of course, the chip system may also include other discrete devices, which are not specifically limited in the embodiment of the present application.

It can be understood that, in order to realize the above-mentioned functions, the above-mentioned terminal and the like include hardware structures and/or software modules corresponding to each function. Those skilled in the art should easily realize that in combination with the units and algorithm steps of the examples described in the embodiments disclosed herein, the embodiments of the present application can be implemented in the form of hardware or a combination of hardware and computer software. Whether a certain function is executed by hardware or computer software-driven hardware depends on the specific application and design constraint conditions of the technical solution. Professionals and technicians can use different methods for each specific application to implement the described functions, but such implementation should not be considered as going beyond the scope of the embodiments of the present invention.

The embodiment of the present application may divide the above-mentioned terminal and the like into functional modules according to the above method examples. For example, each functional module may be divided corresponding to each function, or two or more functions may be integrated into one processing module. The above-mentioned integrated modules can be implemented in the form of hardware or software function modules. It should be noted that the division of modules in the embodiment of the present invention is illustrative, and is only a logical function division, and there may be other division methods in actual implementation.

Through the description of the above embodiments, those skilled in the art can clearly understand that for the convenience and brevity of the description, only the division of the above-mentioned functional modules is used for illustration. In practical applications, the above-mentioned functions can be allocated according to needs. It is completed by different functional modules, that is, the internal structure of the device is divided into different functional modules to complete all or part of the functions described above. For the specific working process of the above-described system, device, and unit, reference may be made to the corresponding process in the foregoing method embodiment, which is not repeated here.

The functional units in the various embodiments of the embodiments of the present application may be integrated into one processing unit, or each unit may exist alone physically, or two or more units may be integrated into one unit. The above-mentioned integrated unit can be implemented in the form of hardware or software functional unit.

If the integrated unit is implemented in the form of a software functional unit and sold or used as an independent product, it can be stored in a computer readable storage medium. Based on this understanding, the technical solutions of the embodiments of the present application are essentially or the part that contributes to related technologies, or all or part of the technical solutions can be embodied in the form of software products, and the computer software products are stored in a storage medium. It includes several instructions to make a computer device (which may be a personal computer, a server, or a network device, etc.) or a processor execute all or part of the steps of the methods described in the various embodiments of the present application. The aforementioned storage media include: flash memory, mobile hard disk, read-only memory, random access memory, magnetic disk or optical disk and other media that can store program codes.

Obviously, the above-mentioned embodiments of this application are merely examples to clearly illustrate this application, and are not meant to limit the implementation of this application. For those of ordinary skill in the art, they can also do on the basis of the above description. Other changes or changes in different forms cannot be exhaustively listed here. Any obvious changes or changes derived from the technical solutions of this application are still within the scope of protection of this application.

Claims

A graphics drawing method, which is applied to a terminal with a touch screen, and the method includes:

Obtain multiple track points entered on the touch screen;

Determine the trajectory points belonging to the same graph according to the input time and coordinates of each trajectory point;

According to the coordinates of the track points belonging to the same graph, determine the coordinate system angle interval corresponding to the track offset included in the track formed by the track points belonging to the same graph;

The recommended figure is determined when the angle interval of the coordinate system corresponding to the trajectory offset included in the trajectory meets a preset rule.
The method according to claim 1, wherein the method further comprises:

A template control is displayed, the template control includes the identification of the recommended graphic
The method according to claim 1, wherein the determining the trajectory points belonging to the same graph according to the input time and coordinates of each trajectory point comprises:

Determine the consecutive multiple trajectory points as belonging to the same graph; and set the coordinate distance to any one of the multiple consecutive trajectory points to be less than the preset first distance threshold, and to the consecutive multiple trajectories A track point whose time interval between the input moment of the last track point in the points is less than a preset time threshold is determined to belong to the same graph as the multiple consecutive track points.
The method according to claim 1, wherein, according to the coordinates of the trajectory points belonging to the same graphic, determining the coordinate system angle interval corresponding to the trajectory offset included in the trajectory formed by the trajectory points belonging to the same graphic comprises:

Determine the offset of adjacent track points according to the coordinates of the adjacent track points in the track points belonging to the same graph, and determine the track offset included in the track formed by the track points belonging to the same graph according to the offset of the adjacent track points. Shift amount.
The method according to claim 4, wherein before the determining the offset of adjacent track points according to the coordinates of the adjacent track points among the track points belonging to the same graph, the method further comprises:

For the adjacent trajectory point formed by the N+1th trajectory point and the Nth trajectory point, if the distance between the N+1th trajectory point and the Nth trajectory point is less than the second distance threshold, replace it with the N+2th trajectory point The N+1th trajectory point is regarded as the adjacent trajectory point of the Nth trajectory point.
The method according to claim 4, wherein the determining the track offset included in the track formed by the track points belonging to the same graph according to the offset of the adjacent track points comprises:

Combine consecutive adjacent track point offsets in the same coordinate system angle interval into one track offset in the coordinate system angle interval.
The method according to any one of claims 1 to 6, wherein the angle interval of the coordinate system comprises:

The first angle interval within ±45° with the positive half axis of the X axis, the second angle interval within ±45° with the positive half axis of the Y axis, and the first angle interval within ±45° of the included angle with the negative half axis of the X axis The third angle interval and the fourth angle interval within ±45° of the negative half axis of the Y axis.
8. The method according to claim 7, wherein the determining the recommended graph when the angle interval of the coordinate system corresponding to the track offset included in the track conforms to a preset rule comprises:

When the trajectory only includes the trajectory offset in an angular interval of the coordinate system, determining that the recommended figure is a straight line;

When the trajectory includes two trajectory offsets in two adjacent angle intervals of the coordinate system, determining that the recommended figure includes at least one of a rectangle, a triangle, and a trapezoid;

When the trajectory includes two or three trajectory offsets in the angle interval of two opposite coordinate systems, determining that the recommended figure is a triangle;

When the trajectory includes three trajectory offsets of three adjacent coordinate system angle intervals sorted in a clockwise or counterclockwise direction, it is determined that the recommended graphics include a circle, an ellipse, a rectangle, a triangle, and a trapezoid. At least one of them.
The method according to claim 2, wherein, after the display of the template control,

The method further includes: in response to the first operation on the mark, using the coordinates of the first track point among the track points belonging to the same graph as the reference coordinates, and displaying the graph corresponding to the mark.
The method according to claim 2, wherein the display template control comprises:

The template control is displayed at the position corresponding to the trajectory formed by the trajectory points belonging to the same graph.
The method according to claim 2, wherein after the displaying the template control, the method further comprises:

If the length of the trajectory formed by the trajectory points belonging to the same graph is greater than the preset length threshold, then stop displaying the template control.
An electronic device, comprising: a processor, a memory, and a touch screen, the memory, the touch screen are coupled to the processor, the memory is used to store computer program code, the computer program code includes computer instructions, The computer instructions, when executed by the processor, cause the electronic device to perform the method according to any one of claims 1-11.
A non-transitory computer storage medium comprising computer instructions, when the computer instructions are executed by a processor of a terminal, the terminal is caused to execute the method according to any one of claims 1-11.