CN113407095A

CN113407095A - Terminal device and method and device for processing drawing content of terminal device

Info

Publication number: CN113407095A
Application number: CN202110695050.6A
Authority: CN
Inventors: 张卫华; 刘石磊
Original assignee: Samsung Electronics Co Ltd
Current assignee: Beijing Samsung Telecom R&D Center; Samsung Electronics Co Ltd
Priority date: 2016-04-12
Filing date: 2016-04-12
Publication date: 2021-09-17
Also published as: CN107291346A; CN107291346B

Abstract

The invention provides a method and a device for processing drawn content of terminal equipment, wherein the method comprises the following steps: positioning a drawing focus of a user based on drawing operation of the user; and according to the positioned drawing focus, carrying out corresponding processing on the drawing content displayed by the terminal equipment. The method, the device or the terminal equipment position the drawing focus according to the drawing operation of the user and correspondingly process the drawing content displayed by the terminal equipment based on the drawing focus, so that the frequent process of manually zooming and dragging the canvas for searching the drawing focus by the user is simplified, the drawing efficiency of the user is improved, and the flexibility of the user for drawing the content by using the terminal equipment is improved.

Description

Terminal device and method and device for processing drawing content of terminal device

The application is a divisional application of an invention patent application with the application number 201610225186.X, and the invention name of the invention is ' drawing content processing method and device of terminal equipment ' and terminal equipment '.

Technical Field

The present invention relates to the field of terminals, and in particular, to a method and an apparatus for processing a drawing content of a terminal device, and also to a terminal device.

Background

Because the screen size of the terminal is limited, in the prior art, when a user uses the terminal device to draw content, the user needs to continuously perform manual zooming and dragging operations to find a drawing focus (as shown in fig. 1a and fig. 1 b), the operation of the user is very complicated, the content drawing efficiency is low, the flexibility is poor, and after multiple manual zooming and dragging operations, the user cannot easily find the previous drawing position. After the user has carried out local detail drawing, often will want to look over the drawing effect and continue drawing, all by manual operation among the prior art, the frequent and drawing inspiration is interrupted easily of operation.

Meanwhile, when the user needs to perform detail supplement on each drawing target one by one after drawing the outline, if the user wants to switch the drawing targets, a series of manual operations of shrinking, dragging and enlarging the canvas are needed, and if the distance between the two drawing objects is long, the operation process is more inconvenient.

Disclosure of Invention

In order to solve the problems of complex operation, low rendering efficiency and poor flexibility caused by manually searching a rendering focus when a user uses a terminal device to render content in the prior art, an embodiment of the present invention provides a method for processing rendering content of a terminal device, including the following steps:

positioning a drawing focus of a user based on drawing operation of the user;

and according to the positioned drawing focus, carrying out corresponding processing on the drawing content displayed by the terminal equipment.

Wherein the drawing operation of the user comprises at least one of the following:

the user selects the operation of drawing a focus, the user pen-down operation and the drawing pen hovering operation.

Preferably, the user pen-down operation and/or the drawing pen hovering operation are determined based on a distance between the drawing pen and the terminal device.

Further, the drawing operation of the user includes: a user pen-down operation and/or a drawing pen hovering operation;

positioning a user drawing focus based on a drawing operation of a user, including at least one of:

confirming the mapping position of the drawing pen on the terminal screen as a user drawing focus;

determining a drawing focus of a user according to the drawing content related information of the local area where the mapping position is located;

and determining the current drawing focus of the user according to the historical drawing focus.

Optionally, the rendering content related information of the local area where the mapping position is located includes at least one of the following:

the line thickness of the drawing content, the line density of the drawing content, the line shape of the drawing content, the line color of the drawing content, the texture information of the drawing content and the boundary information of the drawing content.

Optionally, determining the current drawing focus of the user according to the historical drawing focus, wherein the current drawing focus of the user includes at least one of the following items:

confirming the historical drawing focus as a current drawing focus of the user;

and if the distance between the mapping position and the historical drawing focus is within a preset distance threshold range, confirming the historical drawing focus as the current drawing focus of the user, otherwise, confirming the mapping position as the current drawing focus of the user.

Specifically, the corresponding processing of the drawing content displayed by the terminal device includes at least one of the following:

the method comprises the steps of carrying out zooming-in processing, zooming-out processing, moving the display position of a drawing focus, switching a drawing object, displaying drawing reference information, adjusting the resolution of drawing content and expanding a canvas bearing the drawing content.

Specifically, the enlargement processing is triggered according to at least one of an operation of modifying a parameter of the drawing pen, drawing content related information corresponding to the drawing focus, and a user instruction.

Further, according to the operation of modifying the parameters of the drawing pen and/or the relevant information of the drawing content corresponding to the drawing focus, the drawing content is triggered to be amplified, and the method comprises the following steps:

estimating the drawing intention of the user according to the operation of modifying the parameters of the drawing pen and/or the relevant information of the drawing content corresponding to the drawing focus;

and if the drawing intention of the user is estimated to be fine drawing, triggering to amplify the drawing content.

Preferably, the magnification factor at which the magnification processing is performed is determined by at least one of:

modifying the operation of drawing pen parameters, drawing content related information corresponding to the drawing focus, the distance between the drawing pen and the terminal equipment, the pen-falling speed and the terminal screen size.

Preferably, the drawing pen parameters include at least one of pen type, line color, and texture information.

Optionally, the drawing content related information corresponding to the drawing focus includes at least one of the following:

the method comprises the steps of drawing the thickness of lines of content, the density of the lines of the content, the shape of the lines of the content, the proportion of the content in a canvas and the proportion of the content in a canvas area displayed on a terminal screen; history processing information of the drawn content, history processing information of drawn content associated with the drawn content.

Optionally, the narrowing-down process is triggered according to at least one item of historical processing information of the drawing content corresponding to the user pen-up operation, the user instruction, and the drawing focus.

Optionally, the reduction multiple performed by the reduction processing is determined by at least one of:

the distance between the drawing pen and the terminal equipment, the pen-lifting speed, historical processing information of the drawing content corresponding to the drawing focus, the correlation of the drawing content corresponding to the drawing focus and the terminal screen size.

Optionally, the relevance of the drawing content corresponding to the drawing focus includes at least one of: temporal correlation, spatial correlation, render object correlation, style correlation.

Specifically, moving the display position of the drawing focus includes:

moving a user drawing focus to a preset position of a terminal screen for displaying; and/or

And moving the display position of the drawing focus of the user, and enabling the drawing focus to correspond to the mapping position of the drawing pen on the terminal screen.

Optionally, switching of the drawing object is triggered according to at least one of a user pen-up operation, a user instruction, similarity between the drawing objects, a display position of the drawing object to be drawn, and history processing information of the drawing content corresponding to the drawing focus.

Specifically, the switched drawing object is determined according to at least one of the following items:

a distance between drawing objects corresponding to the user drawing focus;

similarity between drawing objects corresponding to the user drawing focus;

and (5) user instructions.

Further, the method also comprises the following steps: and adjusting the scaling of the canvas according to the size of the switched drawing object.

Specifically, the pen-up operation of the user is determined based on a distance between the drawing pen and the terminal device.

Optionally, the resolution of the drawing content is triggered and adjusted according to at least one of the change of the canvas scaling and the user instruction.

Specifically, the adjusted resolution is determined according to the current canvas size, the terminal screen size and the terminal screen resolution.

Preferably, the adjusting the resolution of the rendered content comprises at least one of: interpolation processing, natural boundary smoothing processing, line interior smoothing processing and contour adjustment.

Optionally, the canvas bearing the drawing content is triggered and expanded according to at least one of the drawing pen motion trend, the canvas area displayed by the terminal screen, and a user instruction.

Further, after the canvas carrying the drawing content is expanded, the method further comprises the following steps:

and fitting the drawing content of the user in the expanded canvas according to the drawing track of the drawing pen in the canvas and the movement trend of the drawing pen.

Specifically, the displaying of the drawing reference information includes:

and searching the drawing reference information according to the drawing content corresponding to the drawing focus, and displaying the searched drawing reference information.

Specifically, the searching for the drawing reference information according to the drawing content corresponding to the drawing focus includes:

and searching drawing reference information according to the content similarity and/or style similarity of the drawing content corresponding to the drawing focus.

Further, the method also comprises the following steps:

and adjusting the display mode of the drawing reference information based on the display mode of the drawing content corresponding to the drawing focus.

Specifically, the display mode includes a scaling and/or a display position.

Another embodiment of the present invention provides a drawn content processing apparatus of a terminal device, including:

a positioning module: the system comprises a positioning module, a drawing module and a control module, wherein the positioning module is used for positioning a drawing focus of a user based on the drawing operation of the user;

a processing module: and the system is used for carrying out corresponding processing on the drawing content displayed by the terminal equipment according to the positioned drawing focus.

Still another embodiment of the present invention also provides a terminal device for executing the drawn content processing method.

According to the method, the device or the terminal equipment, the drawing focus is positioned according to the drawing operation of the user, and the drawing content displayed by the terminal equipment is correspondingly processed based on the drawing focus, so that the frequent processing of manually zooming and dragging the canvas for searching the drawing focus by the user is simplified, the drawing efficiency of the user is improved, and the flexibility of the user for drawing the content by using the terminal equipment is improved.

Additional aspects and advantages of the invention will be set forth in part in the description which follows, and in part will be obvious from the description, or may be learned by practice of the invention.

Drawings

The foregoing and/or additional aspects and advantages of the present invention will become apparent and readily appreciated from the following description of the embodiments, taken in conjunction with the accompanying drawings of which:

FIG. 1a is a diagram illustrating a manual zooming canvas in the prior art;

FIG. 1b is a diagram illustrating a canvas dragged manually according to the prior art;

FIG. 2 is a flowchart illustrating a terminal device according to an embodiment of the present invention;

fig. 3 is a schematic flow chart of a method for processing a drawing content of a terminal device according to an embodiment of the present invention;

FIG. 4 is a diagram illustrating a user selecting a drawing focus according to an embodiment of the present invention;

FIG. 5 is a schematic diagram illustrating determination of a drawing focus according to a pen-down position according to an embodiment of the present invention;

FIG. 6 is a schematic diagram illustrating the determination of a drawing focus according to a closed local area where a pen-down position is located in the embodiment of the present invention;

FIG. 7 is a schematic diagram of a modified pen type according to an embodiment of the present invention;

FIGS. 8a and 8b are exemplary diagrams of rendering contents corresponding to a rendering focus in an embodiment of the present invention;

FIG. 9 is a schematic diagram illustrating an overall drawing effect viewed by a pen lift in an embodiment of the present invention;

FIG. 10 is a schematic diagram of coordinates of changes in the scaling of a canvas with the height of a pen in the embodiment of the present invention;

FIG. 11 is a schematic diagram of coordinates of changes in scaling of canvas on different terminal devices along with a pen-up height according to an embodiment of the present invention;

FIG. 12 is a diagram illustrating switching rendering objects according to an embodiment of the present invention;

FIG. 13 is a diagram illustrating a terminal screen displaying an entire canvas according to an embodiment of the present invention;

FIG. 14 is a schematic diagram of adaptive resolution adjustment according to an embodiment of the present invention;

FIG. 15 is a schematic diagram of a relationship coordinate of a canvas resolution and a canvas scaling ratio according to an embodiment of the present invention;

FIG. 16a is a schematic diagram illustrating coordinates of a scaling relationship between a terminal display resolution and a canvas in an embodiment of the present invention;

FIG. 16b is a schematic diagram illustrating a coordinate of a scaling relationship between a terminal display screen size and a canvas in an embodiment of the present invention;

FIG. 17 is a schematic diagram of boundary smoothing processing according to an embodiment of the present invention;

FIG. 18 is a schematic view of an embodiment of the present invention, with additional internal details;

FIG. 19 is a schematic diagram illustrating partial trimming according to an embodiment of the present invention;

FIG. 20 is a diagram illustrating a process of expanding a canvas according to an embodiment of the present invention;

FIG. 21 is a diagram illustrating effects of writing end supplement according to an embodiment of the present invention;

FIG. 22a is a diagram illustrating an expansion effect of a canvas according to an embodiment of the present invention;

FIG. 22b is a diagram illustrating an effect of a virtual canvas in an embodiment of the present invention;

FIG. 23 is a schematic diagram illustrating recommended reference picture effect according to an embodiment of the present invention;

FIG. 24 is a schematic diagram illustrating an effect of dynamically adjusting a display mode of a reference picture according to an embodiment of the present invention;

FIG. 25 is a drawing illustrating style recommendation drawing in accordance with an embodiment of the present invention;

fig. 26 is a schematic structural diagram of a device for processing rendered contents of a terminal device according to the present invention;

fig. 27 is a schematic diagram of a specific process of the terminal device in the drawing process according to the present invention.

Detailed Description

Reference will now be made in detail to embodiments of the present invention, examples of which are illustrated in the accompanying drawings, wherein like or similar reference numerals refer to the same or similar elements or elements having the same or similar function throughout. The embodiments described below with reference to the drawings are illustrative only and should not be construed as limiting the invention.

The drawing order when the user draws is generally: the overall outline layout is outlined first, and then the detail information is filled one by one. Based on the drawing habits of users, the invention provides an intelligent drawing system, the basic flow chart of which is shown in FIG. 2, when the user outlines, the system automatically identifies drawing objects and classifies similar drawing objects; when a user fills detailed information for drawing objects one by one, the system intelligently positions a drawing focus of the user according to operation of selecting the drawing focus by the user, pen-down operation of the user, hovering operation of a drawing pen and the like, automatically triggers a function of intelligently amplifying the canvas according to operation of modifying parameters of the drawing pen, drawing content related information corresponding to the drawing focus, a user instruction and the like, calculates amplification factors of the canvas, intelligently amplifies the canvas based on the drawing focus, and avoids frequent operation of manually amplifying the canvas by the user.

When a user draws details of an object, the system triggers the function of intelligently reducing the canvas according to pen lifting operation, user instructions, historical processing information of drawing content corresponding to a drawing focus and the like in the process of drawing the details by the user, if the system judges that the user wants to check the global content, the whole canvas can be directly displayed, otherwise, the system calculates the reduction multiple of the canvas, and the canvas is intelligently reduced based on the drawing focus, so that the operation that the user frequently and manually reduces the canvas is avoided.

When the user drops the pen again after lifting the pen, the system judges whether the drawing object needs to be switched, if the drawing object does not need to be switched, the system can move the display position of the drawing focus, for example, the drawing focus corresponds to the mapping position of the drawing pen on the terminal screen, the user does not need to manually drag canvas to search the drawing focus, and the detailed content can be directly drawn at the position before lifting the pen.

If the drawing objects need to be switched, the system can determine the switched drawing objects according to the distance, the similarity and the user instruction between the drawing objects corresponding to the user drawing focuses, the system automatically switches the drawing objects, after the drawing objects are switched, the switched drawing objects correspond to the current drawing focuses of the user, the system adjusts the scaling of the canvas based on the size of the switched drawing objects, and the user only needs to continuously draw detailed contents aiming at the switched drawing objects and does not need to manually drag the canvas to select the next drawing object.

Based on the above principle, referring to fig. 3, an embodiment of the present invention provides a method for processing a drawing content of a terminal device, which specifically includes the following steps:

s101, positioning a drawing focus of a user based on drawing operation of the user; and S102, carrying out corresponding processing on the drawing content displayed by the terminal equipment according to the positioned drawing focus.

In the embodiment of the present invention, the drawing focus is a local area or a position that a user needs to draw, where the user drawing operation in step S101 includes at least one of the following: the user selects the operation of drawing a focus, the user pen-down operation and the drawing pen hovering operation.

Firstly, determining a specific drawing focus mode according to the operation of selecting the drawing focus by a user as follows:

a user directly selects a local area or a position to be drawn on the canvas, as shown in fig. 4, the user selects the local area to be drawn on the display screen by a circle selection method, or the user directly clicks on the display screen to select the position to be drawn, and after the terminal device detects the operation of the user, the local area or the position selected by the user is confirmed as the local area or the position to be drawn by the user, that is, the user draws a focus.

In fig. 4, after the user selects the drawing focus, the terminal device automatically enlarges the canvas according to the located drawing focus, and the user can perform fine drawing on the enlarged canvas for the drawing focus.

And secondly, determining the pen-down operation and/or the pen-hovering operation of the user based on the distance between the pen and the terminal equipment. Specifically, the positioning of the drawing focus based on the pen-down operation and/or the drawing pen-hovering operation of the user includes at least one of:

1. confirming the mapping position of the drawing pen on the terminal screen as a user drawing focus;

the terminal equipment can detect the distance between the drawing pen and the terminal equipment, and when the distance between the drawing pen and the terminal equipment reaches the set triggering distance, the terminal equipment detects a pen-down event. At this time, the current mapping position of the drawing pen on the screen is the pen-falling position of the drawing pen, and the position is used as the position which the user needs to draw, namely the drawing focus.

Similarly, the terminal device can detect the distance between the drawing pen and the terminal device, and when the distance between the drawing pen and the terminal device reaches the set trigger distance and stays for a period of time, the terminal device detects the hovering event of the drawing pen. At this time, the current mapping position of the drawing pen on the screen is the hovering position of the drawing pen, and the position is used as the position which the user needs to draw, namely the drawing focus.

2. Determining a drawing focus of a user according to the drawing content related information of the local area where the mapping position is located;

the drawing content related information of the local area where the mapping position is located comprises at least one of the following items: the line thickness of the drawing content, the line density of the drawing content, the line shape of the drawing content, the line color of the drawing content, the texture information of the drawing content and the boundary information of the drawing content.

After the terminal device detects the pen-falling position or the hovering position of the drawing pen, a local area where the pen-falling position or the hovering position is located is determined in the canvas according to the thickness of lines, the density of the lines, the line color, the line shape, the texture information and the like of the content drawn at the pen-falling position or the hovering position, and the local area is used as a local area needing to be drawn by a user, namely the user draws a focus.

As shown in fig. 5, the terminal device detects that the pen-down position of the user is an animal eye, and the lines of the animal eye are thin and dense, the colors are all black, and the difference from other areas is large, so that the area of the animal eye can be confirmed as the drawing area of the user. In fig. 5, the terminal device automatically enlarges the canvas according to the located drawing focus, and the user can perform fine drawing on the enlarged canvas for the drawing focus.

In addition, the terminal device may further position the drawing focus according to boundary information (such as a boundary outline) of the drawing content at the pen-down position or the hover position, for example, according to the boundary information of the drawing content at the pen-down position or the hover position, the terminal device may determine a closed local area where the pen-down position or the hover position is located, and use the determined closed local area as a local area that needs to be drawn by the user, that is, the user drawing focus.

As shown in fig. 6, when the terminal device detects the pen-down position of the drawing pen, the boundary contour of the area where the pen-down position is located may be extracted, so as to determine the closed local area where the pen-down position is located. In fig. 6, the terminal device automatically enlarges the canvas according to the located drawing focus, and the user can perform fine drawing on the enlarged canvas for the drawing focus.

3. And determining the current drawing focus of the user according to the distance between the mapping position and the historical drawing focus.

Wherein the historical mapping focus comprises at least one of:

a drawing focus when the user draws the content last time; when the user drops the pen again after lifting the pen, lifting the drawing focus in front of the pen; the user has previously drawn the focus of the drawing when the content within the region in which the mapped location is located.

The terminal equipment can directly confirm the historical drawing focus as the current drawing focus of the user, can also detect the distance between the mapping position and the historical drawing focus, if the distance is within the range of a preset distance threshold, the historical drawing focus is confirmed as the current drawing focus of the user, and otherwise, the mapping position is confirmed as the current drawing focus of the user.

1) Drawing focus when the user draws the content last time:

the embodiment of the invention provides that the terminal equipment records a drawing focus of a user before the terminal equipment is interrupted at the moment, and when the user uses the terminal equipment to reenter the drawing application, the terminal equipment can directly take the drawing focus before the interruption (namely the drawing focus when the user draws the content last time) as the current drawing focus of the user. Or, the terminal detects the current pen-down position or hover position of the user, if the pen-down position or hover position is very close to the previous drawing focus when drawing the content, the user is considered to continue drawing the content, the drawing focus when drawing the content at the previous time can be directly used as the current drawing focus of the user, and if the pen-down position or hover position is very far from the previous drawing focus when drawing the content, the user is considered to draw other content, the mapping position can be directly used as the current drawing focus of the user.

2) When the user drops the pen again after lifting the pen, the drawing focus before lifting the pen

Due to the limited screen of the terminal device, when a user uses the terminal device to draw, the user often needs to check the effect of the drawn part in the whole after drawing a plurality of pens, and then continues to draw or modifies the drawn part. The embodiment of the invention provides that when the terminal device detects the pen-up operation, the terminal device records the user drawing focus before the pen-up operation, and when the terminal device detects the pen-down operation or the drawing pen hovering operation, the terminal device can directly take the drawing focus before the pen-up operation as the current drawing focus of the user. Or, the terminal detects the current pen-down position or the hover position of the user, if the pen-down position or the hover position is very close to the rendering focus before pen-up, the user is considered to continue to render the content, the rendering focus before pen-up may be directly used as the current rendering focus of the user, and if the pen-down position or the hover position is far from the rendering focus before pen-up, the user is considered to render other content, the mapping position may be directly used as the current rendering focus of the user.

3) A drawing focus when the user previously draws the content in the region where the mapping position is located

When a user uses a terminal device to draw, the content a is often drawn first, and then the content B is drawn, and when the content B is drawn, the content a may need to be modified. The embodiment of the invention provides that when a user draws content, the terminal equipment records the corresponding relation between the area where the drawing focus is located and the drawing focus, the terminal equipment detects the local area where the mapping position is located after detecting pen-down operation or hovering of the drawing pen, then the drawing focus corresponding to the local area is determined according to the recorded content, and the terminal equipment can directly take the drawing focus corresponding to the local area as the current drawing focus of the user. Alternatively, if the mapping position is very close to the rendering focus corresponding to the local area, the rendering focus corresponding to the local area may be directly used as the current rendering focus of the user, and if the pen-down position is far from the rendering focus corresponding to the local area, the mapping position may be directly used as the current rendering focus of the user.

Due to the fact that the screen of the terminal device is limited, when a user uses the terminal device to draw, the user often needs to check the effect of the drawing part in the whole after drawing a plurality of pens, then continues drawing or modifies the drawn part, at the moment, the user often needs to enlarge the canvas to find the drawing position before checking, and the drawing process is often interrupted by the frequent processing. Therefore, in the embodiment of the invention, after the terminal device triggers the intelligent canvas reducing function, the drawing intention of the user can be determined according to the hovering position of the drawing pen.

The distance between the drawing pen and the terminal equipment can be obtained by automatically selecting the best communication mode according to the electric quantity or network conditions of the terminal equipment, and can also be obtained through wearable equipment. For example, the distance between the drawing pen and the terminal device can be obtained by means of a mobile network, Wi-Fi, bluetooth, ultrasound, infrared, sensors, etc. If the electric quantity of the drawing pen is sufficient, the fastest transmission mode can be selected for obtaining, otherwise, the mode with low electric consumption is selected for obtaining; or, selecting a mobile network or Wi-Fi transmission according to the network condition of the space; can also be directly obtained through a front camera or a wearable device.

Specifically, when drawing with the terminal device, the user may draw on the screen with a drawing pen or a finger.

In step S102, the processing of the drawing content displayed by the terminal device includes at least one of: the method comprises the steps of carrying out zooming-in processing, zooming-out processing, moving the display position of a drawing focus, switching a drawing object, displaying drawing reference information, adjusting the resolution of drawing content and expanding a canvas bearing the drawing content. The respective processes are explained in detail below:

first, amplification treatment

The drawing order when the user draws is generally: the overall outline layout is outlined first, and then the detail information is filled in detail. The embodiment of the invention provides that after a user outlines the overall outline layout, in the process of supplementing details, the drawing focus is automatically positioned, and the canvas is intelligently zoomed according to the drawing focus. In addition, the scheme of the invention can also be applied to the process of outlining the overall outline layout by a user. In the process that a user uses the terminal device to draw, the terminal device can adopt the technical scheme of the invention to intelligently zoom the canvas based on the drawing focus, thereby improving the drawing experience of the user.

In the process of drawing by a user, if the canvas is large, when the user performs detail supplement, the area needing to be drawn generally needs to be enlarged, and then the detail is drawn. Therefore, when the embodiment of the invention provides that the user performs detail supplement, the terminal device can automatically amplify and move the current canvas, and amplify and display the local area needing to be drawn currently, namely the user draws the focus.

For example, after a user outlines the overall layout, the terminal device recognizes a drawing object according to information such as content, lines, color and the like of a drawn part by combining an image recognition technology, when the user starts to draw details of a certain drawing object in the canvas, drawing pen parameters such as pen type and line type are usually changed, the operations can be used for triggering the function of intelligently amplifying the canvas, and can also be used for calculating the scaling when amplifying the canvas, and the terminal device intelligently amplifies the canvas based on a drawing focus.

The specific embodiment is as follows: the method comprises the following steps that a user draws a pond moonlight graph, firstly, the scene is integrally laid out, a main outline is outlined, at the moment, the system identifies the pond moonlight graph, and classifies drawn objects such as lotus, lotus leaves and fish according to the similarity among the drawn objects, at the moment, the pen type is changed by the user, the pen point becomes thin, the line color is changed into pink, the terminal equipment estimates that the user possibly wants to draw petals of the lotus, and the user suspends a drawing pen on the petals of one lotus, at the moment, the terminal equipment automatically enlarges the lotus to a proper proportion, and the petals of the lotus are used as drawing focuses to be enlarged and displayed; if the user changes the thinner pen into yellow and places the pen at the center of the lotus, the terminal equipment automatically increases the scaling so that the user can draw the pistil of the lotus.

The embodiment of the invention provides that the terminal equipment positions a user drawing focus, triggers the function of intelligently amplifying the current canvas when detecting that the triggering condition of intelligently amplifying the current canvas is met, and displays the user drawing focus in an amplifying way on the display screen based on the drawing focus intelligently amplifying canvas.

The process of positioning the user drawing focus is consistent with the above description, and is not repeated here.

Specifically, the processing of intelligently amplifying the current canvas can be triggered by at least one of the following ways:

1. modifying drawing pen parameters

After detecting the event that the user modifies the parameters of the drawing pen, the terminal device estimates the drawing intention of the user according to the event that the user modifies the parameters of the drawing pen, so as to determine whether the triggering condition for intelligently amplifying the current canvas is met. If the drawing intention of the user is estimated to be fine drawing, the condition that the triggering condition for triggering intelligent amplification of the current canvas is met is considered, and the terminal equipment automatically triggers the amplification processing of the current canvas, namely the amplification processing of the drawing content is carried out.

a. Modifying the pen type:

the different pen types have different purposes when drawing, and the terminal device can determine the drawing intention of the user according to the purposes of the various pen types. For example, after the user uses a pencil to perform contour delineation, other pens, such as crayons and watercolors, are replaced, the terminal device judges the drawing intention of the user according to an event of replacing the pen, and possibly wants to fill a local area, and at this time, the terminal device confirms that the triggering condition of intelligently amplifying the current canvas is satisfied.

After the pen type is modified, the thickness of the drawing pen may also change correspondingly, and the terminal device may determine the drawing intention of the user according to the thickness of the drawing pen. When a user wants to draw details, the user usually changes the pen type suitable for the drawing details, as shown in fig. 7, the user changes from a thick big script to a thin small script, the terminal device judges the drawing intention of the user according to the comparison of the thickness of the drawing pen before and after the change of the pen type, and if the user wants to draw some more delicate parts, the terminal device judges that the canvas needs to be enlarged, and the trigger condition for intelligently enlarging the current canvas is confirmed.

After the pen type is modified, the texture/color information of the drawing pen may also be changed correspondingly, and the terminal device may determine the drawing intention of the user according to the texture/color information of the drawing pen. If the user uses a black common drawing pen to perform contour delineation before and then changes a colored drawing pen with special textures, the terminal equipment judges the drawing intention of the user according to the modification event, and needs to perform special effect drawing on the part, and at the moment, the terminal equipment confirms that the triggering condition for intelligently amplifying the current canvas is met.

b. Modifying the line type:

the terminal device may determine the drawing intention of the user from the thickness of the line type. For example, a user usually uses a thinner line type to draw a detailed part, the system judges the drawing intention of the user according to an event of changing the line type, and may want to perform fine drawing on a local area of a canvas, and at this time, the terminal device confirms that a trigger condition for intelligently amplifying the current canvas is satisfied.

c. Line color modification:

the terminal device may determine the drawing intention of the user from the line color. For example, if the user uses a black line to outline before, and then changes a color line, the system will determine the drawing intention of the user according to the modification event, and should be to draw a special effect on the part, and at this time, the terminal device confirms that the triggering condition for intelligently amplifying the current canvas is satisfied.

2. Drawing content related information corresponding to drawing focus

The terminal equipment determines the content needing to be drawn by the user, namely the drawing content corresponding to the drawing focus, according to the drawing focus of the user, estimates the drawing intention of the user according to the content relevant information needing to be drawn, and determines whether the triggering condition for intelligently amplifying the current canvas is met according to the drawing intention of the user. If the drawing intention of the user is estimated to be fine drawing, the condition that the triggering condition for triggering intelligent amplification of the current canvas is met is considered, and the terminal equipment automatically triggers the amplification processing of the current canvas, namely the amplification processing of the drawing content is carried out.

a. And determining whether the content needs to be drawn finely by the user according to the thickness of lines, the shape of the lines, the density of the lines and the like of the content needing to be drawn.

For example, the lines of the content which needs to be drawn by the user at present are thin and dense, and at this time, the terminal device confirms that the content which needs to be drawn is the content which needs to be drawn by the user finely, so that the triggering condition for intelligently amplifying the current canvas is met.

b. And determining whether the content needs to be finely drawn for the user according to the proportion of the content needing to be drawn in the whole canvas or the proportion of the content in the currently displayed canvas area of the terminal screen.

And when the proportion of the content needing to be drawn in the whole canvas or the proportion of the content in the currently displayed canvas area of the terminal screen is smaller than a set proportion threshold value, confirming that the triggering condition for intelligently amplifying the current canvas is met.

The different terminal devices may correspond to different scale thresholds, for example, the scale threshold of the mobile phone is larger than that of the tablet, that is, the same content may need to be displayed in an enlarged manner when being drawn on the mobile phone, and may not need to be displayed in an enlarged manner when being drawn on the tablet.

c. And determining whether a function of intelligently amplifying the current canvas needs to be triggered according to the historical processing information of the content needing to be drawn.

For example, when drawing with a terminal device, a user often needs to check the effect of a drawn part in the whole after drawing several pens, and then continue drawing or modify the drawn part. After the terminal device detects the pen-up operation of the user, processing information of the drawing content corresponding to the drawing focus before the pen-up operation is recorded, wherein the processing information comprises an amplification state and the like. If the drawing content before the pen is lifted is the content displayed after the amplification processing, it can be confirmed that the triggering condition for intelligently amplifying the current canvas is met.

d. And determining whether a function of intelligently amplifying the current canvas needs to be triggered according to historical processing information of drawn contents associated with the contents needing to be drawn.

The association method may be content similarity or other association methods.

The history processing information may include, but is not limited to, an enlarged state of the drawn content.

For example, a user draws a plurality of similar objects one by one, where object a and object B are two of the objects, when object a is drawn, there is an object similar to object a, that is, object B, in the drawn content, and when object B is drawn, the terminal device performs the function of the smart zoom canvas, and when the magnification is Ka, the terminal device confirms that the function of the smart zoom canvas needs to be performed also when object a is drawn.

In another case, when the content a is drawn, if there is no content similar to the content a in the drawn content, the system may determine whether the trigger condition for intelligently enlarging the current canvas is satisfied according to other manners, and if the enlargement state determined by the system at this time does not meet the habit of the user, the user may zoom the canvas in manners such as gestures to assist in adjusting the enlargement ratio of the canvas, for example, if the system determines that the trigger condition for intelligently enlarging the current canvas is not satisfied according to other manners, and therefore the canvas is not enlarged, or if the system determines that the current condition satisfies the trigger condition, and thereby the canvas is enlarged, but the enlargement ratio is inappropriate (too small or too large), the user may adjust the enlargement ratio of the canvas by using the enlargement gesture, and the system may record the enlargement state of the canvas when the content a is drawn, such as the enlargement ratio determined by the system, the enlargement ratio determined by the system, Information such as the canvas magnification factor adjusted by a user; when the content B is drawn, the system detects that the drawn content A is similar to the drawn content B, obtains the amplification state of the canvas recorded when the content A is drawn, preferentially considers whether the canvas is amplified when the content B is drawn according to the amplification state of the canvas when the content A is drawn, and adjusts the amplification factor when the canvas is amplified.

3. User instructions

The user can send out an intelligent current canvas amplification instruction through any one of interaction modes such as voice, keys, gestures and an external controller and any combination mode of the interaction modes, and after the terminal equipment detects the intelligent current canvas amplification instruction, the terminal equipment confirms that the triggering condition of the intelligent current canvas amplification is met.

Regarding to using voice to open, if the user presets a voice open command: and amplifying the canvas, and if receiving a voice control instruction 'amplifying the canvas' sent by a user, performing voice recognition on the voice control instruction so as to determine that the current canvas instruction is intelligently amplified.

The button is turned on by a button, the button may be a hardware button, for example, a volume key or a home key, the user may turn on the function of enlarging the current canvas by pressing the volume key '+' or the home key for a long time, and after the terminal device detects the long-time pressing operation event of the user, it is confirmed that the instruction of intelligently enlarging the current canvas is received at this time. The button may also be a virtual button in the drawing software, for example, a virtual control button, a menu, or the like on the screen, and after receiving an event that the user clicks the virtual button, the terminal device confirms that the current canvas instruction is intelligently amplified.

Regarding opening by gesture, the gesture includes screen gesture such as double-click on screen/long-press on screen, etc., and the gesture also includes blank gesture such as shaking/flipping/tilting the terminal. The gesture may be a single gesture or any combination of any gestures.

Regarding being turned on by the external controller, the external controller may be a drawing pen associated with the terminal, for example, when the terminal detects that the drawing pen is taken out and then quickly inserted back to the terminal, or a preset key on the drawing pen is pressed, or a user makes a preset air gesture using the drawing pen, it is determined that the current canvas instruction is received; the external controller may also be a wearable device or other device associated with the terminal, where the wearable device may be a smart watch, smart glasses, or the like, the wearable device or other device may access the terminal of the user through wifi and/or nfc and/or bluetooth and/or a data network, and the wearable device or other device confirms that the user wants to turn on the function of magnifying the current canvas through at least one of interaction means such as voice, key pressing, and gesture, and notifies the terminal device.

Furthermore, in the process of performing amplification processing on the canvas, the terminal device may first locate a drawing focus of a user, and then detect that a trigger condition for intelligently amplifying the current canvas is satisfied, for example, the user selects a local area to be drawn on the display screen by a circling selection method, and then changes the pen type, the terminal device determines the drawing area of the user by the circling operation of the user, and confirms that the trigger condition for intelligently amplifying the current canvas is satisfied according to the detected event for changing the pen type.

The terminal device may also detect a trigger condition that satisfies the intelligent current canvas magnification first, and then position the drawing focus of the user, for example, the user changes the pen type first, and then executes the drawing pen to approach the screen, the terminal device confirms that the trigger condition satisfies the intelligent current canvas magnification according to the detected event of changing the pen type, and detects the pen-down event through the distance between the drawing pen and the terminal device, thereby determining the drawing area of the user.

The terminal device may also perform the two steps at the same time, for example, the user selects a local area to be drawn on the display screen by a circling selection mode, the terminal device determines the drawing area of the user by the circling selection operation of the user, and confirms that the trigger condition for intelligently amplifying the current canvas is satisfied according to the thickness of lines and/or the density of the lines in the drawing area.

The current canvas is amplified according to the corresponding amplification factor, so that the amplified canvas meets the requirements of users. The embodiment of the invention determines the magnification factor executed by the amplification processing through at least one of the following items:

1. modifying drawing pen parameters

Wherein, the drawing pen parameter comprises at least one item of pen type, line color and texture information. After detecting the event that the user modifies the drawing pen parameters, the terminal device modifies at least one of the following information according to the drawing pen parameters: drawing pen thickness, drawing pen texture, line color, texture information, setting the current canvas magnification Ks, or setting the adjustment factor Ka of the current canvas magnification.

For the thickness of the drawing pen before and after the pen type/line type modification, the scaling factor k1 of the magnification factor of the current canvas can be set according to the thickness ratio of the drawing pen before and after the pen type modification. If the terminal device detects that the user is drawing the contour part of the object by using the pen type with the drawing pen width of w1 and then changes the pen type with the drawing pen width of w2(w2< w1), namely, changes the thinner pen type, the terminal device triggers the function of intelligently amplifying the current canvas, and the terminal device can set the proportionality coefficient k1 to w1/w2 according to the thickness proportion of the drawing pen before and after the modification of the pen type.

For the texture information of the drawing pen before and after the pen type modification, the terminal device may set the scaling factor k2 of the magnification of the canvas according to the texture change of the drawing pen before and after the pen type modification. If the terminal device detects that the user uses the black pen type of the common drawing pen to draw before, and then changes the color pen type of the drawing pen with the special texture, the terminal device triggers the function of the intelligent amplification canvas, and the terminal device can set different proportionality coefficients k2 according to the realization effect of the texture of the drawing pen before and after the modification of the pen type. Here, the scale factor when switching between different texture information may be preset, for example, the scale factor when switching from texture 1 to texture 2, the scale factor when switching from texture 1 to texture 3, and the like are preset. In addition, the terminal equipment can also adjust the set scale factor in real time according to the drawn content of the user.

For the color information of the lines before and after the pen type/line color modification, the terminal device may set the scaling factor k3 of the magnification of the canvas according to the color change of the lines before and after the modification. If the terminal device detects that the user uses black lines to draw before, and then changes colored lines, the terminal device triggers the function of the intelligent amplification canvas, and the terminal device can set different proportionality coefficients k3 according to the realization effect of line colors. The scale factor when switching between different line colors can be preset, and in addition, the terminal equipment can also adjust the set scale factor in real time according to the content drawn by the user.

The terminal device may determine the magnification factor only according to the drawing pen parameter modification, in which case, the terminal device may calculate the magnification factor according to the determined one scaling factor, for example, Ks ═ k1, Ks ═ k2, or Ks ═ k3, or may calculate the magnification factor according to a plurality of scaling factors, for example, the final canvas magnification factor Ks ═ k1 × k2 × k 3.

In addition, the terminal device may determine the magnification factor integrally with other information according to the drawing pen parameter modification, and in this case, the terminal device may calculate the magnification factor adjustment factor according to the determined one scaling factor, for example, Ka-k 1, Ka-k 2, or Ka-k 3, or may calculate the magnification factor adjustment factor according to a plurality of scaling factors, for example, Ka-k 1 × 2 × k 3.

2. Drawing content related information corresponding to drawing focus

The terminal device may determine the content that the user needs to draw, that is, the drawing content corresponding to the drawing focus, according to the user drawing focus, and determine the current canvas magnification Ks or determine the adjustment factor Kb of the current canvas magnification Ks according to the content related information that needs to be drawn.

Wherein, the drawing content related information corresponding to the drawing focus comprises at least one of the following items: the method comprises the steps of drawing the thickness of lines of content, the density of the lines of the content, the shape of the lines of the content, the proportion of the content in a canvas and the proportion of the content in a canvas area displayed on a terminal screen; history processing information of the drawn content, history processing information of drawn content associated with the drawn content.

a. The terminal device may determine the current canvas magnification Ks or determine the adjustment factor Kb of the current canvas magnification according to the thickness of the lines, the density of the lines, and the shape of the lines of the content to be drawn, and if the lines of the content to be drawn are finer, the magnification needs to be increased, otherwise, the magnification needs to be decreased.

As shown in fig. 8a, if the user draws a fine part such as an eye or a feather of an animal, and the lines are very fine, the magnification of the canvas needs to be increased appropriately, so that the user can draw detailed information more conveniently; as shown in fig. 8b, if the user draws a lotus leaf, the vein of the lotus leaf has many slender lines, and if the magnification is too large, the region of the canvas displayed on the screen becomes small, which is disadvantageous for drawing a longer line, and the magnification of the current canvas needs to be appropriately reduced, so that the magnification of the canvas needs to be adjusted with reference to the shape and region of the drawing content, and when the line is slender, the scaling of the current canvas is appropriately reduced.

b. The terminal device may determine the current canvas magnification Ks or determine the adjustment factor Kb of the current canvas magnification Ks according to the proportion of the content to be drawn in the entire canvas or the proportion in the currently displayed canvas area on the terminal screen.

For example, when the terminal device detects that the proportion of the content to be drawn in the current screen display canvas area is smaller than the preset threshold, the system may determine the scale factor Kb according to the proportion of the drawing content in the current screen display canvas area and the proportion of the current screen display canvas to the whole canvas, so as to appropriately increase the magnification ratio of the drawing content.

c. And determining the required magnification Ks of the current canvas or determining the adjustment factor Kb of the magnification of the current canvas according to the historical processing information of the content required to be drawn.

For example, when drawing with a terminal device, a user often needs to check the effect of a drawn part in the whole after drawing several pens, and then continue drawing or modify the drawn part. After the terminal device detects the pen-up operation of the user, the processing information of the drawing content corresponding to the drawing focus before the pen-up operation is recorded, wherein the processing information comprises an amplification state, such as an amplification factor and the like during amplification processing. The magnification factor corresponding to the drawing content before the pen is lifted can be used as the magnification factor when the current canvas is intelligently magnified after the pen is dropped.

c. The terminal device determines the required magnification Ks of the current canvas or determines the adjustment factor Kb of the magnification of the current canvas according to the processing information of the drawn content associated with the content required to be drawn.

The association method may be content similarity or other association methods.

The history processing information may include, but is not limited to, a magnification state of the drawn content, such as a magnification factor.

For example, if the terminal device detects that the user is the details of the first drawing object a, the system automatically searches whether the drawn content has a drawing object similar to the drawing object, if the drawn object B is similar to the object a, the enlargement state of the canvas for drawing the object B is obtained, if the drawn object B is not manually operated, the adjustment factor Kb of the canvas enlargement factor is calculated according to the enlargement factor intelligently calculated by the system for drawing the object B and the size ratio of the object a to the object B, and if the terminal device detects that the user has a manual zoom operation for drawing the object B, the adjustment factor Kb of the current canvas requiring the enlargement factor is set according to the enlargement factor of the canvas after the manual adjustment.

The terminal device may determine the magnification only according to the content to be rendered. In addition, the terminal device may also determine the magnification factor by integrating the content to be drawn with other information, and at this time, the terminal device may determine the magnification adjustment factor Kb.

3. Distance between drawing pen and terminal equipment

The distance between the drawing pen and the terminal device is different, the scaling of the canvas is possibly different, the smaller the distance between the drawing pen and the terminal device is, the finer the content displayed by the canvas is, namely the larger the scaling of the canvas is, and therefore the inverse ratio of the scaling factor Kc of the canvas to the distance can be set. As the distance of the drawing pen from the terminal device changes, the magnification of the canvas also changes.

The terminal equipment sets different canvas amplification proportions by detecting the height of the drawing pen from the terminal screen, the amplification proportion of the canvas is inversely proportional to the height of the drawing pen from the terminal screen, the amplification proportion changes linearly along with the height of the drawing pen from the terminal screen, and the amplification proportion can also be set to be nonlinear change along with the height of the drawing pen from the terminal screen, so that amplified drawing contents which change continuously along with the pen falling height of a user are displayed on the terminal screen. As mentioned above, the distance between the drawing pen and the terminal can be obtained by automatically selecting the best communication mode according to the electric quantity or the network condition, or can be obtained by the wearable device.

4. Speed of pen falling

When the user is slow in pen-down, the user generally wants to view the drawing content progressively, so a small magnification scale factor Kd can be set, and when the pen-down speed is high, the user generally wants to zoom in quickly for drawing, so a large magnification scale can be set. As the pen-down speed of the drawing pen changes, the magnification scale of the canvas may also change.

5. Terminal screen size

Different terminal equipment screen sizes are also different, when a user uses drawing application to draw the same detail information on different terminal equipment, the required amplification states are possibly different, for example, amplification is not needed when drawing on a flat plate, and amplification is needed when drawing on a mobile phone, so that the user has consistent experience when drawing the content with the same detail degree, after the intelligent amplification function of the canvas is triggered, the amplification factor Ke of the canvas needs to be correspondingly adjusted according to the screen size of the terminal equipment, namely the adjustment factor Ke of the current canvas amplification factor is determined according to the specific size of the screen of the terminal equipment.

For example, the screen sizes of three different types of terminal devices are s1, s2 and s3, the determined scaling ratios of the corresponding canvas are k1, k2 and k3, the size of the canvas and the size of the screen size of the terminal device are the same at the beginning, the scaling ratios of the canvas are all 1, after the terminal device triggers the intelligent canvas amplification function, in order to enable a user to draw the same details on different terminals, the canvas needs to be amplified to the same size, and the amplification factor of the canvas meets the requirement of the same size

We can choose a terminal as the standard, i.e. let Ke1 for the device, here say Ke 11, then

Furthermore, the terminal device can also respectively obtain the magnification adjustment factors according to each piece of information in the plurality of pieces of information, and then determine the final magnification of the canvas according to each obtained magnification adjustment factor. For example, the determined magnification adjustment factors are Ka, Kb, and Kc, respectively, so as to obtain the final canvas magnification Ks ═ Ka × Kb × Kc.

After the terminal equipment intelligently amplifies the canvas according to the amplification factor, the function of moving the display position of the drawing focus can be triggered. The positioned drawing focus of the user can be moved to a preset position of a terminal screen to be displayed after the canvas is amplified, and if the user moves to the middle position of the screen to be displayed, the user can conveniently position the drawing focus in the amplified canvas.

In addition, the display position of the drawing focus of the user can be moved, and the drawing focus is corresponding to the mapping position of the drawing pen on the terminal screen. At this time, the user does not need to move the pen-down position, and can directly draw the content on the amplified canvas.

The embodiment of the present invention provides that the function of moving the display position of the drawing focus may be performed after performing the amplification processing each time, for example, after intelligently amplifying the canvas each time, the terminal device may move the display position of the drawing focus to correspond to the pen-down position.

If the user lifts the pen to check the overall effect and then drops the pen to continue drawing the detailed content, the terminal device can also execute the processing of intelligently amplifying the current canvas, and therefore the terminal device can also move the display position of the drawing focus to correspond to the pen dropping position.

In the process of executing the enlargement processing on the current canvas, the enlargement processing can be executed in the following two ways:

1. gradually executing amplification processing according to the distance between the drawing pen and the terminal screen

The method comprises the steps that a user carries out drawing pen to be close to a terminal screen, the pen falling position is the position which the user wants to draw finely, at the moment, the terminal device continuously enlarges canvas along with the continuous reduction of the distance between the drawing pen and the screen, the enlargement factor when the canvas is enlarged is related to the distance between the drawing pen and the screen, and the terminal device takes the initial pen falling position as the drawing position of the user or takes the local area where the initial pen falling position is located as the drawing area of the user. The drawing position and the drawing area of the user are the drawing focus of the user.

In the process of enlarging the canvas, the drawing focus can be always displayed in the middle position of the screen, or the drawing focus always corresponds to the pen-falling position of the drawing pen.

When the user considers that the amplification proportion of the canvas is appropriate, the relative motion between the drawing pen and the screen can be stopped, namely, the distance between the drawing pen and the screen is kept unchanged, if the state lasts for a certain time, the terminal equipment can confirm that the canvas is not amplified any more, and the user can move the canvas to adjust the display position of the canvas.

In the amplification process, the amplification factor of the amplification canvas can be determined by the distance between the drawing pen and the screen, and can also be determined by being integrated with the other information.

2. Performing amplification processing in two steps

When a user outlines the whole outline and wants to draw finely, the proportion of the content which the user wants to draw finely in the canvas may be very small, the user is difficult to directly select the position which the user wants to draw, and at the moment, the terminal device can execute amplification processing twice.

First amplification treatment: the user can close to the terminal screen by executing a drawing pen, the pen-down position is in the area of the position where the user wants to draw finely, after the terminal detects the pen-down event, the object that the user wants to draw is automatically identified according to the pen-down position of the user, and the object is displayed on the terminal screen, and the user can confirm that the user wants to draw finely by some processing, for example, by voice, gesture, such as clicking the object, and the like. And the terminal equipment takes the area corresponding to the object as a drawing area, namely a user draws a focus, enlarges the canvas after determining the magnification factor, and displays the enlarged drawing area at the middle position of the screen.

And (3) second amplification treatment: in the canvas after the enlargements, the user can accurately select the position which the user wants to draw finely, at the moment, the user can drop the drawing pen to the position which the user wants to draw and hover, meanwhile, the terminal equipment can take the hovering position as the drawing position again, namely the drawing focus, the canvas is enlarged again after the magnification factor is determined, and the drawing position is displayed in the middle of the screen when the canvas after the enlargement is displayed.

In the above-mentioned enlargement process, the drawing content corresponding to the position selected by the user in the second enlargement process is different from the content of the drawing object in the first enlargement process in the corresponding line thickness/density/shape, the proportion of the drawing content in the entire canvas, and the enlargement state of the similar content that has been drawn, and therefore the enlargement factor in the second enlargement process is larger than that in the first enlargement process.

The above is only an exemplary illustration of the amplification process, and the specific implementation of the amplification process according to the present invention includes, but is not limited to, the above two manners, and the amplification process may be performed in a corresponding manner as the case may be, during the specific implementation process, and the specific implementation manner is not limited to the method according to the present invention.

Therefore, when the user draws the outlines and then begins to draw the object details one by one, the terminal device automatically captures the interaction event or draws the target part, the canvas is enlarged accordingly, the drawing focus is automatically positioned to the local area or position to be drawn by the user, the operation that the user manually drags the canvas and enlarges the canvas is avoided, the flexibility of the user for drawing the content by using the terminal device is improved, and the user experience is enhanced.

The terminal device calculates the canvas amplification factor according to the preset mode, possibly, the canvas amplification factor is not in line with the drawing habits of some users, the terminal device allows the user to interrupt/close the function of intelligently amplifying the current canvas according to the requirement, namely, the user can interrupt the terminal device to continue to execute the processing of intelligently amplifying the current canvas through some interactive modes in the process that the terminal device triggers and executes the processing of amplifying the current canvas, and the function of intelligently amplifying the current canvas can also be closed. The interrupt event can also trigger the terminal device to record the amplification factor of the canvas at the moment so as to adjust the amplification factor calculated in the subsequent intelligent amplification canvas processing process, so that the operation habit of a user can be better met.

Furthermore, the user can also realize interruption/closing of the function of intelligently amplifying the current canvas through any one of interaction modes such as voice, key, gesture, external controller and the like and any combination mode of the interaction modes. For example, the user may set a voice instruction "interrupt the zoom-in function" or "turn off the zoom-in function", or may control the current canvas function to be interrupted or turned off intelligently by a control command in the drawing software, a gesture such as turning, shaking, multi-finger operation, or some appointed operation on the external controller. In addition, the terminal equipment can automatically detect the operation of the user and automatically interrupt the intelligent amplification processing. For example, when the terminal device triggers a function of intelligently amplifying the current canvas and is executing a process of amplifying the current canvas, and it is detected that a finger of the user quickly clicks a screen of the terminal device or a drawing pen quickly falls to the screen, the terminal device considers that the user wants to interrupt the process of intelligently amplifying the current canvas, thereby interrupting the amplification process. Other intelligent processes described later in this document can be interrupted/closed by the user at any time, and are not described in detail later.

Second, reduce processing

If the canvas is very large, after a user supplements details of a certain object, the user generally needs to reduce the canvas, check the effect of the drawing details in the whole, check the position of the drawing before and modify or continue drawing, in the prior art, the user needs to reduce the canvas through gestures, drag the canvas to the area that the user wants to check, check the area that the user needs to manually move the canvas to the drawing before, and enlarge the canvas through gestures to modify or continue drawing, so that the operation of the user is very complicated.

The embodiment of the invention provides that after the user supplements the details, the terminal equipment can automatically reduce the canvas and display the area related to the current drawing content to check the overall drawing effect, and automatically enlarge the canvas according to the previous enlargement state after the user checks the overall drawing effect.

For example, the following steps are carried out: after the user fills the details, the user usually wants to check the effect of the drawing part in the whole, such as whether the colors are coordinated or not and whether the density of lines is appropriate or not, and then the user can lift the drawing pen, calculate the scaling according to the distance between the drawing pen and the terminal, and gradually see the display effect of the drawing part in the relevant area, thereby determining whether the modification is needed or not. When the user finishes the whole drawing effect or continues drawing or modifying after being interrupted by emergencies such as calls, information and the like, and the pen falls to the position drawn before the screen, the drawing focus is automatically corresponding to the pen falling position, and the complicated operation that the user manually searches the drawing focus is avoided.

As shown in fig. 9, when a user is drawing the eyes of a bird and wants to check whether the position, color, lines, etc. of the drawn eyes on the head of the bird are coordinated, the user may raise the drawing pen a little, the distance between the drawing pen and the terminal device corresponds to the distance d1 in fig. 9, the canvas will automatically reduce the canvas to present a head area having a relatively large correlation with the eyes of the bird, if the user feels that the drawing pen still needs to be modified or continue to draw, the drawing pen hovers after moving to the drawing position before the pen is lifted, the pen-falling focus is automatically positioned to the last drawn position, if the user feels that the displayed area is too small to check the effect of the eyes on the whole body, some pen is raised again, the distance between the drawing pen and the terminal device corresponds to the distance d2 in fig. 9, the canvas will reduce again to present the whole body of the bird, the canvas will automatically adjust the zoom ratio of the canvas according to the height of the pen lifted, when the distance between the pen and the terminal reaches a certain value, the whole canvas is displayed on the screen.

Fig. 10 is a schematic diagram of a change of a scaling of a canvas along with a pen-up height (a distance between a drawing pen and a terminal device) when a pen is lifted to view an overall drawing effect, in the diagram, k0 is the scaling of the canvas during current drawing, H0 is the pen-up height when the current canvas is triggered to be intelligently reduced, H1 is a maximum response height of a pen-up event, and when the pen-up height reaches or exceeds H1, the scaling of the canvas is 1, that is, the size of the canvas is equal to the size of the terminal screen.

Specifically, the process of intelligently narrowing down the current canvas may be triggered by at least one of the following ways:

1. user pen up operation

When a user wants to view the overall effect after supplementing details, the general processing is to lift the drawing pen, and the terminal device triggers the function of intelligently narrowing the current canvas according to the pen lifting event of the drawing pen. As shown in fig. 10, when the terminal detects that the height of the drawing pen from the terminal screen is less than H0, it is considered that the user is drawing the detailed part, and when the terminal detects that the height of the drawing pen from the terminal screen reaches H0, it is considered that this is a pen up event of the user.

And the pen-lifting height is different, the range that the user wants to see is also different, and the display range on the terminal screen is also different, then the pen-lifting event of the drawing pen triggers the function of intelligently narrowing the canvas. The distance between the drawing pen and the terminal equipment can be detected by the terminal equipment, and when the distance between the drawing pen and the terminal equipment reaches a set trigger distance, the terminal equipment detects a pen lifting event. The terminal equipment can automatically lock the function of intelligently reducing the current canvas after triggering the intelligent amplification function until automatically exiting from the locking mode when drawing operation exists, namely, if the terminal equipment executes the intelligent amplification canvas function, a user does not perform any drawing, and when the terminal equipment detects a drawing pen lifting event, the terminal equipment considers that the function of intelligently reducing the current canvas does not need to be triggered.

2. User instructions

The user can send out the intelligent canvas reduction instruction through interaction modes such as voice, gestures, keys, an external controller and the like and any combination mode of the interaction modes, and after the terminal equipment detects the intelligent canvas reduction instruction, the function of intelligently reducing the canvas is triggered. For example, the user may turn on the "canvas down" by presetting a voice turn-on instruction, may press a volume '-' key or a control button in the drawing software for a long time, may also turn on the screen by any one or a combination of any plural ways, such as a multi-finger touch screen, a shaking terminal, a flipping terminal, a tilting terminal, and the like, or may also turn on the screen by an external controller, such as a drawing pen, a wearable device, and the like.

3. History processing information of drawing contents corresponding to drawing focus

The terminal equipment determines whether a function of intelligently zooming out the current canvas needs to be triggered or not according to the historical processing information (including the zooming-in state) of the current drawing content (namely the drawing focus). If the current drawing content is detected to be the content displayed after the amplification processing, namely the current canvas is in the amplification state, the function of intelligently reducing the current canvas can be triggered, otherwise, if the current canvas is not amplified, the function of intelligently reducing the current canvas does not need to be triggered.

And performing reduction processing on the current canvas, wherein reduction is required to be performed according to the corresponding reduction multiple so that the reduced canvas meets the requirements of users. The embodiment of the invention determines the reduction multiple executed by the reduction processing through at least one item of the following items:

1. distance between drawing pen and terminal equipment

The distance between the drawing pen and the terminal device is different, the scaling of the canvas is different, the higher the lifting height of the drawing pen is, the larger the region displayed by the canvas is, namely the smaller the scaling of the canvas is, and therefore the inverse proportion of the scaling factor Ka of the canvas to the distance can be set.

The terminal equipment sets different scaling ratios of the canvas by detecting the height of the drawing pen from the terminal screen, as shown by a path (r) in fig. 10, the scaling ratio of the canvas is inversely proportional to the pen lifting height of the drawing pen, and the scaling ratio is linearly reduced, at this moment, the scaling ratio of the canvas is as follows:

the scaling of the canvas may also be set to be non-linearly reduced, for example, the paths (ii), (iii), (iv), and (v) in fig. 10, and an optimal one or more modes may be selected, so that the drawing effect of the drawing contents in the whole of different levels is displayed on the terminal screen according to the height of the user lifting the pen. As mentioned above, the distance between the drawing pen and the terminal can be obtained by automatically selecting the best communication mode according to the electric quantity or the network condition, or can be obtained by the wearable device.

2. Speed of lifting pen

When the user lifts the pen slowly, the user generally wants to progressively view the drawing effect in a small area, so that a small zoom scale adjustment factor Kb can be set, and when the pen lifting speed is high, the user generally wants to quickly view the overall effect in a large area, so that a large zoom scale adjustment factor Kb can be set.

When the terminal device triggers the function of intelligently reducing the current canvas, an adjustment factor Kc needs to be set according to the amplification state of the current drawing content (i.e., the drawing content corresponding to the drawing focus) to adjust the scaling of the current canvas. In fig. 10, if the magnification K0 of the current drawing content is large, the speed of reducing the canvas should be increased appropriately when calculating the scaling of the current canvas, so that the current canvas can be reduced to a preset size when reaching a preset height, otherwise, if the magnification K0 of the current drawing content is not large, the speed of reducing the current canvas should be decreased when reducing the current canvas, so as to facilitate the user to gradually check the drawing effect of each level. Therefore, an adjustment factor Kc, which is inversely proportional to the magnification of the current drawing content, may be set to adjust the reduction speed of the current canvas.

4. Relevance of drawing content corresponding to drawing focus

After the terminal equipment triggers the function of intelligently reducing the canvas, a scaling adjustment factor Kd (0< Kd <1) is set according to the correlation with the current drawing content, and the reduction ratio of the canvas is adjusted, wherein the correlation comprises at least one of time correlation, space correlation, drawing object correlation and style correlation.

The spatial correlation is the most direct method for calculating the correlation, and the terminal device may extend to the surrounding area with the area being drawn (the area where the drawing focus is located) as the center, and calculate the spatial correlation between these areas and the area being drawn according to the distance.

The time correlation is an auxiliary method for calculating the correlation according to the time length of the time when the peripheral region of the drawing region is drawn and the current time. The user generally draws continuously from the starting position, and therefore, the terminal device may consider that the shorter time interval should be more relevant to the area being drawn, and give priority to displaying it on the screen.

And drawing object correlation, wherein the terminal equipment can cut in from the content aspect of the drawing object to distinguish the object from a background area, if the eyes of an animal are drawn, the head and the body with the highest correlation can be sequentially calculated, the head is automatically used as a local whole on a canvas, the effect of the eyes on the head can be checked, and the body is used as a whole when the canvas is reduced.

The terminal device may calculate the style correlation according to the degree of similarity with the hue, the grayscale map, the lines, the pixel density, and the like of the current rendering region.

5. Terminal screen size

The screen sizes of different terminal devices are different, and in order to enable a user to have consistent user experience when drawing by using different terminal devices, the scaling factor Ke of the current canvas is set according to the size of the terminal screen. That is to say, when the user draws the same detail content, the display size of the content drawn on the mobile phone and the display size of the content drawn on the tablet are the same, when the user lifts the pen to view the whole, if the height of the pen lifting reaches the same preset threshold, the canvas should be reduced to the size of the terminal screen, that is, the scaling ratio is all 1.

As shown in fig. 11, when the same detail content is drawn on different terminal devices, the magnification factor K0 of the current canvas is different, and when the terminal triggers to intelligently reduce the current canvas, the curve path of the canvas scaling from K0 to 1 is also different, for example, assuming that the screen sizes of three different types of terminal devices are s1, s2, and s3, and the corresponding canvas scaling ratios are K1, K2, and K3, respectively, when the canvas is enlarged to the same size, it needs to satisfy the requirement that the canvas is enlarged to the same size

That is, k0 is inversely proportional to the terminal screen size, if the relationship of the sizes of the three terminal screens is s1<s2<s3, then k1>k2>k3, the relation between the canvas scaling and the height of the pen on the three terminal devices is shown in fig. 11, the smaller the terminal screen size is, the faster the canvas scaling is reduced, and the canvas scaling adjustment factor Ke can be set in proportion to the terminal screen size. If the scaling factor Ke1 of the terminal device 1 is 1, the scaling factors of the latter two types of terminal devices

Furthermore, the zoom-out factor of the current canvas may be obtained by obtaining the zoom ratio adjustment factors Ka, Kb, Kc, Kd, and Ke of the canvas according to the distance between the drawing pen and the terminal device, the pen-up speed, the history processing information of the drawing content corresponding to the drawing focus, the correlation of the drawing content corresponding to the drawing focus, and the terminal screen size, and then obtaining the final canvas zoom ratio Ks ═ Ka × Kb × kcd × Ke.

After the current canvas is intelligently amplified by the terminal equipment, the drawing content displayed on the terminal screen needs to be determined, so that the canvas area needing to be displayed on the terminal screen can be determined.

The drawing contents that need to be displayed on the terminal screen can be determined according to the correlation of the drawing contents corresponding to the drawing focus. After a user supplements details to an object, the user generally wants to view the overall effect of the currently drawn details in the object, so that it is meaningful to preferentially display the content with a high correlation with the currently drawn content (i.e., the drawn content corresponding to the drawing focus), and the effect viewed by the user is also the best. As shown in fig. 9, when the user raises the pen slightly, the whole bird body can be displayed, the user can check the effect of the drawing area in the whole bird body, at this time, the user can still see the detailed information of the drawing part, the effect can be seen more easily, and when the pen is raised again, the effect of the bird in the whole bird body environment can be displayed until the whole canvas is displayed on the screen.

In addition, the drawing content required to be displayed on the terminal screen can also be determined according to the selection mode of the drawing focus. When the terminal device triggers the function of intelligently narrowing the current canvas, the selection mode of the current drawing focus can be preferentially considered, and the selection mode of the drawing focus can be selected by operations such as circle selection and click. If the terminal device detects that the user adopts a direct circle selection mode when selecting the drawing focus, the drawing intention of the user is obvious, and the area circled by the user is preferentially determined to be displayed on the screen.

The terminal equipment can display the determined drawing content displayed on the terminal screen at the middle position of the terminal screen, so that a user can better check the overall effect.

Therefore, after the user supplements the detail part, the canvas is automatically reduced according to the distance between the drawing pen and the equipment, and the canvas area is displayed according to the relevance of the drawing content, so that the user can check the effect of the drawing part in the whole without frequent manual zooming and dragging operations.

Thirdly, moving the display position of the drawing focus

After the terminal equipment intelligently amplifies the canvas, the function of moving the display position of the drawing focus can be triggered. The positioned drawing focus of the user can be moved to a preset position of a terminal screen to be displayed after the canvas is amplified, and if the user moves to the middle position of the screen to be displayed, the user can conveniently position the drawing focus in the amplified canvas.

Due to the fact that the screen of the terminal device is limited, when a user uses the terminal device to draw, the user often needs to check the effect of the drawing part in the whole after drawing a plurality of pens, then continues drawing or modifies the drawn part, at the moment, the user often needs to enlarge the canvas to find the drawing position before checking, and the drawing process is often interrupted by the frequent processing. Therefore, in the embodiment of the present invention, after the terminal device triggers the intelligent canvas reducing function, the drawing intention of the user may be determined according to the pen-falling position or the hovering position of the drawing pen.

The terminal equipment is interrupted suddenly sometimes, if the terminal equipment is abnormally quitted when the terminal equipment is powered on, messages and insufficient electric quantity are generated, the system records the states of the canvas and the pen before interruption, and after the terminal equipment enters the system again, the terminal equipment triggers the function of intelligently zooming the current canvas and the display position of the intelligent mobile drawing focus, so that the size and the position of the canvas are the states before the drawing interruption.

And if the terminal equipment detects that the pen falling position or the hovering position of the drawing pen is in the drawing area before pen lifting/interruption, or the pen falling position or the hovering position of the drawing pen is closer to the drawing focus/distance before pen lifting/interruption, the terminal equipment triggers the function of intelligently zooming the current canvas and intelligently moving the display position of the drawing focus. The drawing focus at this time is the drawing focus before pen-up/interruption.

The terminal device can directly obtain the scaling of the canvas when the drawing content corresponding to the drawing focus is drawn, and automatically enlarge or reduce the size of the canvas to the size when the canvas is drawn.

The terminal equipment can move the drawing focus to a preset position of a terminal screen for displaying, move the display position of the drawing focus of a user, and correspond the drawing focus to the mapping position of the drawing pen on the terminal screen.

Therefore, when the user looks at the drawing effect or needs to continuously supplement details after being interrupted by emergencies such as calls, information and the like or reenters after sudden interruption of drawing, the canvas can be automatically enlarged according to the distance between the drawing pen and the equipment, the drawing focus is positioned at the position drawn before, the user can conveniently continue drawing, and inconvenience caused by continuous manual processing and complex processing of manually searching the drawing position by the user are avoided.

Fourthly, switching the drawing object

The embodiment of the invention provides that if a user outlines each drawing object, the terminal equipment can identify each drawing object according to the outline information, color information, line information and the like drawn by the user by combining an image identification technology, and classify each drawing object by calculating the similarity, wherein the similarity reaches a preset threshold value, and is classified as one type for subsequent processing.

When the user has done detail drawing, there are two possibilities: 1) continuously drawing the current target; 2) the next target is drawn. A user usually outlines the whole object first and draws the details of the object one by one, and the user usually chooses to draw one object and then another object when drawing, so that when two similar objects are far away, the user needs to manually zoom out and drag the canvas to find the drawing target.

In the embodiment of the invention, the terminal equipment can automatically identify each drawing object after the user outlines the whole outline, and calculate the similarity between the two drawing objects, if the distance of each drawing object in drawing is far, the terminal equipment can provide an automatic switching function according to the detected drawing state of the user, and the user can conveniently switch to the next drawing object. For example, after a user draws or finishes drawing an object, the user can check the overall effect of the object by lifting a pen, at this time, the canvas is still in an enlarged state, the area displayed on the screen is only a small area on the whole canvas, the distance between the object to be drawn by the user and the currently drawn object is far, and at this time, the terminal can automatically switch to the next drawn object.

In addition, the terminal equipment can also provide a switching button, and if the user is satisfied with the current drawing and hopes to switch to the next drawing object, the user can freely switch by clicking the next button.

If a user draws a plurality of fishes scattered in a lotus pond, details are supplemented one by one after sketching the layout, when the details are supplemented to one of the fishes, the next fish is required to be switched to for details supplementation, and the user can see a button for switching objects after lifting a pen to a preset height, as shown in fig. 12, the user can directly check the drawing object recommended by the terminal by operating a left-right switching key, select the next drawing object according to the drawing habit, and if the drawing object is switched from a drawing object A to a drawing object B, the user can select the fish with a relatively close form for drawing, so that the time for changing the pen and designing can be greatly reduced, and the efficiency and the quality of drawing are improved.

Specifically, the function of intelligently switching the drawing object can be triggered by at least one of the following modes:

1. user pen up operation

When the user finishes drawing an object, the drawing pen is usually lifted, the terminal determines the intention of the user by detecting a pen lifting event of the user, recommends the drawing object to be drawn for the user to select, or directly and automatically switches to the next drawing object. Namely, the terminal equipment triggers the function of intelligently switching the drawing object according to the pen lifting event of the inspection drawing pen.

The pen lifting operation of the user can be determined according to the distance between the drawing pen and the terminal screen, and if the distance is greater than a set threshold value, the pen lifting event of the user is considered. As described above, the pen-up event is also a trigger condition for intelligently narrowing down the current canvas function, after the user draws details, the user lifts the pen up to check the drawing effect, and the user drops the pen down to the current drawing area (i.e., the area where the drawing focus is located before the pen-up) to continue drawing or modifying after the pen-up check effect is described in the foregoing, and here, the user finishes drawing the current object after the pen-up check effect, and switches to the next drawing object. And after detecting the pen-up event, the terminal equipment triggers a corresponding event according to the pen-down position of the user, if the pen-down position of the user is in the current drawing area, the situation is the situation, and if the pen-down position of the user is on the object switching button, the terminal equipment switches the previous or next drawing object according to the user operation.

2. User instructions

The user can send out an intelligent drawing object switching instruction through interaction modes such as voice, gestures, keys and an external controller and any combination of the interaction modes, and after the terminal device detects the intelligent drawing object switching instruction, the function of intelligently switching the drawing object is triggered. For example, the user may set a voice turn-on command "switch the object" in advance, may press a volume key/home key or a control button in the drawing software for a long time, may turn on the object by any one or a combination of any plural ways such as a space gesture, a shaking terminal, a turning terminal, a tilting terminal, or the like, or may turn on the object by an external controller such as a drawing pen or a wearable device.

3. Similarity between rendered objects

The terminal can trigger the function of intelligently switching the drawing object according to whether the current drawing object has an object similar to the current drawing object or not and the amplification state of the current drawing object.

The method comprises the steps that the terminal equipment identifies objects and calculates the similarity between two drawing objects before a user supplements details one by one, after the terminal equipment detects the current drawing object, if the object with the similarity higher than a preset threshold exists, the function of intelligently switching the drawing objects can be triggered, and if the similarity is lower than the preset threshold, the current drawing object is considered to have no object similar to the current drawing object, and the function of switching the drawing objects is not triggered.

4. Display position of drawing object to be drawn

The terminal device detects the display position of a drawing object to be drawn on the terminal screen, if the drawing object to be drawn is detected to be not in the display area of the terminal screen, the terminal device triggers the function of intelligently switching the drawing object, and if the drawing object to be drawn is detected to be in the display area of the terminal screen, a user can see all the drawing objects, and the terminal device does not trigger the function of automatically switching the drawing object.

5. History processing information of drawing contents corresponding to drawing focus

Wherein the history processing information of the drawing content corresponding to the drawing focus includes an enlargement state.

The terminal device may determine whether a function of intelligently switching the drawing object needs to be triggered according to the amplification state of the current drawing content (i.e., the drawing content corresponding to the drawing focus).

As shown in fig. 12, if the current drawing content is in an enlarged state, some drawing objects to be drawn may not be in the display area of the terminal screen, so that the terminal device may trigger the function of intelligently switching the drawing objects; as shown in fig. 13, if the current drawing content is not enlarged and the area displayed on the screen is the entire canvas, the user can see all the drawing objects, and the terminal device may not trigger the function of automatically switching the drawing objects.

Further, the terminal device can identify objects in the drawing, calculate similarity between the drawing objects, and determine the switched drawing objects according to at least one of the following items when the terminal device triggers the function of intelligently switching the drawing objects: a distance between drawing objects corresponding to the user drawing focus; similarity between drawing objects corresponding to the user drawing focus; and (5) user instructions.

The terminal device may determine the switched drawing object according to the distance and/or the similarity between the drawing objects corresponding to the user drawing focus, and automatically perform the operation of switching the drawing object.

The terminal equipment can also recommend the drawing object to be drawn according to the distance and/or the similarity between the drawing objects corresponding to the drawing focuses of the user, and execute the operation of switching the drawing objects according to the user instruction.

Specifically, the terminal device may identify most objects according to the shape of the outline after the user outlines the outline according to some related algorithms in the computer vision, and may also increase the identification of some unidentified objects in the drawing process, determine the drawing object after switching according to the similarity between the two objects, or determine the similarity between the sequential objects recommending the switching object to determine the recommended switching sequence. The terminal equipment can obtain each independent object according to the outline outlined by the user, and obtains the similarity between the two objects according to the shape, the line, the filling, the texture, the drawing part and the drawing sequence of the recognition object, thereby determining the drawing object after switching or recommending the priority sequence of the switching object. And when the similarity of the objects is the same, determining the switched drawing objects or the recommendation sequence according to the distance from the current drawing object from near to far.

For example, if the terminal device has identified 4 similar drawing objects A, B, C, D in the drawing, the object being drawn is a, and when automatic switching of the drawing objects is triggered, the terminal automatically calculates B, C, D and a distances d1, d2, d3 and similarities r1, r2, and r3, and if d1 ═ d2< d3 and r1< r2 ═ r3 are satisfied, the recommended sequence is r2, r3, and r 1.

Furthermore, after the drawing object is switched, the scaling of the canvas can be automatically adjusted according to the size of the switched drawing object, so that the switched drawing object is displayed on a screen in an optimal size, and a user can view the whole drawing object when viewing the switched drawing object.

Therefore, when a user draws an object and the next object to be drawn is far away, the similar objects can be classified by calculating the similarity of the drawing objects according to the image recognition result, and the drawing objects are automatically switched during drawing, so that the switching of the drawing focus is realized, the user does not need to manually perform a series of operations such as reduction, dragging and re-enlargement, and the drawing efficiency of the user is improved.

Fifthly, adjusting the resolution of the drawn content

As shown in FIG. 14, the focus location process is often accompanied by canvas scaling, which may result in poor display quality after the canvas is enlarged if the resolution setting at the time the canvas was initially created is low. In order to meet different requirements of users on the resolution ratio of the canvas, the terminal equipment in the embodiment of the invention can adaptively adjust the resolution ratio of the canvas according to the scaling ratio of the canvas, and improve the display effect of the canvas, thereby improving the resolution ratio of the drawing content. After the resolution of the canvas is improved, the terminal allows the user to perform some local beautification operations.

The terminal equipment judges that the user has a requirement for improving the resolution ratio by detecting the scaling change of the canvas and/or a user instruction, at the moment, the terminal triggers a function of adaptively adjusting the resolution ratio of the canvas, automatically improves the resolution ratio of the canvas, draws according to the high resolution ratio subsequently, and processes the drawn content with low resolution ratio so as to adapt to the improved resolution ratio.

Specifically, the process of adaptively adjusting the canvas resolution may be triggered by at least one of the following ways:

1. canvas scaling

The display quality on the terminal screen is related to the scaling of the canvas, and when the canvas is enlarged, if the resolution of the canvas is not improved, the resolution of the display area on the terminal screen is reduced, and the display quality of the canvas is deteriorated. Therefore, the terminal equipment can trigger the function of adaptively adjusting the resolution ratio of the canvas according to the change of the scaling ratio of the canvas, namely, the terminal is triggered to automatically improve the resolution ratio of the canvas when the scaling ratio of the canvas is increased, and the terminal is triggered to reduce the resolution ratio of the canvas when the scaling ratio of the canvas is reduced, so that the drawing quality is improved.

2. User instructions

A user can send out an instruction for adaptively adjusting the resolution ratio of the canvas through interaction modes such as voice, gestures, keys, an external controller and the like and any combination mode of the interaction modes, and after the terminal equipment detects the instruction for adaptively adjusting the resolution ratio of the canvas, the function for adaptively adjusting the resolution ratio of the canvas is triggered. For example, the user may preset a voice turn-on command to "adjust resolution", may press a designated hardware key or a control button in the drawing software for a long time, may also turn on the terminal through one or a combination of various manners such as a space gesture, a shaking/turning/tilting of the terminal, and the like, or may also turn on the terminal through an external controller such as a drawing pen, a wearable device, and the like.

The self-adaptive canvas resolution adjustment process determines the adjusted canvas resolution according to the size of the current canvas, the size of the terminal screen and the resolution of the terminal screen. The concrete description is as follows:

if the resolution of the current canvas can be guaranteed to be the same as the display resolution of the terminal screen, the display quality of the canvas can be guaranteed, and the terminal equipment can determine the resolution of the current canvas according to the ratio of the size of the current canvas to the size of the terminal screen.

For example, if the initial resolution of the canvas is x0 × y0, the display resolution of the screen is x1 × y1, and the upper limit of the canvas scaling ratio is K1, as shown in fig. 15, when the canvas scaling ratio is smaller than K0, the resolution coefficient s of the canvas is constantly 1, and when the canvas scaling ratio is larger than K0 and smaller than the upper limit of the canvas scaling ratio K1, the resolution coefficient s of the canvas is proportional to the scaling ratio K of the canvas. Where K0 is determined by the ratio of the terminal screen display resolution to the canvas resolution, i.e.

When the scaling of the canvas is K0, the resolution of the canvas area displayed on the terminal screen is equal to the display resolution of the terminal screen, and when the scaling of the canvas is greater than K0, the resolution coefficient s of the canvas is in direct proportion to the scaling K, so that the resolution of the display area on the terminal screen is the same as the display resolution of the terminal screen, and the display quality of the canvas is ensured.

Wherein, the lower limit K0 of the zoom ratio for triggering the self-adaption improvement of the canvas resolution is related to the display resolution of the terminal screen, and the upper limit K1 of the canvas zoom ratio is related to the terminal screen size, so the determination of the canvas resolution is related to the display resolution and the size of the terminal screen. As shown in fig. 16a, the higher the display resolution of the terminal screen is, the larger K0 is, i.e. the larger the lower limit of the scaling for triggering the adaptive canvas resolution increase is, and the larger the canvas resolution increase rate is when the terminal screen size is the same, i.e. K1 is the same; as shown in fig. 16b, the larger the size of the terminal screen, the smaller the canvas scaling upper limit K1, and the smaller the maximum value of the resolution coefficient s if the resolution of the terminal screen is the same, i.e., K0 is the same.

Furthermore, the adaptively adjusting the resolution of the canvas further comprises performing image processing on the canvas to improve the resolution of the canvas. When the canvas is enlarged to a certain proportion, the resolution ratio of the canvas is lower than the display resolution ratio of the terminal screen, the display quality of the canvas is reduced, and the resolution ratio of the canvas needs to be improved so as to improve the display quality of the canvas. Specifically, at least one of the following treatments can be adopted:

1. interpolation processing

After the terminal device triggers the resolution of the self-adaptive canvas adjustment, the canvas needs to determine the color value of the added pixel point, the image difference value is the most common method, and the color value of the pixel point can be calculated according to the color value of the adjacent point of the inserted pixel in the canvas. The interpolation method includes nearest point interpolation, bilinear interpolation, and high-order interpolation, wherein bilinear interpolation is the most commonly used interpolation.

2. Natural boundary smoothing

After the canvas is enlarged, the boundary appears jaggy, and anti-aliasing can be performed through natural boundary smoothing processing. After the terminal device triggers the adaptive adjustment of the resolution of the canvas, the terminal device automatically detects the drawing boundaries of lines and drawing objects in the canvas, fits the boundaries, gives auxiliary lines, smoothes the boundaries in the image, and improves the drawing quality of the canvas, as shown in fig. 17.

3. Line interior smoothing

After the terminal device triggers the adaptive adjustment of the resolution of the canvas, Perlin noise can be used, as shown in fig. 18, to perform texture enhancement on the content of lines or strokes, so that the texture information inside some lines or strokes on the canvas is more real.

4. Contour adjustment

After the terminal equipment triggers the self-adaptive canvas resolution adjustment, the canvas resolution is improved, and a user can perform local fine adjustment on the drawn content according to the requirement. As shown in fig. 19, the terminal system can recognize the contour line between two fixed points according to the two points fixed by the user, and fine-tune the contour according to the manual processing of the user.

Sixthly, expanding canvas processing for bearing drawing content

When a user draws, the user usually lays out and draws at first, but sometimes wants to add some contents, the terminal device can judge the drawing intention of the user according to the motion state of the inspection and drawing pen, and the canvas is automatically expanded according to the drawing intention of the user. For example, in the drawing process or after the user draws, the system finds that some content is added, the system automatically detects the drawing trend of the pen in the drawing process, if the tail exceeds the canvas, the system automatically expands the canvas after the pen is drawn, automatically supplements the tail according to the trend of the current stroke, and uses the supplemented stroke tail as the display area of the terminal screen, so that the user can draw the content.

Specific example 1: after a user draws a landscape painting, the user wants to attach a poem beside the painting, but a poem writing place is not reserved in the previous conception, at the moment, the user can continue to create, and the canvas can automatically extend when strokes exceed the canvas.

Specific example 2: the user wants to draw a Qingming Shang river course, but the preset size proportion and the resolution ratio of the canvas are limited, the user can divide the Qingming Shang river course into a plurality of parts from left to right to draw, and after each part is drawn, the canvas automatically expands, and the user can continue to draw the next part.

In actual drawing, the thickness and length of the drawn handwriting are different according to the force of the drawing pen and the drawing speed, and in drawing software, the shape of the handwriting can be calculated according to the pressure and the speed of the drawing pen. The canvas can be automatically expanded according to information such as the trend, the pressure and the like of strokes, a user can also close the function of automatically expanding the canvas, and at the moment, the system automatically adds the virtual canvas for the canvas so as to automatically fill up the tail of the previously drawn content when the canvas is subsequently expanded for processing. Specifically, the automatic canvas expansion process can be triggered by at least one of the following ways:

1. plotting the trend of pen movements

The motion trend judgment basis of the drawing pen can be information of the motion direction, speed, pressure and the like of the drawing pen, the terminal equipment determines the change of the motion trail according to the motion direction of the drawing pen, and determines the shape of the motion trail and the tail of the handwriting according to the motion speed and the pressure of the drawing pen. When the terminal device detects that the drawing pen reaches the edge of the screen, the movement direction of the drawing pen is outside the screen, and the speed and the pressure of the drawing pen are both greater than zero, the terminal considers that the drawing of the pen by the user is incomplete, and the function of the terminal to expand the canvas is triggered.

2. Canvas area for terminal screen display

When a user draws on a terminal device, due to the fact that the size of a terminal screen is limited, the user can change the size of a canvas and the display area of the canvas on the screen by adopting zooming/moving processing, and if the display area on the terminal screen contains the boundary of the canvas or the boundary of the canvas is overlapped with the boundary of the terminal screen, when the terminal detects that the speed and the pressure of the drawing position of a drawing pen at the boundary of the canvas are not reduced to zero, the function of expanding the canvas is triggered.

If the screen of the terminal only displays the canvas and does not contain the canvas boundary, when the terminal detects that the position of the drawing pen reaches the screen boundary but the speed and the pressure are not reduced to zero, the tail part of the handwriting is automatically calculated, and if the calculated tail part of the handwriting exceeds the current canvas boundary, the function of expanding the canvas is triggered.

3. User instructions

A user can send out a canvas expansion instruction through interaction modes such as voice, gestures, keys, an external controller and the like and any combination of the interaction modes, and after the terminal equipment detects the canvas expansion instruction, the function of the canvas expansion is triggered. For example, the user may turn on the canvas by presetting a voice turn-on instruction "extend the canvas left/right/up/down", may press a designated hardware key or a control button in the drawing software for a long time, may turn on the canvas by one or a combination of various manners such as a space gesture, a shaking/flipping/tilting of the terminal, and the like, and may also turn on the canvas by an external controller such as a drawing pen, a wearable device, and the like.

The embodiment of the invention provides that after the canvas bearing the drawing content is expanded, the terminal equipment can fit the drawing content of the user in the expanded canvas according to the drawing track of the drawing pen in the canvas and the movement trend of the drawing pen.

Specifically, the terminal device performs spline fitting on a possible track outside the current canvas according to specific information (such as a drawing track of a drawing pen in the canvas and a movement trend of the drawing pen), and determines the width of the extended canvas. When the terminal device triggers the function of extending the canvas, if the current screen includes the canvas boundary or the canvas boundary coincides with the boundary of the terminal screen, as shown in fig. 20, the terminal device generates the drawing script by calculation according to the trajectory of the drawing pen outside the canvas on the screen, as shown in (a) in fig. 20, or the terminal device records the information of the position x0, the speed v0, the pressure P0 and the like of the drawing pen leaving the boundary, when it is detected that the drawing pen enters from the boundary again, the terminal records the information of the position x1, the speed v1, the pressure P1 and the like of the drawing pen at the moment, the terminal can adopt a Bezier spline to fit the possible trajectory of the drawing pen leaving the canvas, and calculate and generate the information of the shape, the color and the like of the script according to the change of the speed and the pressure, as shown in (b) in fig. 20. The width that the canvas is extended should be proportional to the width of the computationally generated handwriting. As shown in fig. 20 (c).

And if the terminal equipment detects that the drawing pen does not enter from the canvas boundary after leaving the screen, calculating and generating possible information such as the track, the shape, the color and the like according to the track before the drawing pen leaves the canvas and the spline fitting of the speed and the pressure of the drawing pen reaching the canvas boundary.

As shown in fig. 21, if the display area on the screen is a partial area inside the canvas, when the terminal device detects that the drawing pen reaches the boundary of the screen, if the speed and pressure of the drawing pen are not reduced to zero, the terminal automatically calculates the track outside the screen of the terminal, moves the canvas, and displays the complete handwriting tail.

The automatically extending canvas function makes the lines drawn by the user more complete and natural, as shown in fig. 22a, in addition, the user can also interrupt or close the automatically extending canvas function at any time according to the requirement, and the adoption mode can be button operation, gesture, voice and other modes. After the user closes the function of the automatically expanded canvas, the handwriting drawn to the edge of the canvas is cut off, so that the handwriting effect at the edge is very unnatural when the user wants to expand the canvas, therefore, when the function of the automatically expanded canvas is closed, the terminal can automatically add a larger virtual canvas for the canvas, the virtual canvas is full handwriting, and when the user wants to expand the canvas in subsequent operations, the previously drawn full handwriting can be restored, as shown in fig. 22 b.

Therefore, when the drawing focus is automatically positioned, the resolution ratio of the canvas can be adaptively adjusted according to the scaling ratio of the canvas; the canvas is automatically expanded when the drawing content exceeds the canvas, and the beautifying and fine-tuning functions of detail information are added.

Seventhly, processing of display drawing reference information

Some drawing systems allow users to load pictures as drawing references, but in the prior art, manual searching and importing are generally needed to import reference pictures, the process of searching by the users is long in time, and in some cases, suitable pictures cannot be found, so that the efficiency is low, and the effect is often unsatisfactory. According to the embodiment of the invention, the drawing reference information is searched according to the drawing content corresponding to the drawing focus, the searched drawing reference information is displayed, and the object similar to the drawn content in the local machine or the network can be searched for recommendation. The terminal device may search the rendering reference information according to the content similarity and/or the style similarity of the rendering content corresponding to the rendering focus.

For example, a user outlines a plurality of objects, but the user does not know how to realize the drawing effect or style during drawing, the system automatically recommends some similar contents according to the drawn contents, and the user can select a reference picture according to the preference of the user. The specific embodiment is as follows: the user wants to draw a lotus pool, a group of fishes exist in the lotus pool, the user wants to draw thousands of postures of fishes, however, the user can think that only a plurality of postures are available, and the style of the fishes to be drawn is unclear, at the moment, the user can draw the outlines of the fishes in various postures, when the details of the fishes are drawn one by one, the system can automatically search and match the currently drawn fishes to find out similar targets on a local machine and a network for the user to select, and the user can select the favorite details to draw, as shown in fig. 23.

When the terminal detects that the user starts to supplement the details of the objects one by one, the automatic recommendation function is triggered, and the automatic recommendation function can also be triggered when the terminal triggers the intelligent canvas amplification function.

The terminal device may search the drawing reference information according to the content similarity of the drawing content corresponding to the drawing focus. When the terminal triggers the automatic recommendation function, the terminal device preferentially searches whether an object with similar content exists in the terminal device according to the current drawing content (namely the drawing content corresponding to the drawing focus) by combining an image recognition technology, if the similar image drawn before exists, the corresponding object is intercepted as recommendation, and if the similar image drawn before exists, the similar object is searched as recommendation through the network.

Further, the method of this embodiment further includes adjusting a display mode of the drawing reference information based on a display mode of the drawing content corresponding to the drawing focus. The display mode includes a scaling and/or a display position.

And the terminal equipment adjusts the display area of the recommendation information according to the display area of the canvas when the user operates the current canvas. For example, assuming that the zoom ratio of the current canvas is k1, the position of the center of the terminal screen corresponding to the canvas is (x1, y1), the initial zoom ratio of the recommended image is k2, the position of the center of the recommended information window corresponding to the recommended image is (x2, y2), when the terminal detects that the zoom ratio of the current canvas becomes k 1', and the terminal detects that the zoom ratio of the current canvas becomes k1When the position of the canvas corresponding to the center position of the end screen becomes (x1 ', y 1'), the terminal automatically adjusts the zoom ratio and the display position of the recommended content, and the zoom ratio of the recommended image becomes (x1 ', y 1')

The position of the center of the recommendation information window corresponding to the recommendation image becomes (x2 ', y 2'), where

As shown in fig. 24, after the user selects a reference picture, the picture dynamically changes with the user operation, the corresponding region is displayed in the recommended window, if the user is drawing an eye region, the detailed information of the eye is automatically displayed in the widget, the user drags the canvas, the display position changes accordingly, the user zooms the canvas, the display portion zooms the canvas, the user draws a head region, the displayed region also automatically moves the head region into the display window, the user drags the canvas to the foot, the terminal device displays the foot in the widget, and the drawing focus is always used as the display focus.

Through the processing, the automatic search and dynamic display of the image similar to the drawing content in the drawing process can be realized.

The terminal device may also search the rendering reference information according to the style similarity of the rendering content corresponding to the rendering focus. Specifically, an image with a certain rendering style similar to the current rendering content may be searched as a recommendation through image processing techniques such as edge feature extraction, the user may select a preferred rendering style from the recommended image, or may manually select a preferred rendering style from other images, and the terminal device decomposes the related information according to the image and the selected region selected by the user, thereby extracting the rendering style, and constructing a knowledge base, so that the same rendering effect as the style is achieved during rendering, as shown in fig. 25.

The mode of selecting the recommended style template mainly comprises circle selection or click selection, information extracted from the picture can be information such as color tone, texture, illumination, lines, forms and the like, then the drawing effect with the same style is generated in real time according to information such as pressure, thickness and the like of a pen during drawing, and style copying can be carried out after drawing is finished.

Fig. 26 is a schematic structural diagram of a rendered content processing apparatus of a terminal device according to another embodiment of the present invention, including a positioning module 11 and a processing module 12, wherein,

the positioning module 11 is configured to position a user drawing focus based on a drawing operation of a user; the processing module 12 is configured to perform corresponding processing on the rendering content displayed by the terminal device according to the located rendering focus.

The invention also provides a terminal device, which is used for executing the drawn content processing method of the terminal device or a drawn content processing device with the built-in terminal device. Fig. 27 is a schematic diagram illustrating a specific process of the terminal device in the drawing process.

Fig. 27(a) to 27(e) are diagrams illustrating that a user replaces a pen type to trigger a terminal device to amplify a canvas function, a drawing pen moves to a drawing target object, and when a ratio of an object selected by the user in the canvas is very small, the user hardly directly selects a position where the user wants to draw, the terminal displays an automatically recognized object on a terminal screen, referring to fig. 27 (a); at this time, the user can conveniently select the position which the user wants to draw, referring to fig. 27 (b); the user lands the pen at a position where the user wants to draw and hovers, see fig. 27 (c); meanwhile, the terminal device intelligently amplifies the canvas by taking the hovering position as the center again, and the drawing is shown in fig. 27 (d); the user can draw by dropping his pen, see fig. 27 (e). If the canvas is enlarged to the state of fig. 27(b), or in the middle of the system of fig. 27(c) continuing the intelligent enlargement, the user feels that the enlargement factor has been satisfied, the intelligent enlargement processing of the terminal device can be interrupted at any time, and the drawing state of fig. 27(e) is entered.

Fig. 27(f) shows the user looking at the overall rendering effect by lifting the pen after drawing details, the system automatically selects the area most relevant to the current rendering content to display, and displays the areas of different levels relevant to the rendering content according to the pen lifting height, so that the user can effectively and progressively look at the overall rendering effect, and when the pen lifting height reaches the predetermined height threshold, the whole canvas is displayed.

Fig. 27(g) is a diagram illustrating that the user views the overall effect of the drawing content in the local relevant area, and after the user views the effect, the user may need to continue to modify or draw in the area, or may be satisfied with the drawing effect and want to draw the next object. When the user selects the area drawn before the pen-up position is selected, the system considers that the user wants to continue drawing or modifying, if the distance between the selected position and the drawing position before the pen-up is smaller than the set threshold value, the system considers that the user wants to continue drawing, the system automatically restores the enlarged state of the canvas to the state before the pen-up, and positions the drawing position before the pen-up at the current mapping position of the pen on the screen of the terminal equipment, as shown in fig. 27 (h); if the distance between the selected position and the drawing position before pen lifting is larger than the set threshold value, the user is considered to modify the drawn content of the selected position, and the system automatically restores the canvas magnification state to the canvas magnification state of the pen at the current mapping position on the screen of the terminal equipment during drawing. If the user is satisfied with the current drawing effect, the user needs to continue drawing the next object, when a plurality of similar drawing objects exist in the canvas, the user generally tends to finish the drawing of the similar objects one by one, and then draws other objects, and when the similar drawing objects are far away from each other, the terminal device can provide the user with an automatic switching function, so that the user can select the drawing object recommended by the system through a switching key displayed on the terminal device after finishing one object, as shown in fig. 27 (i).

Compared with the prior art, the scheme of the invention has the following advantages:

1. in the drawing process, when the drawing focus needs to be positioned, a user only needs simple operations of pen lifting, pen dropping, pen changing and the like. Meanwhile, in the process of positioning the focus, the display quality and the drawing rate of the drawing are improved by adaptively adjusting the resolution, and the reference content is recommended in real time, so that a user is allowed to specify the drawing style, and the same drawing style is obtained more conveniently;

2. even if the painting is performed on a limited terminal, the painting experience which is more pleasant than that on a real canvas can be realized;

3. the user does not need to manually zoom and drag the canvas to position the drawing focus, the operation habit of the user is met, and the drawing efficiency is high;

4. when the user suddenly cuts off the drawing, the drawing can be automatically positioned to the position drawn last time, and the user does not need to spend a long time for positioning;

5. when the distance of the drawing object is far, the drawing object is automatically switched, and the user does not need to perform complicated operations such as manual zooming, dragging, re-zooming and the like;

6. in the drawing process of the user, recommending information is given in real time according to drawn contents, so that the drawing of the user is referred to;

7. the user does not need to set complex drawing pen parameters to realize some special effects, but can very conveniently specify the drawing style of the user from the image, and the drawing effect is richer.

The foregoing is only a partial embodiment of the present invention, and it should be noted that, for those skilled in the art, various modifications and decorations can be made without departing from the principle of the present invention, and these modifications and decorations should also be regarded as the protection scope of the present invention.

Claims

1. A method for processing the drawn content of a terminal device is characterized by comprising the following steps:

determining a drawing focus based on the drawing operation;

positioning the drawing focus on a canvas;

processing the drawing content displayed on the screen based on the drawing focus;

wherein the drawing focus is identified based on another drawing focus preceding the drawing focus.

2. The method of claim 1, wherein the drawing focus is a local area or location of drawing on the canvas.

3. The method of claim 1, wherein the drawing operation comprises at least one of: selecting the operation of drawing a focus, the operation of pen-down and the operation of hovering;

wherein the processing of the drawing content includes at least one of zooming in, zooming out, moving a display position of a drawing focus, displaying drawing reference information, switching a drawing object, adjusting a resolution of the drawing content, and expanding a canvas carrying the drawing content.

4. The method according to claim 3, characterized in that the pen-down operation and/or the hover operation are determined based on a distance between the input device and the terminal device.

5. The method of claim 1, wherein determining a rendering focus based on a rendering operation comprises at least one of:

determining the mapping position of the input equipment on the terminal screen as a drawing focus;

and determining a drawing focus according to the drawing content related information of the local area where the mapping position is located.

6. The method according to claim 5, wherein the information related to the rendering content of the local area where the mapping position is located comprises at least one of the following:

7. The method of claim 5, wherein identifying a rendering focus based on another rendering focus prior to the rendering focus comprises at least one of:

determining another drawing focus before the drawing focus as the current drawing focus;

and if the distance between the mapping position and the other drawing focus is within a preset distance threshold range, determining the other drawing focus as the current drawing focus, otherwise, determining the mapping position as the current drawing focus.

8. The method of claim 3, wherein zooming in is triggered based on at least one of modifying a parameter of an input device; wherein the parameters of the input device include: the method comprises the steps of inputting device types, line colors, texture information, drawing content related information corresponding to a drawing focus, the distance between an input device and a terminal device, the pen-down speed, the size of a terminal screen, an instruction for zooming in and the correlation of the drawing content corresponding to the drawing focus.

9. The method according to claim 3, wherein the reduction is triggered in accordance with at least one of an operation of lifting the input device, an instruction of reduction, history processing information of the drawing content corresponding to the drawing focus, a distance from the input device to the terminal device, a speed of lifting the input device, a terminal screen size, and a correlation of the drawing content corresponding to the drawing focus.

10. The method according to claim 8 or 9, wherein the relevance of the drawing content corresponding to the drawing focus point includes at least one of: temporal correlation, spatial correlation, render object correlation, style correlation.

11. The method of claim 3, wherein moving the display position of the drawing focus comprises:

moving the drawing focus to a preset position of a terminal screen for displaying; and/or

And moving the display position of the drawing focus, and corresponding the drawing focus to the mapping position of the input device on the terminal screen.

12. The method according to claim 3, wherein switching the drawing object is triggered based on at least one of an operation of lifting an input device, an instruction, similarity between drawing objects, a display position of the drawing object, and history processing information of drawing contents corresponding to a drawing focus.

13. The method according to claim 12, wherein the switched drawing object is determined according to at least one of:

a distance between drawing objects corresponding to the drawing focus;

similarity between the drawing objects corresponding to the drawing focus;

and (5) user instructions.

14. The method of claim 12, further comprising the step of: and adjusting the scaling of the canvas according to the size of the switched drawing object.

15. The method of claim 2, wherein adjusting the resolution of the rendered content is triggered by at least one of a change in canvas scaling, and an instruction.

16. The method of claim 15, wherein the adjusted resolution is determined based on a current canvas size, a terminal screen size, and a terminal screen resolution.

17. The method of claim 15, wherein adjusting the resolution of the rendered content comprises at least one of: interpolation processing, natural boundary smoothing processing, line interior smoothing processing and contour adjustment.

18. The method of claim 3, wherein after the canvas carrying the drawing content is expanded, the drawing content of the user is fitted in the expanded canvas according to the drawing track of the input device in the canvas and the motion trend of the input device.

19. The method of claim 3, wherein displaying the drawing reference information comprises:

20. The method according to claim 19, wherein searching for drawing reference information according to the drawing content corresponding to the drawing focus comprises:

21. The method of claim 19, further comprising the step of:

22. The method of claim 21, wherein the display mode comprises a zoom ratio and/or a display position.

23. A drawn content processing apparatus of a terminal device, characterized by comprising:

a positioning module: for determining a rendering focus based on a rendering operation, the rendering focus being positioned on a canvas;

a processing module: processing the drawing content displayed on the screen based on the drawing focus;

24. The apparatus of claim 23, wherein the drawing focus is a local area or location of drawing on the canvas.

25. The apparatus of claim 23, wherein the drawing operation comprises at least one of: selecting the operation of drawing a focus, the operation of pen-down and the operation of hovering;

26. The apparatus of claim 25, wherein the pen-down operation and/or the hover operation is determined based on a distance between the input device and the terminal device.

27. The apparatus of claim 23, wherein the positioning module is specifically configured to at least one of:

28. The apparatus according to claim 27, wherein the information related to the rendering content of the local area where the mapping position is located comprises at least one of:

29. The apparatus of claim 27, wherein identifying a rendering focus based on another rendering focus prior to the rendering focus comprises at least one of:

and if the distance between the mapping position and the other drawing focus is within a preset distance threshold range, determining the other drawing focus as the current drawing focus, otherwise, determining the mapping position as the current drawing focus of the user.

30. The apparatus of claim 25, wherein amplification is triggered based on at least one of modifying a parameter of an input device; wherein the parameters of the input device include: the method comprises the steps of inputting device types, line colors, texture information, drawing content related information corresponding to a drawing focus, the distance between an input device and a terminal device, the pen-down speed, the size of a terminal screen, an instruction for zooming in and the correlation of the drawing content corresponding to the drawing focus.

31. The apparatus according to claim 25, wherein the reduction is triggered in accordance with at least one of an operation of lifting the input device, an instruction of reduction, history processing information of the drawing content corresponding to the drawing focus, a distance from the input device to the terminal device, a speed of lifting the input device, a terminal screen size, and a correlation of the drawing content corresponding to the drawing focus.

32. The apparatus according to claim 30 or 31, wherein the relevance of the drawing content corresponding to the drawing focus point comprises at least one of: temporal correlation, spatial correlation, render object correlation, style correlation.

33. The apparatus of claim 25, wherein moving the display position of the drawing focus comprises:

34. The apparatus according to claim 25, wherein switching of the drawing object is triggered based on at least one of an operation of lifting an input device, an instruction, similarity between drawing objects, a display position of the drawing object, and history processing information of drawing contents corresponding to the drawing focus.

35. The apparatus of claim 34, wherein the switched rendering object is determined according to at least one of:

a distance between drawing objects corresponding to the drawing focus;

similarity between the drawing objects corresponding to the drawing focus;

and (5) user instructions.

36. The apparatus of claim 34, further comprising the steps of: and adjusting the scaling of the canvas according to the size of the switched drawing object.

37. The apparatus of claim 24, wherein the adjustment of the resolution of the rendered content is triggered based on at least one of a canvas scaling change, an instruction.

38. The apparatus of claim 37, wherein the adjusted resolution is determined based on a current canvas size, a terminal screen size, and a terminal screen resolution.

39. The apparatus of claim 37, wherein adjusting the resolution of rendered content comprises at least one of: interpolation processing, natural boundary smoothing processing, line interior smoothing processing and contour adjustment.

40. The apparatus of claim 25, wherein after the canvas carrying the drawing content is expanded, the drawing content of the user is fitted in the expanded canvas according to the drawing track of the input device in the canvas and the motion trend of the input device.

41. The apparatus of claim 25, wherein displaying the drawing reference information comprises:

42. The apparatus according to claim 41, wherein searching for drawing reference information according to the drawing content corresponding to the drawing focus comprises:

43. The apparatus of claim 41, further comprising the steps of:

44. The device of claim 43, wherein the display mode comprises a zoom ratio and/or a display position.

45. A terminal device, characterized in that it is configured to perform the method according to any of claims 1-22.