CN113238710B

CN113238710B - Intelligent interactive panel, display method thereof and readable storage medium

Info

Publication number: CN113238710B
Application number: CN202110777766.0A
Authority: CN
Inventors: 张阳阳; 马永达; 卞甲慧; 李英杰; 胡风硕; 张洪雷; 程鸿飞
Original assignee: BOE Technology Group Co Ltd; Beijing BOE Technology Development Co Ltd
Current assignee: BOE Technology Group Co Ltd; Beijing BOE Technology Development Co Ltd
Priority date: 2021-07-09
Filing date: 2021-07-09
Publication date: 2021-11-12
Anticipated expiration: 2041-07-09
Also published as: CN113238710A

Abstract

The invention discloses an intelligent interactive panel, a display method thereof and a readable storage medium, wherein a processor is used for controlling the intelligent interactive panel to execute a handwriting function and controlling the intelligent interactive panel to execute a sawtooth removing operation at the edge of a generated writing track. The display panel corresponds to each pixel of the display writing track, the display panel comprises at least two adjacent pixel groups located at the edge of the writing trace, each pixel group comprises at least one pixel, a first display area and a second display area can be formed in each pixel group, the at least two pixel groups comprise a first pixel group and a second pixel group adjacent to the first pixel group, and the processor controls the display brightness of the second display area of the first pixel group to be lower than the display brightness of the first display area of the first pixel group and the display brightness of the first display area of the second pixel group so as to perform the antialiasing.

Description

Intelligent interactive panel, display method thereof and readable storage medium

Technical Field

The invention relates to the technical field of display, in particular to an intelligent interactive panel, a display method thereof and a readable storage medium.

Background

Electronic display products such as electronic whiteboards and intelligent interactive panels, which are applied to the fields of business meetings or education and teaching, often have a handwriting function. The current products aim to optimize and improve handwriting functions, such as improving the handwriting following speed of a handwriting track, improving the smoothness of the handwriting, and the like. Among them, the antialiasing is one of the important steps for the beautification of the written handwriting.

Disclosure of Invention

The embodiment of the invention provides an intelligent interactive panel, a display method thereof and a readable storage medium, which are used for deswirinizing the edge of handwriting.

In a first aspect, an embodiment of the present invention provides an intelligent interactive tablet, including: the touch control device comprises a touch control assembly, a display panel and a processor; wherein the content of the first and second substances,

the touch control component is used for identifying touch control handwriting track information of a user and sending the handwriting track information to the processor;

the processor is used for generating corresponding handwriting according to the handwriting track information and controlling the display panel to display the handwriting;

the display panel comprises at least two adjacent pixel groups located at the edge of the handwriting, one pixel group comprises at least one pixel, a first display area and a second display area are formed in one pixel group, the at least two pixel groups comprise a first pixel group and a second pixel group adjacent to the first pixel group, and the processor is specifically used for controlling the display brightness of the second display area of the first pixel group to be lower than the display brightness of the first display area of the first pixel group and the display brightness of the first display area of the second pixel group.

Optionally, in some embodiments, the processor is specifically configured to control a pixel voltage of the second display region of the first pixel group to be lower than a pixel voltage of the first display region of the first pixel group and a pixel voltage of the first display region of the second pixel group.

Optionally, in some embodiments, the processor is specifically configured to control a ratio of a pixel voltage of the second display region of the first pixel group to a pixel voltage of the first display region of the first pixel group to be less than or equal to 4/5, and control a ratio of a pixel voltage of the second display region of the first pixel group to a pixel voltage of the first display region of the second pixel group to be less than or equal to 4/5.

Optionally, in some embodiments, the processor is specifically configured to control the brightness of each of the second display regions in the at least two pixel groups to be the lowest brightness or the background brightness that can be displayed by the display panel.

Optionally, in some embodiments, the processor is specifically configured to control the brightness of each of the first display regions in the at least two pixel groups to decrease.

Optionally, in some embodiments, the processor is specifically configured to control the pixel voltage of the same sub-pixel in each of the first display regions in the at least two pixel groups to decrease.

Optionally, in some embodiments, an included angle between the handwriting and the horizontal direction is a handwriting angle, and the processor is specifically configured to control the edge of the handwriting, where the handwriting angle is within a preset angle range, to set at least four pixel groups;

the preset angle range is a partial angle range within-30 to +30 degrees, or the preset angle range is a partial angle range within 60 to 120 degrees, or the preset angle range is a partial angle range within a range formed by-30 to +30 degrees and 60 to 120 degrees.

Optionally, in some embodiments, the preset angle range is an internal angle range from-20 degrees to +20 degrees, or the preset angle range is an internal angle range from 70 degrees to 110 degrees, or the preset angle range is an internal angle range from-20 degrees to +20 degrees and from 70 degrees to 110 degrees.

Optionally, in some embodiments, the processor is configured to generate a first writing script having a first writing script angle, generate a second writing script having a second writing script angle;

the first handwriting angle and the second handwriting angle are within +20 to-20 degrees and are not 0 degree, the absolute value of the first handwriting angle is smaller than the absolute value of the second handwriting angle, and the processor is used for setting the number of pixel groups at the edge of the first handwriting to be more than that at the edge of the second handwriting;

or the first handwriting angle and the second handwriting angle are angles within 70-120 degrees and are not 90 degrees, the absolute value of the difference value between the first handwriting angle and 90 degrees is smaller than the absolute value of the difference value between the second handwriting angle and 90 degrees, and the processor is used for setting the number of pixel groups at the edge of the first handwriting to be more than the number of pixel groups at the edge of the second handwriting.

Optionally, in some embodiments, the touch component is specifically configured to determine single or continuous touch point information according to the received touch signal and send the single or continuous touch point information to the processor;

the processor is specifically configured to generate a first writing script and a second writing script according to the touch point information, control the display panel to display the first writing script in the process of receiving the touch point information, and control the display panel to display by using the second writing script instead of the first writing script after determining that the receiving of the touch point information is stopped;

the number of the pixel groups set in the second handwriting by the processor is more than that set in the first handwriting.

Optionally, in some embodiments, the processor is specifically configured to determine to stop receiving the touch point information when the touch point information is not received for more than a threshold time.

Optionally, in some embodiments, the processor is specifically configured to draw the first writing trace directly in a frame buffer of a current display screen, and draw the second writing trace in a buffer area and then combine the second writing trace in an idle frame buffer.

Optionally, in some embodiments, the processor is specifically configured to, when it is detected that a user performs a writing operation on a current writing interface of the writing software, acquire the writing operation on the current writing interface, where the writing operation is a screen touch event within a range of the current writing interface;

displaying the first writing handwriting following the writing operation on the current writing interface; the writing interface comprises a display interface with a first display layer and a second display layer, and the first writing handwriting is displayed on the display interface of the first display layer;

displaying the second writing on a display interface of a second display layer, and clearing the first writing; the second writing handwriting is generated according to writing operation; and the first handwriting on the first display layer is synthesized through hardware, and the second handwriting on the second display layer is synthesized through software.

Optionally, in some embodiments, the display panel includes a first pixel located inside the writing script; the processor is specifically configured to control the display brightness of a sub-pixel in the first display region in the pixel group to be smaller than the display brightness of the same sub-pixel in the first pixel.

Optionally, in some embodiments, the processor is specifically configured to control a pixel voltage of a sub-pixel in the first display region in the pixel group to be smaller than a pixel voltage of the same sub-pixel in the first pixel.

Optionally, in some embodiments, one of the sub-pixels in the first display region in the pixel group has a first pixel voltage, the same sub-pixel in the first pixel has a second pixel voltage, and the processor is specifically configured to control a ratio of the first pixel voltage to the second pixel voltage to be less than 2/3.

Optionally, in some embodiments, the processor is specifically configured to set an area ratio of the first display region to the second display region in one pixel group to be 1:1 to 1: 4.

Optionally, in some embodiments, the processor is specifically configured to set an area ratio of the first display region to the second display region within one of the pixel groups to be 1: 2.

Optionally, in some embodiments, the processor is specifically configured to be disposed in one of the pixel groups, and the first display region and the second display region include sub-pixels of the same color.

Optionally, in some embodiments, the processor is specifically configured to set one of the pixel groups to include at least two pixels; in one of the pixel groups, the first display region and the second display region are constituted by different pixels.

Optionally, in some embodiments, the processor is specifically configured to set the first display area to include m pixels, set the second display area to include n pixels, and set the ratio of n: m is between 1 and 4.

Optionally, in some embodiments, the processor is specifically configured to set one of the pixel groups to include three pixels, the first display region includes one pixel, and the second display region includes two pixels.

Optionally, in some embodiments, the processor is specifically configured to set a portion of one of the pixel groups including two pixels; in one of the pixel groups, the first display region is formed of a portion of one pixel, the second display region is formed of a portion of another pixel, and an area ratio of the first display region to the second display region is 1:1 to 1: 4.

Optionally, in some embodiments, the processor is specifically configured to control an area ratio of the first display region and the second display region to be 1: 2.

Optionally, in some embodiments, the processor is specifically configured to set one of the pixels to include at least three kinds of sub-pixels, where the sub-pixels include a first portion and a second portion, the first display region includes each of the first portions, and the second display region includes each of the second portions.

Optionally, in some embodiments, the processor is specifically configured to set an area ratio of the second portion to the first portion in the same sub-pixel to be between 1 and 4.

Optionally, in some embodiments, the processor is specifically configured to set an area ratio of the second portion to the first portion in the same sub-pixel to be 2.

Optionally, in some embodiments, the sub-pixels include sub-pixels formed by dividing regions according to the gate lines and the data lines.

Optionally, in some embodiments, the processor is specifically configured to control the first portion and the second portion of the sub-pixel through the same gate line and the same data line.

Optionally, in some embodiments, the processor is specifically configured to set one of the pixel groups to include one pixel, and one of the pixels to include at least three sub-pixels; in one of the pixel groups, the first display region and the second display region are constituted by different kinds of sub-pixels.

Optionally, in some embodiments, the processor is specifically configured to set the first display area to include a sub-pixels, set the second display area to include b sub-pixels, and set the ratio of b: a is between 1 and 3.

Optionally, in some embodiments, the processor is specifically configured to set one of the pixels to include four sub-pixels; the first display area comprises a sub-pixel, and the second display area comprises three sub-pixels.

Optionally, in some embodiments, the processor is specifically configured to set one of the pixels to include RGBW four sub-pixels; the first display area comprises W sub-pixels, the second display area comprises RGB sub-pixels, and the processor is specifically used for controlling display of white writing.

Optionally, in some embodiments, the processor is specifically configured to arrange the first pixel group and the second pixel group to be arranged along a vertical direction or to be arranged along a horizontal direction.

Alternatively, in some embodiments, in one of the pixel groups, the first display region and the second display region are arranged in a vertical direction or in a horizontal direction.

In a second aspect, an embodiment of the present invention further provides a display method for an intelligent interactive tablet, including:

receiving touch handwriting track information of a user, which is identified by a touch component;

generating corresponding writing traces according to the handwriting trace information, and controlling a display panel to display the writing traces; wherein the content of the first and second substances,

the display panel comprises at least two adjacent pixel groups which are positioned at the edge of the handwriting, wherein one pixel group comprises at least one pixel, a first display area and a second display area are formed in one pixel group, the at least two pixel groups comprise a first pixel group and a second pixel group adjacent to the first pixel group, and the display brightness of the second display area of the first pixel group is controlled to be lower than that of the first display area of the first pixel group and that of the first display area of the second pixel group.

Optionally, in some embodiments, the pixel voltage of the second display region of the first pixel group is controlled to be lower than the pixel voltages of the first display region of the first pixel group and the first display region of the second pixel group.

Optionally, in some embodiments, a ratio of the pixel voltage of the second display region of the first pixel group to the pixel voltage of the first display region of the first pixel group is controlled to be less than or equal to 4/5, and a ratio of the pixel voltage of the second display region of the first pixel group to the pixel voltage of the first display region of the second pixel group is controlled to be less than or equal to 4/5.

Optionally, in some embodiments, the brightness of each of the second display regions in the at least two pixel groups is controlled to be the lowest brightness or the background brightness that the display panel can display.

Optionally, in some embodiments, the brightness of each of the first display regions in the at least two pixel groups is controlled to decrease.

Optionally, in some embodiments, the pixel voltage of the same sub-pixel in each of the first display regions in the at least two pixel groups is controlled to decrease.

Optionally, in some embodiments, an included angle between the handwriting and the horizontal direction is a handwriting angle, and at least four pixel groups are arranged on the edge of the handwriting, where the handwriting angle is controlled to be within a preset angle range;

Optionally, in some embodiments, generating a first writing script having a first writing script angle, generating a second writing script having a second writing script angle;

the first handwriting angle and the second handwriting angle are within +20 to-20 degrees and are not 0 degree, the absolute value of the first handwriting angle is smaller than that of the second handwriting angle, and the number of pixel groups arranged at the edge of the first handwriting angle is more than that of the pixel groups at the edge of the second handwriting angle;

or the first handwriting angle and the second handwriting angle are angles within 70-120 degrees and are not 90 degrees, the absolute value of the difference value between the first handwriting angle and 90 degrees is smaller than the absolute value of the difference value between the second handwriting angle and 90 degrees, and the number of pixel groups arranged at the edge of the first handwriting is more than that of pixel groups arranged at the edge of the second handwriting.

Optionally, in some embodiments, the method specifically includes:

receiving single or continuous touch point information determined by the touch component according to the received touch signal;

generating a first writing script and a second writing script according to the touch point information; the number of the pixel groups set in the second handwriting is more than that set in the first handwriting;

controlling the display panel to display the first handwriting in the process of receiving the touch point information;

and after the touch point information is determined to stop being received, controlling the display panel to display by adopting the second handwriting to replace the first handwriting.

Optionally, in some embodiments, the determining to stop receiving the touch point information specifically includes:

and determining to stop receiving the touch point information when the touch point information is not received within a threshold time.

Optionally, in some embodiments, the method specifically includes: and directly drawing the first handwriting in the frame buffer of the current display picture, and drawing the second handwriting in a buffer area and then synthesizing the second handwriting in the idle frame buffer.

Optionally, in some embodiments, the method specifically includes:

when it is detected that a user performs writing operation on a current writing interface of writing software, acquiring the writing operation on the current writing interface, wherein the writing operation is a screen touch event within the range of the current writing interface;

Optionally, in some embodiments, the display panel includes a first pixel located inside the writing script; and controlling the display brightness of a sub-pixel in a first display area in the pixel group to be smaller than the display brightness of the same sub-pixel in the first pixel.

Optionally, in some embodiments, the pixel voltage of a sub-pixel in the first display region in the pixel group is controlled to be smaller than the pixel voltage of the same sub-pixel in the first pixel.

Optionally, in some embodiments, a sub-pixel in a first display region in the pixel group has a first pixel voltage, the same sub-pixel in the first pixel has a second pixel voltage, and a ratio of the first pixel voltage to the second pixel voltage is controlled to be less than 2/3.

Optionally, in some embodiments, the area ratio of the first display region to the second display region in one pixel group is set to be 1:1 to 1: 4.

Optionally, in some embodiments, an area ratio of the first display region to the second display region within one of the pixel groups is set to 1: 2.

Optionally, in some embodiments, the first display region and the second display region include sub-pixels of the same color, which are arranged in one pixel group.

Optionally, in some embodiments, one of the pixel groups is set to include at least two pixels; in one of the pixel groups, the first display region and the second display region are constituted by different pixels.

Optionally, in some embodiments, the first display region is configured to include m pixels, the second display region includes n pixels, and n: m is between 1 and 4.

Optionally, in some embodiments, one of the pixel groups is configured to include three pixels, the first display region includes one pixel, and the second display region includes two pixels.

Optionally, in some embodiments, one of the pixel groups is provided to include a portion of two pixels; in one of the pixel groups, the first display region is formed of a portion of one pixel, the second display region is formed of a portion of another pixel, and an area ratio of the first display region to the second display region is controlled to be 1:1 to 1: 4.

Optionally, in some embodiments, the area ratio of the first display region and the second display region is controlled to be 1: 2.

Optionally, in some embodiments, one of the pixels is configured to include at least three kinds of sub-pixels, each of the sub-pixels includes a first portion and a second portion, the first display region includes each of the first portions, and the second display region includes each of the second portions.

Optionally, in some embodiments, the area ratio of the second portion to the first portion in the same sub-pixel is set to be between 1 and 4.

Optionally, in some embodiments, the area ratio of the second portion to the first portion in the same sub-pixel is set to 2.

Optionally, in some embodiments, the first and second portions of the sub-pixels are controlled by the same gate line and the same data line.

Optionally, in some embodiments, one of the pixel groups is set to include one pixel, and one of the pixels includes at least three sub-pixels; in one of the pixel groups, the first display region and the second display region are constituted by different kinds of sub-pixels.

Optionally, in some embodiments, the first display region is configured to include a sub-pixels, the second display region includes b sub-pixels, and b: a is between 1 and 3.

Optionally, in some embodiments, one of the pixels includes four sub-pixels; the first display area comprises a sub-pixel, and the second display area comprises three sub-pixels.

Optionally, in some embodiments, one of the pixels is set to include RGBW four sub-pixels; the first display area comprises W sub-pixels, the second display area comprises RGB sub-pixels, and white writing is controlled and displayed.

Optionally, in some embodiments, the first pixel group and the second pixel group are arranged to be aligned in a vertical direction or aligned in a horizontal direction.

Alternatively, in some embodiments, the first display region and the second display region are arranged in a vertical direction or in a horizontal direction, provided in one of the pixel groups.

In a third aspect, an embodiment of the present invention further provides a readable storage medium, including a memory;

the memory is used for storing instructions which, when executed by the processor, cause the apparatus comprising the readable storage medium to perform the display method provided by the second aspect of the invention.

The invention has the following beneficial effects:

according to the intelligent interactive panel, the display method and the readable storage medium provided by the embodiment of the invention, the intelligent interactive panel is controlled by the processor to execute the handwriting function, and the edge of the generated writing track is controlled to execute the sawtooth removing operation. The display panel corresponds to each pixel of the display writing track, the display panel comprises at least two adjacent pixel groups located at the edge of the writing trace, each pixel group comprises at least one pixel, a first display area and a second display area can be formed in each pixel group, the at least two pixel groups comprise a first pixel group and a second pixel group adjacent to the first pixel group, and the processor controls the display brightness of the second display area of the first pixel group to be lower than the display brightness of the first display area of the first pixel group and the display brightness of the first display area of the second pixel group so as to perform the antialiasing.

Drawings

FIG. 1 is a schematic diagram of a writing script in a horizontal direction;

FIG. 2 is a schematic diagram of a writing script in a vertical orientation;

FIG. 3 is a diagram of pixels occupied by writing traces in different directions;

fig. 4 is a schematic structural diagram of an intelligent interactive tablet according to an embodiment of the present invention;

FIG. 5a is a diagram illustrating a general filter kernel;

FIG. 5b is a schematic diagram of an architecture of a directional filter kernel;

FIG. 5c is a schematic diagram of another structure of a directional filter kernel;

FIG. 5d is a schematic illustration of the filter kernel desdonning of the pixels of the fill portion using the filter kernel of FIG. 5 a;

FIG. 6 is a diagram of a pen-touch model being a raindrop model;

FIG. 7 is a schematic illustration of the jagging of the edge of the writing;

FIG. 8 is a schematic diagram of a pixel group in an intelligent interactive tablet according to an embodiment of the present invention;

FIG. 9 is a schematic diagram of another pixel group in the smart interactive tablet according to an embodiment of the present invention;

FIG. 10 is a schematic diagram of another pixel group in the smart interactive tablet according to an embodiment of the present invention;

FIG. 11 is a schematic diagram of another pixel group in the smart interactive tablet according to an embodiment of the present invention;

FIG. 12 is a schematic diagram of another pixel set in the smart interactive tablet according to an embodiment of the present invention;

FIG. 13 is a schematic diagram of another pixel group in the smart interactive tablet according to an embodiment of the present invention;

FIG. 14 is a schematic diagram of another pixel group in the smart interactive tablet according to an embodiment of the present invention;

FIG. 15 is a schematic diagram of another pixel set in the smart interactive tablet according to an embodiment of the present invention;

FIG. 16 is a schematic diagram of switching from a first writing to a second writing;

FIG. 17 is a diagram of an embedded system framework.

Detailed Description

The jaggy of the handwriting is caused by the fact that a system drawing algorithm is not optimized enough or the system computing power is not high enough or the resolution of a screen is not high enough, an anti-aliasing algorithm is adopted in the conventional method for removing the jaggy, but the processing of the anti-aliasing algorithm on the global handwriting track brings a large operation burden along with the increase of the resolution of the display panel. Therefore, there is a need to optimize the desdonning algorithm.

In addition, with the current improvement of the resolution of the display panel, adaptive improvement is also needed for the method for antialiasing the writing. For example, the inventor finds that the current antialiasing algorithm has a poor antialiasing effect especially when the writing is close to 0 degrees (i.e. horizontal direction as shown in fig. 1) or 90 degrees (i.e. vertical direction as shown in fig. 2), and needs to optimize and improve the antialiasing method.

The inventors speculate that the reason why the writing handwriting in the nearly horizontal direction or the vertical direction generates jaggies is as follows: horizontal or vertical track points have a relatively low directional resolution, which is understood to be the ratio of the number of rows or columns of pixels to the length of the track. For example, as shown in fig. 3, the number of pixels passed by a track segment at the same distance at different angles is compared. For the track points with the angle of 45 degrees, more pixels pass through in the horizontal direction and the vertical direction, namely, the resolution ratio in the horizontal direction or the vertical direction is higher, and extra handwriting beautification is not needed. For the track points in the horizontal direction, there are fewer pixels passing through in the vertical direction, and only 2 rows of pixels are shown in fig. 3, and the resolution in the vertical direction is low, and in the case of low resolution, jaggy may easily occur. Similarly, for track points in the vertical direction, the resolution in the horizontal direction is low, and therefore, the saw teeth are also easy to appear.

In order to make the objects, technical solutions and advantages of the embodiments of the present invention clearer, the technical solutions of the embodiments of the present invention will be clearly and completely described below with reference to the drawings of the embodiments of the present invention. It is to be understood that the embodiments described are only a few embodiments of the present invention, and not all embodiments. And the embodiments and features of the embodiments may be combined with each other without conflict. All other embodiments, which can be derived by a person skilled in the art from the described embodiments of the invention without any inventive step, are within the scope of protection of the invention.

Unless defined otherwise, technical or scientific terms used herein shall have the ordinary meaning as understood by one of ordinary skill in the art to which this invention belongs. The use of the word "comprise" or "comprises", and the like, in the context of this application, is intended to mean that the elements or items listed before that word, in addition to those listed after that word, do not exclude other elements or items.

It should be noted that the sizes and shapes of the figures in the drawings are not to be considered true scale, but are merely intended to schematically illustrate the present invention. And the same or similar reference numerals denote the same or similar elements or elements having the same or similar functions throughout.

As shown in fig. 4, an intelligent interactive tablet 100 provided by the embodiment of the present invention may be, for example, an electronic whiteboard, a conference machine, and other display device products. The smart interactive tablet 100 specifically includes a touch-sensing component 110, a processor 120, and a display panel 130.

The touch device 110 may be an infrared touch device, a capacitive touch device, an electromagnetic touch device, or the like. The touch component 110 is used for recognizing touch handwriting track information of a user and sending the handwriting track information to the processor 120. Specifically, the touch component 110 is specifically configured to receive a touch signal of a user, determine single or continuous touch point information according to the received touch signal, and send the single or continuous touch point information to the processor.

The processor 120 is configured to generate a corresponding handwriting according to the handwriting track information, and control the display panel to display the handwriting. Specifically, the processor 120 is specifically configured to receive touch point information sent by the touch component 110, draw a handwriting image according to the touch point information, and cache the handwriting image. The display panel 130 may read the handwriting image from the buffer and display the handwriting image. Specifically, the display panel 130 may periodically read data of the handwriting image from the buffer of the processor 120 according to the vertical synchronization signal.

Specifically, the processor 120 may perform the following processing methods:

1. touch point information (specifically, 1 or more touch point information forms a sequence) is obtained from the touch component 11, and a pen-touch model is determined. Wherein, determining the stroke model specifically comprises: determining the shape of the brush strokes, such as circles, ellipses, raindrop shapes, and the like; and determining the size of the pen stroke, for example, adjusting the size of the pen stroke according to the acquired speed or pressure of a specific touch point. It should be noted that the stroke can be understood as the contact area between a virtual pen and paper, and the larger the stroke is, the thicker the written handwriting is; the smaller the speed of the touch point is, the larger the pen touch is; the larger the pressure of the touch point is, the larger the pen touch is. Specifically, pressure may be obtained by an active stylus, and velocity may be obtained by sampling time and distance between adjacent touch points.

2. And generating initial writing according to the position (such as xy coordinates) of the touch point, the shape of the pen touch and the size of the pen touch. In addition, when the initial writing trace is generated, the initial writing trace may be determined according to a preset connection mode, for example, the pen touches of two adjacent touch points may be connected by a straight line (for example, for a circular pen touch, a common tangent line may be used for connection). Of course, curves, such as bezier curves, may be used to connect to obtain smoother handwriting, and the invention is not limited thereto.

3. And performing sawtooth removing operation to obtain the display writing after sawtooth removing. The jaggies are caused by the speed of drawing the handwriting trace, sudden changes in pressure, the capability of the processor, the reasonableness of the algorithm, errors in user operation, the resolution of the display panel, and the like. It is therefore necessary to perform a de-aliasing operation on the handwritten traces. The antialiasing operation may be performed in various ways, for example, the original handwriting may be antialiased using an antialiasing algorithm, or may be antialiased using other schemes, for example, antialiasing the original handwriting using a filter kernel, such as a general filter kernel as shown in fig. 5a, a directional filter kernel as shown in fig. 5b and 5c, and a gray level change before and after antialiasing using a general filter kernel as shown in fig. 5 d. Besides, in addition to the filtering kernel mode, all points needing to be drawn can be determined according to the line width, and the farther the distance from the real coordinate point is, the lower the gray scale of the pixel is, and the lower the pixel voltage for charging a certain pixel is, the more the jagging is removed.

Alternatively, instead of performing the antialiasing operation with an additional step, the antialiasing pen stroke model may be constructed when the pen stroke model is constructed. For example, as shown in fig. 6, the pen-touch model is a raindrop model, and the middle graph is a conventional raindrop model, i.e., the gray level of a pixel is either 0 or 1, and there is no intermediate transition. The right-most diagram is the raindrop model for performing the antialiasing, with the gray levels of the pixels in the edge region of the raindrop transitioning from large to small, e.g., decreasing from 100% to 0% from inside to outside. The handwriting constructed in this way can also achieve the effect of sawtooth removal.

The invention does not limit the time sequence of the process of performing the de-aliasing on the processor, and the effect of the invention can be achieved no matter what time node the de-aliasing is performed.

In the present invention, the processor 120 controls the smart interactive tablet to perform a handwriting function and controls a de-aliasing operation to be performed at an edge of the generated writing trace. For example, in determining that the display panel 130 corresponds to each pixel of the displayed writing trace, the processor 120 may divide at least two adjacent pixel groups located at the edge of the writing trace, that is, the display panel 130 may not itself include the pixel group, and after the processor 120 forms the writing trace, the pixel groups are defined at the edge of the writing trace according to the display position of the writing trace. For example, the display panel 130 itself includes pixel groups in hardware by circuit arrangement or division of regions, and the processor performs control of brightness, gray scale, or pixel voltage. One pixel group comprises at least one pixel, a first display area and a second display area can be formed in one pixel group, at least two pixel groups can comprise a first pixel group and a second pixel group adjacent to the first pixel group, and the processor 120 specifically controls the display brightness of the second display area of the first pixel group to be lower than that of the first display area of the first pixel group and that of the first display area of the second pixel group, namely, the writing handwriting edge comprises an area with alternate light and shade to perform the antialiasing.

Specifically, as shown in fig. 8 to 13, the display panel 130 includes two adjacent pixel groups, namely a first pixel group 131 and a second pixel group 132, at the edge of the handwriting, and each pixel group includes a first display region 1301 and a second display region 1302. When performing the antialiasing, the processor 120 controls the display luminance of the second display region 1302 of the first pixel group 131 to be lower than the display luminance of the first display region 1301 of the first pixel group 131, and the luminance of the second display region 1302 of the first pixel group 131 to be lower than the luminance of the first display region 1302 of the second pixel group 132, so as to perform the antialiasing.

When performing the antialiasing operation, the processor 120 in the present invention controls the average brightness of the second display region 1302 of the first pixel group 131 to be lower than both the first display region 1301 of the first pixel group 131 and the first display region 1301 of the second pixel group 132, so as to perform antialiasing. This is an effect that the inventors have found in performing write-handwriting deswiving for a high-resolution display panel. For this reason, the jaggy is generated because the region of several consecutive pixels visible to the naked human eye is simultaneously turned on or off, for example, the a position of fig. 7, and the region of several consecutive pixels adjacent thereto performs the opposite operation, for example, the B position of fig. 7, which gives the user the feeling of jaggy due to the step generated at the adjacent position.

After several concepts of desdonning have been tried by the inventor, it was found that the use of such a scheme of opening one first display region 1301 at a distance (for example, at a distance from the second display region 1302) greatly reduces the sensitivity of the user to the jaggy in use, because the human eye cannot easily recognize the step when observing several scattered first display regions 1301 at a longer distance. And as the resolution of the display panel is increased, for example, a 4K or 8K display screen, the area of a single pixel is gradually reduced, and the effect of the above scheme is more remarkable. In addition, the scheme that the edge of the re-written handwriting is separated from the second display area 1302 to open the first display area 1301 is closer to the real handwriting, because ink is not very continuous when being spread on paper, the scheme just simulates the effect, and the quite unexpected de-aliasing effect is achieved.

Optionally, in the embodiment of the present invention, only the edge of a part of the writing script may be subjected to the antialiasing, for example, an included angle between the writing script and the horizontal direction is taken as a writing angle, the processor 120 controls the edge of the writing script, of which the writing angle is located within a preset angle range, to be provided with at least four pixel groups, the preset angle range is a part of the angle range from-30 degrees to +30 degrees, or a part of the angle range from 60 degrees to 120 degrees, or a part of the angle range from-30 degrees to +30 degrees and from 60 degrees to 120 degrees, that is, the edge close to the vertical direction and/or the horizontal direction may be subjected to the antialiasing selectively. For example, at least two pixel groups can be set only for the edge with the preset angle ranging from-10 degrees to +10 degrees, or at least two pixel groups can be set only for the edge with the preset angle ranging from 80 degrees to 100 degrees.

Further, in the embodiment of the present invention, the preset angle range may be a partial angle range within a range from-20 degrees to +20 degrees, or the preset angle range may be a partial angle range within a range from 70 degrees to 110 degrees, or the preset angle range may be a partial angle range within a range from-20 degrees to +20 degrees and 70 degrees to 110 degrees.

Optionally, in the embodiment of the present invention, the processor may further generate a first writing script having a first writing script angle, and generate a second writing script having a second writing script angle; the first handwriting angle and the second handwriting angle can be angles within +20 to-20 degrees and are not 0 degree, the absolute value of the first handwriting angle is smaller than that of the second handwriting angle, and the number of pixel groups at the edge of the first handwriting angle is more than that at the edge of the second handwriting angle, namely, more pixel groups are arranged on the handwriting edge closer to the horizontal direction; or, the first handwriting angle and the second handwriting angle can be angles within 70 degrees to 120 degrees and are not 90 degrees, the absolute value of the difference value between the first handwriting angle and 90 degrees is smaller than the absolute value of the difference value between the second handwriting angle and 90 degrees, the number of the pixel groups at the edge of the first handwriting can be set by the processor to be more than the number of the pixel groups at the edge of the second handwriting, namely, more pixel groups are arranged at the edge of the handwriting which is closer to the vertical direction.

Specifically, for a line needing to be drawn with a certain width, a plurality of coordinates through which the original line passes can be stored, and when the handwriting is drawn, a rectangle with a certain width is drawn between two adjacent points, namely, a part of the line with a certain line width is drawn, and the line needing to be drawn is combined. For a line requiring antialiasing, after two coordinate points p1(x1, y1), p2(x2, y2) and a line width w are transmitted, four coordinate points and a slope k of a rectangle with a straight line of the two coordinate points as a central axis and the line width w as a line width are determined.

And then performing the sawtooth removing treatment on the line with the slope k meeting the requirement.

Alternatively, in the embodiment of the present invention, the luminance difference between the first display region 1301 and the second display region 1302 is caused by the difference of the pixel voltages, and therefore, the processor 120 may control the pixel voltage of the second display region 1302 of the first pixel group 131 to be lower than the pixel voltage of the first display region 1301 of the first pixel group 131 and the first display region 1301 of the second pixel group 132, so that the antialiasing is performed. Specifically, the inventors found that the processor 120 can obtain a better antialiasing effect when the ratio of the pixel voltage of the second display region 1302 of the first pixel group 131 to the pixel voltage of the first display region 1301 of the first pixel group 131 is controlled to be less than or equal to 4/5, and the ratio of the pixel voltage of the second display region 1302 of the first pixel group 131 to the pixel voltage of the first display region 1301 of the second pixel group 132 is controlled to be less than or equal to 4/5.

Optionally, in the embodiment of the present invention, the processor 120 may control the luminance of each second display region 1302 in the at least two pixel groups to be the lowest luminance that can be displayed by the display panel, that is, the lowest luminance when the second display region 1302 (0 gray scale) is turned off and includes the case of light leakage of the display panel, or the processor 120 may also control the luminance of each second display region 1302 in the at least two pixel groups to be the background luminance, for example, display a 5 gray scale screen, so as to improve the luminance difference between the second display region 1302 and the first display region 1301.

Alternatively, in the embodiment of the present invention, the processor 120 may control the brightness of each first display region 1301 in at least two pixel groups to be decreased. That is, along the arrangement direction of each pixel group, the luminance of each first display region 1301 in each pixel group decreases, and a better antialiasing effect can be achieved in cooperation with the low-luminance display of the second display region 1302.

Specifically, the processor may control the pixel voltage of the same sub-pixel in each first display region of the at least two pixel groups to decrease, so as to achieve a better antialiasing effect. It should be noted that the decreasing mentioned here is a decreasing trend of the pixel voltage, that is, there may be a case where the pixel voltage decreases discontinuously, that is, a case where at least two adjacent pixel voltages are the same.

Alternatively, in the embodiment of the present invention, as shown in fig. 8, the display panel includes a first pixel located inside the writing (the writing generally has a certain width, and is considered to be inside the writing in a non-edge area); the display brightness of a sub-pixel (for example, a red writing is an R sub-pixel, a green writing is a G sub-pixel, a blue writing is a B sub-pixel, and a common white writing is a white writing, and may be any one of RGB or a single W sub-pixel) in the first display area in the pixel group of the edge area may be less than that of the same sub-pixel in the first pixel, and a better antialiasing effect may be achieved in the edge area. Specifically, since the luminance difference of the pixels is caused by the difference of the pixel voltages, the processor may control the pixel voltage of a sub-pixel in the first display region in the pixel group to be smaller than the pixel voltage of the same sub-pixel in the first pixel, so that the antialiasing is performed.

Specifically, one sub-pixel in the first display region in the pixel group has a first pixel voltage, the same sub-pixel in the first pixel has a second pixel voltage, and the processor controls the ratio of the first pixel voltage to the second pixel voltage to be less than 2/3, so that a better sawtooth-removing effect can be achieved in the edge region.

Alternatively, in the embodiment of the present invention, as shown in fig. 9 and 12, the adjacent first pixel group 131 and second pixel group 132 may be arranged in the vertical direction, or, as shown in fig. 10, 11, 13, and 14, the adjacent first pixel group 131 and second pixel group 132 may be arranged in the horizontal direction.

Alternatively, in an embodiment of the present invention, in one pixel group, that is, the first pixel group 131 and the second pixel group 132, as shown in fig. 9, 10, 12, and 13, the first display region 1301 and the second display region 1302 may be arranged in a vertical direction, or, as shown in fig. 11 and 14, the first display region 1301 and the second display region 1302 may be arranged in a horizontal direction.

Optionally, in the embodiment of the present invention, the area ratio of the first display region 1301 to the second display region 1302 in one pixel group is 1:1 to 1:4, and a preferred ratio is 1: 2. That is, the area of the first display region 1301 is smaller than that of the second display region 1302, so that the area occupied by the region with higher brightness in the pixel group at the edge of the handwriting is smaller, and a better antialiasing effect can be achieved.

The configurations of the first display region 1301 and the second display region 1302 are described in detail below.

The first embodiment is as follows:

in one pixel group including at least two pixels, the first display region 1301 and the second display region 1302 within one pixel group may be composed of different pixels. Specifically, the first display region 1301 may include m pixels, the second display region 1302 may include n pixels, and n: m is between 1 and 4. Preferably, n: when m is 2, the effect of optimizing the antialiasing can be achieved. For example, as shown in fig. 9 to 11, one pixel group includes three pixels, three sub-pixels of RGB form one pixel, the first display region 1301 includes one pixel, and the second display region 1302 includes two pixels.

Specifically, as shown in fig. 9, the first pixel group 131 and the second pixel group 132 may be arranged in a vertical direction, or, as shown in fig. 10 and 11, the first pixel group 131 and the second pixel group 132 may be arranged in a horizontal direction. Also, as shown in fig. 9 and 10, the first display region 1301 and the second display region 1302 may be aligned in a vertical direction, or, as shown in fig. 11, the first display region 1301 and the second display region 1302 may be aligned in a horizontal direction. In fig. 9 to 11, an example is given in which one pixel includes three sub-pixels arranged in the horizontal direction.

Alternatively, as shown in fig. 15, one pixel group 131 includes a portion of two pixels (two pixels adjacent up and down are illustrated in fig. 15, and the two pixels are divided by a bold dashed line); in one pixel group 131, the first display region 1301 is formed by a portion of one pixel (a pixel located at the upper portion in fig. 15), the second display region 1302 is formed by a portion of another pixel (a pixel located at the lower portion in fig. 15), the area ratio of the first display region 1301 to the second display region 1302 is 1:1 to 1:4, preferably, the area ratio of the first display region 1301 to the second display region 1302 is 1:2, and the effect of optimization of antialiasing can be achieved; the pixel may be a pixel divided by control of the gate and data lines, for example, a portion and another portion of the pixel are spaced by the gate line, but the portion and the another portion are controlled and driven by the same gate and data lines.

Example two:

at least one pixel may be included in a pixel group, each pixel including at least three sub-pixels, each sub-pixel including a first portion and a second portion. The luminance of the first and second portions of each sub-pixel may have some correlation, but not a completely uniform average luminance. The first display region 1301 in each pixel group includes first portions, and the second display region 1302 includes second portions. For example, as shown in fig. 12 and 13, one pixel group includes one pixel including three sub-pixels each including a first portion and a second portion. Specifically, the area ratio of the second portion to the first portion in the same sub-pixel may be between 1 and 4, and preferably, the ratio is 2, which can achieve the effect of optimal antialiasing.

In the embodiment, in consideration of the diversity of the pixel design, in order to improve the antialiasing capability of the display panel, when designing the pixel, the sub-pixel may be designed to include a first portion and a second portion, and the two portions together form a sub-pixel.

For example, one sub-pixel includes sub-pixels formed by area division according to gate lines and data lines, that is, the gate lines and the data lines may divide the display panel into a plurality of small areas, and the first portion and the second portion of the same sub-pixel are located in the same small area.

For another example, the gate line and the data line may divide the display panel into a plurality of small regions, the first portion and the second portion of the same sub-pixel are located in different small regions, that is, one sub-pixel portion is located in one small region, and the other portion is located in an adjacent small region, and different portions of two sub-pixels are included in one small region, at this time, the first portion and the second portion of the same sub-pixel are controlled by the same gate line and the same data line, but parameters such as a width-to-length ratio of the TFT transistor corresponding to the first portion or the second portion are adjusted, so that pixel voltages of the first portion and the second portion are different, and of course, the present application does not limit the difference in achieving the pixel voltages in many ways.

In summary, the gray levels of the first portion and the second portion may have a certain relationship, for example, the two portions may have non-uniform brightness, and as the brightness of the first portion is higher, the brightness of the second portion is also higher, i.e. the brightness of the two portions may have a positive correlation.

Example three:

one pixel is included in one pixel group, and one pixel comprises at least three sub-pixels; in one pixel group, the first display region 1301 and the second display region 1302 are composed of different kinds of sub-pixels. Specifically, the first display region 1301 may include a sub-pixels, the second display region 1302 may include b sub-pixels, and b: a is between 1 and 3. Preferably, as shown in fig. 14, one pixel includes four kinds of sub-pixels, the first display region 1301 includes one kind of sub-pixel, and the second display region 1302 includes three kinds of sub-pixels. For example, in fig. 14, one pixel includes four subpixels RGBW, and the arranged W subpixel can improve the transmittance of the display panel. The sub-pixel color included in the first display region 1301 may be selected according to a handwriting color selected by a user, for example, white writing is displayed, the first display region 1301 may include W sub-pixels, and the second display region 1302 may include RGB sub-pixels. When the processor performs the antialiasing operation, the processor may control the sub-pixel luminance of the second display region 1302 to decrease below the luminance of the first display region 1301, thereby achieving antialiasing.

In both the first embodiment and the second embodiment, the first display region 1301 and the second display region 1302 each include subpixels of the same color in one pixel group, that is, the first display region 1301 and the second display region 1302 each include RGB subpixels. Embodiment two and embodiment three compared to embodiment one, in the first display region 1301 can be smaller than one pixel, and therefore, the granularity of the pixel itself can be reduced, and the smaller the granularity, the better the effect of implementing the antialiasing is.

Handwriting acceleration in the field refers to improvement of follow-up performance of handwriting, and if the phenomenon that follow-up performance is poor and observation is carried out is that the handwriting speed is high, the handwriting is displayed without following the position of a user, so that user experience is poor. Therefore, in the embodiment of the present disclosure, a mechanism of double drawing is adopted, and there is both the first writing script and the second writing script. The first writing handwriting is the writing handwriting which is not subjected to the de-jagging operation or is subjected to partial de-jagging operation, and the algorithm occupies less calculation force due to the simple or insufficient de-jagging algorithm of the first writing handwriting, so that the handwriting following effect is better. The second writing is the writing after the full de-aliasing operation. When the user writes, the processor draws the first writing handwriting and the second writing at the same time, and of course, the processor may draw the first writing first and then draw the second writing. It is noted that the tools used to draw the first writing and the second writing in the android system are not the same, and will be described more fully below.

Specifically, when the user performs handwriting operation, the processor controls drawing of the first handwriting, the drawn first handwriting is stored in a frame buffer (Framebuffer), and the display panel can read and display data of the first handwriting stored in the frame buffer. When the user finishes drawing, namely the user is detected to lift the pen, and the condition that the user inputs touch point information again within a certain time threshold range such as 1s is not detected, the processor controls the frame buffer for storing the second handwriting to be exchanged with the frame buffer for storing the first handwriting, and the display panel reads and displays data of the second handwriting stored in the frame buffer. Specifically, the processor generates a first writing script and a second writing script according to the touch point information, controls the display panel to display the first writing script in the process of receiving the touch point information, and controls the display panel to display the first writing script by replacing the second writing script after determining that the receiving of the touch point information is stopped. Thus, the user will see a pen-up and the displayed handwriting is refreshed again and the edge jaggies disappear. The specific effect diagram is shown in fig. 16, where the left side diagram is a first writing trace, and the right side diagram is a second writing trace, it can be seen that half-open pixels in the second writing trace are increased, and the half-open pixels are pixel groups including the first display area and the second display area provided by the embodiment of the present invention, that is, the number of the pixel groups set in the first writing trace is smaller than the number of the pixel groups set in the second writing trace.

The drawing mechanism of the first handwriting and the second handwriting is described in detail below by using two specific implementations.

The first implementation mode comprises the following steps:

when a rendering program in an operating system (such as an android system) updates a display screen each time, all Surface objects corresponding to all display windows on the display screen need to be overlaid according to the size of their own Layer to form a bitmap file (bitmap) with the same size as the display screen, the bitmap file is written into an idle frame buffer, and a vertical synchronization signal (vsync signal) is waited, so that the rendering program can use the idle frame buffer as a currently displayed frame buffer according to the vsync signal, and thus, the screen is displayed on a display panel, and the rendering update of the display screen is completed. The bitmap file is a Windows standard format graphic file, which defines an image as being composed of dots (pixels), each of which can be represented by a plurality of colors. Frame buffering is a driver interface for driving a video display device from a memory buffer containing complete frame data by a video output device.

When a user performs touch writing on a display screen with a touch component, in the process of refreshing the display screen to display the writing of the user through the method, because certain time is needed for the superposition synthesis of the writing of a Surface object (for example, an App of an android system has at least one Surface) and the waiting of a vsync signal, the display of the writing on the display screen is delayed, the phenomenon that the writing on the screen does not follow the writing of the user and is correspondingly and synchronously displayed occurs, and the user experience is extremely poor.

In a first implementation manner, the first writing script skips the process of superposition synthesis of the writing scripts of the Surface object and waits for the vsync signal, and the first writing script is directly drawn into the frame buffer of the current display screen, namely, the fb0 (/ dev/fb0 or/dev/graphics/fb 0) device file is directly written. And when the second handwriting is drawn, the second handwriting is drawn in a buffer area (namely a Surface object), then the second handwriting is synthesized with other Surface objects and then stored in an idle frame buffer, and the frame buffer is generally double-buffered or multi-buffered, waits for a vertical synchronization signal and then is directly displayed.

Specifically, since the frame buffer is a continuous physical memory reserved for the GPU in the embedded system, the display panel regards it as a display buffer, and the display panel reads data from the frame buffer through a dedicated bus and displays the data on the screen. Therefore, the first handwriting can be directly drawn for the frame buffer currently displayed through the Native layer of the Android, and the display of the handwriting on the screen is realized. As shown in fig. 17, the embedded system framework may specifically operate the frame buffer of the bottom layer through libfd _ dev.so as to implement reading and writing, the Skia framework is responsible for drawing Native handwriting, and the related drawing interface is provided for the upper application APP through the JNI mechanism of the Android to make calls.

Specifically, Skia is a graphics library of multiple aspects of graphics, images, animations, SVG, texts and the like of a bottom layer of Google, and is a 2D engine of a graphics system in Android. 2D rendering interfaces (such as rendering straight lines, circles, bitmaps and the like) provided by Android to APP development programmers are JNI packaging for Skia library interfaces of a Native layer.

In order to realize the direct drawing of a simple 2D image in the current displayed cache and ensure the consistency with the track called by the upper layer standard, the realization mode adopts the mode of directly calling the Skia interface to draw the coordinate data transmitted by the upper layer, thereby ensuring the high efficiency and realizing the accuracy of the track.

Because the handwriting operation of the intelligent interactive tablet is a single simple operation and only relates to the operation of constructing, analyzing and drawing the Path object, the Path object is drawn into the SkBitmap object corresponding to the canvas SkCanvas only by a drawPath () method corresponding to Skia, and the relevant coordinate pixels are written into the corresponding video memory position, so that the correct follow-up display of the handwriting is realized.

And by utilizing the drawing mechanism of the first writing script, the second writing script is drawn in the surface opposite direction, and then the second writing script is synthesized in the idle frame buffer by utilizing a system tool surface flicker.

The second implementation mode comprises the following steps:

specifically, when it is detected that a user performs writing operation on a current writing interface of writing software of the intelligent interactive tablet, the intelligent interactive tablet acquires the writing operation on the current writing interface, and the writing operation is a screen touch event within the range of the current writing interface.

Displaying a first writing handwriting following the writing operation on a current writing interface; the writing interface comprises a display interface with a first display layer and a second display layer, and the first writing handwriting is displayed on the display interface of the first display layer.

Displaying the second writing on a display interface of the second display layer, and clearing the first writing; wherein the second handwriting is generated according to the writing operation; the first handwriting on the first display layer is synthesized through hardware, and the second handwriting on the second display layer is synthesized through software.

In the second implementation mode, because the first writing handwriting on the first display layer is synthesized through hardware, the second writing handwriting on the second display layer is synthesized through software, and the display response speed of the first writing handwriting synthesized through hardware is higher than that of the second writing handwriting synthesized through software, the first writing handwriting is displayed on the first display layer with the higher display response speed of the writing handwriting, and the second writing handwriting is displayed on the second display layer with the lower writing response speed, so that the phenomenon of handwriting display delay on the writing software is solved, the display of the writing handwriting is accelerated, the phenomenon that the handwriting follows the hand of a user in the visual effect is realized, and the use experience of the user is improved.

Specifically, the second display Layer specifically includes a mouse cursor hardware display Layer (hard ware cursor Layer) (), and the current writing interface includes a mouse cursor hardware display Layer (hard ware cursor Layer), a media Layer (media Layer), and at least one normal view Layer. The content on the common view Layer needs to be displayed by software synthesis, namely, a plurality of display windows corresponding to the common view Layer superpose respective bitmap files (bitmaps) according to the size and the position of the Layer of the display window corresponding to the display windows to synthesize a bitmap file (bitmap), the bitmap file is synthesized in a mode of occupying a CPU, and the bitmap file is rendered and written into an idle Frame buffer. The content display on the hardware display layer of the mouse cursor and the content display on the media layer do not need to be synthesized by software, the content display on the hardware display layer of the mouse cursor and the content display on the media layer are synthesized and displayed in a hardware synthesis mode (hardware combination abstract layer, HW Composer), and the content displayed by the HW Composer HAL layer is synthesized on the Frame buffer corresponding to the equipment file of the HW Composer through one or more special synthesis chips. And then when the current writing interface is refreshed and displayed, the Frame buffer synthesized by the software display layer and the Frame buffers on different hardware layers are overlapped, fused and displayed on the display in a hardware synthesis mode, and the overlapped display of all the layers on the display screen is completed. The content display processing on the ordinary view layer needs a soft layer synthesized by a GPU, the result is submitted to HW Composer for display, the display contents on the mouse cursor hardware display layer and the media layer are processed by the HW Composer for display, the synthesis of the display contents on the mouse cursor hardware display layer and the media layer cannot influence the synthesis of the ordinary view layer, and the response speed of the mouse cursor hardware display layer is higher than that of the ordinary view layer because the priority of the mouse cursor hardware display layer is higher than that of the ordinary view layer.

Based on the above principles, the rendering of the first writing may be done faster by separate hardware.

Based on the same inventive concept, the embodiment of the invention also provides a display method of the intelligent interactive tablet, which comprises the following steps:

generating corresponding writing handwriting according to the handwriting track information, and controlling a display panel to display the writing handwriting; wherein the content of the first and second substances,

the display panel comprises at least two adjacent pixel groups positioned at the edge of the handwriting, each pixel group comprises at least one pixel, a first display area and a second display area are formed in each pixel group, the at least two pixel groups comprise a first pixel group and a second pixel group adjacent to the first pixel group, and the display brightness of the second display area of the first pixel group is controlled to be lower than that of the first display area of the first pixel group and that of the first display area of the second pixel group.

Optionally, in the embodiment of the present invention, the pixel voltage of the second display region of the first pixel group is controlled to be lower than the pixel voltages of the first display region of the first pixel group and the first display region of the second pixel group.

Optionally, in the embodiment of the present invention, a ratio of the pixel voltage of the second display region of the first pixel group to the pixel voltage of the first display region of the first pixel group is less than or equal to 4/5, and the ratio of the pixel voltage of the second display region of the first pixel group to the pixel voltage of the first display region of the second pixel group is controlled to be less than or equal to 4/5.

Optionally, in this embodiment of the present invention, the brightness of each second display region in at least two pixel groups is controlled to be the lowest brightness or the background brightness that can be displayed by the display panel.

Optionally, in an embodiment of the present invention, the brightness of each of the first display regions in at least two pixel groups is controlled to decrease.

Optionally, in the embodiment of the present invention, an included angle between the handwriting and the horizontal direction is a handwriting angle, and at least four pixel groups are arranged at an edge of the handwriting, where the handwriting angle is controlled to be within a preset angle range;

the preset angle range is a partial angle range within-30 to +30 degrees, or a partial angle range within 60 to 120 degrees, or a partial angle range within a range consisting of-30 to +30 degrees and 60 to 120 degrees.

Optionally, in the embodiment of the present invention, the preset angle range is a partial angle range within a range from-20 degrees to +20 degrees, or a partial angle range within a range from 70 degrees to 110 degrees, or a partial angle range within a range formed by a range from-20 degrees to +20 degrees and a range from 70 degrees to 110 degrees.

Optionally, in the embodiment of the present invention, a first writing script with a first writing script angle is generated, and a second writing script with a second writing script angle is generated;

the first handwriting angle and the second handwriting angle are within +20 to-20 degrees and are not 0 degree, the absolute value of the first handwriting angle is smaller than that of the second handwriting angle, and the number of pixel groups arranged at the edge of the first handwriting is more than that of the second handwriting;

or the first handwriting angle and the second handwriting angle are angles within 70-120 degrees and are not 90 degrees, the absolute value of the difference value between the first handwriting angle and the 90 degrees is smaller than the absolute value of the difference value between the second handwriting angle and the 90 degrees, and the number of the pixel groups arranged at the edge of the first handwriting is more than the number of the pixel groups arranged at the edge of the second handwriting.

Optionally, in an embodiment of the present invention, the method specifically includes:

receiving single or continuous touch point information determined by the touch control assembly according to the received touch control signal;

generating a first writing script and a second writing script according to the touch point information; the number of the pixel groups arranged in the second handwriting is more than that of the pixel groups arranged in the first handwriting;

controlling a display panel to display first handwriting in the process of receiving the touch point information;

Optionally, in the embodiment of the present invention, determining to stop receiving the touch point information specifically includes:

and determining to stop receiving the touch point information when the touch point information is not received within the time exceeding a threshold value.

Optionally, in an embodiment of the present invention, the method specifically includes: the first handwriting is directly drawn in the frame buffer of the current display picture, and the second handwriting is drawn in a buffer area and then synthesized in the idle frame buffer.

when it is detected that a user performs writing operation on a current writing interface of the writing software, the writing operation on the current writing interface is obtained, wherein the writing operation is a screen touch event within the range of the current writing interface;

displaying a first writing handwriting following the writing operation on a current writing interface; the writing interface comprises a display interface of a first display layer, and the first writing handwriting is displayed on the display interface of the first display layer;

Optionally, in the embodiment of the present invention, the pixel voltage of one sub-pixel in the first display area in the pixel group is controlled to be smaller than the pixel voltage of the same sub-pixel in the first pixel.

Optionally, in an embodiment of the present invention, the display panel includes a first pixel located inside the writing script; and controlling the display brightness of one sub-pixel in the first display area in the pixel group to be smaller than the display brightness of the same sub-pixel in the first pixel.

Optionally, in the embodiment of the present invention, the pixel voltage of one sub-pixel in each first display region in at least two pixel groups is controlled to be smaller than the pixel voltage of the same sub-pixel in the first pixel.

Optionally, in an embodiment of the present invention, one of the sub-pixels in each of the first display regions in the pixel group has a first pixel voltage, the same one of the sub-pixels in the first pixel has a second pixel voltage, and a ratio of the first pixel voltage to the second pixel voltage is controlled to be less than 2/3.

Optionally, in the embodiment of the present invention, an area ratio of the first display region to the second display region in one pixel group is set to be 1:1 to 1: 4.

Optionally, in the embodiment of the present invention, an area ratio of the first display region to the second display region in one pixel group is set to be 1: 2.

Optionally, in an embodiment of the present invention, the first display region and the second display region include sub-pixels of the same color, which are arranged in one pixel group.

Optionally, in the embodiment of the present invention, one pixel group is set to include at least two pixels; in one pixel group, the first display region and the second display region are constituted by different pixels.

Optionally, in this embodiment of the present invention, the first display region is configured to include m pixels, the second display region includes n pixels, and n: m is between 1 and 4.

Optionally, in the embodiment of the present invention, it is configured that one pixel group includes three pixels, the first display region includes one pixel, and the second display region includes two pixels.

Alternatively, in the embodiment of the present invention, a portion in which one pixel group includes two pixels is provided; in one pixel group, the first display region is formed by a portion of one pixel, the second display region is formed by a portion of another pixel, and the area ratio of the first display region to the second display region is controlled to be 1: 1-1: 4.

Alternatively, in the embodiment of the present invention, the area ratio of the first display region and the second display region is controlled to be 1: 2.

Optionally, in this embodiment of the present invention, a pixel is provided that includes at least three sub-pixels, each sub-pixel includes a first portion and a second portion, the first display region includes each first portion, and the second display region includes each second portion.

Optionally, in the embodiment of the invention, the area ratio of the second part to the first part in the same sub-pixel is set to be between 1 and 4.

Optionally, in the embodiment of the present invention, the area ratio of the second portion to the first portion in the same sub-pixel is set to 2.

Optionally, in the embodiment of the present invention, the sub-pixels include sub-pixels formed by performing area division according to the gate lines and the data lines.

Optionally, in the embodiment of the present invention, the first portion and the second portion of the sub-pixel are controlled by the same gate line and the same data line.

Optionally, in the embodiment of the present invention, one pixel group is set to include one pixel, and one pixel includes at least three sub-pixels; in one pixel group, the first display region and the second display region are constituted by different kinds of sub-pixels.

Optionally, in this embodiment of the present invention, it is set that the first display region includes a sub-pixels, the second display region includes b sub-pixels, and b: a is between 1 and 3.

Optionally, in the embodiment of the present invention, one pixel is set to include four seed pixels; the first display area comprises a sub-pixel, and the second display area comprises three sub-pixels.

Optionally, in the embodiment of the present invention, one pixel is set to include RGBW four-sub-pixels; the first display area comprises W sub-pixels, the second display area comprises RGB sub-pixels, and the processor is specifically used for controlling display of white writing.

Alternatively, in the embodiment of the present invention, the first pixel group and the second pixel group are arranged to be aligned in the vertical direction or aligned in the horizontal direction.

Alternatively, in the embodiment of the present invention, the first display region and the second display region are arranged in a vertical direction or in a horizontal direction in one pixel group.

Based on the same inventive concept, the embodiment of the invention also provides a readable storage medium, which comprises a memory;

the memory is used for storing instructions which, when executed by the processor, cause the apparatus comprising the readable storage medium to perform the above-described display method.

As will be appreciated by one skilled in the art, embodiments of the present invention may be provided as a method, system, or computer program product. Accordingly, the present invention may take the form of an entirely hardware embodiment, an entirely software embodiment or an embodiment combining software and hardware aspects. Furthermore, the present invention may take the form of a computer program product embodied on one or more computer-usable storage media (including, but not limited to, disk storage, CD-ROM, optical storage, and the like) having computer-usable program code embodied therein.

The present invention is described with reference to flowchart illustrations and/or block diagrams of methods, apparatus (systems) and computer program products according to the invention. It will be understood that each flow and/or block of the flow diagrams and/or block diagrams, and combinations of flows and/or blocks in the flow diagrams and/or block diagrams, can be implemented by computer program instructions. These computer program instructions may be provided to a processor of a general purpose computer, special purpose computer, embedded processor, or other programmable data processing apparatus to produce a machine, such that the instructions, which execute via the processor of the computer or other programmable data processing apparatus, create means for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks.

These computer program instructions may also be stored in a computer-readable memory that can direct a computer or other programmable data processing apparatus to function in a particular manner, such that the instructions stored in the computer-readable memory produce an article of manufacture including instruction means which implement the function specified in the flowchart flow or flows and/or block diagram block or blocks.

These computer program instructions may also be loaded onto a computer or other programmable data processing apparatus to cause a series of operational steps to be performed on the computer or other programmable apparatus to produce a computer implemented process such that the instructions which execute on the computer or other programmable apparatus provide steps for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks.

It will be apparent to those skilled in the art that various changes and modifications may be made in the present invention without departing from the spirit and scope of the invention. Thus, if such modifications and variations of the present invention fall within the scope of the claims of the present invention and their equivalents, the present invention is also intended to include such modifications and variations.

Claims

1. An intelligent interactive tablet, comprising: the touch control device comprises a touch control assembly, a display panel and a processor; wherein the content of the first and second substances,

the display panel comprises at least two adjacent pixel groups located at the edge of the handwriting, each pixel group comprises at least one pixel, a first display area and a second display area are formed in each pixel group, the at least two pixel groups comprise a first pixel group and a second pixel group adjacent to the first pixel group, and the processor is specifically used for controlling the display brightness of the second display area of the first pixel group to be lower than the display brightness of the first display area of the first pixel group and the display brightness of the first display area of the second pixel group;

the display panel further comprises a first pixel positioned inside the writing script; the processor is specifically configured to control the display brightness of a sub-pixel in the first display region in the pixel group to be smaller than the display brightness of the same sub-pixel in the first pixel.

2. The smart interactive tablet of claim 1, wherein the processor is specifically configured to control a pixel voltage of the second display region of the first pixel group to be lower than a pixel voltage of the first display region of the first pixel group and the first display region of the second pixel group.

3. The smart interactive tablet of claim 2, wherein the processor is specifically configured to control a ratio of a pixel voltage of the second display region of the first pixel group to a pixel voltage of the first display region of the first pixel group to be less than or equal to 4/5 and to control a ratio of a pixel voltage of the second display region of the first pixel group to a pixel voltage of the first display region of the second pixel group to be less than or equal to 4/5.

4. The smart interactive tablet of claim 1, wherein the processor is specifically configured to control the brightness of each of the second display regions in the at least two pixel groups to be a lowest brightness or a background brightness that the display panel is capable of displaying.

5. The smart interactive tablet of claim 1, wherein the processor is specifically configured to control a decrease in brightness of each of the first display regions in the at least two pixel groups.

6. The smart interactive tablet of claim 5, wherein the processor is further configured to control the pixel voltage of the same subpixel in each of the first display regions in the at least two pixel groups to decrement.

7. The intelligent interactive tablet as claimed in claim 1, wherein the included angle between the handwriting and the horizontal direction is a handwriting angle, and the processor is specifically configured to control the edge of the handwriting, where the handwriting angle is within a preset angle range, to set at least four pixel groups;

8. The intelligent interactive tablet of claim 7, wherein the preset angle range is a partial angle range within-20 to +20 degrees, or the preset angle range is a partial angle range within 70 to 110 degrees, or the preset angle range is a partial angle range within a range consisting of-20 to +20 degrees and 70 to 110 degrees.

9. The intelligent interactive tablet of claim 8, wherein the processor is to generate a first writing script having a first writing script angle, generate a second writing script having a second writing script angle;

10. The smart interactive tablet of claim 1, wherein the touch component is specifically configured to determine single or continuous touch point information according to the received touch signal and send the single or continuous touch point information to the processor;

11. The smart interactive tablet of claim 10, wherein the processor is specifically configured to determine to stop receiving the touch point information if the touch point information is not received for more than a threshold time.

12. The intelligent interactive tablet as recited in claim 10, wherein the processor is specifically configured to draw the first handwriting directly into a frame buffer of a current display screen, draw the second handwriting into a buffer area, and then combine the second handwriting into an idle frame buffer.

13. The smart interactive tablet of claim 10, wherein the processor is specifically configured to, upon detecting that a user performs a writing operation on a current writing interface of the writing software, obtain the writing operation on the current writing interface, where the writing operation is a screen touch event within a range of the current writing interface;

14. The smart interactive tablet of any one of claims 1-13, wherein the processor is specifically configured to control a pixel voltage of a sub-pixel within the first display region of the group of pixels to be less than a pixel voltage of the same sub-pixel within the first pixel.

15. The smart interactive tablet of claim 14, wherein a subpixel in a first display region of the group of pixels has a first pixel voltage and the same subpixel in the first pixel has a second pixel voltage, the processor being further configured to control a ratio of the first pixel voltage to the second pixel voltage to be less than 2/3.

16. The smart interactive tablet of any one of claims 1-13, 15, wherein the area ratio of the first display region to the second display region within the pixel group is 1:1 to 1: 4.

17. The smart interactive tablet of claim 16, wherein the first display region to the second display region within the pixel group has an area ratio of 1: 2.

18. The smart interactive tablet of any one of claims 1-13, 15 wherein the first display region and the second display region comprise subpixels of the same color in one of the pixel groups.

19. The smart interactive tablet of claim 18, wherein the processor is specifically configured to set one of the pixel groups to include at least two pixels; in one of the pixel groups, the first display region and the second display region are constituted by different pixels.

20. The smart interactive tablet of claim 19, wherein the processor is specifically configured to configure the first display region to include m pixels, the second display region to include n pixels, n: m is between 1 and 4.

21. The smart interactive tablet of claim 20, wherein the processor is specifically configured to set one of the pixel groups to include three pixels, the first display region to include one pixel, and the second display region to include two pixels.

22. The smart interactive tablet of claim 18, wherein the processor is specifically configured to set a portion of one of the groups of pixels to comprise two pixels; in one of the pixel groups, the first display region is formed of a portion of one pixel, the second display region is formed of a portion of another pixel, and an area ratio of the first display region to the second display region is 1:1 to 1: 4.

23. The smart interactive tablet of claim 22, wherein the processor is specifically configured to control an area ratio of the first display region and the second display region to be 1: 2.

24. The smart interactive tablet of claim 18, wherein the processor is specifically configured to configure one of the pixels to include at least three sub-pixels, the sub-pixels including a first portion and a second portion, the first display area including each of the first portions, the second display area including each of the second portions.

25. The smart interactive panel of claim 24, wherein the subpixels comprise subpixels formed by area division according to the gate lines and the data lines.

26. The smart interactive tablet of claim 24, wherein the processor is specifically configured to control the first portion and the second portion of the subpixels with a same gate line and a same data line.

27. The smart interactive tablet of any one of claims 24-26, wherein the processor is specifically configured to set an area ratio of the second portion to the first portion in the same sub-pixel between 1 and 4.

28. The smart interactive tablet of claim 27, wherein the processor is specifically configured to set an area ratio of the second portion to the first portion in the same sub-pixel to 2.

29. The smart interactive tablet of any of claims 1-13, 15 wherein the processor is specifically configured to set one of the pixel groups to comprise one pixel, one of the pixels comprising at least three sub-pixels; in one of the pixel groups, the first display region and the second display region are constituted by different kinds of sub-pixels.

30. The smart interactive tablet of claim 29, wherein the processor is specifically configured to set the first display area to include a sub-pixels, the second display area to include b sub-pixels, b: a is between 1 and 3.

31. The smart interactive tablet of claim 29, wherein the processor is specifically configured to configure one of the pixels to include four sub-pixels; the first display area comprises a sub-pixel, and the second display area comprises three sub-pixels.

32. The smart interactive tablet of claim 31, wherein the processor is specifically configured to set one of the pixels to include RGBW four sub-pixels; the first display area comprises W sub-pixels, the second display area comprises RGB sub-pixels, and the processor is specifically used for controlling display of white writing.

33. The smart interactive tablet of any one of claims 1-13, 15, wherein the processor is specifically configured to arrange the first pixel group and the second pixel group to be aligned in a vertical direction or to be aligned in a horizontal direction.

34. The smart interactive tablet of any one of claims 1-13, 15 wherein in one of the pixel groups, the first display region and the second display region are arranged in a vertical direction or in a horizontal direction.

35. A display method of an intelligent interactive tablet is characterized by comprising the following steps:

the display panel comprises at least two adjacent pixel groups which are positioned at the edge of the handwriting, wherein one pixel group comprises at least one pixel, a first display area and a second display area are formed in one pixel group, the at least two pixel groups comprise a first pixel group and a second pixel group adjacent to the first pixel group, and the display brightness of the second display area of the first pixel group is controlled to be lower than that of the first display area of the first pixel group and that of the first display area of the second pixel group;

the display panel further comprises a first pixel positioned inside the writing script; and controlling the display brightness of a sub-pixel in a first display area in the pixel group to be smaller than the display brightness of the same sub-pixel in the first pixel.

36. The display method according to claim 35, wherein a pixel voltage of the second display region of the first pixel group is controlled to be lower than pixel voltages of the first display region of the first pixel group and the first display region of the second pixel group.

37. The display method of claim 36, wherein a ratio of the pixel voltage of the second display region of the first pixel group to the pixel voltage of the first display region of the first pixel group is controlled to be less than or equal to 4/5, and wherein a ratio of the pixel voltage of the second display region of the first pixel group to the pixel voltage of the first display region of the second pixel group is controlled to be less than or equal to 4/5.

38. The display method according to claim 35, wherein the brightness of each of the second display regions in the at least two pixel groups is controlled to be a lowest brightness or a background brightness that can be displayed by the display panel.

39. The display method as claimed in claim 35, wherein the brightness of each of the first display regions in the at least two pixel groups is controlled to be decreased.

40. The display method as claimed in claim 39, wherein the pixel voltage of the same sub-pixel in each of the first display regions in the at least two pixel groups is controlled to decrease.

41. The display method of claim 35, wherein an included angle between the handwriting and a horizontal direction is a handwriting angle, and at least four pixel groups are arranged on an edge of the handwriting, the handwriting angle of which is controlled to be within a preset angle range;

42. The display method according to claim 41, wherein the preset angle range is a partial angle range within a range from-20 degrees to +20 degrees, or the preset angle range is a partial angle range within a range from 70 degrees to 110 degrees, or the preset angle range is a partial angle range within a range from-20 degrees to +20 degrees and from 70 degrees to 110 degrees.

43. A display method as claimed in claim 42, wherein a first writing script having a first writing angle is generated, a second writing script having a second writing angle is generated;

44. The display method of claim 35, specifically comprising:

45. The display method of claim 44, wherein the determining to stop receiving the touch point information specifically comprises:

46. The display method of claim 44, specifically comprising: and directly drawing the first handwriting in the frame buffer of the current display picture, and drawing the second handwriting in a buffer area and then synthesizing the second handwriting in the idle frame buffer.

47. The display method of claim 44, specifically comprising:

48. The method of any one of claims 35-47, wherein a sub-pixel in a first display region of the pixel group is controlled to have a pixel voltage less than a pixel voltage of a same sub-pixel in the first pixel.

49. The method as claimed in claim 48, wherein a sub-pixel in a first display region of the pixel group has a first pixel voltage, the same sub-pixel in the first pixel has a second pixel voltage, and a ratio of the first pixel voltage to the second pixel voltage is controlled to be less than 2/3.

50. The display method according to any one of claims 35 to 47 and 49, wherein the area ratio of the first display region to the second display region in one pixel group is set to be 1:1 to 1: 4.

51. The display method according to claim 50, wherein an area ratio of the first display region to the second display region in one of the pixel groups is set to 1: 2.

52. The display method according to any one of claims 35 to 47 or 49, wherein the first display region and the second display region include sub-pixels of the same color, which are provided in one of the pixel groups.

53. The display method according to claim 52, wherein one of the pixel groups is set to include at least two pixels; in one of the pixel groups, the first display region and the second display region are constituted by different pixels.

54. The display method according to claim 53, wherein the first display region is provided to include m pixels, the second display region includes n pixels, and n: m is between 1 and 4.

55. The display method according to claim 54, wherein one of the pixel groups is set to include three pixels, the first display region includes one pixel, and the second display region includes two pixels.

56. The display method according to claim 52, wherein one of the pixel groups is provided to include a portion of two pixels; in one of the pixel groups, the first display region is formed of a portion of one pixel, the second display region is formed of a portion of another pixel, and an area ratio of the first display region to the second display region is controlled to be 1:1 to 1: 4.

57. The display method of claim 56, wherein an area ratio of the first display region and the second display region is controlled to be 1: 2.

58. The display method according to any one of claims 35 to 47 and 49, wherein one of the pixels is provided to include at least three kinds of sub-pixels, the sub-pixels include first portions and second portions, the first display regions include the respective first portions, and the second display regions include the respective second portions.

59. The display method of claim 58, wherein the area ratio of the second portion to the first portion in the same sub-pixel is set to be between 1 and 4.

60. The display method as claimed in claim 59, wherein the area ratio of the second portion to the first portion in the same sub-pixel is set to 2.

61. The display method of claim 58, wherein the subpixels comprise subpixels formed by area division according to the gate lines and the data lines.

62. The display method of claim 58, wherein the first portion and the second portion of the sub-pixels are controlled by a same gate line and a same data line.

63. A display method according to any one of claims 35-47, 49, wherein one of said pixel groups is arranged to comprise one pixel, and one of said pixels comprises at least three sub-pixels; in one of the pixel groups, the first display region and the second display region are constituted by different kinds of sub-pixels.

64. The display method of claim 63, wherein the first display region is configured to include a sub-pixels, the second display region includes b sub-pixels, and b: a is between 1 and 3.

65. The display method according to claim 64, wherein one of the pixels is provided to include four kinds of sub-pixels; the first display area comprises a sub-pixel, and the second display area comprises three sub-pixels.

66. The display method according to claim 65, wherein one of the pixels is provided to include RGBW four sub-pixels; the first display area comprises W sub-pixels, the second display area comprises RGB sub-pixels, and white writing is controlled and displayed.

67. The display method according to any one of claims 35 to 47 or 49, wherein the first pixel group and the second pixel group are arranged to be aligned in a vertical direction or aligned in a horizontal direction.

68. The display method according to any one of claims 35 to 47 or 49, wherein the first display region and the second display region are arranged in a vertical direction or in a horizontal direction in one of the pixel groups.

69. A readable storage medium, comprising a memory;

the memory is to store instructions that, when executed by the processor, cause an apparatus comprising the readable storage medium to perform a display method as claimed in any one of claims 35-68.