CN111651079B - Handwriting display method, device, equipment and computer storage medium - Google Patents
Handwriting display method, device, equipment and computer storage medium Download PDFInfo
- Publication number
- CN111651079B CN111651079B CN202010421736.1A CN202010421736A CN111651079B CN 111651079 B CN111651079 B CN 111651079B CN 202010421736 A CN202010421736 A CN 202010421736A CN 111651079 B CN111651079 B CN 111651079B
- Authority
- CN
- China
- Prior art keywords
- writing
- client
- handwriting
- webpage
- point data
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/03—Arrangements for converting the position or the displacement of a member into a coded form
- G06F3/041—Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means
- G06F3/0416—Control or interface arrangements specially adapted for digitisers
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/90—Details of database functions independent of the retrieved data types
- G06F16/95—Retrieval from the web
- G06F16/957—Browsing optimisation, e.g. caching or content distillation
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
- G06F3/0487—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser
- G06F3/0488—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures
- G06F3/04883—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures for inputting data by handwriting, e.g. gesture or text
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- General Engineering & Computer Science (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Human Computer Interaction (AREA)
- Databases & Information Systems (AREA)
- Data Mining & Analysis (AREA)
- Information Transfer Between Computers (AREA)
- User Interface Of Digital Computer (AREA)
Abstract
The invention provides a handwriting display method, a device, equipment and a computer storage medium, wherein a webpage end is loaded through a webpage rendering control of a client, and the method comprises the following steps: if the client obtains touch point data generated in the writing operation process of the webpage end, distributing the touch point data to the webpage end through a preset interface; and superposing and displaying the client-side writing handwriting on the webpage-side writing handwriting, wherein the client-side writing handwriting is obtained by writing a bitmap obtained by touch point data into a frame buffer area by the client-side, and the webpage-side writing handwriting is obtained by rendering the touch point data in a webpage rendering mode. Because the writing delay in the mode of directly writing into the frame buffer is smaller than the writing delay in the page rendering mode, and the client writing handwriting is covered on the webpage writing handwriting, a user can think that the client writing handwriting is the handwriting which is being drawn by the user in a sense, and the phenomenon that the writing handwriting is not correspondingly and synchronously displayed along with the writing of the user is avoided.
Description
Technical Field
The present invention relates to the field of intelligent devices, and in particular, to a method, an apparatus, a device, and a computer storage medium for displaying handwriting.
Background
The user can open the writing software of the webpage version (webpage end for short) through the browser, and the writing operation is carried out by utilizing the webpage end. In practical application, since the webpage end needs to render the handwriting through the script, the efficiency is very low when the script is analyzed, and especially on equipment with poor performance, the phenomenon that the handwriting is correspondingly and synchronously displayed without following the writing of a user can occur due to long webpage rendering time delay.
Disclosure of Invention
The invention provides a writing display method, a device, equipment and a computer storage medium, which are used for solving the defect that writing is not correspondingly and synchronously displayed along with writing of a user in the prior art.
According to a first aspect of an embodiment of the present invention, there is provided a writing display method, in which a web page end is loaded through a web page rendering control of a client, the method including:
if the client obtains touch point data generated in the writing operation process of the webpage end, distributing the touch point data to the webpage end through a preset interface;
and superposing and displaying the client-side writing handwriting on the webpage-side writing handwriting, wherein the client-side writing handwriting is obtained by writing a bitmap obtained by the touch point data into a frame buffer area through the client-side, and the webpage-side writing handwriting is obtained by rendering the touch point data through a webpage rendering control in a webpage rendering mode.
In one embodiment, the client communicates with the web page end through the preset interface provided by the browser kernel.
In one embodiment, the method further comprises:
after the webpage end starts the writing function, the client is informed to start the writing handwriting drawing function of the client through the preset interface.
In one embodiment, the touch point data is distributed to the web page end through a first sub-thread provided by the web page rendering control.
In one embodiment, the drawing of the client writing is performed on a second sub-thread of the client, and the drawing of the web page-side writing is performed on a main thread of the client.
In one embodiment, the displaying the client-side handwriting superimposed on the web-side handwriting includes:
and writing a bitmap obtained from the touch point data into a frame buffer area corresponding to the main interface layer so that the client writing handwriting is overlapped on the webpage writing handwriting of the main interface layer.
In one embodiment, the displaying the client-side handwriting superimposed on the web-side handwriting includes:
and writing a bitmap obtained from the touch point data into a frame buffer area corresponding to the mouse layer, and superposing the mouse layer on a main interface layer, wherein the main interface layer comprises webpage end writing handwriting.
In one embodiment, the method further comprises:
after the writing operation is finished and the first preset time is delayed, the client-side writing handwriting is cleared, wherein the first preset time is a preset difference value used for indicating the drawing completion time of the webpage-side writing handwriting and the drawing completion time of the client-side writing handwriting.
In one embodiment, the determining of the end of writing operation includes:
when a touch lifting event is detected, judging that the writing operation is finished; or alternatively, the first and second heat exchangers may be,
and judging that the writing operation is finished when a touch lifting event is detected and a touch falling event of the same touch body or a different touch body is not detected within a second preset time after the touch lifting event.
In one embodiment, the client is client writing software, and the web page is web page version writing software.
According to a second aspect of an embodiment of the present invention, there is provided a writing display apparatus, a web page end being loaded through a web page rendering control of a client, the apparatus comprising:
the data transmission module is used for distributing touch point data generated in the writing operation process of the webpage end to the webpage end through a preset interface if the client side obtains the touch point data;
The handwriting display module is used for displaying the client-side handwriting on the webpage-side handwriting in a superimposed mode, the client-side handwriting is obtained by writing a bitmap obtained by the touch point data into a frame buffer area through the client-side, and the webpage-side handwriting is obtained by rendering the touch point data through a webpage rendering control in a webpage rendering mode.
In one embodiment, the client communicates with the web page end through the preset interface provided by the browser kernel.
In one embodiment, the client starts the writing drawing function of the client, and the webpage end notifies the client through the preset interface after the webpage end starts the writing function.
In one embodiment, touch point data is distributed to a web page end through a first sub-thread provided by a web page rendering control.
In one embodiment, the drawing of the client writing is performed on a second sub-thread of the client, and the drawing of the web page-side writing is performed on a main thread of the client.
In one embodiment, the handwriting display module is specifically configured to:
and writing a bitmap obtained from the touch point data into a frame buffer area corresponding to the main interface layer so that the client writing handwriting is overlapped on the webpage writing handwriting of the main interface layer.
In one embodiment, the handwriting display module is specifically configured to:
and writing a bitmap obtained from the touch point data into a frame buffer area corresponding to the mouse layer, and superposing the mouse layer on a main interface layer, wherein the main interface layer comprises webpage end writing handwriting.
In one embodiment, the apparatus further comprises a data clearing module for:
after the writing operation is finished and the first preset time is delayed, the client-side writing handwriting is cleared, wherein the first preset time is a preset difference value used for indicating the drawing completion time of the webpage-side writing handwriting and the drawing completion time of the client-side writing handwriting.
In one embodiment, the data clearing module is specifically configured to:
when a touch lifting event is detected, judging that the writing operation is finished; or alternatively, the first and second heat exchangers may be,
and judging that the writing operation is finished when a touch lifting event is detected and a touch falling event of the same touch body or a different touch body is not detected within a second preset time after the touch lifting event.
In one embodiment, the client is client writing software, and the web page is web page version writing software.
According to a third aspect of an embodiment of the present invention, there is provided an electronic apparatus including:
A processor;
a memory for storing processor-executable instructions;
the processor executes the program to implement the following method:
if the client obtains touch point data generated in the writing operation process of the webpage end, distributing the touch point data to the webpage end through a preset interface; the webpage end is loaded through a webpage rendering control of the client;
and superposing and displaying the client-side writing handwriting on the webpage-side writing handwriting, wherein the client-side writing handwriting is obtained by writing a bitmap obtained by the touch point data into a frame buffer area through the client-side, and the webpage-side writing handwriting is obtained by rendering the touch point data through a webpage rendering control in a webpage rendering mode.
According to a fourth aspect of embodiments of the present invention there is provided a computer storage medium having stored thereon a computer program which when executed by a processor performs the steps of a writing display method according to any of the preceding claims.
The technical scheme provided by the embodiment of the invention can comprise the following beneficial effects:
by applying the embodiment of the invention, the client writing handwriting is obtained by writing the bitmap obtained by the touch point data into the frame buffer area through the client, the webpage end writing handwriting is obtained by rendering the touch point data in a webpage rendering mode, and the writing delay in a mode of directly writing into the frame buffer area is smaller than that in a page rendering mode, and the client writing handwriting is overlapped and displayed on the webpage end writing handwriting, so that a user can think that the client writing handwriting is the handwriting which is being drawn by the user in sense, thereby avoiding the phenomenon that the writing handwriting does not follow the writing of the user and is correspondingly and synchronously displayed, and greatly improving the user experience.
It is to be understood that both the foregoing general description and the following detailed description are exemplary and explanatory only and are not restrictive of the invention as claimed.
Drawings
The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate embodiments consistent with the invention and together with the description, serve to explain the principles of the invention.
Fig. 1 is a flowchart illustrating a writing script display method according to an exemplary embodiment of the present invention.
Fig. 2A is a schematic diagram illustrating another writing display method according to an exemplary embodiment of the present invention.
FIG. 2B is a schematic diagram illustrating another writing display method according to an exemplary embodiment of the present invention.
FIG. 3 is a flow chart illustrating another writing trace display method according to an exemplary embodiment of the present invention.
Fig. 4 is a block diagram of a writing display apparatus according to an exemplary embodiment of the present invention.
Fig. 5 is a hardware configuration diagram of an electronic device in which the handwriting display apparatus of the present invention is located.
Detailed Description
Reference will now be made in detail to exemplary embodiments, examples of which are illustrated in the accompanying drawings. When the following description refers to the accompanying drawings, the same numbers in different drawings refer to the same or similar elements, unless otherwise indicated. The embodiments described in the following exemplary embodiments do not represent all embodiments consistent with the present invention. Rather, they are merely examples of apparatus and methods consistent with aspects of the invention as detailed in the accompanying claims.
The terminology used herein is for the purpose of describing particular embodiments only and is not intended to be limiting of the invention. As used in this specification and the appended claims, the singular forms "a," "an," and "the" are intended to include the plural forms as well, unless the context clearly indicates otherwise. It should also be understood that the term "and/or" as used herein refers to and encompasses any or all possible combinations of one or more of the associated listed items.
It should be understood that although the terms first, second, third, etc. may be used herein to describe various information, these information should not be limited by these terms. These terms are only used to distinguish one type of information from another. For example, first information may also be referred to as second information, and similarly, second information may also be referred to as first information, without departing from the scope of the invention. The word "if" as used herein may be interpreted as "at … …" or "at … …" or "responsive to a determination", depending on the context.
In an application scenario where writing is performed by loading a web page end through a client, the web page end may be: through touch event distribution on the main thread, when the touch event is distributed to a webpage rendering control (such as WebView), handwriting is rendered on Canvas through a webpage end on the main thread, and finally a writing rendering flow of a touch point is completed. However, when drawing a track, the touch device samples, and the writing rendering process of a single touch point is completed for each touch point. Aiming at the equipment with poor performance, the phenomenon that the writing handwriting is not correspondingly and synchronously displayed along with the writing of the user can occur due to longer time delay of webpage rendering.
The inventor finds that on low-performance equipment, rendering of canvas on a webpage is difficult to improve in efficiency, and therefore, the method and the device optimize user experience in a mode that the client side handwriting is utilized to shield the webpage side handwriting by rendering the real-time handwriting on the client side.
The handwriting display method provided in this embodiment may be implemented by software, or may be implemented by a combination of software and hardware or by hardware, where the related hardware may be composed of two or more physical entities, or may be composed of one physical entity. The method of the embodiment can be applied to the electronic equipment with the touch control function. The electronic device may be an intelligent writing device such as an intelligent interaction tablet, a digital tablet, or an intelligent mobile phone, an intelligent learning machine, a tablet computer, a notebook computer, a desktop computer, a PDA (Personal Digital Assistant ) or the like with a touch function.
In one embodiment, a smart interactive tablet is illustrated as an example. The execution subject of the embodiment of the invention can be an intelligent interaction panel, a program in the intelligent interaction panel and the like.
The intelligent interaction panel, also called as an interaction intelligent panel, can be integrated equipment for controlling the content displayed on the display panel and realizing man-machine interaction operation through a touch technology, and integrates one or more functions of a projector, an electronic whiteboard, a curtain, a sound, a television, a video conference terminal and the like. Further, the interactive smart tablet may also establish a data connection with at least one external device. External devices include, but are not limited to: stylus, cell phone, notebook computer, USB flash disk, tablet computer, desktop computer, etc. The embodiment of the communication mode of the data connection between the external device and the interactive intelligent tablet is not limited, and the communication modes such as USB connection, internet, local area network, bluetooth, wi-Fi or purple peak protocol (ZigBee) can be used.
Next, an embodiment of the present invention will be exemplified with reference to the drawings.
Referring to fig. 1, which is a flowchart illustrating a handwriting display method according to an exemplary embodiment of the present invention, a web page end is loaded through a web page rendering control of a client, and the method may include steps 102 to 104:
in step 102, if the client obtains touch point data generated during writing operation of the web page end, distributing the touch point data to the web page end through a preset interface;
In step 104, the client-side writing handwriting is displayed on the web-side writing handwriting in a superimposed manner, the client-side writing handwriting is obtained by writing a bitmap obtained from the touch point data into a frame buffer area by the client-side, and the web-side writing handwriting is obtained by rendering the touch point data by a web-page rendering control in a web-page rendering manner.
The client may be application software installed on the electronic device, and may also be referred to as APP. Further, in order to enable fast rendering of real-time handwriting, in one example, the client may be client software for writing, which may also be referred to as client writing software. For example, the software may be whiteboard software, drawing software, annotation software, or the like that can provide a writing function and can be installed on an electronic device. The webpage end depends on the client and can be loaded through a webpage rendering control of the client. For example, the web page side may be web page version writing software.
The following is mainly exemplified by a handwriting display process of the Android system, and of course, the operation process of the handwriting display method on other operation systems such as a window system is similar to the operation process on the Android system, which is not described herein again. In the Android system, the webpage rendering control is WebView, so that a WebView kernel can be used for loading a webpage end and communicating. For example, after the client is started, the web page end may be loaded in WebView of the client, and the Android webkit provides a relevant interface for communication between the client and the web page end (may be simply referred to as a preset interface).
The webpage rendering control of the client can load the webpage end, and after the webpage end starts the writing function, the client can be informed to start the writing handwriting drawing function of the client through a preset interface, and the function can also be called as a real-time drawing function and can be used for drawing the writing handwriting of the client. The client and the webpage end can communicate through the preset interface provided by the browser kernel (webkit). For example, in Android, the real-time drawing function of the client can be opened through a preset interface. Furthermore, handwriting attributes of the webpage end, such as thickness, color and the like, can be configured, and the handwriting attributes of the webpage end are synchronized to the client end through a preset interface, so that the client end has the same handwriting attributes as the webpage end, and the client end writing handwriting drawn by the client end is the same as the webpage end writing handwriting under the condition that the touch point data are the same.
If the fact that the user performs writing operation on the writing interface of the webpage end is detected, the Android touch distribution mechanism can distribute touch point data to WebView. After the client obtains touch point data generated in the writing operation process of the webpage end by the user, the touch point data can be intercepted.
On one hand, the client side starts the real-time drawing function, so that the handwriting of the client side can be drawn. As one example, the client writing is obtained by the client writing to a frame buffer. The display screen of the Android device is abstracted as a frame buffer (FrameBuffer), and the surfeflinger service in the Android system can draw the user interface of the application program by writing content into this frame buffer. The frame buffer is usually used as a driver of an LCD controller or other display device, the frame buffer driver is a character device, the device node is/dev/fbX, the primary device number may be 29, the secondary device number is incremented, the user may consider the frame buffer as a mapping of the display memory, after mapping it to the process address space, the read/write operation may be directly performed, and the write operation may be immediately reflected on the screen.
On the other hand, in order to ensure that the touch points distributed and obtained by the client are consistent with the webpage end, touch point data obtained by the client can be distributed to the webpage end through a preset interface, so that handwriting written on the webpage end can be drawn through a webpage rendering control on the webpage end. The preset interface can be js interface, and the data of the touch points can be ensured to be consistent by transmitting the js interface to the webpage end, so that the problem that the handwriting of the webpage end cannot be completely covered by the handwriting of the client end is avoided. In addition, touch events are not consumed in the main thread, and the problems that touch data cannot be distributed to a webpage end due to the fact that the client intercepts the touch data, buttons on the webpage end cannot be clicked and the like are avoided.
Because the WebView is drawn in a webpage rendering mode, the efficiency is lower than that of a client directly writing into a frame buffer, the delay of the client writing handwriting is smaller than that of the webpage writing handwriting, and at the moment, the client writing handwriting is covered above the webpage writing handwriting, so that a user basically only thinks that the client writing handwriting is the handwriting being drawn by the user in sense. In the whole process, the writing delay sensed by the user is the writing delay of the client, and the writing delay is far smaller than the writing delay of directly drawing by using WebView, so that the phenomenon that the writing is correspondingly and synchronously displayed without following the writing of the user can be avoided, and the user experience is greatly improved. And meanwhile, the condition that sampling points are lost is avoided.
In one example, to prevent main thread blocking, touch point data obtained by the web page end may be distributed to the web page end through a first sub-thread provided by the web page rendering control. For example, in the Android system, the distribution of touch point data to the web page end through the js interface may be implemented by a JSBridge thread (also a child thread) provided by the WebView kernel. According to the embodiment, the JSBridge thread transmits touch point data to the webpage end, so that too many tasks can be prevented from being executed on the main thread, and the situation that touch point information is lost due to the fact that the main thread is blocked when the touch point is transmitted through the main thread is avoided.
In practical application, the situation that the main thread is blocked and the main thread is blocked when too many tasks are executed on the main thread occurs, and for equipment with poor performance, if the rendering process of a single point takes a long time, the sampling period of the touch equipment is exceeded, the sampling point is lost. To avoid this, in one embodiment, it may also be implemented that the main thread is only used to provide the web page rendering control to perform web page-side handwriting drawing, avoiding performance consumption. For example, the drawing of the writing handwriting of the client is performed in a second sub-thread of the client, and the drawing of the writing handwriting of the webpage is performed in a main thread of the client. The second sub-thread and the first sub-thread are different sub-threads and are distinguished by different names. The problem of sampling point loss can be solved because the rendering of the client writing handwriting occurs in the sub-thread and because the frame buffer is directly operated, the efficiency is higher than that of webpage rendering and is not limited by vertical synchronization (vsync).
Regarding how to draw the webpage-side handwriting, the webpage-side handwriting is obtained by adopting a webpage rendering mode through a webpage rendering control, namely the webpage-side handwriting is obtained by adopting a general webpage rendering flow.
When window display is performed by each operating system (such as a window system, an Android system or a Linux system), window management services of the operating system come from different components and windows of the system. Taking an Android system as an example, an Android window management service manages files from different activities (activities are application program components, provide a screen, and can be used by a user to interact to complete a task), each window corresponds to a Surface object (Surface is essentially a memory area), each Surface object corresponds to a Layer value (hierarchy), and if the Layer value is larger, the corresponding window is displayed on the upper Surface, and other windows are blocked.
When the rendering program in each operating system updates the display picture, the WebView can execute js script first, then render to the main thread according to the script, and render the writing handwriting at the webpage end. For example, the WebView kernel may execute JavaScript scripts to parse and render into corresponding activities. All Surface objects corresponding to all display windows on the display screen are superimposed according to the size of the Layer of the Surface objects to form a bitmap (bitmap file, for example, a standard format graphic file, which defines an image as being composed of dots (pixels), each of which can be represented by a plurality of colors) which is the same as the size of the display screen, and this bitmap rendering is written into an idle frame buffer, and a vsync signal (vertical synchronization signal) is waited for so that the rendering program takes the idle frame buffer as the currently displayed frame buffer according to the vsync signal, so that the screen is displayed on the display, and the rendering update of the display screen is completed so far.
For convenience of distinction, the layer where the handwriting is written at the web page end may be referred to as the main interface layer. The main interface layer can be a media layer or a common view layer, and is specifically determined by the webpage rendering control. And executing a webpage rendering process, waiting for the vsync signal, and writing data into a frame buffer corresponding to the main interface layer according to the vsync signal, so as to obtain the webpage end writing handwriting. Specifically, the frame buffer corresponding to the main interface layer can be written by writing the device file corresponding to the main interface layer. The device file of the frame buffer corresponding to the main interface layer can be/dev/fb 0 or/dev/graphics/fb 0.
Two embodiments are provided below for illustration of how client writing is drawn.
In one embodiment, in order to improve the rendering efficiency of the client writing, the bitmap obtained from the touch point data may be written into the frame buffer area corresponding to the main interface layer, so that the client writing is superimposed on the web page writing of the main interface layer. For ease of understanding, as shown in FIG. 2A, there is a schematic diagram of another writing display method according to an exemplary embodiment of the present invention. In the schematic diagram, touch point information can be distributed to a webpage end through a JSBridge thread provided by a WebView kernel, and handwriting of the webpage end is drawn on a main thread in a webpage rendering mode. The main interface FrameBuffer is written by directly writing fb () (/ dev/fb0huo/dev/graphics/fb 0) through JSBridge sub-thread operation, and then rendered onto the screen by the FrameBuffer through the GPU. Because the process of executing the JavaScript script to render canvas and the steps of superposition synthesis of writing scripts of the surface object and waiting for the vsync signal can be skipped, the handwriting is directly drawn into the main interface frame buffer, so that the efficiency is higher than that of webpage rendering, and the writing delay time of a client is smaller than that of drawing by using webview, thereby improving the user experience.
In another embodiment, some devices are further provided with other layers than the main interface layer, such as a mouse layer, for which purpose the client writing may be displayed on the other layers by writing the client into the frame buffer, the web page end writing may be displayed on the main interface layer by web page rendering with the web page rendering control, and the other layers may be superimposed (overlaid) on the main interface layer, thereby implementing the superimposed display of the client writing on the web page end writing. Because the writing delay time corresponding to the direct writing frame buffer area is smaller than the writing delay time corresponding to the webpage rendering, and other layers are overlapped on the main interface layer, the phenomenon of handwriting display delay on the main interface layer is solved, the display of writing handwriting is quickened, the handwriting following phenomenon is realized for a user on the visual effect, and the use experience of the user is improved.
Taking the mouse layer as an example, the mouse layer may be referred to as a mouse cursor layer (hardwarecursor Layer). The display of the content on the main interface Layer needs to perform software synthesis, that is, the multiple display windows corresponding to the Suface objects located on the main interface Layer stack the respective bitmap files (bitmaps) into a bitmap file (bitmap) according to the size and the position of the Layer of the bitmap file, and perform synthesis in a manner of occupying a CPU (Central processing Unit), and then write the bitmap file rendering into an idle frame buffer, namely the frame buffer corresponding to the main interface Layer for short. The display of the content on the mouse layer does not need to be synthesized by software, the display of the content on the mouse layer is synthesized and displayed by a hardware synthesis mode (hardware combination abstract layer, HW compound), the content displayed by the user is synthesized on the frame buffer corresponding to the device file by driving the HW compound HAL layer of one or more special synthesis chips, then the frame buffer synthesized by the software display layer and the frame buffer on different hardware layers are overlapped and fused and displayed on the display by the hardware synthesis mode when the refreshing display of the current writing interface is carried out, and the overlapped display of all layers on the display screen is completed, namely, the display processing of the content on the main interface layer needs the soft map layer synthesized by the GPU, the result is submitted to the HW compound for display, and the display content on the mouse layer is displayed after being processed by the HW compound by the user, so that the synthesis of the display content of the mouse layer can not influence the synthesis of the main interface layer. And the mouse layer frame buffer is used for drawing the client writing handwriting, and the mouse layer frame buffer is not coupled with the frame buffer for rendering the main picture, so that mutual influence is avoided, and the client writing handwriting can be ensured to cover the webpage writing handwriting.
Correspondingly, the step of displaying the client-side handwriting superimposed on the webpage-side handwriting includes: and writing a bitmap obtained from the touch point data into a frame buffer area corresponding to the mouse layer, and superposing the mouse layer on a main interface layer, wherein the main interface layer comprises webpage end writing handwriting.
For ease of understanding, as shown in FIG. 2B, a schematic diagram of another writing display method according to an exemplary embodiment of the present invention is shown. In the schematic diagram, touch point information can be distributed to a webpage end through a JSBridge thread provided by a WebView kernel, and handwriting of the webpage end is drawn on a main thread in a webpage rendering mode. And directly writing dev/fb3 or/dev/graphics/fb 3 drive by the JSbridge sub-thread to write into the mouse layer frame buffer so as to update the mouse layer interface. At this time, the mouse layer can draw handwriting on the bitmap through the sub-thread, and then the bitmap is written into the frame buffer of the mouse layer through the fb3 driving, so that the user handwriting is drawn in real time. Because the series of drawing processes run in the sub-threads, and simultaneously the client side distributes touch points to the webpage side one by one through the JSbridge, the consistency of the touch points distributed by the client side and the webpage side is ensured, the main thread is prevented from being blocked, and the main thread is only used for providing WebView for webpage side handwriting drawing, so that the performance consumption is avoided. Because the WebView is drawn in a webpage rendering mode, the efficiency is lower than that of a client which directly writes into a frame buffer, the display speed of the client writing is faster than that of the webpage writing, and because the client writing is covered above the WebView, the user can only basically consider that the writing of the client is the writing which is being drawn by the user in sense.
It should be appreciated that other ways of displaying the client-side handwriting superimposed on the web-side handwriting may also be used, and this is not repeated here.
In some application scenarios, all writing is ultimately desired to be on the web, where the writing needs to be entered into the web page, for which purpose, in one embodiment, the method further comprises: and after the writing operation is finished and the first preset time is delayed, the client-side writing handwriting is cleared. The first preset time may be a preset difference value between a time for indicating that the writing on the webpage end is drawn and a time for indicating that the writing on the client end is drawn. For example, the first preset time may be obtained according to statistics of a delay time of the writing handwriting of the web page end compared with the writing handwriting of the client end in the history record, or may be an empirical value, for example, the first preset time may be 500ms. The method aims to wait for the completion of webview drawing and avoid the situation that the client writing handwriting blocked by the webpage end writing handwriting which is not drawn yet disappears. For the case that the bitmap obtained from the touch point data is written into the frame buffer area corresponding to the main interface layer, the writing handwriting of the client can be directly cleared. For the situation that the bitmap obtained by the touch point data is written into the frame buffer area corresponding to the mouse layer, the data written into the mouse layer can be cleared, and further, after the handwriting of the client is cleared, the transparency of the mouse layer can be adjusted to hide the mouse layer, and the main interface layer is displayed.
Regarding the judgment process of the end of the writing operation, since the touch event may include a touch DOWN event (action_down), a plurality of consecutive touch MOVE events (action_move), and a touch UP event (action_up), in one example, the end of the writing operation may be judged when the touch UP event is detected. In practical application, the handwriting may be short, so in another embodiment, when the time difference between two writing times is less than the second preset time, all the handwriting does not disappear, and until the time of raising the hand exceeds the time of delaying disappearance, all the handwriting is disappeared simultaneously.
Correspondingly, judging that the writing operation is finished when a touch lifting event is detected and a touch falling event of the same touch body or a different touch body is not detected within a second preset time after the touch lifting event. The touch body may be an operation body recognizable by a screen such as a finger, a palm, a stylus, or the like. In some devices only a single touch can be implemented, while in some devices multiple touches can be implemented. The multi-point touch realizes a touch screen or a touch pad, and simultaneously receives input information from a plurality of touch points on the screen, that is to say, multi-point or multi-user interactive operation can be completed on the same display interface at the same time. For example, the touch screen of the electronic device may be, but is not limited to, a multi-touch screen such as a multi-point capacitive touch screen. The multi-touch screen allows simultaneous touches by multiple fingers to be detected, as well as other non-finger touch forms, such as palm, face, fist, etc. For a device supporting single touch, it may be determined that the writing operation is ended as long as a touch-up event is detected and a touch-down event is not detected within a second preset time after the touch-up event. For the device supporting multi-touch, if the touch falling event of the same touch body or different touch bodies is detected within the second preset time after the touch lifting event is detected, the writing operation can be considered to be finished, so that resource waste caused by writing handwriting of the client is avoided under the condition of short handwriting.
The various technical features of the above embodiments may be arbitrarily combined as long as there is no conflict or contradiction between the combinations of the features, but are not described one by one, so that the arbitrary combination of the various technical features of the above embodiments also falls within the scope of the disclosure of the present specification.
An example is illustrated in one of the combined embodiments. As shown in fig. 3, there is a flowchart of another writing display method according to an exemplary embodiment of the present invention, the method including:
step 301: client writing software (app) is started.
Step 302: the webpage-side writing software is loaded in WebView of the client-side writing software, and an Android webkit provides a relevant interface for communication between the client-side writing software and the webpage-side writing software (js interface).
Step 303: when the writing function of the webpage end writing software is opened, the mouse layer of the UI of the system is operated through js interface, and the mouse layer on which the client end writing handwriting is rendered can be also called as a real-time handwriting layer.
Step 304: when a user starts writing a touch screen, the Android touch distribution mechanism distributes touch point data to WebView.
Step 305: after the client writing software obtains the touch point data, the client writing handwriting is drawn on the mouse layer through the mouse layer frame buffer driving in the sub-thread. Meanwhile, touch point data are distributed to webpage-end writing software through js interface to carry out handwriting rendering. The mouse layer is superimposed on the primary interface layer.
Thus, although the web page rendering speed is relatively slow, the handwriting has a large delay, and is particularly obvious on a low-performance machine. But this delay is not noticeable to the user because the real-time handwriting layer of the client writing software is overlaid on top of WebView. On the other hand, the sub-thread drawing and js interface transfer of touch points also avoid performing too many tasks on the main thread, thereby avoiding stuck and lost touch points. The js interface is used for transmitting the touch points to the webpage writing software, so that the consistency of data on two sides can be ensured, and the problem that the webpage writing cannot be completely covered by the client writing is avoided. In addition, the touch event is not consumed in the main thread, and the problem that touch data cannot be distributed to writing software at the webpage end and a button on the webpage end cannot be clicked due to the fact that the touch data is intercepted by the real-time handwriting layer is avoided. The reason for using the mouse layer frame buffer to draw the real-time handwriting is that the layer is not coupled with the frame buffer for rendering the main picture to cause mutual influence, and the real-time drawing layer can be ensured to cover the writing handwriting at the webpage end.
Step 306: after the webpage end writing software acquires touch point data issued by the client, the webpage end writing software synchronously draws the webpage end writing handwriting on the main thread. The writing handwriting of the webpage end is displayed on the main interface layer.
Step 307: after the writing operation is finished and the first preset time is delayed, the writing handwriting of the client is cleared.
When writing is finished and a user lifts his hand, the real-time handwriting layer cannot disappear immediately, and the phenomenon of flickering caused by that the webpage end is not drawn yet is avoided. So that the frame buffer of the mouse layer can be cleared again when no new touch event exists within the first preset time. By way of example, the first preset time may be 500ms. Through the scheme, the writing experience of a user to the webpage whiteboard software can be greatly improved, and the handwriting and hand experience with extremely low writing delay is obtained.
It is to be understood that fig. 3 is the same as the related art in fig. 1, and is not described in detail herein.
Taking a client as whiteboard software for illustration, after the whiteboard software is started, webView of the whiteboard software loads webpage writing software, and a relevant interface (js interface for short) can be provided for communication between the whiteboard software and the webpage writing software through an Android webkit. When the writing function of the webpage writing software is opened, the real-time drawing function of the whiteboard software is opened through the js interface. And the handwriting attribute of the webpage writing software can be sent to the whiteboard software through the js interface, so that the client writing handwriting drawn by the whiteboard software is identical to the webpage writing handwriting under the condition that the touch point data are identical. When a user writes on an interface of the webpage writing software, the data acquisition module can distribute touch data to the whiteboard software, and a bitmap obtained from the touch point data is written into a frame buffer area corresponding to a mouse layer on a sub-thread of the whiteboard software to obtain the writing handwriting of the client. The whiteboard software distributes touch data to the webpage writing software through a JSbridge thread provided by a WebView kernel, renders touch point data on a main thread of the whiteboard software in a webpage rendering mode to obtain webpage-end writing handwriting, and further covers and displays the client-end writing handwriting on the webpage-end writing handwriting. Thus, through the embodiment, the writing experience of the user on the webpage whiteboard software can be greatly improved, the writing delay is extremely low, and the handwriting following experience is improved.
Corresponding to the embodiment of the writing display method, the invention also provides a writing display device, an electronic device applied by the writing display device and an embodiment of a computer storage medium.
FIG. 4 is a block diagram of a handwriting display apparatus according to an exemplary embodiment of the invention, a web page being loaded by a web page rendering control of a client, the apparatus comprising:
the data transmission module 42 is configured to, if the client obtains touch point data generated during the writing operation of the web page end, distribute the touch point data to the web page end through a preset interface;
and the handwriting display module 44 is configured to superimpose and display the client-side writing handwriting on the webpage-side writing handwriting, where the client-side writing handwriting is obtained by writing a bitmap obtained from the touch point data into a frame buffer area by the client, and the webpage-side writing handwriting is obtained by rendering the touch point data by a webpage rendering control in a webpage rendering manner.
In one embodiment, the client communicates with the web page end through the preset interface provided by the browser kernel.
Further, the client starts the writing drawing function of the client, and the webpage end notifies the client through the preset interface after the webpage end starts the writing function.
In one embodiment, touch point data is distributed to a web page end through a first sub-thread provided by a web page rendering control.
In one embodiment, the drawing of the client writing is performed on a second sub-thread of the client, and the drawing of the web page-side writing is performed on a main thread of the client.
In one embodiment, the handwriting display module is specifically configured to:
and writing a bitmap obtained from the touch point data into a frame buffer area corresponding to the main interface layer so that the client writing handwriting is overlapped on the webpage writing handwriting of the main interface layer.
In one embodiment, the handwriting display module is specifically configured to:
and writing a bitmap obtained from the touch point data into a frame buffer area corresponding to the mouse layer, and superposing the mouse layer on a main interface layer, wherein the main interface layer comprises webpage end writing handwriting.
In one embodiment, the apparatus further comprises a data purge module (not shown in fig. 4) for:
after the writing operation is finished and the first preset time is delayed, the client-side writing handwriting is cleared, wherein the first preset time is a preset difference value used for indicating the drawing completion time of the webpage-side writing handwriting and the drawing completion time of the client-side writing handwriting.
In one embodiment, the data clearing module is specifically configured to:
when a touch lifting event is detected, judging that the writing operation is finished; or alternatively, the first and second heat exchangers may be,
and judging that the writing operation is finished when a touch lifting event is detected and a touch falling event of the same touch body or a different touch body is not detected within a second preset time after the touch lifting event.
In one embodiment, the client is client writing software, and the web page is web page version writing software.
Correspondingly, the embodiment of the invention also provides electronic equipment, which comprises a processor; a memory for storing processor-executable instructions; wherein the processor is configured to implement the steps of a writing display method of any of the above.
Accordingly, an embodiment of the present invention also provides a computer storage medium having stored thereon a computer program which, when executed by a processor, implements the steps of the writing display method of any of the above.
The present invention may take the form of a computer program product embodied on one or more storage media (including, but not limited to, magnetic disk storage, CD-ROM, optical storage, etc.) having program code embodied therein. Computer-usable storage media include both permanent and non-permanent, removable and non-removable media, and information storage may be implemented by any method or technology. The information may be computer readable instructions, data structures, modules of a program, or other data. Examples of storage media for a computer include, but are not limited to: phase change memory (PRAM), static Random Access Memory (SRAM), dynamic Random Access Memory (DRAM), other types of Random Access Memory (RAM), read Only Memory (ROM), electrically Erasable Programmable Read Only Memory (EEPROM), flash memory or other memory technology, compact disc read only memory (CD-ROM), digital Versatile Disks (DVD) or other optical storage, magnetic cassettes, magnetic tape magnetic disk storage or other magnetic storage devices, or any other non-transmission medium, may be used to store information that may be accessed by the computing device.
Specific details of the implementation process of the functions and roles of each module in the device are shown in the implementation process of the corresponding steps in the method, and are not repeated here.
For the device embodiments, reference is made to the description of the method embodiments for the relevant points, since they essentially correspond to the method embodiments. The apparatus embodiments described above are merely illustrative, wherein the modules illustrated as separate components may or may not be physically separate, and the components shown as modules may or may not be physical, i.e., may be located in one place, or may be distributed over a plurality of network modules. Some or all of the modules may be selected according to actual needs to achieve the purposes of the present invention. Those of ordinary skill in the art will understand and implement the present invention without undue burden.
The embodiment of the handwriting display device can be applied to electronic equipment. The apparatus embodiments may be implemented by software, or may be implemented by hardware or a combination of hardware and software. Taking software implementation as an example, the device in a logic sense is formed by reading corresponding computer program instructions in a nonvolatile memory into a memory by a processor of an electronic device where the device is located for operation. In terms of hardware, as shown in fig. 5, a hardware structure diagram of an electronic device in which the handwriting display device 532 of the present invention is located is shown, and in addition to the processor 510, the network interface 520, the memory 530, and the nonvolatile memory 540 shown in fig. 5, the electronic device in which the device 532 is located in the embodiment generally includes other hardware according to the actual functions of the electronic device, which will not be described herein.
As one embodiment, the electronic device may be a smart interactive tablet.
Other embodiments of the invention will be apparent to those skilled in the art from consideration of the specification and practice of the invention disclosed herein. This invention is intended to cover any variations, uses, or adaptations of the invention following, in general, the principles of the invention and including such departures from the present disclosure as come within known or customary practice within the art to which the invention pertains. It is intended that the specification and examples be considered as exemplary only, with a true scope and spirit of the invention being indicated by the following claims.
It is to be understood that the invention is not limited to the precise arrangements and instrumentalities shown in the drawings, which have been described above, and that various modifications and changes may be effected without departing from the scope thereof. The scope of the invention is limited only by the appended claims.
The foregoing description of the preferred embodiments of the invention is not intended to be limiting, but rather to enable any modification, equivalent replacement, improvement or the like to be made within the spirit and principles of the invention.
Claims (11)
1. The handwriting display method is characterized in that a webpage end is loaded through a webpage rendering control of a client, and the method comprises the following steps:
If the client obtains touch point data generated in the writing operation process of the webpage end, distributing the touch point data to the webpage end through a preset interface;
and superposing and displaying the client-side writing handwriting on the webpage-side writing handwriting, wherein the client-side writing handwriting is obtained by writing a bitmap obtained by the touch point data into a frame buffer area through the client-side, and the webpage-side writing handwriting is obtained by rendering the touch point data through a webpage rendering control in a webpage rendering mode.
2. The method of claim 1, wherein the client communicates with the web page through the preset interface provided by a browser kernel; the method further comprises the steps of:
after the webpage end starts the writing function, the client is informed to start the writing handwriting drawing function of the client through the preset interface.
3. The method of claim 1, wherein the touch point data is distributed to the web page end through a first sub-thread provided by a web page rendering control, wherein the drawing of the client writing is performed at a second sub-thread of the client, and wherein the drawing of the web page end writing is performed at a main thread of the client.
4. The method of claim 1, wherein the displaying the client-side handwriting superimposed on the web-side handwriting comprises:
and writing a bitmap obtained from the touch point data into a frame buffer area corresponding to the main interface layer so that the client writing handwriting is overlapped on the webpage writing handwriting of the main interface layer.
5. The method of claim 1, wherein the displaying the client-side handwriting superimposed on the web-side handwriting comprises:
and writing a bitmap obtained from the touch point data into a frame buffer area corresponding to the mouse layer, and superposing the mouse layer on a main interface layer, wherein the main interface layer comprises webpage end writing handwriting.
6. The method according to any one of claims 1 to 5, further comprising:
after the writing operation is finished and the first preset time is delayed, the client-side writing handwriting is cleared, wherein the first preset time is a preset difference value used for indicating the drawing completion time of the webpage-side writing handwriting and the drawing completion time of the client-side writing handwriting.
7. The method of claim 6, wherein the determining of the end of writing operation comprises:
When a touch lifting event is detected, judging that the writing operation is finished; or alternatively, the first and second heat exchangers may be,
and judging that the writing operation is finished when a touch lifting event is detected and a touch falling event of the same touch body or a different touch body is not detected within a second preset time after the touch lifting event.
8. The method of any one of claims 1 to 5, wherein the client is client writing software and the web page is web page writing software.
9. A handwriting display device, wherein a web page end is loaded through a web page rendering control of a client, the device comprising:
the data transmission module is used for distributing touch point data generated in the writing operation process of the webpage end to the webpage end through a preset interface if the client side obtains the touch point data;
the handwriting display module is used for displaying the client-side handwriting on the webpage-side handwriting in a superimposed mode, the client-side handwriting is obtained by writing a bitmap obtained by the touch point data into a frame buffer area through the client-side, and the webpage-side handwriting is obtained by rendering the touch point data through a webpage rendering control in a webpage rendering mode.
10. An electronic device, comprising:
a processor;
a memory for storing processor-executable instructions;
the processor executes the program to realize the following method:
if the client obtains touch point data generated in the writing operation process of the webpage end, distributing the touch point data to the webpage end through a preset interface; the webpage end is loaded through a webpage rendering control of the client;
and superposing and displaying the client-side writing handwriting on the webpage-side writing handwriting, wherein the client-side writing handwriting is obtained by writing a bitmap obtained by the touch point data into a frame buffer area through the client-side, and the webpage-side writing handwriting is obtained by rendering the touch point data through a webpage rendering control in a webpage rendering mode.
11. A computer storage medium having stored thereon a computer program, which when executed by a processor performs the steps of the method according to any of claims 1 to 8.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010421736.1A CN111651079B (en) | 2020-05-18 | 2020-05-18 | Handwriting display method, device, equipment and computer storage medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010421736.1A CN111651079B (en) | 2020-05-18 | 2020-05-18 | Handwriting display method, device, equipment and computer storage medium |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN111651079A CN111651079A (en) | 2020-09-11 |
| CN111651079B true CN111651079B (en) | 2023-09-29 |
Family
ID=72352750
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202010421736.1A Active CN111651079B (en) | 2020-05-18 | 2020-05-18 | Handwriting display method, device, equipment and computer storage medium |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN111651079B (en) |
Families Citing this family (9)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2022134180A1 (en) * | 2020-12-25 | 2022-06-30 | 安徽鸿程光电有限公司 | Handwriting display method and apparatus, electronic device, and storage medium |
| CN112783346A (en) * | 2021-01-19 | 2021-05-11 | 深圳市皓丽智能科技有限公司 | Handwriting data processing method and system, computer equipment and storage medium |
| CN113934394B (en) * | 2021-10-19 | 2024-05-03 | 河北师达教育科技有限公司 | Method, device and terminal equipment for realizing memory display in display screen |
| CN115639920B (en) * | 2021-12-24 | 2023-12-22 | 荣耀终端有限公司 | Drawing method, electronic device, and readable storage medium |
| CN114610188B (en) * | 2022-02-09 | 2024-02-13 | 广东能龙教育股份有限公司 | Interface handwriting writing method and system, control device and storage medium |
| CN114579032A (en) * | 2022-02-15 | 2022-06-03 | 长沙朗源电子科技有限公司 | OCR-based intelligent hand-drawn graphic method, device and equipment for electronic whiteboard |
| CN114900641A (en) * | 2022-04-29 | 2022-08-12 | 安徽听见科技有限公司 | Data storage and backtracking method, device and system |
| CN115348328A (en) * | 2022-08-11 | 2022-11-15 | 环胜电子(深圳)有限公司 | Handwritten data processing method and handwritten data processing system |
| WO2024040383A1 (en) * | 2022-08-22 | 2024-02-29 | 广州视源电子科技股份有限公司 | Writing display method, writing response method and apparatus, terminal device, and server |
Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JPH02191018A (en) * | 1989-01-20 | 1990-07-26 | Tokyo Electric Power Co Inc:The | Input device and picture processor |
| CN105677107A (en) * | 2016-01-11 | 2016-06-15 | 福州瑞芯微电子股份有限公司 | Method and system for optimizing screen handwriting following performance |
| CN108364324A (en) * | 2018-01-22 | 2018-08-03 | 广州市动景计算机科技有限公司 | Image processing method, device and electric terminal |
| CN109144382A (en) * | 2018-07-10 | 2019-01-04 | 广州视源电子科技股份有限公司 | Handwriting display method, device, terminal device and storage medium based on dual system |
| CN110580125A (en) * | 2018-06-07 | 2019-12-17 | 广州视源电子科技股份有限公司 | partial refreshing method, device, equipment and medium for display interface |
| CN110597444A (en) * | 2018-06-12 | 2019-12-20 | 广州视源电子科技股份有限公司 | Handwriting display method and device, terminal device and storage medium |
-
2020
- 2020-05-18 CN CN202010421736.1A patent/CN111651079B/en active Active
Patent Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JPH02191018A (en) * | 1989-01-20 | 1990-07-26 | Tokyo Electric Power Co Inc:The | Input device and picture processor |
| CN105677107A (en) * | 2016-01-11 | 2016-06-15 | 福州瑞芯微电子股份有限公司 | Method and system for optimizing screen handwriting following performance |
| CN108364324A (en) * | 2018-01-22 | 2018-08-03 | 广州市动景计算机科技有限公司 | Image processing method, device and electric terminal |
| CN110580125A (en) * | 2018-06-07 | 2019-12-17 | 广州视源电子科技股份有限公司 | partial refreshing method, device, equipment and medium for display interface |
| CN110597444A (en) * | 2018-06-12 | 2019-12-20 | 广州视源电子科技股份有限公司 | Handwriting display method and device, terminal device and storage medium |
| CN109144382A (en) * | 2018-07-10 | 2019-01-04 | 广州视源电子科技股份有限公司 | Handwriting display method, device, terminal device and storage medium based on dual system |
Also Published As
| Publication number | Publication date |
|---|---|
| CN111651079A (en) | 2020-09-11 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN111651079B (en) | Handwriting display method, device, equipment and computer storage medium | |
| US20200319763A1 (en) | Method and device for managing tab window indicating application group including heterogeneous applications | |
| US9141264B2 (en) | Variable refresh rates for portions of shared screens | |
| CN110597444B (en) | Handwriting display method and device, terminal device and storage medium | |
| KR102307163B1 (en) | Cross-platform rendering engine | |
| US11036345B2 (en) | System and method for on-screen graphical user interface encapsulation and reproduction | |
| US7053905B2 (en) | Screen display processing apparatus, screen display processing method and computer program | |
| WO2016095728A1 (en) | Multi-window display method and device | |
| US20100325527A1 (en) | Overlay for digital annotations | |
| US20130057572A1 (en) | Multiple Display Device Taskbars | |
| CA2604763A1 (en) | System and method for providing a window management mode | |
| CN109375980B (en) | Touch drawing method based on Andriod system | |
| CN103455292A (en) | Business data display and processing method and device and user equipment | |
| US20160378272A1 (en) | Systems and methods for providing multi-focus to applications for collaboration | |
| WO2021068412A1 (en) | Interaction method and apparatus for intelligent interaction tablet, terminal device, and storage medium | |
| CN114237482A (en) | Handwriting display processing method, device, system, equipment and storage medium | |
| CN114237481A (en) | Handwriting display processing method, system, device, equipment and storage medium | |
| JP2014002436A (en) | Information processing apparatus, information processing method, and information processing program | |
| CN116339900B (en) | Multi-window fusion display method for cross-operating environment | |
| CN112462989A (en) | Operation method and device of intelligent interaction panel, intelligent interaction panel and medium | |
| US9483171B1 (en) | Low latency touch input rendering | |
| CN109960562B (en) | Information display method and device and computer readable storage medium | |
| US20210389849A1 (en) | Terminal, control method therefor, and recording medium in which program for implementing method is recorded | |
| CN115639920B (en) | Drawing method, electronic device, and readable storage medium | |
| CN116136721A (en) | Delay-free line drawing display method, device, equipment and storage medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |