WO2019015098A1

WO2019015098A1 - Dual-system-based writing stroke displaying and processing method and system, storage medium and apparatus

Info

Publication number: WO2019015098A1
Application number: PCT/CN2017/103430
Authority: WO
Inventors: 张维元
Original assignee: 广州视源电子科技股份有限公司; 广州视臻信息科技有限公司
Priority date: 2017-07-21
Filing date: 2017-09-26
Publication date: 2019-01-24
Also published as: CN107450831A; CN107450831B

Abstract

The present invention relates to a dual-system-based writing stroke displaying and processing method and system, storage medium and apparatus. The method comprises: when a writing software of a second system is activated, transmitting an activation instruction to a first system by the second system, and activating a transparent writing layer in the first system according to the activation instruction; according to a detected touch event, performing a writing stroke drawing operation on the transparent writing layer to obtain a first writing stroke, and displaying the first writing stroke on the transparent writing layer; according to the touch event, performing a writing stroke drawing operation on a writing interface of the writing software to obtain a second writing stroke, and displaying the second writing stroke on the writing layer of the second system; and when the touch event is detected to be finished, if the writing stroke drawing operation on the writing software is completed, erasing the first writing stroke. The above method and system do not need to go through HDMI encoding and decoding and transmission delay during display, thus reducing delay in the process of writing stroke display.

Description

Handwriting display processing method and system based on dual system, storage medium and device

Technical field

The present invention relates to the field of touch screen technologies, and in particular, to a dual system based handwriting display processing method and system, a storage medium and a device.

Background technique

A dual system display device is an electronic device that includes two complete operating systems. For example, the operating system of the dual system display device may be composed of a main Android system plus other Android systems, or a main Android system plus a Windows system. Generally, the main Android system is referred to as a first system, and the other system is referred to as a second system. .

At present, in the dual system display device, when the signal of the second system is displayed, the display signal of the second system needs to be physically connected to the first system through the HDMI (High Definition Multimedia Interface) line for display. Output, after receiving the signal of the second system, the first system performs HDMI decoding and displays, and the picture of one frame of the second system needs to be HMDI encoded, transmitted, and HDMI decoded before being presented to the user.

Then, when the electronic writing software is placed in the second system for the user to use, the user will experience the above HDMI codec and transmission delay each time the handwriting is drawn on the writing software, resulting in a delay in the handwriting display process. Larger.

Summary of the invention

Based on this, it is necessary to provide a handwriting display processing method and system based on dual system, a storage medium and a device for the problem of large time delay.

A dual system based handwriting display processing method includes the following steps:

When the writing software of the second system is started, sending, by the second system, a startup instruction to the first system, and starting the transparent writing layer in the first system according to the startup instruction;

Performing a handwriting drawing operation on the transparent writing layer according to the detected touch event to obtain the first pen Traces and displaying the first handwriting on the transparent writing layer;

Performing a handwriting drawing operation on the writing interface of the writing software according to the touch event, obtaining a second handwriting, and displaying the second handwriting on a writing layer of the second system;

After detecting the end of the touch event, if the handwriting drawing operation on the writing software is completed, the first handwriting is erased.

A dual system based handwriting display processing system comprising:

a startup module, configured to send, by the second system, a startup instruction to the first system when the writing software of the second system is started, and activate a transparent writing layer in the first system according to the startup instruction;

a first drawing module, configured to perform a handwriting drawing operation on the transparent writing layer according to the detected touch event, to obtain a first handwriting, and display the first handwriting on the transparent writing layer;

a second drawing module, configured to perform a handwriting drawing operation on the writing interface of the writing software according to the touch event, to obtain a second handwriting, and display the second handwriting on a writing layer of the second system;

And a first erasing module, configured to erase the first handwriting if the handwriting drawing operation on the writing software is completed after detecting the end of the touch event.

A computer readable storage medium having stored thereon a computer program that, when executed by a processor, implements a dual system based handwriting display processing method.

A computer device comprising a memory, a processor, and a computer program stored on the memory and operable on the processor, the processor executing the program to implement a dual system based handwriting display processing method.

The above-described dual system-based handwriting display processing method and system, storage medium and device, when the writing software of the second system is started, simultaneously starts the transparent writing layer in the first system, and in the writing interface of the second system and the first system Simultaneous handwriting and handwriting display on the transparent writing layer. After the handwriting drawing operation on the second system writing interface is completed, the first handwriting on the transparent writing layer is erased, and the user perceives that the first system is on the transparent writing layer. In the first stroke, the first handwriting does not need to undergo HDMI codec and transmission delay when displayed, which reduces the delay in the handwriting display process.

DRAWINGS

1 is a flow chart of a dual system based handwriting display processing method according to an embodiment;

2 is a split view of a dual system based handwriting drawing operation of an embodiment;

FIG. 3 is a schematic structural diagram of a dual system based handwriting display processing system according to an embodiment.

Detailed ways

The technical solution of the present invention will be described below with reference to the accompanying drawings.

As shown in FIG. 1 , the present invention provides a dual system based handwriting display processing method, which may include the following steps:

S1, when the writing software of the second system is started, sending, by the second system, a startup instruction to the first system, and starting the transparent writing layer in the first system according to the startup instruction;

In one embodiment, the first system may be an operating system such as an Android system, an IOS system, or a Windows system, and the second system may also be one of the above systems. In a typical embodiment, the first system and the second system may both be Android systems. The writing software of the second system is the writing software installed in the second system. When the handwriting is drawn by the writing software of the second system, the handwriting display process needs to be displayed after HMDI encoding, transmission, and HDMI decoding. In order to speed up the handwriting display, when the writing software of the second system is started, a startup command can be sent to the first system through the second system, and a transparent writing layer is activated in the first system. Since the writing software of the second system is activated first, the transparent writing layer is activated, so that the transparent writing layer will overwrite the writing software of the second system. Moreover, since the first system starts the transparent writing layer, that is, the background thereof is transparent, it is impossible for the user to perceive the existence of the transparent writing layer of the first system, and the startup process is not perceived.

S2, performing a handwriting drawing operation on the transparent writing layer according to the detected touch event, obtaining a first handwriting, and displaying the first handwriting on the transparent writing layer;

In this step, a touch event start command issued by the system may be detected, and if detected, a touch event is determined to occur. Taking the Android system as an example, when the ACTION_DOWN command issued by the system is detected, it can be determined that a touch event occurs. In an embodiment, the handwriting attribute information may also be sent to the first system by the second system before performing the drawing operation, and the handwriting attribute information may include the thickness of the handwriting line, the definition of the handwriting line being a solid line or a broken line, and/or Or information such as the color of the handwriting lines. Into one In an embodiment of the step, the second system may send the changed handwriting attribute information to the first system after receiving the change instruction to the handwriting attribute information. After acquiring the handwriting attribute information, the first system may perform a handwriting drawing operation according to the handwriting attribute information, and display the drawn first handwriting on the transparent writing layer. In a further embodiment, the first handwriting can also be rendered and the rendered first handwriting displayed on the transparent writing layer. If the handwriting attribute information acquired by the first system includes the color information of the handwriting line, the first handwriting may be rendered according to the color information.

S3, performing a handwriting drawing operation on the writing interface of the writing software according to the touch event, obtaining a second handwriting, and displaying the second handwriting on a writing layer of the second system;

This step can be performed while performing step S2. In this step, when the handwriting drawing operation is performed, the handwriting can be drawn according to the predefined handwriting attribute information. Before performing the handwriting drawing operation, the modification event of the handwriting attribute information may also be detected. If detected, the handwriting is drawn according to the modified handwriting attribute information; otherwise, the handwriting drawing may be performed according to the default handwriting attribute information.

By performing step S2 and step S3, when the user performs touch writing, the two systems simultaneously process the touch event and draw the handwriting at the same time; since the user opens the writing software of the second system, the transparent writing layer of the first system is opened. Therefore, the writing handwriting of the first system will completely cover the handwriting of the second system. When the user writes, the natural handwriting is the handwriting of the first system transparent writing layer, and the writing handwriting of the second system is not perceived. However, due to the transparency of the first system's writing layer, the user will think that he is always using the writing software of the second system; the writing of the first system can replace the writing of the second system to speed up the handwriting display, because the first The display of the system does not require the delay of HDMI codec, transmission or even encryption and decryption. The split diagram of the handwriting drawing operation based on the dual system is shown in Fig. 2. In Fig. 2, the black pattern represents the transparent writing layer of the first system and the handwriting thereon, and the gray pattern represents the writing software of the second system and the handwriting thereon. The transparent writing layer is overlaid on the writing software of the second system.

S4. After detecting the end of the touch event, if the handwriting drawing operation on the writing software is completed, the first handwriting is erased.

When the user starts writing, the first system and the second system both write at the same time, the user perceives the writing of the first system, and when the user lifts the pen, the first system will clear the drawing. The handwriting returns the transparent state without handwriting; when the handwriting of the first system disappears, the user will see the handwriting that has already been drawn by the second system. Since the handwriting of the two systems completely overlaps, the user cannot perceive the first system. The process of handwriting disappearing. Whether the touch event is ended can be determined by detecting a touch event end instruction. When the touch event end instruction is detected, it may be determined that the touch event ends, otherwise, it is determined that the touch event has not ended. Taking the Android system as an example, the ACTION_UP event can be detected. If detected, the touch event can be determined to end, otherwise, the touch event is not ended.

After detecting the end of the touch event, performing a handwriting editing operation on the first handwriting and the second handwriting respectively according to the detected handwriting editing event, if the writing interface is detected after detecting the end of the handwriting editing event The upper handwriting editing operation is completed, and the first handwriting is erased. In the conventional technology, when the user needs to edit the handwriting of the second system, the edited second handwriting also needs to pass the delay of HDMI codec, transmission, and even encryption and decryption when displaying. By adopting the above method, the handwriting can be directly edited in the first system, and the edited handwriting can be directly displayed, thereby reducing the display delay when the handwriting is edited. In one embodiment, the handwriting editing operations may include operations such as handwriting movement and/or handwriting scaling.

Since the user may finish the touch event after the handwriting is finished, and then perform the handwriting editing, the timing may be started after the touch end event is detected, if the time is reached before the preset first time threshold is reached. The handwriting editing event performs a handwriting editing operation on the first handwriting according to the handwriting editing event. In this way, the time gap between the end of the touch event and the start of the handwriting editing event is reserved for the user, which is convenient for the user to operate. Further, if the editing event is not detected before the timing reaches the preset first time threshold, the first handwriting may be erased. Further, timing may be started when the handwriting editing operation is completed, and the first handwriting is erased when the timing reaches a preset second time threshold. When the user needs to continuously perform the handwriting editing operation, in the above manner, it is possible to avoid erasing the first handwriting before the handwriting editing operation is all ended.

In this scheme, the handwriting is simultaneously drawn by the dual system, and the acceleration of the handwriting display process is completed by the fast belt slow (the first system with the second system), by drawing and displaying on the transparent writing layer, and after the handwriting is drawn. Clearing the handwriting on the transparent writing layer, completely displaying the handwriting of the second system to facilitate the user to perform other operations on the second system handwriting, the handwriting is displayed without HDMI codec and The transmission delay reduces the delay during the handwriting display.

As shown in FIG. 3, the present invention further provides a dual-system handwriting display processing system, which may include:

The startup module 10 is configured to send, by the second system, a startup instruction to the first system when the writing software of the second system is started, and activate the transparent writing layer in the first system according to the startup instruction;

The first drawing module 20 is configured to perform a handwriting drawing operation on the transparent writing layer according to the detected touch event, obtain a first handwriting, and display the first handwriting on the transparent writing layer;

In this module, the touch event start command issued by the system can be detected, and if detected, the touch event is determined to occur. Taking the Android system as an example, when the ACTION_DOWN command issued by the system is detected, it can be determined that a touch event occurs. In an embodiment, the handwriting attribute information may also be sent to the first system by the second system before performing the drawing operation, and the handwriting attribute information may include the thickness of the handwriting line, the definition of the handwriting line being a solid line or a broken line, and/or Or information such as the color of the handwriting lines. In a further embodiment, the second system may transmit the altered handwriting attribute information to the first system after receiving the change instruction to the handwriting attribute information. After acquiring the handwriting attribute information, the first system may perform a handwriting drawing operation according to the handwriting attribute information, and display the drawn first handwriting on the transparent writing layer. In a further embodiment, the first rendering module can include a rendering unit and a display unit, wherein the rendering unit can render the first handwriting, and the display unit can display the rendered first handwriting on the transparent writing layer. If the handwriting attribute information acquired by the first system includes handwriting lines Color information, which can be rendered according to the color information.

a second drawing module 30, configured to perform a handwriting drawing operation on the writing interface of the writing software according to the touch event, to obtain a second handwriting, and display the second handwriting on a writing layer of the second system;

While the functions of the first rendering module 20 are performed, the functions of the module can be performed. When performing the handwriting drawing operation, the module can draw the handwriting according to the predefined handwriting attribute information. Before performing the handwriting drawing operation, the modification event of the handwriting attribute information may also be detected. If detected, the handwriting is drawn according to the modified handwriting attribute information; otherwise, the handwriting drawing may be performed according to the default handwriting attribute information.

By performing the functions of the first drawing module 20 and the second drawing module 30, when the user performs touch writing, the two systems simultaneously process the touch event, and simultaneously draw the handwriting; since the user opens the writing software of the second system, Open the transparent writing layer of the first system, so the writing handwriting of the first system will completely cover the handwriting of the second system. When the user writes, the handwriting is naturally the handwriting of the first system transparent writing layer, and the perception is not To the writing of the second system, but because the first system is transparent, the user will always think that he is using the writing software of the second system; the writing of the first system can speed up the writing of the second system. The handwriting shows that this is because the display of the first system does not require a delay of HDMI codec, transmission or even encryption and decryption. The split diagram of the handwriting drawing operation based on the dual system is shown in Fig. 2. In Fig. 2, the black pattern represents the transparent writing layer of the first system and the handwriting thereon, and the gray pattern represents the writing software of the second system and the handwriting thereon. The transparent writing layer is overlaid on the writing software of the second system.

The first erasing module 40 is configured to erase the first handwriting if the handwriting drawing operation on the writing software is completed after detecting the end of the touch event.

When the user starts writing, the first system and the second system both write at the same time, the user perceives the writing of the first system, and when the user lifts the pen, the first system will clear the drawn handwriting. Recovering the transparent state without handwriting; when the handwriting of the first system disappears, the user will see the handwriting that has already been drawn by the second system. Since the handwriting of the two systems completely overlaps, the user does not perceive the first system handwriting disappearing. the process of. Whether the touch event is knotted can be determined by detecting a touch event end instruction bundle. When the touch event end instruction is detected, it may be determined that the touch event ends, otherwise, it is determined that the touch event has not ended. Taking the Android system as an example, the ACTION_UP event can be detected. If detected, the touch event can be determined to end, otherwise, the touch event is not ended.

In one embodiment, the dual system based handwriting display system may further include: a handwriting editing module for performing a handwriting editing operation on the first handwriting and the second handwriting respectively according to the detected handwriting editing event; and a second erasure And a module, configured to erase the first handwriting after the handwriting editing operation on the writing interface is completed after detecting the end of the handwriting editing event. In the conventional technology, when the user needs to edit the handwriting of the second system, the edited second handwriting also needs to pass the delay of HDMI codec, transmission, and even encryption and decryption when displaying. By adopting the above method, the handwriting can be directly edited in the first system, and the edited handwriting can be directly displayed, thereby reducing the display delay when the handwriting is edited. In one embodiment, the handwriting editing operations may include operations such as handwriting movement and/or handwriting scaling.

Since the user may finish the touch event and then perform handwriting editing after drawing the handwriting, the handwriting editing module may include a timing unit for starting timing after detecting the touch end event; and editing the unit, If the handwriting editing event is detected before the timing reaches the preset first time threshold, the handwriting editing operation is performed on the first handwriting according to the handwriting editing event. In this way, the time gap between the end of the touch event and the start of the handwriting editing event is reserved for the user, which is convenient for the user to operate. Further, if the editing event is not detected before the timing reaches the preset first time threshold, the first handwriting may be erased. Further, timing may be started when the handwriting editing operation is completed, and the first handwriting is erased when the timing reaches a preset second time threshold. When the user needs to continuously perform the handwriting editing operation, in the above manner, it is possible to avoid erasing the first handwriting before the handwriting editing operation is all ended.

In this scheme, the handwriting is simultaneously drawn by the dual system, and the acceleration of the handwriting display process is completed by the fast belt slow (the first system with the second system), by drawing and displaying on the transparent writing layer, and after the handwriting is drawn. Clear the handwriting on the transparent writing layer, completely display the handwriting of the second system to facilitate the user to perform other operations on the second system handwriting. The handwriting does not need to pass HDMI codec and transmission delay when displaying, which reduces the delay in the handwriting display process. .

The dual system-based handwriting display processing system of the present invention has a one-to-one correspondence with the dual system-based handwriting display processing method of the present invention, and the technical features and beneficial effects thereof described in the above embodiment of the dual system-based handwriting display processing method are applicable. In the embodiment of the dual system based handwriting display processing system, it is hereby declared.

In another embodiment, the present invention also provides a computer readable storage medium having stored thereon a computer program that, when executed by a processor, implements the dual system based handwriting display processing method of any of the above embodiments.

The method performed by the computer readable storage medium is the same as the dual system based handwriting display processing method in the above embodiment, and details are not described herein again.

In another embodiment, the present invention also provides a computer device comprising a memory, a processor, and a computer program stored on the memory and operable on the processor, the processor implementing the program to implement any of the above implementations The dual system based handwriting display processing method in the example.

The method performed by the processor in the computer device is the same as the dual-system based handwriting display processing method in the above embodiment, and details are not described herein again.

The logic and/or steps represented in the flowchart or otherwise described herein, for example, may be considered as an ordered list of executable instructions for implementing logical functions, and may be embodied in any computer readable medium, Used in conjunction with, or in conjunction with, an instruction execution system, apparatus, or device (eg, a computer-based system, a system including a processor, or other system that can fetch instructions and execute instructions from an instruction execution system, apparatus, or device) Or use with equipment. For the purposes of this specification, a "computer-readable medium" can be any apparatus that can contain, store, communicate, propagate, or transport a program for use in an instruction execution system, apparatus, or apparatus, or in conjunction with such an instruction execution system, apparatus, or apparatus.

More specific examples (non-exhaustive list) of computer readable media include the following: electrical connections (electronic devices) having one or more wires, portable computer disk cartridges (magnetic devices), random access memory (RAM), Read only memory (ROM), erasable editable read only memory (EPROM or flash memory), fiber optic devices, and portable compact disk read only memory (CDROM). In addition, the computer readable medium may even be a paper or other suitable medium on which the program can be printed, as it may be optically scanned, for example by paper or other medium, followed by editing, interpretation or, if necessary, He processes it in a suitable manner to obtain the program electronically and then stores it in computer memory.

It should be understood that portions of the invention may be implemented in hardware, software, firmware or a combination thereof. In the above-described embodiments, multiple steps or methods may be implemented in software or firmware stored in a memory and executed by a suitable instruction execution system. For example, if implemented in hardware, as in another embodiment, it can be implemented by any one or combination of the following techniques well known in the art: having logic gates for implementing logic functions on data signals. Discrete logic circuits, application specific integrated circuits with suitable combinational logic gates, programmable gate arrays (PGAs), field programmable gate arrays (FPGAs), etc.

In the description of the present specification, the description with reference to the terms "one embodiment", "some embodiments", "example", "specific example", or "some examples" and the like means a specific feature described in connection with the embodiment or example. A structure, material or feature is included in at least one embodiment or example of the invention. In the present specification, the schematic representation of the above terms does not necessarily mean the same embodiment or example. Furthermore, the particular features, structures, materials, or characteristics described may be combined in a suitable manner in any one or more embodiments or examples.

The technical features of the above-described embodiments may be arbitrarily combined. For the sake of brevity of description, all possible combinations of the technical features in the above embodiments are not described. However, as long as there is no contradiction between the combinations of these technical features, All should be considered as the scope of this manual.

The above-described embodiments are merely illustrative of several embodiments of the present invention, and the description thereof is more specific and detailed, but is not to be construed as limiting the scope of the invention. It should be noted that a number of variations and modifications may be made by those skilled in the art without departing from the spirit and scope of the invention. Therefore, the scope of the invention should be determined by the appended claims.

Claims

A dual system based handwriting display processing method, comprising the steps of:

When the writing software of the second system is started, sending, by the second system, a startup instruction to the first system, and starting the transparent writing layer in the first system according to the startup instruction;

Performing a handwriting drawing operation on the transparent writing layer according to the detected touch event, obtaining a first handwriting, and displaying the first handwriting on the transparent writing layer;

Performing a handwriting drawing operation on the writing interface of the writing software according to the touch event, obtaining a second handwriting, and displaying the second handwriting on a writing layer of the second system;

After detecting the end of the touch event, if the handwriting drawing operation on the writing software is completed, the first handwriting is erased.
The method for processing a handwriting display based on a dual system according to claim 1, wherein the step of displaying the first handwriting on the transparent writing layer comprises:

Rendering the first handwriting;

The rendered first handwriting is displayed on the transparent writing layer.
The method for processing a handwriting display based on the dual system according to claim 1, wherein after detecting the end of the touch event, the method further comprises the following steps:

Performing a handwriting editing operation on the first handwriting and the second handwriting respectively according to the detected handwriting editing event;

After detecting the end of the handwriting editing event, if the handwriting editing operation on the writing interface is completed, the first handwriting is erased.
The dual-system-based handwriting display processing method according to claim 3, wherein the step of performing a handwriting editing operation on the first handwriting and the second handwriting respectively according to the detected handwriting editing event comprises:

After detecting the touch end event, timing is started;

If the handwriting editing event is detected before the timing reaches the preset first time threshold, a handwriting editing operation is performed on the first handwriting according to the handwriting editing event.
A dual system based handwriting display processing method according to claim 4, wherein It also includes the following steps:

If the editing event is not detected before the timing reaches the preset first time threshold, the first handwriting is erased.
The method for processing a handwriting display based on a dual system according to claim 4, further comprising the steps of:

Start timing when the handwriting editing operation is completed;

The first handwriting is erased when the timing reaches a preset second time threshold.
A dual system based handwriting display processing system, comprising:

a startup module, configured to send, by the second system, a startup instruction to the first system when the writing software of the second system is started, and activate a transparent writing layer in the first system according to the startup instruction;

a first drawing module, configured to perform a handwriting drawing operation on the transparent writing layer according to the detected touch event, to obtain a first handwriting, and display the first handwriting on the transparent writing layer;

a second drawing module, configured to perform a handwriting drawing operation on the writing interface of the writing software according to the touch event, to obtain a second handwriting, and display the second handwriting on a writing layer of the second system;

And a first erasing module, configured to erase the first handwriting if the handwriting drawing operation on the writing software is completed after detecting the end of the touch event.
The dual system-based handwriting display processing method according to claim 7, further comprising:

a handwriting editing module, configured to perform a handwriting editing operation on the first handwriting and the second handwriting according to the detected handwriting editing event;

And a second erasing module, configured to erase the first handwriting after the handwriting editing operation on the writing interface is completed after detecting the end of the handwriting editing event.
A computer readable storage medium having stored thereon a computer program, wherein the program is executed by a processor to implement the dual system based handwriting display processing method according to any one of claims 1 to 6.
A computer device comprising a memory, a processor, and a computer program stored on the memory and operable on the processor, wherein the processor implements the right to execute the program The dual system based handwriting display processing method according to any one of 1 to 6.