CN115588413A

CN115588413A - Electronic ink screen refreshing method and device and readable storage medium

Info

Publication number: CN115588413A
Application number: CN202211163800.6A
Authority: CN
Inventors: 曾舒钏; 郑晓斌; 刘丽琼
Original assignee: Allwinner Technology Co Ltd
Current assignee: Allwinner Technology Co Ltd
Priority date: 2022-09-23
Filing date: 2022-09-23
Publication date: 2023-01-10

Abstract

The invention discloses a refreshing method and a refreshing device of an electronic ink screen and a readable storage medium, wherein the method comprises the following steps: responding to an initialization instruction, and acquiring drawn handwriting to a buffer area; determining an updating area according to the buffer area; and judging whether the updating area is a handwritten layer or not, and if the updating area is the handwritten layer, sending the updating area to an electronic ink screen for displaying. Therefore, the refreshing speed of the electronic ink screen is improved in the handwriting scene. The invention can be widely applied to the field of refreshing of electronic ink screens.

Description

Electronic ink screen refreshing method and device and readable storage medium

Technical Field

The invention relates to the field of electronic ink screens, in particular to a refreshing method and device of an electronic ink screen and a readable storage medium.

Background

At present, electronic ink screens are increasingly becoming the first choice for people to read. On the Android platform, however, the electronic ink screen is low in refreshing speed due to the physical characteristics of the screen. In a handwriting scenario, the native refresh mechanism is delayed for more than 200ms, with other region flickers occurring. The use experience of the user during handwriting is greatly influenced.

Disclosure of Invention

In view of this, the embodiments of the present invention provide a method and an apparatus for refreshing an electronic ink screen, and a readable storage medium. The refreshing speed of the electronic ink screen in the handwriting scene is improved.

One aspect of the present invention provides a method for refreshing an electronic ink screen, including: responding to an initialization instruction, and acquiring drawn handwriting to a buffer area; determining an updating area according to the buffer area; and judging whether the updating area is a handwritten layer or not, and if the updating area is the handwritten layer, sending the updating area to an electronic ink screen for displaying.

According to some embodiments of the invention, the response initialization instruction comprises: responding to the initialization instruction, and stopping layer composition; and applying for a buffer area according to the size of the handwriting area, and storing a handle of the buffer area.

According to some embodiments of the present invention, the determining whether the update area is a handwritten layer further includes: and if the updating area is a common layer, performing layer synthesis on the updating area to obtain a target updating layer, and sending the target updating layer to a buffer area.

According to some embodiments of the present invention, after the step of performing layer synthesis on the update area to obtain a target update layer, and sending the target update layer to a buffer area, the method further includes: and acquiring the target updating layer from the buffer area, and sending the target updating layer to an electronic ink screen for displaying.

According to some embodiments of the present invention, the determining whether the updated area is a handwritten layer further includes: and judging whether the updating area is a conflict area, if so, waiting for the updating of the conflicted pipeline to be finished, and sending the conflict area which is updated by handwriting to a buffer area, wherein the conflict area is the area in which the handwriting is being updated.

According to some embodiments of the present invention, after the waiting for the updated conflicted pipe is completed and the conflict area for completing the update is sent to the buffer, the method further includes: and acquiring the updated conflict area from the buffer area, and sending the conflict area to an electronic ink screen for displaying.

Another aspect of the present invention provides a refreshing apparatus for an electronic ink screen, including: the first module is used for responding to the initialization instruction and acquiring the drawn handwriting to the buffer area; a second module for determining an update region according to the buffer region; and the third module is used for judging whether the updating area is a handwritten layer or not, and if the updating area is the handwritten layer, sending the updating area to the electronic ink screen for displaying.

Another aspect of the invention provides an electronic device comprising a processor and a memory; the memory is used for storing programs; the processor executes the program to realize the refreshing method of the electronic ink screen as described in any one of the above.

The electronic equipment according to the embodiment of the invention has at least the same beneficial effects as the refreshing method of the electronic ink screen.

Another aspect of the present invention provides a computer-readable storage medium, which stores a program, the program being executed by a processor to implement the method for refreshing an electronic ink screen as described in any one of the above.

The computer-readable storage medium according to the embodiment of the invention has at least the same advantages as the above-mentioned refreshing method of the electronic ink screen.

The embodiment of the invention also discloses a computer program product or a computer program, which comprises computer instructions, and the computer instructions are stored in a computer readable storage medium. The computer instructions may be read by a processor of a computer device from a computer-readable storage medium, and the computer instructions executed by the processor cause the computer device to perform the foregoing method.

The embodiment of the invention responds to the initialization instruction and directly obtains the drawn notes to the buffer area, thereby realizing that the input event is not obtained through the frame, directly processing and drawing the handwriting in the handwriting service and simplifying the input flow. And determining an updating area according to the buffer area, judging whether the updating area is a handwritten layer or not, and if the updating area is the handwritten layer, sending the updating area to an electronic ink screen for displaying. The Android native layer synthesis is bypassed, and the handwritten content is directly sent to the display driver for display, so that synchronous refreshing is realized. By simplifying the input flow, the synchronous refreshing mechanism improves the refreshing speed of the electronic ink screen in the handwriting scene.

Drawings

In order to more clearly illustrate the technical solutions in the embodiments of the present application, the drawings needed to be used in the description of the embodiments are briefly introduced below, and it is obvious that the drawings in the following description are only some embodiments of the present application, and it is obvious for those skilled in the art to obtain other drawings based on these drawings without creative efforts.

FIG. 1 is a block diagram of refreshing of an electronic ink screen provided by an embodiment of the present invention;

FIG. 2 is a flowchart illustrating steps of a method for refreshing an electronic ink screen according to an embodiment of the present invention;

FIG. 3 is a schematic block diagram of a refreshing apparatus for an electronic ink screen provided in an embodiment of the present invention;

fig. 4 is a schematic block diagram of an apparatus of an embodiment of the present invention.

Detailed Description

In order to make the objects, technical solutions and advantages of the present application more clearly understood, the present application is further described in detail below with reference to the accompanying drawings and embodiments. It should be understood that the specific embodiments described herein are merely illustrative of the present application and are not intended to limit the present application.

On an Android platform, the electronic ink screen is low in refreshing speed due to the physical characteristics of the screen. In a handwriting scenario, the native refresh mechanism is delayed for more than 200ms, with other region flickers occurring. In order to solve the problem of slow refreshing in the handwriting scene of the electronic ink screen, the following schemes are provided in the industry at present:

(1) And setting a specific refreshing mode, and processing a refreshing mode of the screen in a handwriting scene.

(2) The handwriting area is updated and displayed, deep customization is adopted in the industry of the part, the handwriting area is driven from an application end to a bottom layer, and the whole path is matched to realize handwriting refreshing.

(3) The handwritten content is processed using Eink TCON hardware.

However, the prior art has the following problems:

(1) The Android native refresh frame has a complex flow, and small area update in a handwriting scene can also cause the synthesis of the whole screen, thereby consuming system resources and time.

(2) The Android electromagnetic pen data report time consumption through a native input framework, and the handwriting input delay is increased.

(3) The buffer is shared between the user layer and the drive layer, and the map and unmap virtual addresses need to be repeated through the buffer handle, so that the system delay is increased.

(4) The electronic ink screen refreshing mechanism can cause refreshing wait under the condition of processing refreshing area conflict and increase the handwriting display delay.

Therefore, the electronic ink screen refreshing method, the electronic ink screen refreshing device and the readable storage medium are provided, so that the electronic ink screen refreshing speed in a handwriting scene is increased, and the electronic ink screen refreshing method, the electronic ink screen refreshing device and the readable storage medium can be applied to Android electronic ink screen products.

The terms appearing herein are explained first:

surface flag: is a process, the function of the surfacemaker is to accept graphical display data from multiple sources, synthesize them, and send them to a display device.

Handle: is the basis of the whole Windows programming. A handle refers to a unique integer value, i.e., a 4-byte (8-byte in a 64-bit procedure) long value, used to identify different objects in an application and different instances in a class.

Eink HWC: is a HAL Layer module for window (Layer) synthesis and display in Android, the implementation of which is device specific.

Buffer: the buffer area is a section of memory for temporarily storing input and output data.

Eink200: electronic ink. Is a new material produced by integrating chemistry, physics and electronics. It features easy to read, flexible, cheap and cheap manufacture and low power consumption.

DE refers to display engine, which is a display synthesis module with a band in SoC.

TCON: also called logic board, screen driving board, central control board.

Referring to FIG. 1, a block diagram of a refresh of an electronic ink screen in an embodiment is provided:

the application includes handwriting application; the frame comprises a window management service, a handwriting service and a surface flag; the hardware abstraction layer comprises Eink HWC; the screen drive includes: input, DE, and Eink200.

In the Android native display framework, a handwriting service management handwriting refreshing process is added, and a handwriting application is in butt joint with the native display framework and simultaneously is in butt joint with an interface of a newly added handwriting service. And when the handwriting is initialized, the handwriting service is informed to start a handwriting mode, and the surface flag synthesis is stopped, so that the refresh synthesis of the whole screen is avoided. And simultaneously transmitting the data to the Surface of the handwriting area, applying for display buffer by the handwriting service according to the size of the Surface, transmitting the handle to the HWC, and starting a handwriting drawing thread. In the handwriting process, the handwriting service acquires an input event, handwriting is directly drawn, a handwriting area is updated in real time, and the handwriting service directly drives to acquire the input event without passing through an input service layer. And after receiving the updating area, the screen driver directly updates the area in the display buffer to the ink screen, wherein the conflicting areas wait for combination until all current handwriting are updated and then are uniformly issued. Under an Android platform, the updating speed of handwriting of conventional application is delayed greatly due to the characteristics of an electronic ink screen product, so that the handwriting service is independently opened, an input event is processed and display refreshing is performed, the characteristics of the electronic ink screen are fully utilized to perform display updating, the updating delay time of the handwriting is reduced, and the updating speed is increased. It is noted that the handwriting service may also be directly integrated into the native display framework, not exist as a separate service, but provide similar efficacy. Or the work of the handwriting service is performed by the handwriting application, and the handwriting application is directly connected to the hardware abstraction layer in an interfacing mode and can also provide similar effects.

Referring to FIG. 2, a method of an embodiment of the present invention includes steps S100-S300.

And S100, responding to the initialization instruction, and acquiring the drawn handwriting to a buffer area.

Specifically, the method includes the steps of responding to an initialization instruction, triggering a handwriting mode, stopping a Surface flag to enable layer composition, in order to avoid screen refreshing composition, applying for a buffer area according to the size of a Surface of a handwriting area, conducting a handle to the HWC, and starting a handwriting drawing thread, which are initialization work before handwriting. In the handwriting process, after the screen driver receives the update, the drawn handwriting is acquired to the buffer area. It should be noted that, in the currently common technology, the buffer is shared between the user layer and the driver layer, and the map and unmap virtual addresses need to be repeated through the buffer handle, thereby increasing the system delay. By conducting the handle in the HWC, the handwritten content buffer is maintained using the same physical address, so there is no need to remap, unmap each time the content is updated. The display driving map and unmap processes are optimized, and the driving delay is reduced. And by managing the application surface layer, an Android surface Flinger synthesis mechanism is bypassed. And under the handwriting mode, the layer of the UI of the handwriting area does not trigger the layer updating any more.

And step S200, determining an updating area according to the buffer area.

Specifically, in the handwriting process, corresponding handwriting is drawn into the buffer area according to the input of the electromagnetic pen, and the updating area is issued.

And step S300, judging whether the updating area is a handwritten layer or not, and if the updating area is the handwritten layer, sending the updating area to an electronic ink screen for displaying.

In step S300, the method further includes the steps of:

if the updated area is a common layer, performing layer synthesis on the updated area to obtain a target updated layer, and sending the target updated layer to a buffer area; and acquiring a target updating layer from the buffer area, and sending the target updating layer to an electronic ink screen for displaying.

If the updating area is the handwriting layer, judging whether the updating area is a conflict area, if so, waiting for the conflict pipeline to finish updating, and sending the conflict area which finishes updating to a buffer area, wherein the conflict area is the area in which the handwriting is updating; and acquiring the updated conflict area from the buffer area, and sending the conflict area to the electronic ink screen for display.

Specifically, the HWC is configured to determine whether the update area is a handwritten layer, and if the update area is a handwritten layer, continue to determine whether the update area is a conflict area, and send a non-conflict area in the handwritten layer to the eink for display; and for the handwritten layer in the conflict area, after finishing the updated stroke, uniformly combining the conflict areas, and sending the merged conflict areas to the eink for display. If the updated area is judged to be not the handwritten layer by the HWC, the updated area represents that the ordinary application SurfaceFlinger is updated, and therefore the updated area is sent to the DE to be subjected to layer combination to obtain a target updated layer and is sent to the eink to be displayed. An ioctl interface is designed in the screen drive of the ink screen, so that an application can obtain a dma address corresponding to a buffer, and the dma physical address is directly used in the drive. And the service layer is directly communicated with the display layer, the Android native layer synthesis is bypassed in the process of processing the handwriting area, and the handwriting content is directly sent to the display driver for display. When the handwriting is updated, the complete screen does not need to be refreshed, the HWC layer is informed to refresh the updating area, the input event is not acquired through the frame, and the handwriting is directly processed and drawn in the handwriting service. Thereby reducing the delay time and increasing the speed.

In another embodiment, the display path for the update area is specifically:

and the upper layer is written back to the memory buffer after DE synthesis. Eink acquires display content from the memory buffer to the screen. And through the DE write-back function, the conflict areas of the handwriting are temporarily not sent for display, and after one handwriting is finished, the conflict areas are uniformly merged and are updated to a screen for display together.

In one aspect, referring to fig. 3, this embodiment provides a refreshing apparatus for an electronic ink screen, which at least includes: a first module 410, a second module 420, and a third module 430.

Specifically, the first module 410 responds to the initialization instruction and obtains drawn handwriting to a buffer area, the second module 420 is connected with the first module 410, the buffer area in the first module 410 is obtained to determine an update area, the third module 430 is connected with the second module 420, whether the update area is a handwriting layer or not is judged, and if yes, the update area is sent to a display driver of the electronic ink screen for display. It will be appreciated that the apparatus comprises a framework as in figure 1 and is capable of performing a method as in figure 2.

In addition, the application development is basically consistent with common Android application, and only special variable marks need to be set. The development universality is high. And the handwriting scene is customized, the performance is close to the hardware realization level, and the experience is close to the paper writing effect. And a software implementation scheme is adopted, so that some hardware IP modules are saved, and the cost is saved.

Referring to fig. 4, the present embodiment provides an electronic device, which includes a processor 510 and a memory 520 coupled to the processor 510, wherein the memory 520 stores program instructions executable by the processor 510, and the processor 510 executes the program instructions stored in the memory 520 to implement the target risk website detecting method. The processor 510 may also be referred to as a Central Processing Unit (CPU), among others. Processor 510 may be an integrated circuit chip having signal processing capabilities. Processor 510 may also be a general purpose processor, a Digital Signal Processor (DSP), an Application Specific Integrated Circuit (ASIC), a Field Programmable Gate Array (FPGA) or other programmable logic device, discrete gate or transistor logic, discrete hardware components. The general purpose processor may be a microprocessor, but in the alternative, the general purpose processor may be any conventional processor or the like. Memory 520 may include various components (e.g., machine-readable media), including but not limited to random access memory components, read only components, and any combination thereof. The memory 520 may also include: instructions (e.g., software) (e.g., stored on one or more machine-readable media); the instruction implements the target risk website detection method in the above embodiment. The electronic device has a function of loading and operating a software system for target risk website detection provided by the embodiment of the present invention, for example, a Personal Computer (PC), a mobile phone, a smart phone, a Personal Digital Assistant (PDA), a wearable device, a Pocket PC (Pocket PC), a tablet Computer, and the like.

The embodiment of the invention also discloses a computer program product or a computer program, which comprises computer instructions, and the computer instructions are stored in a computer readable storage medium. The computer instructions may be read by a processor of a computer device from a computer-readable storage medium, and executed by the processor, causing the computer device to perform the method illustrated in fig. 2.

In alternative embodiments, the functions/acts noted in the block diagrams may occur out of the order noted in the operational illustrations. For example, two blocks shown in succession may, in fact, be executed substantially concurrently, or the blocks may sometimes be executed in the reverse order, depending upon the functionality/acts involved. Furthermore, the embodiments presented and described in the flow charts of the present invention are provided by way of example in order to provide a more comprehensive understanding of the technology. The disclosed methods are not limited to the operations and logic flows presented herein. Alternative embodiments are contemplated in which the order of various operations is changed, and in which sub-operations described as part of larger operations are performed independently.

Furthermore, although the present invention is described in the context of functional modules, it should be understood that, unless otherwise indicated to the contrary, one or more of the described functions and/or features may be integrated in a single physical device and/or software module, or one or more functions and/or features may be implemented in separate physical devices or software modules. It will also be appreciated that a detailed discussion of the actual implementation of each module is not necessary for an understanding of the present invention. Rather, the actual implementation of the various functional modules in the apparatus disclosed herein will be understood within the ordinary skill of an engineer, given the nature, function, and internal relationship of the modules. Accordingly, those of ordinary skill in the art will be able to practice the invention as set forth in the claims without undue experimentation. It is also to be understood that the specific concepts disclosed are merely illustrative of and not intended to limit the scope of the invention, which is defined by the appended claims and their full scope of equivalents.

The functions, if implemented in the form of software functional units and sold or used as a stand-alone product, may be stored in a computer readable storage medium. Based on such understanding, the technical solution of the present invention or a part thereof which substantially contributes to the prior art may be embodied in the form of a software product, which is stored in a storage medium and includes several instructions for causing a computer device (which may be a personal computer, a server, or a network device) to execute all or part of the steps of the method according to the embodiments of the present invention. And the aforementioned storage medium includes: a U-disk, a removable hard disk, a Read-Only Memory (ROM), a Random Access Memory (RAM), a magnetic disk or an optical disk, and other various media capable of storing program codes.

The logic and/or steps represented in the flowcharts or otherwise described herein, e.g., an ordered listing of executable instructions that can be considered to implement logical functions, can be embodied in any computer-readable medium for use by or in connection with an instruction execution system, apparatus, or device, such as a computer-based system, processor-containing system, or other system that can fetch the instructions from the instruction execution system, apparatus, or device and execute the instructions. For the purposes of this description, a "computer-readable medium" can be any means that can contain, store, communicate, propagate, or transport the program for use by or in connection with the instruction execution system, apparatus, or device.

More specific examples (a non-exhaustive list) of the computer-readable medium would include the following: an electrical connection (electronic device) having one or more wires, a portable computer diskette (magnetic device), a Random Access Memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber device, and a portable compact disc read-only memory (CDROM). Additionally, the computer-readable medium could even be paper or another suitable medium upon which the program is printed, as the program can be electronically captured, via for instance optical scanning of the paper or other medium, then compiled, interpreted or otherwise processed in a suitable manner if necessary, and then stored in a computer memory.

It should be understood that portions of the present invention may be implemented in hardware, software, firmware, or a combination thereof. In the above embodiments, the various steps or methods may be implemented in software or firmware stored in memory and executed by a suitable instruction execution system. For example, if implemented in hardware, as in another embodiment, any one or combination of the following technologies, which are well known in the art, may be used: a discrete logic circuit having a logic gate circuit for implementing a logic function on a data signal, an application specific integrated circuit having an appropriate combinational logic gate circuit, a Programmable Gate Array (PGA), a Field Programmable Gate Array (FPGA), or the like.

In the description herein, references to the description of the term "one embodiment," "some embodiments," "an example," "a specific example," or "some examples," etc., mean that a particular feature, structure, material, or characteristic described in connection with the embodiment or example is included in at least one embodiment or example of the invention. In this specification, the schematic representations of the terms used above do not necessarily refer to the same embodiment or example. Furthermore, the particular features, structures, materials, or characteristics described may be combined in any suitable manner in any one or more embodiments or examples.

While embodiments of the present invention have been shown and described, it will be understood by those of ordinary skill in the art that: various changes, modifications, substitutions and alterations can be made to the embodiments without departing from the principles and spirit of the invention, the scope of which is defined by the claims and their equivalents.

While the preferred embodiments of the present invention have been illustrated and described, it will be understood by those skilled in the art that various changes in form and details may be made therein without departing from the spirit and scope of the invention as defined by the appended claims.

Claims

1. A refreshing method of an electronic ink screen is characterized by comprising the following steps:

responding to the initialization instruction, and acquiring drawn handwriting to a buffer area;

determining an updating area according to the buffer area;

and judging whether the updating area is a handwritten layer or not, and if the updating area is the handwritten layer, sending the updating area to an electronic ink screen for displaying.

2. The method of refreshing an electronic ink screen of claim 1, wherein said responding to an initialization command comprises:

responding to the initialization instruction, and stopping layer composition;

and applying for a buffer area according to the size of the handwriting area, and storing a handle of the buffer area.

3. The method for refreshing an electronic ink screen according to claim 1, wherein said determining whether the updated area is a handwritten layer further comprises:

and if the updating area is a common layer, performing layer composition on the updating area to obtain a target updating layer, and sending the target updating layer to a buffer area.

4. The method for refreshing an electronic ink screen according to claim 3, wherein after the step of performing layer composition on the updated area to obtain a target updated layer and sending the target updated layer to a buffer, the method further comprises:

and acquiring the target updating layer from the buffer area, and sending the target updating layer to an electronic ink screen for displaying.

5. The method for refreshing an electronic ink screen according to claim 1, wherein said determining whether the updated area is a handwritten layer further comprises:

and judging whether the updating area is a conflict area, if so, waiting for the updating of the conflicted pipeline to be finished, and sending the conflict area which is updated to a buffer area, wherein the conflict area is the area in which the handwriting is being updated.

6. The method for refreshing an electronic ink screen according to claim 5, wherein after the conflict area for completing the update is sent to the buffer area after the pipeline waiting to be updated by the conflict is updated, the method further comprises:

and acquiring the updated conflict area from the buffer area, and sending the conflict area to an electronic ink screen for displaying.

7. A refreshing device of an electronic ink screen is characterized by comprising:

the first module is used for responding to the initialization instruction and acquiring the drawn handwriting to a buffer area;

a second module for determining an update region according to the buffer region;

and the third module is used for judging whether the updating area is a handwritten layer or not, and if the updating area is the handwritten layer, sending the updating area to an electronic ink screen for displaying.

8. An electronic device comprising a processor and a memory;

the memory is used for storing programs;

the processor executing the program realizes the method of any one of claims 1 to 6.

9. A computer-readable storage medium, characterized in that the storage medium stores a program, which is executed by a processor to implement the method according to any one of claims 1 to 6.

10. A computer program product comprising a computer program, wherein the computer program when executed by a processor implements the method of any one of claims 1 to 6.