CN117667276A - Page refreshing method and electronic device - Google Patents

Page refreshing method and electronic device Download PDF

Info

Publication number
CN117667276A
CN117667276A CN202211054402.0A CN202211054402A CN117667276A CN 117667276 A CN117667276 A CN 117667276A CN 202211054402 A CN202211054402 A CN 202211054402A CN 117667276 A CN117667276 A CN 117667276A
Authority
CN
China
Prior art keywords
page
refresh
local
refreshing
global
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN202211054402.0A
Other languages
Chinese (zh)
Inventor
夏季
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Huawei Technologies Co Ltd
Original Assignee
Huawei Technologies Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Huawei Technologies Co Ltd filed Critical Huawei Technologies Co Ltd
Priority to CN202211054402.0A priority Critical patent/CN117667276A/en
Publication of CN117667276A publication Critical patent/CN117667276A/en
Pending legal-status Critical Current

Links

Landscapes

  • Control Of Indicators Other Than Cathode Ray Tubes (AREA)

Abstract

The application provides a page refreshing method and electronic equipment, wherein the method comprises the following steps: receiving an operation of a user on a second page, and determining that the operation is local refreshing or global refreshing of the second page; stopping the driving waveform conversion of the global refresh of the second page and performing the driving waveform conversion of the local refresh of the second page when the operation is the local refresh of the second page; and displaying the second page after the local refreshing according to the driving waveform of the global refreshing and the driving waveform of the local refreshing. According to the method, the conversion of the local brushing driving waveform can be directly inserted in the process of converting the global driving waveform of the electronic equipment, so that the conversion of the local brushing driving waveform is not delayed, the corresponding local display content of local operation of a user can be displayed rapidly, the problem of local refreshing delay is solved, the handwriting pen is used as an application scene of local refreshing, the problem of handwriting pen delay is solved, and the user experience is improved.

Description

Page refreshing method and electronic device
Technical Field
The present application relates to the field of display technologies, and in particular, to a method for refreshing a page and an electronic device.
Background
The electronic ink is a flicker-free and self-luminous display technology, and an ink screen developed based on the electronic ink has the obvious advantage of protecting eyes, and electronic equipment such as electronic books, electronic writing boards and electronic labels increasingly use the ink screen.
The ink drops in the ink screen are an electrochemical material, and display content is changed by virtue of movement of black and white ink drops under an electric field. Compared with electronic screens such as a liquid crystal display (liquid crystal display, LCD) or an organic light emitting semiconductor (organic electroluminescence display, OLED), the ink screen has a slower display update speed, and may have the phenomena of smear, delay, jamming, flickering, and the like.
As an important application scenario of the handwriting pen as an ink screen, the experience of using the handwriting pen by a user is poor due to delayed display of the handwriting pen, so how to solve the problem of handwriting pen delay is a urgent need in the field of ink screens at present.
Disclosure of Invention
The application provides a page refreshing method and electronic equipment, when a page needs to be locally refreshed, driving waveform conversion of global page refreshing is paused, waveform conversion of local page refreshing is performed, the problem of local refreshing delay is solved, a handwriting pen is used as an application scene of local refreshing, the problem of handwriting pen delay is solved, and user experience is improved.
In a first aspect, a method of page refreshing is provided, the method being applied to an ink screen device. The execution subject of the method can be an ink screen device or a chip mounted on the ink screen device. The method comprises the following steps: receiving an operation of a user on a second page, and determining that the operation is local refreshing or global refreshing of the second page; stopping the driving waveform conversion of the global refresh of the second page and performing the driving waveform conversion of the local refresh of the second page when the operation is the local refresh of the second page; and displaying the second page after the local refreshing according to the driving waveform of the global refreshing and the driving waveform of the local refreshing.
According to the method provided by the first aspect, the conversion of the local brushing driving waveform can be directly inserted in the process of the conversion of the global driving waveform of the electronic equipment, so that the conversion of the local brushing driving waveform is not delayed, the corresponding local display content of local operation of a user can be rapidly displayed, the problem of local refreshing delay is solved, the handwriting pen is used as an application scene of local refreshing, the problem of handwriting pen delay is solved, and the user experience is improved.
In a possible implementation manner of the first aspect, when the operation is local refresh of the second page, the driving waveform conversion of global refresh of the second page is stopped, and the driving waveform conversion of local refresh of the second page is performed until the time corresponding to the global refresh is ended. In the implementation mode, the local refreshing of the second page is executed while the global refreshing of the second page is carried out, the local refreshing of the page is realized while the global refreshing is realized, and further, the local display content corresponding to the local operation of the user can be rapidly displayed, and the user experience is improved.
It should be understood that the time corresponding to the global refresh refers to switching from the first page to the second page and displaying the second page entirely on the display screen. Illustratively, when the first page is switched to the second page and the second page is completely displayed, the refresh is required to be performed for 14 frames, that is, the global refresh corresponds to 14 frames, it should be understood that the second page may be displayed when the refresh time of the first page is switched to the second page is less than 14 frames, but the sharpness or color saturation of the second page displayed at this time may be lower than the second page displayed when the 14 frames are completely refreshed.
In a possible implementation manner of the first aspect, when the operation is a local refresh of the second page, the driving waveform conversion of the global refresh of the second page is stopped, and the driving waveform conversion of the local refresh of the second page is performed until the time corresponding to the local refresh is ended. In the implementation manner, when the electronic device needs to perform local refreshing on the second page, the global refreshing driving waveform conversion of the second page is stopped, the local display content corresponding to the local operation of the user can be ensured to be displayed quickly by performing the local refreshing driving waveform conversion of the second page, the time from the local refreshing driving waveform conversion of the second page to the local refreshing is ended, and the page display quality after the local refreshing can be ensured.
In a possible implementation manner of the first aspect, determining that the operation is a local refresh or a global refresh of the second page includes: acquiring a GraphicBuffer of the refreshed second page; judging whether the operation is local refreshing or global refreshing of the second page according to the GraphiBuffer of the second page after refreshing.
The electronic device may determine that the operation is a local refresh or a global refresh of the second page by determining whether the graphics buffer of the second page includes coordinates corresponding to the local area. For example, when the GraphicBuffer of the second page includes coordinates corresponding to the local area, it indicates that the operation is a local refresh of the second page. And when the GraphicBuffer of the second page comprises coordinates corresponding to the global refreshing, the operation is the local refreshing of the second page.
In one possible implementation manner of the first aspect, the ink screen device includes a surfacefringer main thread, where the surfacefringer main thread includes an electronic ink driving waveform (einkwaveform) sub-thread, and when the second page needs to be locally refreshed, the einkwaveform sub-thread stops the global refresh driving waveform conversion, and performs the local refresh driving waveform conversion. In the implementation mode, the einkwaveform sub-thread is arranged in the surfaceflinger main thread, and the einkwaveform sub-thread is used for driving waveform conversion, which is equivalent to the use of multithreading to realize the display of the page, so that the display efficiency of the page is improved.
In a possible implementation manner of the first aspect, the method further includes: the surface executor main thread determines a gray level image of the refreshed second page according to the refreshed GraphicBuffer of the second page; and the einkwave form sub-thread carries out conversion of the locally refreshed driving waveform according to the refreshed gray level image of the second page.
In a possible implementation manner of the first aspect, the determining, by the surface dominant thread, the gray image of the refreshed second page according to the refreshed GraphicBuffer of the second page includes: synthesizing a display layer of the refreshed second page by the surface active device main thread according to the refreshed GraphicBuffer of the second page; the surfaceflinger main thread converts the display layer of the refreshed second page into a gray level image of the refreshed second page.
In a possible implementation manner of the first aspect, before receiving the operation of the user on the second page, the method further includes: when the first page needs to be globally refreshed to the second page, judging whether the time corresponding to the global refreshing of the first page is ended or not; when the time corresponding to the global refreshing of the first page is over, determining a driving waveform of the second page according to the GraphicBuffer of the second page; and displaying the second page according to the driving waveform of the second page.
In one possible implementation manner of the first aspect, the ink screen device includes a surfacefringer main thread, where the surfacefringer main thread includes an einkwaveform sub-thread, and when a time corresponding to global refreshing of the first page ends, the einkwaveform sub-thread determines a driving waveform of the second page according to a GraphicBuffer of the second page. In the implementation mode, the einkwaveform sub-thread is arranged in the surfaceflinger main thread, and the einkwaveform sub-thread is used for driving waveform conversion, which is equivalent to the use of multithreading to realize the display of the page, so that the display efficiency of the page is improved.
In a possible implementation manner of the first aspect, the determining, by the einkwaveform sub-thread, a driving waveform of the second page according to a GraphicBuffer of the second page includes: the surfaceflinger main thread determines a gray image of the second page according to the GraphiBuffer of the second page; the einkwaveform sub-thread determines a driving waveform of the second page according to the gray level image of the second page.
In a possible implementation manner of the first aspect, the determining, by the surfaceflinger main thread, the gray image of the second page according to the GraphicBuffer of the second page includes: synthesizing a display layer of the second page by the surfaceflinger main thread according to the GraphicBuffer of the second page; the surfaceflinger main thread converts the display layer of the second page into a gray scale image of the second page.
In a second aspect, a communication device is provided, comprising means for performing the steps of the above first aspect or any of the possible implementations of the first aspect.
In a third aspect, a communication device is provided, the communication device comprising at least one processor and a memory, the processor and the memory being coupled, the memory storing program instructions which, when executed by the processor, perform the method of the first aspect above or any of the possible implementation forms of the first aspect.
In a fourth aspect, a communication device is provided, the communication device comprising at least one processor and interface circuitry, the at least one processor being configured to perform the method of the above first aspect or any of the possible implementation forms of the first aspect.
In a fifth aspect, there is provided an ink screen apparatus comprising the communication device provided in the third aspect, or the terminal apparatus comprising the communication device provided in the fourth aspect.
In a sixth aspect, a computer program product is provided, comprising a computer program for performing the method of the first aspect above or any of the possible implementation forms of the first aspect when executed by a processor.
In a seventh aspect, a computer readable storage medium is provided, in which a computer program is stored which, when executed, is adapted to carry out the above method of the first aspect or any of the possible implementation manners of the first aspect.
In an eighth aspect, there is provided a chip comprising: a processor for calling and running a computer program from a memory, causing a communication device on which the chip is mounted to perform a method for performing the above first aspect or any of the possible implementation forms of the first aspect.
Drawings
Fig. 1 illustrates an exemplary scenario for application provided in an embodiment of the present application;
FIG. 2 is a schematic diagram of an ink screen according to an embodiment of the present disclosure;
FIG. 3 illustrates a schematic diagram of a control waveform provided by an embodiment of the present application;
FIG. 4 shows a software architecture diagram of an electronic device provided in an embodiment of the present application;
FIG. 5 is a schematic diagram illustrating an example of a related art ink screen device according to an embodiment of the present disclosure;
FIG. 6 shows a schematic flow chart of page refreshing in the related art provided by the embodiments of the present application;
FIG. 7 is a schematic diagram of page refreshing in another related art according to an embodiment of the present application;
FIG. 8 shows a software architecture block diagram of an electronic device of an embodiment of the present application;
FIG. 9 shows a schematic flow chart of a page refreshing method of an ink screen according to an embodiment of the present application;
fig. 10 shows an interface schematic diagram of a page refreshing manner provided in an embodiment of the present application;
FIG. 11 is a schematic diagram illustrating an example of driving waveform conversion according to an embodiment of the present application;
FIG. 12 shows a schematic flow chart diagram of another example page refresh method provided by embodiments of the present application;
FIG. 13 is a schematic diagram of another example of driving waveform transitions provided by embodiments of the present application;
FIG. 14 shows a schematic flow chart of a method of global refresh provided by an embodiment of the present application;
FIG. 15 is a schematic flow chart diagram of another example of a page refreshing method according to an embodiment of the present application;
FIG. 16 is a schematic diagram of an electronic device structure provided herein;
fig. 17 shows a schematic block diagram of a communication apparatus 1700 provided by an embodiment of the present application;
FIG. 18 is a schematic block diagram of a communication device 1800 of an embodiment of the present application;
fig. 19 shows a schematic diagram of a chip system according to an embodiment of the present application.
Detailed Description
The technical solutions in the embodiments of the present application will be clearly and completely described below with reference to the drawings in the embodiments of the present application.
The terminology used in the following embodiments is for the purpose of describing particular embodiments only and is not intended to be limiting of the application. As used in the specification and the appended claims, the singular forms "a," "an," "the," and "the" are intended to include, for example, "one or more" such forms of expression, unless the context clearly indicates to the contrary. It should also be understood that in embodiments of the present application, "one or more" refers to one or more than two (including two); "and/or", describes an association relationship of the association object, indicating that three relationships may exist; for example, a and/or B may represent: a alone, a and B together, and B alone, wherein A, B may be singular or plural. The character "/" generally indicates that the context-dependent object is an "or" relationship.
Reference in the specification to "one embodiment" or "some embodiments" or the like means that a particular feature, structure, or characteristic described in connection with the embodiment is included in one or more embodiments of the application. Thus, appearances of the phrases "in one embodiment," "in some embodiments," "in other embodiments," and the like in the specification are not necessarily all referring to the same embodiment, but mean "one or more but not all embodiments" unless expressly specified otherwise. The terms "comprising," "including," "having," and variations thereof mean "including but not limited to," unless expressly specified otherwise.
The plurality of the embodiments of the present application refers to greater than or equal to two. It should be noted that, in the description of the embodiments of the present application, the terms "first," "second," and the like are used for distinguishing between the descriptions and not necessarily for indicating or implying a relative importance, or alternatively, for indicating or implying a sequential order.
The page refreshing method of the ink screen is applied to the electronic equipment with the ink screen, and in the following description, if no special description exists, the electronic equipment is the electronic equipment with the ink screen. Exemplary, fig. 1 shows an exemplary scenario for application provided in the embodiment of the present application. As shown in fig. 1 (a), the electronic device 100 has an ink screen 101. Ink screen 101 may display pages of an Application (APP) installed in electronic device 100. Specifically, the ink screen 101 displays a display page 102 (page 1) and a display page 103 (page 2) of the APP. It should be appreciated that each APP contains multiple display pages, and when a user turns pages on the basis of display page 102, electronic device 100 jumps from display page 102 to display page 103, and the jump from display page 102 to display page 103 requires a global refresh of the electronic device.
As shown in fig. 1 (b), when the user performs a local operation on the display page 103, the electronic device may perform a local refresh on the display interface to display a page (page 104) after the local refresh on the display page 103. Illustratively, when the APP is of the reading type, after the user reads page 1 (page 102), the user turns page 2 (page 103), and when the user wants to make a note on page 2 (page 103), the user can edit on page 2 (page 103) in the form of a stylus or touch screen, and after the electronic device performs local refresh, the user can see the display page 104.
First, the concept of the ink screen mentioned in the embodiment of the present application will be specifically explained.
Exemplary, fig. 2 shows a schematic structural diagram of an ink screen according to an embodiment of the present application. Fig. 2 may be a plane view of the ink screen 101 in the AA' direction in fig. 1 (a) or fig. 1 (b). As shown in fig. 2, the ink screen includes a large number of ink droplets 13 therein. The ink droplets 13 are also called microcapsules (microcapsules) which have a size of about the size of the diameter of human hair. The ink droplet 13 contains a clear liquid, white particles 15 and black particles 16 suspended in the clear liquid, the white particles 15 having a positive charge, and the black particles 16 having a negative charge. The ink screen further comprises a top transparent electrode 11 and a bottom electrode 12 for applying an electric field to control the movement of white particles 15 and black particles 16 in the ink droplets 13.
For example, as shown in the ink droplet 13 on the left side in fig. 2, the electric field is set positive, the positive voltage is applied to the bottom electrode 12, the white particles 15 in the ink droplet 13 move toward the top of the ink droplet, i.e., toward the screen upward, so that the ink screen appears white to the user, and at the same time, the black particles 16 in the ink droplet 13 are pulled to the bottom of the ink droplet, thereby hiding.
For example, as shown in the ink droplet 13 on the right side in fig. 2, the electric field is set negative, the bottom electrode 12 applies a negative voltage, the black particles 16 in the ink droplet 13 move toward the top of the ink droplet, i.e., toward the screen upward, so that the ink screen appears black to the user, and at the same time, the white particles 15 in the ink droplet 13 are pulled to the bottom of the ink droplet, so as to be hidden.
It can be seen that the movement of white and black particles in the ink droplets can be controlled by the electric field applied by the top transparent electrode 11 and the bottom electrode 12, so that the ink screen can display color and display picture content. Wherein the colors include white, black, and gray levels (also referred to as gray levels) between white and black. The number of gray scales is not limited in the embodiment of the present application, for example, 2 gray scales, 16 gray scales, 32 gray scales, and the like.
The control chip of the ink screen may receive the control waveforms and apply an electric field to the top transparent electrode 11 and the bottom electrode 12 according to the control waveforms. Fig. 3 is a schematic diagram of a control waveform according to an embodiment of the present application. As shown in fig. 3, the control waveform has different voltage values at different time points, and the voltage values may be positive, negative or 0. The control waveform has a refresh frequency, which is also the frequency of refreshing the screen of the ink screen. The higher the refresh rate, the faster the picture refresh rate at the time of ink screen display, and conversely, the lower the refresh rate, the slower the picture refresh rate at the time of ink screen display.
Based on the display principle of the ink screen, the ink screen has the obvious advantages of low power consumption and eye protection. However, ink screens are typically slower to refresh when displayed, and the displayed color level is typically limited. When the ink screen displays animation, video and other contents, the situations of smear, jamming, flickering and the like may occur. The smear is also called afterimage, which is an afterimage on a display, and it can be understood that when the display switches the pictures, the previous picture does not disappear immediately, and the phenomenon that the previous picture and the next picture appear simultaneously and the previous picture disappear slowly appears on the visual effect.
To cope with different display scenes, the ink screen has a plurality of refresh modes. In different refresh modes, the control waveforms are different, for example, the frequency of the control waveforms is different and/or the voltage amplitude of the control waveforms is different, so that the requirements of different application scenes are met, and different display effects are provided.
Illustratively, the plurality of refresh modes includes: INIT (initial mode), DU (direct update), GC16 (gray level clear), GL16, GLR16, GLD16, and A2. The parameters for each refresh mode include: gray scale and refresh frequency.
The INIT mode is used to completely erase the display screen and keep it in a white state. It is suitable for display refresh in the case where the display information in the memory is not an indeterminate state of the optical element, e.g. a state after the device has been fully powered down after receiving power. This waveform will switch the display multiple times and place it in a white state.
A DU is a very fast, non-flashing update. For the DU refresh mode, there is 2 gray levels. This mode supports switching from any gray level to either black or white. It cannot be used for updating to any grey color other than black or white. The mode has fast updating time, and can be used for monochromatic menus, mouse pointers, text input, touch screen input, touch pen input, handwriting pen input, quick page turning, jump-out window, item selection (for example, word size selection), highlight marks and the like, little or no ghost shadow is generated, and the picture has no flicker.
The GC16 mode is used to update the full display and provide high image quality. The GC16 mode has 16 individual gray levels. When the GC16 is used with a full display update, the entire display will be updated as new images are written. If a "partial update" command is used, only pixels whose gray values change will be updated. Is generally used for displaying high-quality images, fine characters and the like, has little or no afterimage, and can provide a better picture display effect.
The GL16 waveform is mainly used to update sparse content on a white background, such as anti-aliasing, to reduce sparkle. The GL16 waveform has 16 unique gray levels.
The GLR16 refresh mode is generally used for displaying text, graphics, etc. in a white background, with little or no afterimage, and with little flicker during screen conversion.
The A2 mode is a fast, non-flashing update mode that can be used for fast page turning or simple black/white mode animation. For the A2 refresh mode, there is 2 gray levels, which only supports transitions from sum to black or white (meaning only black to white or white to black). It cannot be used for updating to any grey color other than black or white. Refresh is fast but contrast is poor, and is typically used for displays requiring fast refresh of scenes, such as fast page turning, video playing, animation, etc.
It should be noted that the above-mentioned refresh mode is only an example, and is not limited to the refresh mode, parameters of the refresh mode, application scenario, and display effect.
In order to facilitate understanding of the processing flow of display data of the electronic device, a general software architecture involved in displaying the electronic device is described. The software system of the electronic device may employ a layered architecture, an event driven architecture, a microkernel architecture, a microservice architecture, a cloud architecture, and the like. The embodiment of the application is described by taking a layered architecture as an example of electronic equipment. The layered architecture divides the software into a plurality of layers, each layer has clear roles and division, and the layers are communicated through software interfaces.
Fig. 4 is a schematic diagram of a software architecture of an electronic device according to an embodiment of the present application. As shown in fig. 4, the software architecture includes, from top to bottom, an Application (Application) layer, a framework (framework) layer, a Native Services layer, and a kernel layer.
The application layer, also referred to as the application layer, includes the APP provided by the system to the user, as shown in fig. 4, the application may be identified as APP 1-APP N, where N is a positive integer. Applications may include, but are not limited to: gallery, calendar, map, navigation, bluetooth, music, video, short message, etc.; the applications may also include third party applications such as: weChat reading, weChat, taobao, etc. APP 1-APP N can generate data to be displayed, and the electronic equipment processes the data to be displayed and then displays the data on the display screen. In this embodiment of the present application, the display screen is an ink screen.
The framework layer is also referred to as a framework service layer, and is used to provide application programming interfaces (application programming interface, APIs) and programming frameworks to application programs of the application layer. The framework layer may include some predefined functions, such as a layout subsystem and a rendering subsystem. The layout subsystem is used for realizing a layout flow, and the drawing subsystem is used for realizing a drawing flow.
The local service layer is used to provide the system level implementation required by the framework layer, such as graphics caching, database storage, etc. The local service layer may include a display composition subsystem for implementing a graph composition flow. For example, layers may be synthesized using an interface synthesis system (surfeflinger).
The kernel layer, also called the device driver layer, is the layer between hardware and software. The device driver layer includes at least display (display) drivers. In an embodiment of the present application, a waveform (waveform) module is further included for generating a control waveform. The control chip of the ink screen can apply an electric field according to the control waveform, so that the ink screen displays.
The electronic equipment processes the data to be displayed generated by the application program according to the display pipeline, and presents a display interface to the user. The display pipeline mainly comprises a layout flow, a drawing flow and a surfacefeldger synthesis flow. The layout process obtains the data to be displayed of at least one application program, and lays out the data to be displayed of each application program. And the drawing flow draws the content according to the layout corresponding to the data to be displayed of each application program, and generates a layer. And the surface eflinger synthesis flow synthesizes and displays a plurality of layers generated by the drawing flow, namely, the synthesized data is pushed to a display screen.
Next, an implementation of the page refresh mode of the ink screen in the related art will be described with reference to the scenario shown in fig. 1.
Fig. 5 is a schematic diagram showing an example of a structure of an ink screen apparatus in the related art, as shown in fig. 5, the ink screen apparatus including: a system on chip SOC, a timer control register Tcon, an electronic paper controller EPDC and an ink screen EPD. The main control devices such as a CPU and the like are integrated on the SOC and are main chips of the ink screen device; the Tcon is used for looking up a table according to the gray level image output by the SOC to obtain a driving waveform corresponding to the pixel. The SOC and the Tcon are electrically connected through an interface of a mobile industry processor (mobile industry processor interface, MIPI), and a grayscale image output from the SOC is transmitted to the Tcon. The EPDC is used for driving the ink particles in the EPD to move according to the driving waveform detected by the Tcon to realize imaging. However, when local refresh data is generated on a page, EPDC also needs to process the local refresh driving waveform after processing the global refresh driving waveform.
Optionally, the ink screen device further has an electromagnetic board, the electromagnetic board provides an electromagnetic handwriting function, a user can write any note content on the devices by using a handwriting pen, the electromagnetic board receives the induction data of the note, and finally the induction data can be processed to display the note content in the ink screen device, so that the user can conveniently mark in the reading process.
Fig. 6 shows a schematic flow chart of page refresh in the related art. As shown in fig. 6, when a user triggers a page turning operation, the electronic device performs global page refreshing, jumps from page 1 to page 2, performs synthesis of a layer corresponding to page 2 in a surface file, and then sends the synthesized layer to Tcon through an MIPI interface. The Tcon first performs gray processing on the image output in the surfacer, that is, converts the color image synthesized by the surfacer into a gray image. For example: the gray image can be obtained according to the gray value of each pixel point. And then, the Tcon looks up a table according to the gray image to acquire a driving waveform corresponding to the pixel position on the ink screen, and finally, the electronic equipment drives ink particles in the ink screen to move according to the driving waveform searched by the Tcon to realize imaging.
However, when the Tcon is still processing the globally refreshed data sent by the MIPI interface, the user triggers local refresh, and then the electronic device sends the image frame corresponding to the local brush (the position and the coordinate generated by drawing the handwriting pen) to the Tcon by using a universal serial bus interface (serial peripheral interface, SPI) channel, the Tcon firstly performs gray level conversion according to the local image frame to generate a gray level image, and then the Tcon obtains a driving waveform corresponding to the pixel according to the gray level image table lookup, and then the electronic device drives the ink particles in the ink screen to move according to the driving waveform searched by the Tcon to realize imaging.
Note that if the Tcon is processing the globally refreshed data sent by the MIPI interface, the data sent to the Tcon by the SPI needs to wait for a period of time before the Tcon can be processed, which eventually results in delay of the locally refreshed data displayed on the ink screen, and thus delay of the stylus pen. Illustratively, processing the data sent by the SPI requires waiting 500ms.
Fig. 7 shows another page refresh schematic in the related art. As shown in fig. 7, when a user triggers a page turning operation, the electronic device performs global refresh, and in the process of skipping from the page 1 to the page 2, a surface pointer in the electronic device first synthesizes a layer corresponding to the page 2, and then calculates a refresh area of the page 2 relative to the page 1. It should be appreciated that when the electronic device requires a global refresh, the refresh area is a global refresh area. And then, transmitting the calculated refreshing region to a hardware graphics renderer (hardware composer, HWC) by the surfacer, carrying out gray image transformation on the refreshing region by the HWC, and driving ink particles in an ink screen to move through an MIPI interface to realize imaging after obtaining a driving waveform corresponding to the pixel according to the gray image table lookup.
At the same time as the global refresh, the user triggers a local refresh, i.e. after the user performs a local operation on page 2, the electronic device performs the local refresh based on the user operation. In the process of jumping the page 103 to the page 104, a surface filter in the electronic device synthesizes a layer corresponding to the page 2 after partial refreshing, then calculates a refreshing area of the page 2 after partial refreshing relative to the page 2 before refreshing, finally, the surface filter transmits the partial refreshing area to the HWC, the HWC carries out gray image transformation on the refreshing area, and after a driving waveform corresponding to a pixel is obtained according to a gray image table lookup, ink particles in an ink screen are driven to move through an MIPI interface to realize imaging.
In this implementation manner, the global refresh and the local refresh are both performed by the HWC to perform gray image conversion first, and then the corresponding driving waveforms are searched according to the gray image, so when the global refresh is not completed yet, the local refresh needs to wait for the HWC to process the data of the global refresh when the local refresh is performed to refresh the data of the area, and therefore, the local refresh needs to wait, and finally, the handwriting pen is delayed. In addition, the chips corresponding to each APP are different, the HWC wants to finish page refreshing of a plurality of APP, and a plurality of different chips are required to be equipped, so that the cost is high and the resource is wasted finally.
In summary, whether the page refreshing method shown in fig. 6 or the page refreshing method shown in fig. 7 is adopted, the user needs to wait for the global refreshing to finish when the local refreshing is performed, and the handwriting pen scene is used as an important application scene of the local refreshing, and the handwriting pen is delayed due to the delay of the local refreshing, so that the user experience is poor. How to solve the response speed of the stylus pen is a problem in the field of ink screens.
In view of this, the present application provides a method for refreshing a page, in which global refresh and local refresh are performed simultaneously by inserting local refresh driving waveform conversion in the global refresh driving waveform conversion process, so as to solve the problem of local refresh delay caused by that the local refresh is performed only after the global refresh is completed in the related art, further improve the response rate of the local refresh, shorten the display time of the local refresh area, and improve the user experience.
The embodiment of the application does not limit the type, the model and the shape of the electronic equipment. Examples of some electronic devices are, for example: a wireless terminal in a cell phone, tablet, palm top, electronic book, electronic tablet, electronic sign, wearable device, smart screen, teaching device, internet of things (internet of things, IOT) device, or smart home (smart home), etc.
The page refreshing method provided by the embodiment of the application can be applied to the application scene shown in fig. 1, and can of course also be applied to other scenes, and the embodiment of the application is not limited.
Next, a software architecture of an electronic device implementing the page refreshing method provided in the embodiment of the present application is described.
The software of the electronic device 100 may employ a layered architecture, an event driven architecture, a microkernel architecture, a microservice architecture, or a cloud architecture. In this embodiment, taking an Android system with a layered architecture as an example, a software structure of the electronic device 100 is illustrated.
Fig. 8 is a software configuration block diagram of an electronic device according to an embodiment of the present application. The layered architecture divides the software into several layers, each with distinct roles and branches. The layers communicate with each other through a software interface. In some embodiments, the Android system is divided into five layers, and as shown in fig. 8, the software architecture of the electronic device includes an application layer, a framework layer, a local service layer, a hardware abstraction layer and a kernel layer from top to bottom. The application layer, the framework layer, the local service layer, and the kernel layer may refer to the relevant descriptions in fig. 3, and are not described herein.
In this embodiment of the present application, the Surfaceflinger main thread in the local service layer is used to provide an image synthesis service, for example, to synthesize a layer after global refresh, or output a layer after local refresh. The Surfaceflinger main thread is also used to convert the synthesized color layer into a grayscale layer and output the grayscale layer to the HWC.
The surface active main thread in the local service layer comprises an electronic ink driving waveform (einkwave form) sub-thread which is mainly used for converting the gray level image into the driving waveform.
Specifically, when the einkwaveform sub-thread receives a locally refreshed waveform frame conversion task, the einkwaveform sub-thread may begin executing the locally refreshed waveform frame conversion while suspending the globally refreshed waveform conversion, and the locally refreshed waveform frame conversion times are the remaining globally refreshed waveform conversion times.
Alternatively, when the einkwaveform sub-thread receives a locally refreshed waveform frame conversion task, the einkwaveform sub-thread may begin executing the locally refreshed waveform frame conversion while suspending the globally refreshed waveform conversion, and the locally refreshed waveform frame conversion number is the number of times the entire page is refreshed.
A hardware abstraction layer (hardware abstract layer, HAL) is used to abstract the hardware. For example, the hardware abstraction layer may include an audio hardware abstraction layer, a bluetooth hardware abstraction layer, a camera hardware abstraction layer, a hardware renderer (hardware composer, HWC) abstraction layer, and other hardware device abstraction layers; the hardware renderer abstract layer can be connected with a hardware renderer algorithm library, and after graphic data are displayed on the device screen, the hardware renderer abstract layer can call algorithms in the hardware renderer algorithm library to render, and the hardware renderer is the core of all Android graphic rendering. The HWC in the hardware abstraction layer is also used to transfer the synthesized drive waveforms to the underlying drive.
The display driver in the kernel layer is used for driving ink particles in the ink screen to move according to the driving waveform to realize imaging.
Fig. 9 shows a schematic flowchart of an example page refreshing method provided in an embodiment of the present application. The page refreshing method provided by the embodiment of the application can be applied to the electronic equipment with the ink screen. As shown in fig. 9, the method 900 may include steps S910-S930:
s910, in response to user operation, the electronic device judges whether the current page needs local refreshing or global refreshing.
In the embodiment of the application, based on the operation of the user, the electronic device determines whether to perform the page skip on the current page or perform the local operation on the current page. It should be understood that the page skip corresponds to the electronic device performing a global refresh on the basis of the current page, and the local operation on the basis of the current page corresponds to the electronic device performing a local refresh on the basis of the current page.
Exemplary, fig. 10 shows an interface schematic diagram of a page refresh mode provided in an embodiment of the present application. If the current page is the second page, based on user operation, two possibilities exist on the basis of the second page, one possibility is based on page turning operation of the user, and the electronic equipment jumps to the third page after performing global refreshing on the basis of the second page; another is to display an update of the local area on the second page after the electronic device performs the local refresh on the basis of the second page, based on a local operation of the user, for example, the local operation may be taking notes, graffiti, etc. on the second page. Of course, the local operation may also be other manners, and the embodiments of the present application do not limit the manner of the local operation.
In some embodiments, the electronic device may obtain the operation signal by sensing movement of the handwriting pen through the electromagnetic plate, and then determine whether the user operation is a page skip or a local operation based on the page according to the operation signal.
For example, during the process of executing the handwriting operation by the user, the electromagnetic board monitors the handwriting report data generated by the handwriting operation, and generates new real-time report data in real time along with the handwriting operation by the user, and then the electromagnetic board detects the new real-time generated handwriting report data. The handwriting point data includes at least data reflecting tactile pressure, a position of the handwriting point, a dwell time of the handwriting point, and/or a thickness of the handwriting line, so as to determine handwriting content written by the handwriting operation. If the handwriting report data output by the electromagnetic plate is monitored, and the user is indicated to use the handwriting pen to execute handwriting operation, the user is in a handwriting use scene (local refreshing) corresponding to the update of the local area displayed on the basis of the second page in fig. 10. Otherwise, if a longer time has elapsed since the last time handwriting report point data was detected, it is considered that the global refresh is performed on the basis of the second page in fig. 9 corresponding to the non-handwriting use scene (global refresh).
In other embodiments, the electronic device may further determine whether the user operation is a page skip or a local operation based on the page according to the acquired graphic buffer.
It should be understood that, according to the drawing principle of the graphics system, whether the system is a built-in application or a third party application, a piece of graphics buffer is required to be applied from the BufferQueue for drawing the content of the application. Therefore, in the embodiment of the present application, the electronic device may determine, according to the GraphicBuffer obtained from the BufferQueue, whether the electronic device corresponding to the user operation needs global refresh or local refresh.
For example, based on user operation, if the GraphicBuffer acquired by the electronic device includes coordinates of a local area, the electronic device may determine that local refresh is needed on the basis of the current page. If the electronic device obtains the coordinates of the local area in the GraphicBuffer, the electronic device can determine that global refreshing is needed on the basis of the current page. Therefore, the electronic device can determine whether the electronic device performs global refreshing or local refreshing on the basis of the current page through the GraphicBuffer generated by user operation.
Illustratively, when the user's operation is to flip from the second page to the third page as shown in fig. 10, there is no coordinates of the local area in the GraphicBuffer; when the user's operation is as shown in fig. 10, the update contents are displayed in the local area on the second page, and there are coordinates of the local area in the GraphicBuffer. For example, the coordinates of the partial region may be coordinates where "notes" are located on the second page shown in fig. 10.
S920, when the current page needs local refreshing, stopping the driving waveform conversion of global refreshing, and converting the driving waveform of the local refreshing to the time corresponding to the global refreshing.
In the embodiment of the application, in order not to affect the waveform conversion of the local refresh, when receiving the waveform frame of the driving waveform conversion of the local refresh in the process of performing the driving waveform conversion of the global refresh, the electronic device can stop the waveform conversion of the global refresh and directly perform the waveform conversion of the local refresh, so as to reduce the display time of the local refresh area, thereby improving the efficiency of the local refresh of the electronic device.
It should be noted that, the time corresponding to the global refresh refers to switching from the first page to the second page, and the second page is completely displayed on the display screen. Illustratively, when the first page is switched to the second page and the second page is completely displayed, the refresh is required to be performed for 14 frames, that is, the global refresh corresponds to 14 frames, it should be understood that the second page may be displayed when the refresh time of the first page is switched to the second page is less than 14 frames, but the sharpness or color saturation of the second page displayed at this time may be lower than the second page displayed when the 14 frames are completely refreshed.
It should be understood that the Surfaceflinger may synthesize the GraphicBuffer after drawing the image data into the final image content, and display the final image content as the display information of the current page.
Therefore, in the embodiment of the present application, when the current page is locally refreshed, the electronic device sends the graphics buffer acquired in the BufferQueue to the Surfaceflinger in the electronic device, and then the Surfaceflinger synthesizes the layer of the locally refreshed current page according to the drawn graphics buffer. If the current page is the second page in fig. 10, the Surfaceflinger synthesizes the layer of the second page after the partial refresh according to the drawn GraphicBuffer.
Specifically, in the embodiment of the present application, the surface eflinger includes an app interface, where the app interface is configured to receive a drawn layer, for example, the app interface may receive a graphics buffer, and assuming that the frame rate is 1s/60 frames, the app interface receives a frame of the drawn layer every 16.67 ms; included in the surfeflinger is an appsf interface for synthesizing the received layers, for example, at a frame rate of 1s/60 frames, then appsf synthesizes the received layers once every 16.67 ms.
Based on the display principle of the ink screen, the electronic equipment also needs to perform graying treatment on the color image layer synthesized by the surface energy to obtain a gray image of the second page after local refreshing.
In one possible implementation, a Surfaceflinger in an electronic device may convert a color layer to a grayscale layer. Specifically, the surfacefelder may look up a table according to the gray value of each pixel point on the gray image to obtain a driving waveform corresponding to the pixel position on the ink screen. It should be appreciated that the transition of the drive waveform is also referred to as a transition of the waveform frame.
In this embodiment of the present application, after the electronic device obtains the gray image corresponding to the refreshed second page, the electronic device further needs to search and display the refreshed second page driving waveform according to the gray image, so as to complete final display.
Optionally, as a possible implementation manner, the einkwaveform sub-thread in the surfaefeldger main thread on the electronic device performs the conversion of the driving waveform.
Optionally, the surface Tcon interface may be further included in the surface active device, where the surface active device is used to find whether the conversion task of the locally refreshed waveform frame is sent, for example, the frame rate is 1s/60 frames, and the surface Tcon interface is found every 16 ms.
Optionally, the electronic device may also register a callback (callback) function in the einkwaveform sub-thread, where the callback function is used to receive a conversion task of a waveform frame in the create Tcon interface, and similarly, the callback function may also be received every 16 ms.
Therefore, when the einkwaveform sub-thread receives the transform task of the waveform frame, the waveform frame needs to be transformed. However, in general, when the einkwaveform sub-thread needs to convert a locally brushed waveform frame, the conversion of the fully brushed waveform frame by the einkwaveform sub-thread is not completed. In other words, when the electronic device needs to perform local area refresh of the second page, global refresh of the first page to the second page is ongoing. When the electronic device sends the gray image corresponding to the second page which is locally refreshed to the einkwaveform sub-thread, the einkwaveform sub-thread on the electronic device is converting the gray image which is globally refreshed from the first page to the second page into a driving waveform.
In this embodiment of the present application, the electronic device may stop the conversion of the globally refreshed waveform frame and directly perform the conversion of the locally refreshed waveform frame. It should be appreciated that a locally refreshed wave form frame is converted to continue conversion corresponding to a wave form frame of the global region, whereas a wave form frame of the local region is converted to begin conversion at the time of conversion of the locally refreshed wave form frame. In other words, the conversion of the locally refreshed wave form frame corresponds to the conversion of the wave form frame in which the global refresh is also performed.
For ease of understanding, further description is provided in connection with fig. 10 and 11. Fig. 11 is a schematic diagram illustrating an example of driving waveform conversion provided in the embodiment of the present application, as shown in fig. 11, when a surface active main thread in an electronic device sends a gray image corresponding to a locally refreshed second page to a einkwave form sub-thread, the einkwave form sub-thread on the electronic device performs conversion from a gray image of a first page to a gray image of a second page to a driving waveform. In other words, when a full-brush wave form frame needs to be converted, the full-brush wave form frame is being converted. Also, as can be seen from fig. 11, when a partially brushed wave form frame needs to be converted, the full brushed wave form frame has completed conversion of 8 frames.
It should be appreciated that in this example, a waveform frame complete 14 frame transition indicates that the waveform transition from the first page to the second page full brush is complete. Then, when the einkwaveform sub-thread receives the waveform frame to be converted of the local brush, the full-brush waveform frame does not complete conversion, but the full-brush waveform frame does not wait for the conversion of the full-brush waveform frame to complete and then performs conversion, but performs conversion of the full-brush waveform frame directly after the 8 th frame of the full brush. I.e., beginning at frame 9, the transition of the office swipe frame is initiated. Corresponding to the 1 st to 6 th frames of the partial brush being completed at the same time as the 9 th to 14 th frames of the full brush are completed.
In the implementation manner, the conversion of the drive waveform of the local brush can be directly inserted in the process of converting the overall drive waveform of the electronic equipment, so that the conversion of the drive waveform of the local brush is not influenced, the local display content corresponding to the local operation of the user can be rapidly displayed, and the user experience is improved.
And S930, the electronic equipment displays the page after the local refreshing according to the driving waveform of the global refreshing and the driving waveform of the local refreshing.
In the embodiment of the present application, the driving waveform of the page after the partial refresh may be generated based on the switching manner of the driving waveform in step S920.
And the electronic equipment drives ink particles in the ink screen to move based on the driving waveform to realize imaging, namely, finally, the page after the partial refreshing is displayed on the display interface.
According to the method provided by the embodiment of the application, the conversion of the drive waveform of the local brush can be directly inserted in the process of converting the drive waveform of the global drive waveform of the electronic equipment, so that the conversion of the drive waveform of the local brush is not delayed, the local display content corresponding to the local operation of the user can be displayed rapidly, and the user experience is improved. However, because the method of refreshing a page provided by the method 900 does not pass through a complete refresh cycle, the display effect of the page after the partial refresh displayed by the method 900 is not very good. Therefore, the embodiment of the application provides another page refreshing method, which ensures the efficiency of local refreshing and simultaneously ensures that the local refreshing can pass through a complete refreshing period.
Another method for refreshing a page according to the embodiment of the present application shown in fig. 12 is specifically described below. Fig. 12 shows a schematic flowchart of another example of a method for page refresh according to an embodiment of the present application, and the method 1200 mainly includes steps S1210-S1230.
S1210, responding to user operation, and judging whether the current page needs local refreshing or global refreshing by the electronic equipment.
Step S1210 may refer to the description of step S910, and will not be described herein.
S1220, when the current page needs local refreshing, stopping the driving waveform conversion of global refreshing, and ending the driving waveform conversion of executing local refreshing until the time corresponding to the local refreshing.
In the embodiment of the present application, when the einkwaveform sub-thread receives the task of converting the waveform frame, the waveform frame needs to be converted. However, in general, when the einkwaveform sub-thread needs to convert a locally brushed waveform frame, the conversion of the fully brushed waveform frame by the einkwaveform sub-thread is not completed. In other words, when the electronic device needs to perform local area refresh of the second page, global refresh of the first page to the second page is ongoing. When the electronic device sends the gray image corresponding to the second page which is locally refreshed to the einkwaveform sub-thread, the einkwaveform sub-thread on the electronic device is converting the gray image which is globally refreshed from the first page to the second page into a driving waveform.
In this embodiment of the present application, the electronic device may stop the conversion of the globally refreshed waveform frame and directly perform the conversion of the locally refreshed waveform frame. Unlike step S920, step S1220 performs a complete transition process, i.e., the transition of the driving waveform for performing the partial refresh to the end of the time corresponding to the partial refresh, when performing the transition of the waveform frame of the partial refresh.
For ease of understanding, further description will be given by taking fig. 13 as an example. Fig. 13 is a schematic diagram illustrating another embodiment of driving waveform conversion provided in the embodiment of the present application, as shown in fig. 13, when a surface active main thread in an electronic device sends a gray image corresponding to a locally refreshed second page to a einkwaveform sub-thread, the einkwaveform sub-thread on the electronic device is performing conversion from a gray image of a first page to a gray image of a second page to a driving waveform. In other words, when a full-brush wave form frame needs to be converted, the full-brush wave form frame is being converted. Also, as can be seen from fig. 13, when a partially brushed wave form frame needs to be converted, the full brushed wave form frame has completed conversion of 8 frames. Then, at this time, after the einkwaveform sub-thread receives the waveform frame to be converted of the local brush, the local brush waveform frame does not wait for the conversion of the full brush waveform frame to be completed, but directly performs the conversion of the local brush waveform frame after the 8 th frame of the full brush. I.e., starting at frame 9, starts the transition of the office swipe frame and recounts until the end of a complete cycle. Corresponding to the first frame through 14 th frame of the partial brush being completed after the 1 st through 8 th frames of the full brush are completed.
In the implementation manner, the conversion of the drive waveform of the local brush can be directly inserted in the process of converting the drive waveform of the global drive waveform of the electronic equipment, so that the conversion of the drive waveform of the local brush is not delayed, the conversion of the drive waveform of the complete local brush is executed, and the quality of a display picture is ensured while the local display content corresponding to the local operation of a user is rapidly displayed, so that the user experience is further improved.
S1230, the electronic device displays the page after the local refresh according to the driving waveform of the global refresh and the driving waveform of the local refresh.
The specific description of step S1230 may refer to step S930, and will not be described herein.
According to the method provided by the embodiment of the application, the conversion of the drive waveform of the local brush can be directly inserted in the process of converting the drive waveform of the global drive waveform of the electronic equipment, so that the conversion of the drive waveform of the local brush is not delayed, the conversion of the drive waveform of the complete local brush is executed, and the quality of a display picture is ensured while the local display content corresponding to the local operation of a user is displayed quickly, so that the user experience is further improved.
It should be noted that, the foregoing global page refreshing process in the method 900 and the method 1200 may refer to the specific description of the related art in the embodiments of the present application, or may refer to the global page refreshing process provided in the embodiments of the present application, which is not limited to this embodiment of the present application.
The global refreshing process provided in the embodiment of the present application is specifically described below. For example, reference may be made to fig. 10 of how an electronic device switches from a first page to a second page. Fig. 14 shows a schematic flowchart of a method for global refresh provided in an embodiment of the present application, and as shown in fig. 14, the method 1400 includes steps S1410 to S1430.
S1410, when the first page needs global refreshing to the second page, judging whether the first page is displayed completely.
In this embodiment of the present application, when the electronic device determines that the first page needs to be globally refreshed, that is, when the first page needs to be globally refreshed to the second page, based on the operation of the user, the electronic device needs to determine whether the sending task of the first page is completed.
It should be appreciated that refreshing of each page requires multiple waveform frames to be displayed completely clear on the page. Only if the transition of the plurality of waveform frames on the second page is completed, the transition of the locally refreshed waveform frames of the second page can be started.
Therefore, it is possible to determine whether the first page is completed by determining whether the wave form frame displaying the first page is converted to be sent.
S1420, when the first page is displayed, determining a driving waveform of the second page according to the image data of the second page.
It should be understood that when the first page on the electronic device completes display, based on user operation, the electronic device starts refreshing the second page, so that the electronic device sends the acquired GraphicBuffer to the surface processor to perform layer synthesis. And then obtaining a synthesized image layer corresponding to the second page, and carrying out gray-scale treatment on the synthesized color image layer based on the display principle of the ink screen to obtain a gray-scale image of the second page.
In one possible implementation, the grayscale image of the second page may be generated using a surfacefeldger in the first electronic device.
And according to the gray value of each pixel point on the gray image, looking up a table to obtain a driving waveform corresponding to the pixel position on the ink screen. It should be appreciated that this drive waveform is also referred to as a waveform frame.
In one possible implementation, embodiments of the present application utilize a einkwaveform sub-thread on an electronic device to convert a grayscale image to a driving waveform.
S1430, the electronic device displays the second page according to the driving waveform of the second page.
In the embodiment of the application, the einkwaveform sub-thread sends the converted driving waveform to the HWC, and the HWC renders and then sends the driving waveform to the display interface for page display.
That is, the electronic device performs a local operation on the second page during the process of refreshing from the first page to the second page, and thus the electronic device needs to complete the local refresh process during the global refresh process, which may refer to the above-mentioned method 900 and method 1200.
The page refreshing method provided by the application is described below with reference to another structure diagram. Fig. 15 shows a schematic flowchart of another page refreshing method provided in an embodiment of the present application. As shown in fig. 15, when the electronic device receives the refresh message, the electronic device reads a graphic buffer corresponding to the user click operation from the buffer request generated by the APP. And the electronic equipment judges whether the operation corresponding to the user on the current page is global refreshing or local refreshing according to the acquired graphicbuffer.
And when the coordinates of the local area are not included in the graphicbuffer, the operation corresponding to the user on the current page is indicated to be global refreshing. The electronic device judges whether the driving waveform frame of the last frame of the current page is sent, if the driving waveform frame of the last frame of the page is sent, the electronic device can refresh the current page, which indicates that the last page is displayed. The electronic device caches the globally refreshed graphicbuffer and then sends the graphicbuffer to the surfaceflinger main thread to perform layer synthesis, and it is understood that the synthesized layer is a color layer, and the surfaceflinger main thread needs to convert the color layer into a gray layer for displaying on the ink screen device. The electronic device sends the gray layer to the einkwaveform sub-thread to perform driving waveform conversion. Illustratively, as shown in FIG. 15, the electronic device is undergoing a transition from frame 1 to frame 8 of the global refresh.
When the graphicbuffer comprises the coordinates of the local area, the corresponding operation of the user on the current page is indicated to be local refreshing. The electronic device sends the acquired locally refreshed graphicbuffer to the surfaceflinger main thread to perform layer synthesis, and it is understood that the synthesized layer is a color layer, and the surfaceflinger main thread needs to convert the color layer into a gray layer for displaying on the ink screen device. The electronic device sends the gray layer to the einkwaveform sub-thread to perform driving waveform conversion. As shown in fig. 15, when the electronic apparatus needs to perform the transition of the drive waveform of the local refresh, the transition of the drive waveform of the global refresh is being performed, and in this case, the electronic apparatus suspends the transition of the drive waveform of the global refresh and performs the transition of the drive waveform of the local refresh. Illustratively, as shown in fig. 15, the electronic device pauses after performing the transition of the 8 th frame driving waveform of the global refresh, and starts performing the transition of the 1 st frame driving waveform of the local refresh. In this implementation, delays in local refresh can be avoided.
As shown in fig. 15, the Surfaceflinger main thread further includes an app interface, where the app interface is used for the Surfaceflinger to receive the drawn layer; included in the Surfaceflinger is an appsf interface for Surfaceflinger to synthesize the received layers. The surface file may further include a create Tcon interface, where the interface is used for the surface file to find whether a conversion task of the locally refreshed waveform frame is sent. The electronic device may also register a callback (callback) function in the einkwaveform sub-thread, through which a translation task of the waveform frame in the create Tcon interface is received.
The embodiments of the method for refreshing a page provided in the embodiments of the present application are described above in conjunction with fig. 9 to 15, and the electronic device provided in the embodiments of the present application is described below.
Fig. 16 is a schematic diagram illustrating an example of a structure of an electronic device 100 provided in the present application, and as shown in fig. 16, the electronic device 100 may include a processor 310, an external memory interface 320, an internal memory 321, a universal serial bus (universal serial bus, USB) interface 330, an antenna 1, an antenna 2, a mobile communication module 350, a wireless communication module 360, an audio module 370, a speaker 370A, a receiver 370B, a microphone 370C, an earphone interface 370D, a sensor module 380, and the like.
It is to be understood that the structure illustrated in the embodiments of the present application does not constitute a specific limitation on the electronic device 100. In other embodiments of the present application, electronic device 100 may include more or fewer components than shown, or certain components may be combined, or certain components may be split, or different arrangements of components. The illustrated components may be implemented in hardware, software, or a combination of software and hardware.
The processor 310 may include one or more processing units, such as: the processor 310 may include an application processor (application processor, AP), a modem processor, a graphics processor (graphics processing unit, GPU), an image signal processor (image signal processor, ISP), a controller, a memory, a video codec, a digital signal processor (digital signal processor, DSP), a baseband processor, and/or a neural network processor (neural-network processing unit, NPU), etc. Wherein the different processing units may be separate devices or may be integrated in one or more processors.
A memory may also be provided in the processor 310 for storing instructions and data. In some embodiments, the memory in the processor 310 is a cache memory. The memory may hold instructions or data that the processor 310 has just used or recycled. If the processor 310 needs to reuse the instruction or data, it may be called directly from the memory. Repeated accesses are avoided and the latency of the processor 310 is reduced, thereby improving the efficiency of the system.
The wireless communication function of the electronic device 100 may be implemented by the antenna 1, the antenna 2, the mobile communication module 350, the wireless communication module 360, a modem processor, a baseband processor, and the like.
The antennas 1 and 2 are used for transmitting and receiving electromagnetic wave signals. Each antenna in the electronic device 100 may be used to cover a single or multiple communication bands. Different antennas may also be multiplexed to improve the utilization of the antennas. For example: the antenna 1 may be multiplexed into a diversity antenna of a wireless local area network. In other embodiments, the antenna may be used in conjunction with a tuning switch.
The mobile communication module 350 may provide a solution for wireless communication, including 2G/3G/4G/5G, etc., applied on the electronic device 100. The mobile communication module 350 may include at least one filter, switch, power amplifier, low noise amplifier (low noise amplifier, LNA), etc. The mobile communication module 350 may receive electromagnetic waves from the antenna 1, perform processes such as filtering, amplifying, and the like on the received electromagnetic waves, and transmit the processed electromagnetic waves to the modem processor for demodulation. The mobile communication module 350 may amplify the signal modulated by the modem processor, and convert the signal into electromagnetic waves through the antenna 1 to radiate the electromagnetic waves. In some embodiments, at least some of the functional modules of the mobile communication module 350 may be disposed in the processor 310. In some embodiments, at least some of the functional modules of the mobile communication module 350 may be provided in the same device as at least some of the modules of the processor 310.
The wireless communication module 360 may provide solutions for wireless communication including wireless local area networks (wireless local area networks, WLAN), such as wireless fidelity (wireless fidelity, wi-Fi) networks, bluetooth (BT), global navigation satellite systems (global navigation satellite system, GNSS), frequency modulation (frequency modulation, FM), near field wireless communication technology (near field communication, NFC), infrared technology (IR), and the like, for application on the electronic device 100. The wireless communication module 360 may be one or more devices that integrate at least one communication processing module. The wireless communication module 360 receives electromagnetic waves via the antenna 2, modulates the electromagnetic wave signals, filters the electromagnetic wave signals, and transmits the processed signals to the processor 310. The wireless communication module 360 may also receive a signal to be transmitted from the processor 310, frequency modulate it, amplify it, and convert it to electromagnetic waves for radiation via the antenna 2.
In some embodiments, antenna 1 and mobile communication module 350 of electronic device 100 are coupled, and antenna 2 and wireless communication module 360 are coupled, such that electronic device 100 may communicate with a network and other devices through wireless communication techniques. The wireless communication techniques may include the Global System for Mobile communications (global system for mobile communications, GSM), general packet radio service (general packet radio service, GPRS), code division multiple access (code division multiple access, CDMA), wideband code division multiple access (wideband code division multiple access, WCDMA), time division code division multiple access (time-division code division multiple access, TD-SCDMA), LTE, BT, GNSS, WLAN, NFC, FM, and/or IR techniques, among others. The GNSS may include a global satellite positioning system (global positioning system, GPS), a global navigation satellite system (global navigation satellite system, GLONASS), a beidou satellite navigation system (beidou navigation satellite system, BDS), a quasi zenith satellite system (quasi-zenith satellite system, QZSS) and/or a satellite based augmentation system (satellite based augmentation systems, SBAS).
The electronic device 100 implements display functions through a GPU, an ink screen 394, an application processor, and the like. The GPU is a microprocessor for image processing, connecting the ink screen 394 and the application processor. The GPU is used to perform mathematical and geometric calculations for graphics rendering. Processor 310 may include one or more GPUs that execute program instructions to generate or change display information.
Ink screen 394 is used to display images, video, etc. Ink screen 394 includes a display panel. The display panel may employ a liquid crystal display (liquid crystal display, LCD), an organic light-emitting diode (OLED), an active-matrix organic light-emitting diode (AMOLED) or an active-matrix organic light-emitting diode (matrix organic light emitting diode), a flexible light-emitting diode (flex), a mini, a Micro led, a Micro-OLED, a quantum dot light-emitting diode (quantum dot light emitting diodes, QLED), or the like. In some embodiments, the electronic device 100 may include 1 or N ink screens 394, N being a positive integer greater than 1.
Electronic device 100 may implement capture functionality through an ISP, camera 393, video codec, GPU, ink screen 394, and application processor, among others.
The ISP is used to process the data fed back by camera 393. For example, when photographing, the shutter is opened, light is transmitted to the camera photosensitive element through the lens, the optical signal is converted into an electric signal, and the camera photosensitive element transmits the electric signal to the ISP for processing and is converted into an image visible to naked eyes. ISP can also optimize the noise, brightness and skin color of the image. The ISP can also optimize parameters such as exposure, color temperature and the like of a shooting scene. In some embodiments, the ISP may be provided in the camera 393.
Camera 393 is used to capture still images or video. The object generates an optical image through the lens and projects the optical image onto the photosensitive element. The photosensitive element may be a charge coupled device (charge coupled device, CCD) or a Complementary Metal Oxide Semiconductor (CMOS) phototransistor. The photosensitive element converts the optical signal into an electrical signal, which is then transferred to the ISP to be converted into a digital image signal. The ISP outputs the digital image signal to the DSP for processing. The DSP converts the digital image signal into an image signal in a standard RGB, YUV, or the like format. In some embodiments, electronic device 100 may include 1 or N cameras 393, N being a positive integer greater than 1.
The digital signal processor is used for processing digital signals, and can process other digital signals besides digital image signals. For example, when the electronic device 100 is making a frequency bin selection, the digital signal processor is used to fourier transform the frequency bin energy, etc.
Video codecs are used to compress or decompress digital video. The electronic device 100 may support one or more video codecs. In this way, the electronic device 100 may play or record video in a variety of encoding formats, such as: dynamic picture experts group (moving picture experts group, MPEG) 1, MPEG2, MPEG3, MPEG4, etc.
The external memory interface 320 may be used to connect an external memory card, such as a Micro SD card, to enable expansion of the memory capabilities of the electronic device 100. The external memory card communicates with the processor 310 through an external memory interface 320 to implement data storage functions. For example, files such as music, video, etc. are stored in an external memory card.
The internal memory 321 may be used to store computer executable program code comprising instructions. The processor 310 executes various functional applications of the electronic device 100 and data processing by executing instructions stored in the internal memory 321. The internal memory 321 may include a storage program area and a storage data area. The storage program area may store an application program (such as a sound playing function, an image playing function, etc.) required for at least one function of the operating system, etc. The storage data area may store data created during use of the electronic device 100 (e.g., audio data, phonebook, etc.), and so on. In addition, the internal memory 321 may include a high-speed random access memory, and may also include a nonvolatile memory, such as at least one magnetic disk storage device, a flash memory device, a universal flash memory (universal flash storage, UFS), and the like.
The electronic device 100 may implement audio functionality through an audio module 370, a speaker 370A, a receiver 370B, a microphone 370C, an ear-headphone interface 370D, and an application processor, among others. Such as music playing, recording, etc.
The audio module 370 is used to convert digital audio information into an analog audio signal output and also to convert an analog audio input into a digital audio signal. The audio module 370 may also be used to encode and decode audio signals. In some embodiments, the audio module 370 may be disposed in the processor 310, or some of the functional modules of the audio module 370 may be disposed in the processor 310.
Speaker 370A, also known as a "horn," is used to convert audio electrical signals into sound signals. The electronic device 100 may listen to music, or to hands-free conversations, through the speaker 370A.
A receiver 370B, also referred to as a "earpiece", is used to convert the audio electrical signal into a sound signal. When electronic device 100 is answering a telephone call or voice message, voice may be received by placing receiver 370B close to the human ear.
Microphone 370C, also known as a "microphone" or "microphone", is used to convert sound signals into electrical signals. When making a call or transmitting voice information, the user can sound near the microphone 370C through the mouth, inputting a sound signal to the microphone 370C. The electronic device 100 may be provided with at least one microphone 370C. In other embodiments, the electronic device 100 may be provided with two microphones 370C, and may implement a noise reduction function in addition to collecting sound signals. In other embodiments, the electronic device 100 may also be provided with three, four, or more microphones 370C to enable collection of sound signals, noise reduction, identification of sound sources, directional recording functions, etc.
The earphone interface 370D is for connecting a wired earphone. The headset interface 370D may be a USB interface 330 or a 3.5mm open mobile electronic device platform (open mobile terminal platform, OMTP) standard interface, a american cellular telecommunications industry association (cellular telecommunications industry association of the USA, CTIA) standard interface.
The sensor module 380 may include therein pressure sensors, gyroscope sensors, barometric pressure sensors, magnetic sensors, acceleration sensors, distance sensors, proximity sensors, fingerprint sensors, temperature sensors, touch sensors, ambient light sensors, bone conduction sensors, and the like.
Of course, the electronic device 100 may further include a charge management module, a power management module, a battery, a key, an indicator, 1 or more SIM card interfaces, and the like, which is not limited in any way by the embodiments of the present application.
It is to be understood that the structure illustrated in the embodiments of the present application does not constitute a specific limitation on the electronic device 100. In other embodiments of the present application, electronic device 100 may include more or fewer components than shown, or certain components may be combined, or certain components may be split, or different arrangements of components. The illustrated components may be implemented in hardware, software, or a combination of software and hardware.
It should be understood that, for the specific process of executing the corresponding steps by the electronic device 100, reference is made to the related descriptions of the steps executed by the electronic device in the foregoing embodiments, and for brevity, description is omitted here.
The embodiment may further divide the functional modules of the electronic device according to the method. For example, each function may be divided into each functional module, or two or more functions may be integrated into one processing module. The integrated modules described above may be implemented in hardware. It should be noted that, in this embodiment, the division of the modules is schematic, only one logic function is divided, and another division manner may be implemented in actual implementation.
It should be noted that, the relevant content of each step related to the above method embodiment may be cited to the functional description of the corresponding functional module, which is not described herein.
The electronic device provided in the embodiment of the present application is configured to execute any one of the methods provided in the foregoing method embodiment to refresh a page, so that the same effect as that of the foregoing implementation method may be achieved. In case an integrated unit is employed, the electronic device may comprise a processing module, a storage module and a communication module. The processing module can be used for controlling and managing the actions of the electronic equipment. For example, may be used to support an electronic device in performing steps performed by a processing unit. Memory modules may be used to support storage of program code, data, and the like. And the communication module can be used for supporting the communication between the electronic equipment and other electronic equipment.
Wherein the processing module may be a processor or a controller. Which may implement or perform the various exemplary logic blocks, modules, and circuits described in connection with this disclosure. A processor may also be a combination that performs computing functions, e.g., including one or more microprocessors, digital signal processing (digital signal processing, DSP) and microprocessor combinations, and the like. The memory module may be a memory. The communication module can be specifically an electronic device such as a radio frequency circuit, a Bluetooth chip, a Wi-Fi chip and the like which interact with other servers.
By way of example, fig. 17 shows a schematic block diagram of a communication apparatus 1700 provided in an embodiment of the present application, where the communication apparatus 1700 may correspond to an electronic device described in each of the embodiments of the method 900, the method 1200 or the method 1400 described above, or may be a chip or a component applied to an electronic device, and each module or unit in the communication apparatus 1700 is configured to perform each action or process performed by an electronic device described in each of the embodiments of the method 900, the method 1200 or the method 1400 described above.
As shown in fig. 17, the communication apparatus 1700 includes a transmitting-receiving unit 1710 and a processing unit 1720. The transceiver 1710 is configured to perform specific signal transceiving under the driving of the processing unit 1720.
In some embodiments:
a transceiver 1710, configured to receive an operation of a user on the second page;
a processing unit 1720 to determine whether the operation is a local refresh or a global refresh of the second page;
the processing unit 1720 is further configured to stop driving waveform conversion of global refresh of the second page and perform driving waveform conversion of local refresh of the second page when the operation is local refresh of the second page;
the processing unit 1720 is further configured to display the second page after the local refresh according to the driving waveform of the global refresh and the driving waveform of the local refresh.
According to the communication device, the conversion of the drive waveform of the local brush can be directly inserted in the process of converting the drive waveform of the global state of the electronic equipment, so that the conversion of the drive waveform of the local brush is not delayed, the corresponding local display content of local operation of a user can be displayed rapidly, the problem of local refresh delay is solved, the handwriting pen is used as an application scene of local refresh, the problem of handwriting pen delay is solved, and the user experience is improved.
Optionally, the processing unit 1720 is further configured to stop, when the operation is a local refresh of the second page, a driving waveform conversion of a global refresh of the second page, and perform a driving waveform conversion of the local refresh of the second page to end at a time corresponding to the global refresh.
Optionally, the processing unit 1720 is further configured to stop, when the operation is a local refresh of the second page, a driving waveform transition of the global refresh of the second page, and perform a driving waveform transition of the local refresh of the second page to end at a time corresponding to the local refresh.
Optionally, the transceiver 1710 is further configured to obtain a GraphicBuffer of the second page after the refresh.
Optionally, the processing unit 1720 is further configured to determine whether the operation is a local refresh or a global refresh of the second page according to the GraphicBuffer of the second page after the refresh.
For example, when the GraphicBuffer of the second page includes coordinates corresponding to the local area, the user operation is to locally refresh the second page.
Optionally, the processing unit 1720 is further configured to determine whether the time corresponding to the global refresh of the first page is over.
Optionally, the processing unit 1720 is further configured to determine a driving waveform of the second page according to the GraphicBuffer of the second page;
optionally, the processing unit 1720 is further configured to display the second page according to a driving waveform of the second page.
Further, the communication device 1700 may further include a storage unit, and the transceiver unit 1710 may be a transceiver, an input/output interface, or an interface circuit. The storage unit is used for storing instructions executed by the transceiver unit 1710 and the processing unit 1720. The transceiver 1710, the processing unit 1720, and the storage unit are coupled to each other, the storage unit stores instructions, the processing unit 1720 is configured to execute the instructions stored in the storage unit, and the transceiver 1710 is configured to perform specific signal transmission and reception under the driving of the processing unit 1720.
It should be appreciated that, for the sake of brevity, the specific process of each unit in the communication apparatus 1700 to perform the corresponding steps described above is referred to in the foregoing description related to the terminal server in the related embodiment of the method 900, the method 1200 or the method 1400, which is not repeated herein.
It should be appreciated that the transceiver unit 1710 may be a transceiver, an input/output interface, or an interface circuit. The memory unit may be a memory. The processing unit 1720 may be implemented by a processor. Fig. 18 is a schematic block diagram of a communication device 1800 of an embodiment of the present application. It should be understood that the communication apparatus may refer to the electronic device described above, and that the communication apparatus 1800 shown in fig. 18 may be used to perform steps that are performed by electronic devices corresponding to those shown in fig. 9, 12, and 14. The communication device embodiment corresponds to a method embodiment, and similar descriptions can refer to a method embodiment, the communication device 1800 comprising: the processor 1810 and transceiver 1830, and optionally the apparatus may also include a memory 1820. The processor 1810, the memory 1820, and the transceiver 1830 are communicatively connected, the memory 1820 stores instructions, the processor 1810 is configured to execute the instructions stored in the memory 1820, and the transceiver 1830 is configured to perform specific signaling under the driving of the processor 1810.
It should be noted that in the embodiment of the present application, the processor 1810 may be implemented by a processing module, the memory 1820 may be implemented by a storage module, and the transceiver 1830 may be implemented by a transceiver module, and the communication apparatus 1700 shown in fig. 17 or the communication apparatus 1800 shown in fig. 18 may implement the steps performed by the electronic device in the foregoing embodiments of the method 900, the method 1200 or the method 1400. Similar descriptions can be made with reference to the descriptions in the corresponding methods previously described. In order to avoid repetition, a description thereof is omitted.
It should also be appreciated that the communication apparatus 1700 shown in fig. 17 or the communication apparatus 1800 shown in fig. 18 may be an electronic device.
It should also be understood that the division of the units in the above apparatus is merely a division of a logic function, and may be fully or partially integrated into a physical entity or may be physically separated. And the units in the device can be all realized in the form of software calls through the processing element; or can be realized in hardware; it is also possible that part of the units are implemented in the form of software, which is called by the processing element, and part of the units are implemented in the form of hardware. For example, each unit may be a processing element that is set up separately, may be implemented as integrated in a certain chip of the apparatus, or may be stored in a memory in the form of a program, and the functions of the unit may be called and executed by a certain processing element of the apparatus. The processing element, which may also be referred to herein as a processor, may be an integrated circuit with signal processing capabilities. In implementation, each step of the above method or each unit above may be implemented by an integrated logic circuit of hardware in a processor element or in the form of software called by a processing element. In one example, the unit in any of the above apparatuses may be one or more integrated circuits configured to implement the above methods, for example: one or more application specific integrated circuits (application specific integrated circuit, ASIC), or one or more digital signal processors (digital signal processor, DSP), or one or more field programmable gate arrays (field programmable gate array, FPGA), or a combination of at least two of these integrated circuit forms. For another example, when the units in the apparatus may be implemented in the form of a scheduler of processing elements, the processing elements may be general-purpose processors, such as a central processing unit (central processing unit, CPU) or other processor that may invoke the program. For another example, the units may be integrated together and implemented in the form of a system-on-a-chip (SOC).
Embodiments of the present application also provide a chip system, as shown in fig. 19, comprising at least one processor 1901 and at least one interface circuit 1902. The processor 1901 and the interface circuit 1902 may be interconnected by wires. For example, interface circuit 1902 may be used to receive signals from other devices, such as the memory of the electronic apparatus described above. For another example, the interface circuit 1902 may be used to transmit signals to other devices, such as the processor 1901. For example, the interface circuit 1902 may read instructions stored in a memory and send the instructions to the processor 1901. The instructions, when executed by the processor 1901, may cause the electronic device to perform the various steps performed by any of the electronic devices in the embodiments described above. Of course, the chip system may also include other discrete devices, which are not specifically limited in this embodiment of the present application.
The embodiment of the application also provides a device which is contained in the electronic equipment and has the function of realizing the behavior of the electronic equipment in any embodiment. The functions can be realized by hardware, and can also be realized by executing corresponding software by hardware. The hardware or software includes at least one module or unit corresponding to the functions described above.
The application also provides electronic equipment, which comprises the device provided by the embodiment of the application.
The present application further provides a computer readable storage medium storing computer program code, where the computer program includes instructions for executing the steps of performing page refreshing by the electronic device in any of the embodiments provided in the present application. The readable medium may be read-only memory (ROM) or random access memory (random access memory, RAM), which the embodiments of the present application do not limit.
The present application also provides a computer program product comprising instructions which, when executed, cause an electronic device to perform the steps performed by the electronic device in any of the embodiments described above.
The embodiment of the application also provides a chip, which comprises: a processing unit, which may be, for example, a processor, and a communication unit, which may be, for example, an input/output interface, pins or circuitry, etc. The processing unit may execute computer instructions to cause the electronic device row to execute any of the methods for page refreshing provided in the embodiments of the present application.
Optionally, the computer instructions are stored in a storage unit.
Alternatively, the storage unit is a storage unit in the chip, such as a register, a cache, etc., and the storage unit may also be a storage unit in the terminal located outside the chip, such as a ROM or other type of static storage device that can store static information and instructions, a random RAM, etc. The processor mentioned in any of the above may be a CPU, microprocessor, ASIC, or one or more integrated circuits for controlling the execution of the program of the above-mentioned method for refreshing pages of an electronic device. The processing unit and the storage unit may be decoupled and respectively disposed on different physical devices, and the respective functions of the processing unit and the storage unit are implemented by wired or wireless connection, so as to support the system chip to implement the various functions in the foregoing embodiments. Alternatively, the processing unit and the memory may be coupled to the same device.
The electronic device, the apparatus, the computer readable storage medium, the computer program product, or the chip provided in this embodiment are used to execute the corresponding method provided above, so that the beneficial effects achieved by the electronic device, the apparatus, the computer readable storage medium, the computer program product, or the chip can refer to the beneficial effects in the corresponding method provided above, and are not described herein.
It will be appreciated that the memory in embodiments of the present application may be either volatile memory or nonvolatile memory, or may include both volatile and nonvolatile memory. The nonvolatile memory may be a ROM, a Programmable ROM (PROM), an erasable programmable EPROM (EPROM), an electrically erasable programmable EPROM (EEPROM), or a flash memory, among others. The volatile memory may be RAM, which acts as external cache. There are many different types of RAM, such as Static RAM (SRAM), dynamic RAM (DRAM), synchronous DRAM (SDRAM), double data rate SDRAM (DDR SDRAM), enhanced SDRAM (ESDRAM), synchronous Link DRAM (SLDRAM), and direct memory bus RAM (DR RAM).
Various objects such as various messages/information/devices/network elements/systems/devices/actions/operations/processes/concepts may be named in the present application, and it should be understood that these specific names do not constitute limitations on related objects, and that the named names may be changed according to the scenario, context, or usage habit, etc., and understanding of technical meaning of technical terms in the present application should be mainly determined from functions and technical effects that are embodied/performed in the technical solution.
In the various embodiments of the application, if there is no specific description or logical conflict, terms and/or descriptions between the various embodiments are consistent and may reference each other, and features of the various embodiments may be combined to form new embodiments according to their inherent logical relationships.
Those of ordinary skill in the art will appreciate that the various illustrative elements and algorithm steps described in connection with the embodiments disclosed herein may be implemented as electronic hardware, or combinations of computer software and electronic hardware. Whether such functionality is implemented as hardware or software depends upon the particular application and design constraints imposed on the solution. Skilled artisans may implement the described functionality in varying ways for each particular application, but such implementation decisions should not be interpreted as causing a departure from the scope of the present application.
The methods in the embodiments of the present application may be implemented in whole or in part by software, hardware, firmware, or any combination thereof. When implemented in software, may be implemented in whole or in part in the form of a computer program product. The computer program product includes one or more computer programs or instructions. When the computer program or instructions are loaded and executed on a computer, the processes or functions described in the embodiments of the present application are performed in whole or in part. The computer may be a general purpose computer, a special purpose computer, a computer network, or other programmable apparatus. The computer program or instructions may be stored in or transmitted across a computer-readable storage medium. The computer readable storage medium may be any available medium that can be accessed by a computer or a data storage device such as a server that integrates one or more available media.
It will be clear to those skilled in the art that, for convenience and brevity of description, specific working procedures of the above-described systems, apparatuses and units may refer to corresponding procedures in the foregoing method embodiments, and are not repeated herein.
In the several embodiments provided in this application, it should be understood that the disclosed systems, devices, and methods may be implemented in other manners. For example, the apparatus embodiments described above are merely illustrative, e.g., the division of the units is merely a logical function division, and there may be additional divisions when actually implemented, e.g., multiple units or components may be combined or integrated into another system, or some features may be omitted or not performed. Alternatively, the coupling or direct coupling or communication connection shown or discussed with each other may be an indirect coupling or communication connection via some interfaces, devices or units, which may be in electrical, mechanical or other form.
The units described as separate units may or may not be physically separate, and units shown as units may or may not be physical units, may be located in one place, or may be distributed on a plurality of network units. Some or all of the units may be selected according to actual needs to achieve the purpose of the solution of this embodiment.
In addition, each functional unit in each embodiment of the present application may be integrated in one processing unit, or each unit may exist alone physically, or two or more units may be integrated in one unit.
The functions, if implemented in the form of software functional units and sold or used as a stand-alone product, may be stored in a computer-readable storage medium. Based on such understanding, the technical solution of the present application may be embodied essentially or in a part contributing to the prior art or in a part of the technical solution, in the form of a software product stored in a readable storage medium, including several instructions for causing a computer device (which may be a personal computer, a server, or a network device, etc.) to perform all or part of the steps of the methods described in the embodiments of the present application. And the aforementioned readable storage medium includes: a usb disk, a removable hard disk, a ROM, a RAM, a magnetic disk, or an optical disk, etc.
The foregoing is merely specific embodiments of the present application, but the scope of the present application is not limited thereto, and any person skilled in the art can easily think about changes or substitutions within the technical scope of the present application, and the changes and substitutions are intended to be covered by the scope of the present application. Therefore, the protection scope of the present application shall be subject to the protection scope of the claims.

Claims (18)

1. A method of page refreshing, the method being applied to an ink screen device, the method comprising:
receiving operation of a user on a second page;
determining that the operation is a local refresh or a global refresh of the second page;
stopping the driving waveform conversion of the global refresh of the second page and performing the driving waveform conversion of the local refresh of the second page when the operation is the local refresh of the second page;
and displaying the second page after the local refreshing according to the driving waveform of the global refreshing and the driving waveform of the local refreshing.
2. The method of claim 1, wherein when the operation is a partial refresh of the second page, the drive waveform switching of the global refresh of the second page is stopped, and the drive waveform switching of the partial refresh of the second page is performed to the end of the time corresponding to the global refresh.
3. The method according to claim 1, wherein when the operation is a partial refresh of the second page, a drive waveform transition of a global refresh of the second page is stopped, and a drive waveform transition of the partial refresh of the second page is performed to an end of a time corresponding to the partial refresh.
4. A method according to any of claims 1-3, wherein the determining that the operation is a local refresh or a global refresh of the second page comprises:
acquiring a GraphicBuffer of the refreshed second page;
judging whether the operation is local refreshing or global refreshing of the second page according to the GraphicBuffer of the second page after refreshing.
5. The method of claim 4, wherein the operation is determined to be a local refresh of the second page when coordinates corresponding to a local area are included in a GraphicBuffer of the second page.
6. The method of any of claims 1-5, wherein the ink screen device includes a surfacefringer main thread including an einkwaveform sub-thread that stops global refresh drive waveform transitions and performs local refresh drive waveform transitions when the second page requires local refresh.
7. The method of claim 6, wherein the method further comprises:
the surfaceflinger main thread determines a gray level image of the refreshed second page according to the GraphiBuffer of the refreshed second page;
And the einkwave form sub-thread carries out conversion of a locally refreshed driving waveform according to the refreshed gray level image of the second page.
8. The method of claim 7, wherein the surfacefringer main thread determining the gray image of the refreshed second page according to the GraphicBuffer of the refreshed second page comprises:
the surfaceflinger main thread synthesizes a display layer of the refreshed second page according to the GraphicBuffer of the refreshed second page;
and the surfaceflinger main thread converts the display image layer of the refreshed second page into a gray level image of the refreshed second page.
9. The method of any of claims 1-8, wherein prior to the receiving user operation on the second page, the method further comprises:
when a first page needs to be globally refreshed to the second page, judging whether the time corresponding to the global refreshing of the first page is ended or not;
when the time corresponding to the global refreshing of the first page is over, determining a driving waveform of the second page according to the GraphiBuffer of the second page;
and displaying the second page according to the driving waveform of the second page.
10. The method of claim 9, wherein the ink screen device includes a surfaceflinger main thread including an einkwaveform sub-thread that determines a driving waveform of the second page according to a GraphicBuffer of the second page when a time corresponding to the global refresh of the first page ends.
11. The method of claim 10, wherein the einkwaveform sub-thread determines a driving waveform of the second page according to a GraphicBuffer of the second page, comprising:
the surfaceflinger main thread determines a gray image of the second page according to the GraphiBuffer of the second page;
and the einkwave form sub-thread determines the driving waveform of the second page according to the gray level image of the second page.
12. The method of claim 11, wherein the surfacefringer main thread determines the grayscale image of the second page according to the GraphicBuffer of the second page, comprising:
the surfaceflinger main thread synthesizes a display layer of the second page according to the GraphiBuffer of the second page;
and the surfaceflinger main thread converts the display image layer of the second page into a gray image of the second page.
13. An electronic device comprising a processor and a memory for storing instructions, the processor for reading the instructions to perform the method of any one of claims 1 to 12.
14. A communication device comprising means for performing the steps of the method according to any of claims 1 to 12.
15. A communication apparatus, the apparatus comprising at least one processor coupled with at least one memory:
the at least one processor configured to execute a computer program or instructions stored in the at least one memory to cause the communication device to perform the method of any one of claims 1 to 12.
16. An ink screen device comprising the apparatus of claim 14 or the apparatus of claim 15.
17. A computer readable storage medium, characterized in that the computer readable storage medium has stored therein a computer program comprising program instructions which, when executed by a processor, cause the processor to perform the method of any of claims 1 to 12.
18. A chip, comprising: a processor for calling and running a computer program from a memory, causing a communication device on which the chip is mounted to perform the method of any of claims 1 to 12.
CN202211054402.0A 2022-08-31 2022-08-31 Page refreshing method and electronic device Pending CN117667276A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202211054402.0A CN117667276A (en) 2022-08-31 2022-08-31 Page refreshing method and electronic device

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202211054402.0A CN117667276A (en) 2022-08-31 2022-08-31 Page refreshing method and electronic device

Publications (1)

Publication Number Publication Date
CN117667276A true CN117667276A (en) 2024-03-08

Family

ID=90068607

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202211054402.0A Pending CN117667276A (en) 2022-08-31 2022-08-31 Page refreshing method and electronic device

Country Status (1)

Country Link
CN (1) CN117667276A (en)

Similar Documents

Publication Publication Date Title
CN111724293B (en) Image rendering method and device and electronic equipment
CN115631258B (en) Image processing method and electronic equipment
WO2022007862A1 (en) Image processing method, system, electronic device and computer readable storage medium
CN112767231B (en) Layer composition method and device
CN113132526B (en) Page drawing method and related device
CN114756359A (en) Image processing method and electronic equipment
CN113986162A (en) Layer composition method, device and computer readable storage medium
WO2022166624A1 (en) Screen display method and related apparatus
CN115373777A (en) Display method and related device
CN114531519A (en) Control method based on vertical synchronization signal and electronic equipment
WO2023071482A1 (en) Video editing method and electronic device
CN117667276A (en) Page refreshing method and electronic device
WO2022078116A1 (en) Brush effect picture generation method, image editing method and device, and storage medium
CN115686403A (en) Display parameter adjusting method, electronic device, chip and readable storage medium
CN116257235A (en) Drawing method and electronic equipment
CN115220621A (en) Graphical interface display method, electronic device, medium, and program product
CN116700578B (en) Layer synthesis method, electronic device and storage medium
CN116664375B (en) Image prediction method, device, equipment and storage medium
CN116993619B (en) Image processing method and related equipment
WO2023124227A1 (en) Frame rate switching method and device
CN115482143B (en) Image data calling method and system for application, electronic equipment and storage medium
US20240184504A1 (en) Screen projection method and system, and related apparatus
CN116664630B (en) Image processing method and electronic equipment
CN116095220B (en) Parameter determination method and related device
US20240056677A1 (en) Co-photographing method and electronic device

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination