CN116149765A

CN116149765A - Method for determining refresh mode of ink screen, electronic device and storage medium

Info

Publication number: CN116149765A
Application number: CN202111398365.0A
Authority: CN
Inventors: 周亮; 王波; 段利华
Original assignee: Huawei Technologies Co Ltd
Current assignee: Huawei Technologies Co Ltd
Priority date: 2021-11-23
Filing date: 2021-11-23
Publication date: 2023-05-23
Also published as: WO2023093458A1

Abstract

The embodiment of the application relates to the technical field of display, and provides a method for determining a refresh mode of an ink screen, electronic equipment and a storage medium. The electronic device has an ink screen. A method of determining a refresh mode of an ink screen, comprising: determining the content type and the display area of a first display unit in a page to be displayed of an application program; the first display unit is a non-web page control or a web page element in the web page control; setting a refresh mode corresponding to a display area of the first display unit according to the content type of the first display unit; the refresh mode is used for the ink screen to display the display area of the first display unit. Aiming at the display unit, the refreshing mode of the display area of the display unit is set according to the content type of the display unit when the ink screen displays the page to be displayed, so that different refreshing modes can be set in different display areas of the page to be displayed, the accuracy and the rationality of setting the refreshing mode of the ink screen are improved, and the display effect of the ink screen is improved.

Description

Method for determining refresh mode of ink screen, electronic device and storage medium

Technical Field

The embodiment of the application relates to the technical field of display, in particular to a method for determining a refresh mode of an ink screen, electronic equipment and a storage medium.

Background

The electronic ink is a flicker-free and self-luminous display technology, and an ink screen developed based on the electronic ink has the obvious advantage of protecting eyes, and electronic equipment such as electronic books, electronic writing boards and electronic labels increasingly use the ink screen.

The ink drops in the ink screen are an electrochemical material, and display content is changed by virtue of movement of black and white ink drops under an electric field. Compared with electronic screens such as a liquid crystal display (liquid crystal display, LCD) or an organic light emitting semiconductor (organic electroluminescence display, OLED), the ink screen has a slower display update speed, and may have the phenomena of smear, jamming, flickering, and the like. Thus, ink screens typically have multiple refresh modes, with different refresh modes having different display effects. Thus, it is important to reasonably configure the refresh mode of the ink screen.

At present, the method for configuring the refreshing mode of the ink screen is poor in rationality, so that the display effect of the ink screen is poor.

Disclosure of Invention

The embodiment of the application provides a method for determining a refreshing mode of an ink screen, electronic equipment and a storage medium, which improve the accuracy and rationality of configuring the refreshing mode of the ink screen and improve the display effect of the ink screen.

In a first aspect, an embodiment of the present application provides a method for determining a refresh mode of an ink screen, including: determining the content type and the display area of a first display unit in a page to be displayed of an application program; the first display unit is a non-web page control or a web page element in the web page control; setting a refresh mode corresponding to a display area of the first display unit according to the content type of the first display unit; the refreshing mode is used for displaying a display area of a first display unit in a page to be displayed on the ink screen.

By the method for determining the refreshing mode of the ink screen, the electronic equipment can set the refreshing mode of the ink screen for the display unit, and the refreshing mode is set according to the content type of the display unit, so that different refreshing modes are set for different display units or different areas in the page to be displayed, the accuracy and the rationality for setting the refreshing mode of the ink screen are improved, and the display effect is improved. In addition, the electronic equipment directly sets a refreshing mode of the ink screen aiming at the display unit in the page to be displayed of the application program at the operating system level, so that the workload and difficulty of an application program developer are reduced.

In a possible implementation manner, determining a content type and a display area of a first display unit in a page to be displayed of an application program includes: and determining the content type and the display area of the first display unit when the layout processing is carried out on the page to be displayed.

In the implementation mode, the content type and the display area of the display unit can be determined in the layout stage, so that the refresh mode corresponding to the display area of the display unit is determined, the data processing amount is greatly reduced, and the processing efficiency is improved.

In a possible implementation manner, the page to be displayed includes a non-web page control, the first display unit is the non-web page control, and the determining the content type and the display area of the first display unit includes: identifying at least one non-web page control used when laying out a page to be displayed, wherein the at least one non-web page control comprises a first display unit; the content type and the display area of the identified first display unit are determined.

In the implementation mode, the content type and the display area of the non-webpage control are determined in the process of laying out the page to be displayed of the application program.

In a possible implementation manner, a page to be displayed includes a web page control, a first display unit is a web page element, and determining a content type and a display area of the first display unit includes: acquiring at least one webpage element in a webpage control included in a webpage to be displayed in a browser kernel, wherein the at least one webpage element comprises a first display unit; and determining the content type and the display area of the first display unit according to the document objectification model corresponding to the first display unit.

In the implementation mode, the content types and the display areas of the webpage elements in the webpage control are determined in the process of laying out the webpage to be displayed of the application program.

In a possible implementation manner, the method for determining the refresh mode of the ink screen further includes: acquiring event information; the event information comprises a content refreshing area and a refreshing time period which correspond to the user operation in the page to be displayed, wherein the user operation is used for triggering the content in the content refreshing area to be refreshed and displayed in the refreshing time period, and the content refreshing area comprises a display area of the first display unit; and if the current moment is in the refreshing period, determining a refreshing mode corresponding to the display area of the first display unit according to the refreshing display mode.

In the implementation manner, for a scene with content refreshing dynamic display in a page to be displayed, a refreshing mode corresponding to a content refreshing area is determined according to a refreshing display mode, and compared with the fact that the refreshing mode is determined according to the content type of a first display unit in the content refreshing area, the accuracy and the rationality of determining the refreshing mode corresponding to the content refreshing area are improved, and then the display effect of the ink screen is improved.

In one possible implementation, the manner in which the display is refreshed includes any one of the following: sliding display, scrolling display, page turning display, zoom-out display, or zoom-in display.

In a possible implementation manner, the page to be displayed further comprises a second display unit, the content types of the first display unit and the second display unit are the same, and no display unit with other content types is arranged between the display area of the first display unit and the display area of the second display area; setting a refresh mode corresponding to a display area of the first display unit according to a content type of the first display unit, including: setting a refresh mode corresponding to the target area according to the content type of the first display unit; the target area includes a display area of the first display unit, a display area of the second display unit, and a display area between the first display unit and the second display unit.

In the implementation manner, when the content types of the plurality of display units are the same and the positions are adjacent, the refresh mode can be set for the whole target area where the plurality of display units are located, so that the display area of each display unit is prevented from being set, and the processing efficiency is improved.

In a possible implementation manner, the page to be displayed further includes a fifth display unit, and the method for determining the refresh mode of the ink screen further includes: acquiring a configuration file; if the configuration file comprises the corresponding relation between the window of the page to be displayed to which the fifth display unit belongs and the refresh mode, setting the refresh mode corresponding to the window to which the fifth display unit belongs as the refresh mode corresponding to the display area of the fifth display unit; or if the configuration file includes the correspondence between the application program to which the fifth display unit belongs and the refresh mode, setting the refresh mode corresponding to the application program to which the fifth display unit belongs as the refresh mode corresponding to the display area of the fifth display unit.

In this implementation, the corresponding relationship between different application programs and the refresh mode, or the corresponding relationship between the window of different display pages and the refresh mode, is preset in the configuration file. For the fifth display unit, the refresh mode of the display area of the fifth display unit can be set directly according to the configuration file, so that a supplementary scheme for setting the refresh mode is provided.

In a possible implementation manner, the number of pages to be displayed is multiple, the multiple pages to be displayed belong to one or more application programs, and a refresh mode corresponding to a display area of the first display unit is set according to a content type of the first display unit, including: acquiring page coverage relations among a plurality of pages to be displayed; when the first display unit is a display unit in a first page to be displayed at the highest layer, setting a refresh mode corresponding to a display area of the first display unit in the first page to be displayed according to the content type of the first display unit in the first page to be displayed; or when the first display unit is a display unit in a second to-be-displayed page positioned under the highest layer, determining a non-overlapping area which is not overlapped with the target to-be-displayed page in a display area of the first display unit in the second to-be-displayed page, and setting a refresh mode corresponding to the non-overlapping area according to the content type of the first display unit in the second to-be-displayed page; the target page to be displayed comprises the sum of the areas of all the pages to be displayed which are positioned above the second page to be displayed.

In this implementation, there may or may not be a plurality of pages to be displayed, and there may be an overlapping region between the plurality of pages to be displayed. For the display units in the uppermost page to be displayed, the display units are visible to the user, and the refresh mode can be directly set according to the content type of the display unit, so that the accuracy and the rationality are improved. For the display unit in the page to be displayed below the uppermost layer, part or all of the display area of the display unit may be shielded, the part which is not shielded is visible to the user, and for the non-overlapping area in the display unit, a refresh mode can be set according to the content type of the display unit, so that the accuracy and the rationality are improved, and the display effect of the ink screen is improved.

In a possible implementation manner, determining a content type and a display area of a first display unit in a page to be displayed of an application program includes: after carrying out layout processing, drawing processing and layer composition processing on a page to be displayed, obtaining composite display data; the content type and the display area of the first display unit are determined from the composite display data.

In this implementation, the to-be-displayed page is subjected to the processing of the layout flow, the drawing flow, and the diagram layer synthesizing flow, and then synthesized display data is generated. The electronic equipment analyzes the synthesized display data to obtain the content type of the display unit, so that the refresh mode corresponding to the display area of the display unit can be set according to the content type, and the accuracy and the rationality of setting the refresh mode of the ink screen are improved.

In a possible implementation manner, the page to be displayed further includes a third display unit, and the method for determining the refresh mode of the ink screen further includes: and setting the preset refresh mode of the third display unit as a refresh mode corresponding to the display area of the third display unit.

In this implementation, a preset refresh mode may be directly set for a specific display unit, so as to improve the display effect of the ink screen.

In a possible implementation manner, the page to be displayed further includes a fourth display unit, the content types of the first display unit and the fourth display unit are different, and the method for determining the refresh mode of the ink screen further includes: and setting a refresh mode corresponding to the display area of the fourth display unit according to the content type of the fourth display unit.

In this implementation manner, if the page to be displayed includes at least two content types of display units, for example, the first display unit and the fourth display unit, the corresponding refresh modes are set according to different content types, so that accuracy and reasonability of setting the refresh mode of the ink screen are improved. If the page to be displayed comprises a display unit with one content type, the whole area of the page to be displayed can be set to be in the same refresh mode, and the display unit does not need to be set respectively, so that the processing efficiency is improved.

In a possible implementation manner, the method for determining the refresh mode of the ink screen further includes: and determining whether to use a dithering algorithm for the display area of the first display unit according to the refresh mode corresponding to the display area of the first display unit.

In this implementation, the display effect of the ink screen may be further improved by determining whether to use a dithering algorithm.

In one possible implementation, the content type includes any one of the following: text, pictures or video.

In a possible implementation manner, the first display unit includes any one of the following: a text control, a picture control, a video play control, a text element in a web page control, a picture element in a web page control, or a video element in a web page control.

In a second aspect, an embodiment of the present application provides an apparatus for determining a refresh mode of an ink screen, including: the determining module is used for determining the content type and the display area of the first display unit in the page to be displayed of the application program; the first display unit is a non-web page control or a web page element in the web page control; the setting module is used for setting a refresh mode corresponding to the display area of the first display unit according to the content type of the first display unit; the refreshing mode is used for displaying a display area of a first display unit in a page to be displayed on the ink screen.

In a possible implementation manner, the determining module is configured to: and determining the content type and the display area of the first display unit when the layout processing is carried out on the page to be displayed.

In a possible implementation manner, the page to be displayed includes a non-web page control, the first display unit is the non-web page control, and the determining module is configured to: identifying at least one non-web page control used when laying out a page to be displayed, wherein the at least one non-web page control comprises a first display unit; the content type and the display area of the identified first display unit are determined.

In a possible implementation manner, the page to be displayed includes a web page control, the first display unit is a web page element, and the determining module is configured to: acquiring at least one webpage element in a webpage control included in a webpage to be displayed in a browser kernel, wherein the at least one webpage element comprises a first display unit; and determining the content type and the display area of the first display unit according to the document objectification model corresponding to the first display unit.

In a possible implementation manner, the setting module is further configured to: acquiring event information; the event information comprises a content refreshing area and a refreshing time period which correspond to the user operation in the page to be displayed, wherein the user operation is used for triggering the content in the content refreshing area to be refreshed and displayed in the refreshing time period, and the content refreshing area comprises a display area of the first display unit; and if the current moment is in the refreshing period, determining a refreshing mode corresponding to the display area of the first display unit according to the refreshing display mode.

In a possible implementation manner, the page to be displayed further comprises a second display unit, the content types of the first display unit and the second display unit are the same, and no display unit with other content types is arranged between the display area of the first display unit and the display area of the second display area; the setting module is used for: setting a refresh mode corresponding to the target area according to the content type of the first display unit; the target area includes a display area of the first display unit, a display area of the second display unit, and a display area between the first display unit and the second display unit.

In a possible implementation manner, the page to be displayed further includes a fifth display unit, and the setting module is further configured to: acquiring a configuration file; if the configuration file comprises the corresponding relation between the window of the page to be displayed to which the fifth display unit belongs and the refresh mode, setting the refresh mode corresponding to the window to which the fifth display unit belongs as the refresh mode corresponding to the display area of the fifth display unit; or if the configuration file includes the correspondence between the application program to which the fifth display unit belongs and the refresh mode, setting the refresh mode corresponding to the application program to which the fifth display unit belongs as the refresh mode corresponding to the display area of the fifth display unit.

In a possible implementation manner, the number of pages to be displayed is multiple, the multiple pages to be displayed belong to one or more application programs, and the setting module is used for: acquiring page coverage relations among a plurality of pages to be displayed; when the first display unit is a display unit in a first page to be displayed at the highest layer, setting a refresh mode corresponding to a display area of the first display unit in the first page to be displayed according to the content type of the first display unit in the first page to be displayed; or when the first display unit is a display unit in a second to-be-displayed page positioned under the highest layer, determining a non-overlapping area which is not overlapped with the target to-be-displayed page in a display area of the first display unit in the second to-be-displayed page, and setting a refresh mode corresponding to the non-overlapping area according to the content type of the first display unit in the second to-be-displayed page; the target page to be displayed comprises the sum of the areas of all the pages to be displayed which are positioned above the second page to be displayed.

In a possible implementation manner, the determining module is configured to: after carrying out layout processing, drawing processing and layer composition processing on a page to be displayed, obtaining composite display data; the content type and the display area of the first display unit are determined from the composite display data.

In a possible implementation manner, the page to be displayed further includes a third display unit, and the setting module is further configured to: and setting the preset refresh mode of the third display unit as a refresh mode corresponding to the display area of the third display unit.

In a possible implementation manner, the page to be displayed further includes a fourth display unit, the content types of the first display unit and the fourth display unit are different, and the setting module is further configured to: and setting a refresh mode corresponding to the display area of the fourth display unit according to the content type of the fourth display unit.

In a possible implementation manner, the setting module is further configured to: and determining whether to use a dithering algorithm for the display area of the first display unit according to the refresh mode corresponding to the display area of the first display unit.

In a third aspect, there is provided an electronic device comprising a processor for coupling with a memory and reading instructions in the memory and causing the electronic device to perform the method provided in the first aspect in accordance with the instructions.

In a fourth aspect, there is provided a program for performing the method provided in the first aspect when being executed by a processor.

In a fifth aspect, there is provided a computer readable storage medium having instructions stored therein which, when executed on a computer or processor, implement the method provided in the first aspect.

In a sixth aspect, a program product is provided, the program product comprising a computer program stored in a readable storage medium, from which at least one processor of an electronic device can read, the at least one processor executing the computer program causing the electronic device to carry out the method provided in the first aspect.

Drawings

Fig. 1A is a schematic view of a scenario suitable for use in the embodiments of the present application;

fig. 1B is a schematic structural diagram of an ink screen according to an embodiment of the present disclosure;

FIG. 2 is a schematic diagram of a control waveform according to an embodiment of the present application;

fig. 3 is a software architecture diagram of an electronic device according to an embodiment of the present application;

FIGS. 4A-4C are a set of interface schematic diagrams of an ink screen according to an embodiment of the present disclosure;

FIGS. 5A-5H are a set of schematic diagrams of pages provided in embodiments of the present application;

Fig. 6 is another software architecture diagram of an electronic device according to an embodiment of the present application;

FIG. 7A is a schematic diagram of a refresh mode set using the software architecture shown in FIG. 6;

FIG. 7B is a schematic diagram showing a display effect of FIG. 7A;

fig. 8 is an interface diagram of an electronic device in setting a refresh mode according to an embodiment of the present application;

FIG. 9 is a schematic diagram of the manner in which the refresh mode is set in FIG. 8;

fig. 10A to 10H are setup diagrams of refresh modes of the pages shown in fig. 5A to 5H;

FIG. 11 is a schematic view of a display effect of FIG. 10D;

fig. 12 is a further software architecture diagram of an electronic device according to an embodiment of the present application;

fig. 13 is a further software architecture diagram of an electronic device according to an embodiment of the present application;

FIG. 14 is a flowchart of a method for determining a refresh mode of an ink screen according to an embodiment of the present application;

FIG. 15 is a schematic diagram of a page to be displayed according to an embodiment of the present disclosure;

FIG. 16 is a schematic diagram of a refresh mode corresponding to each region in FIG. 15;

FIG. 17 is a schematic structural diagram of an apparatus for determining a refresh mode of an ink screen according to an embodiment of the present disclosure;

fig. 18 is a schematic structural diagram of an electronic device according to an embodiment of the present application.

Detailed Description

Embodiments of the present application are described below with reference to the accompanying drawings.

The method for determining the refreshing mode of the ink screen is applied to the electronic equipment with the ink screen. Fig. 1A is a schematic view of a scenario applicable to the embodiment of the present application. As shown in fig. 1A, an electronic device 100 has an ink screen 101. Ink screen 101 may display the content of an Application (APP) installed in electronic device 100. Specifically, the ink screen 101 includes a window 102, and a page 103 to be displayed of the APP is displayed in the window 102.

The embodiment of the application does not limit the type, the model and the shape of the electronic equipment. Examples of some electronic devices are, for example: a wireless terminal in a cell phone, tablet, palm top, electronic book, electronic tablet, electronic sign, wearable device, smart screen, teaching device, internet of things (internet of things, IOT) device, or smart home (smart home), etc.

The name and type of the APP installed in the electronic equipment are not limited.

First, concepts related to the embodiments of the present application will be described.

1. Ink screen

Exemplary, fig. 1B is a schematic structural diagram of an ink screen according to an embodiment of the present application. Fig. 1B may be a cross-sectional view of the ink Shui Bing 101 in the AA' direction of fig. 1A. As shown in fig. 1B, a large number of ink droplets 13 are included in the ink screen. The ink droplets 13 are also called microcapsules (microcapsules) which have a size of about the size of the diameter of human hair. The ink droplet 13 contains a clear liquid, white particles 15 and black particles 16 suspended in the clear liquid, the white particles 15 having a positive charge, and the black particles 16 having a negative charge. The ink screen further comprises a top transparent electrode 11 and a bottom electrode 12 for applying an electric field to control the movement of white particles 15 and black particles 16 in the ink droplets 13.

For example, as shown in the ink droplet 13 on the left side in fig. 1B, the electric field is set positive, the positive voltage is applied to the bottom electrode 12, the white particles 15 in the ink droplet 13 move toward the top of the ink droplet, i.e., toward the screen upward, so that the ink screen appears white to the user, and at the same time, the black particles 16 in the ink droplet 13 are pulled to the bottom of the ink droplet, thereby hiding.

For example, as shown in the ink droplet 13 on the right side in fig. 1B, the electric field is set negative, the bottom electrode 12 applies a negative voltage, and the black particles 16 in the ink droplet 13 move toward the top of the ink droplet, i.e., toward the screen upward, so that the ink screen appears black to the user, while the white particles 15 in the ink droplet 13 are pulled to the bottom of the ink droplet, thereby being hidden.

It can be seen that the movement of white and black particles in the ink droplets can be controlled by the electric field applied by the top transparent electrode 11 and the bottom electrode 12, so that the ink screen can display color and display picture content. Wherein the colors include white, black, and gray levels (also referred to as gray levels) between white and black. The number of gray scales is not limited in the embodiment of the present application, for example, 16 gray scales, 32 gray scales, and the like.

The control chip of the ink screen may receive the control waveforms and apply an electric field to the top transparent electrode 11 and the bottom electrode 12 according to the control waveforms. Fig. 2 is a schematic diagram of control waveforms according to an embodiment of the present application. As shown in fig. 2, the control waveform has different voltage values at different time points, and the voltage values may be positive, negative or 0. The control waveform has a refresh frequency, which is also the frequency of refreshing the screen of the ink screen. The higher the refresh rate, the faster the picture refresh rate at the time of ink screen display, and conversely, the lower the refresh rate, the slower the picture refresh rate at the time of ink screen display.

2. Ink screen refresh mode

Based on the display principle of the ink screen, the ink screen has the obvious advantages of low power consumption and eye protection. However, ink screens are typically slower to refresh when displayed, and the displayed color level is typically limited. When the ink screen displays animation, video and other contents, the situations of smear, jamming, flickering and the like may occur. The smear is also called afterimage, which is an afterimage on a display, and it can be understood that when the display switches the pictures, the previous picture does not disappear immediately, and the phenomenon that the previous picture and the next picture appear simultaneously and the previous picture disappear slowly appears on the visual effect.

To cope with different display scenes, the ink screen has a plurality of refresh modes. In different refresh modes, the control waveforms are different, for example, the frequency of the control waveforms is different and/or the voltage amplitude of the control waveforms is different, so that the requirements of different application scenes are met, and different display effects are provided.

Illustratively, table 1 shows a plurality of refresh modes, including: INIT (initial mode), DU, GC16, GL16, GLR16, GLD16, A2, and DU4. The parameters for each refresh mode include: gray scale and refresh frequency. Wherein the refresh frequency is represented by a typical time consumption at 25 ℃. For example, a typical time consumption of 450ms at 25 ℃ corresponds to a refresh frequency of 1s/450ms, approximately 2Hz; a typical time consuming 250ms at 25 ℃ corresponds to a refresh frequency of 4Hz. The greater the typical time consumption at 25 ℃, the lower the refresh rate, and is suitable for static display content, e.g., text, pictures, etc. Conversely, the less typically time consuming at 25 ℃, the higher the refresh rate, which is suitable for dynamic display of content, e.g., video, animation, etc. The larger the number of gray levels, the more colors the ink screen displays, and is suitable for display contents, such as pictures, videos and the like, which have requirements for color diversity. Conversely, the smaller the number of gray levels, the less color the ink screen displays, and is suitable for display content, such as text, having a lower demand for color diversity.

For example. As shown in table 1, for the DU refresh mode, with 2 gray levels, a typical time-consuming at 25 ℃ is 260ms, the refresh frequency is about 4Hz, which is typically used to display a scene with gray level variation, such as a single color menu, a mouse pointer, text input, touch screen input, stylus input, quick page turning, pop-out window, item selection (e.g., word size selection), highlight mark, etc., with little or no ghost, and no flicker. The GC16 refresh mode has 16 gray levels, typically takes 450ms at 25 ℃, has a refresh frequency of about 2Hz, is slow to refresh, is generally used for displaying high-quality images, fine characters and the like, has little or no image sticking, and can provide a better picture display effect. The GLR16 refresh mode is generally used for displaying text, graphics, etc. in a white background, with little or no afterimage, and with little flicker during screen conversion. For the A2 refresh mode, which has 2 gray levels, a typical time-consuming at 25 ℃ of 120ms, a refresh frequency of about 8Hz, a fast refresh but poor contrast, is typically used for displaying scenes requiring a fast refresh, such as fast page turning, video playing or animation, etc.

It should be noted that table 1 is only an example, and is not limited to the refresh mode, parameters of the refresh mode, application scenario, and display effect.

TABLE 1

3. Dithering algorithm

The dithering algorithm is an image processing algorithm, when a color image is reduced to a low-gray-scale image for display, the color lump or deformation problem is easy to occur, and at the moment, the color lump or deformation problem can be greatly reduced through the dithering algorithm, so that the display effect is improved. The embodiment of the application does not describe the specific implementation of the dithering algorithm in detail, and can adopt the existing algorithm implementation mode.

Generally, if the number of gray levels of the refresh mode of the ink screen is smaller than a preset value, the display effect can be improved by combining a dithering algorithm. For example, the DU refresh mode and the A2 refresh mode in table 1. The preset values are not limited in this embodiment.

4. Universal software architecture for electronic device display

In order to facilitate understanding of the processing flow of display data of the electronic device, a general software architecture involved in displaying the electronic device is described. The software system of the electronic device may employ a layered architecture, an event driven architecture, a microkernel architecture, a microservice architecture, a cloud architecture, and the like. The embodiment of the application is described by taking a layered architecture as an example of electronic equipment. The layered architecture divides the software into a plurality of layers, each layer has clear roles and division, and the layers are communicated through software interfaces.

Fig. 3 is a schematic diagram of a software architecture of an electronic device according to an embodiment of the present application. As shown in fig. 3, the software architecture includes, from top to bottom, an Application (Application) layer, a framework (framework) layer, a Native Services layer, and a kernel layer.

The application layer, also referred to as the application layer, includes the APP provided by the system to the user, as shown in fig. 3, the application may be identified as APP 1-APP N, where N is a positive integer. Applications may include, but are not limited to: gallery, calendar, map, navigation, bluetooth, music, video, short message, etc. APP 1-APP N can generate data to be displayed, and the electronic equipment processes the data to be displayed and then displays the data on the display screen. In this embodiment of the present application, the display screen is an ink screen.

The framework layer is also referred to as a framework service layer, and is used to provide application programming interfaces (application programming interface, APIs) and programming frameworks to application programs of the application layer. The framework layer may include some predefined functions, such as a layout subsystem and a rendering subsystem. The layout subsystem is used for realizing a layout flow, and the drawing subsystem is used for realizing a drawing flow.

The local service layer is used to provide the system level implementation required by the framework layer, such as graphics caching, database storage, etc. The local service layer may include a display composition subsystem for implementing a layer (surfeflinger) composition flow.

The kernel layer, also called the device driver layer, is the layer between hardware and software. The device driver layer includes at least display (display) drivers. In an embodiment of the present application, a waveform (waveform) module is further included for generating a control waveform. The control chip of the ink screen can apply an electric field according to the control waveform, so that the ink screen displays.

The electronic equipment processes the data to be displayed generated by the application program according to the display pipeline, and presents a display interface to the user. The display pipeline mainly comprises a layout flow, a drawing flow and a SurfaceFlinger synthesis flow. The layout process obtains the data to be displayed of at least one application program, and lays out the data to be displayed of each application program. And the drawing flow draws the content according to the layout corresponding to the data to be displayed of each application program, and generates a layer. And the surface eFlinger synthesis flow synthesizes and displays a plurality of layers generated in the drawing flow, namely, the synthesized data is pushed to a display screen.

5. Window, page, view (control), web page view (WebView), web page element, display unit

The application displays content in a window, which is a tool that displays pages, which are content displayed in a window. For example. After the electronic device runs APP1, the content of APP1 is displayed in window 1. Suppose APP1 is a view-like application, the page currently displayed in window 1 includes picture 1. The user can switch the display content of APP1 by operating. For example, the user performs an operation of switching the picture, and switches the picture 1 to the picture 2. Accordingly, the electronic device refreshes the page displayed in the window 1 to include the picture 2 in response to the operation of switching the picture by the user.

Optionally, the frame of the window may or may not be displayed.

Alternatively, an application may display a page in one window, or may display a page in a plurality of windows, respectively. When an application corresponds to multiple pages, there may or may not be an overlap region between the multiple pages. When there is an overlap area between the plurality of pages, there is a page coverage relationship in the up-down direction between the plurality of pages. Illustratively, in one example, as shown in FIG. 4A, APP1 corresponds to window 411 and window 412 in ink screen 40, page 1 is displayed in window 411, page 2 is displayed in window 412, and page 1 and page 2 do not have overlapping areas. In another example, as shown in fig. 4B, APP1 corresponds to a window 421 and a window 422 in the ink screen 40, page 1 is displayed in the window 421, page 2 is displayed in the window 422, page 1 and page 2 have overlapping areas, and page 2 is located at the upper layer of page 1.

The electronic device may display a page of one application or may display pages of a plurality of applications. The pages of each application are described above and will not be repeated here. When the electronic device displays pages of a plurality of application programs, the electronic device displays at least two pages. There may or may not be an overlap region between at least two pages. When there is an overlap region between at least two pages, there is a page coverage relationship in the up-down direction between at least two pages. Illustratively, as shown in FIG. 4C, in ink screen 40, APP1 corresponds to window 431, and page 1 is displayed in window 431. APP2 corresponds to window 432, with page 2 displayed in window 432. APP3 corresponds to window 433 and window 434, with page 3 displayed in window 433, page 4 displayed in window 434, page 4 being located at the upper layer of page 3. APP4 corresponds to window 435, with page 5 displayed in window 435. Wherein page 2 and page 5 have overlapping areas, and page 5 is located at the upper layer of page 2. Similarly, page 5 is also located at the upper layer of page 3. The page coverage relationship between page 1 to page 5 includes: page 1, page 4, and page 5 are at the highest level, with pages above page 2 comprising page 5 and pages above page 3 comprising page 4 and page 5.

The type, name and page content to be displayed of the application program are not limited in the embodiment of the application program. For example, in fig. 4C, page 4 is a floating window type page, and page 5 is a display page of an input method or a display page of a stylus pen.

At least one view, also referred to as a control, may be included in the page. In the embodiment of the application, the refresh mode of the ink screen can be set for the control. Alternatively, the controls may include web page views (WebView) and non-web page views. The non-web page view is also referred to as a non-web page control. The web page view is also referred to as a web page control, which includes web page elements. In the embodiment of the application, the refresh mode of the ink screen can also be set for the webpage element.

For convenience of explanation, a unit in which a refresh mode of the ink screen can be set is defined as a display unit. The display unit includes any one of the following: non-web page controls or web page elements in web page controls. Alternatively, the non-web page controls may include, but are not limited to, text controls, picture controls, or video play controls. Alternatively, the web page elements may include, but are not limited to, text elements, picture elements, or video elements.

The display unit has content types, and different content types may correspond to different refresh modes. Alternatively, the content types may include a dynamic display type and a static display type. Alternatively, static display types include, but are not limited to: text, pictures. Dynamic display types include, but are not limited to: video, animation.

Alternatively, the page may include one display unit, or may include a plurality of display units. When a plurality of display units are included in a page, the content types of the plurality of display units may be the same or different. Optionally, the page may include only non-web page controls, or only web page controls, or both web page controls and non-web page controls.

Next, a relationship between a page and a display unit is exemplarily described with reference to fig. 5A to 5H, and a display scene applicable to the embodiment of the present application is exemplarily described, but fig. 5A to 5H are not limited thereto.

Alternatively, in one example, only 1 display element is included in the page. Alternatively, the display unit may be a non-web page control or a web page element. For example, as shown in fig. 5A, the page 1 includes 1 display unit, which is a non-web page control 1, and the content type of the non-web page control 1 is text.

Optionally, in another example, the page includes a plurality of display units, and content types of the plurality of display units are the same. Optionally, the plurality of display units includes non-web page controls and/or web page elements. For example, as shown in fig. 5B, the page 2 includes 2 display units, which are respectively a non-web page control 1 to a non-web page control 2, and the content types are all texts.

Optionally, in another example, the page includes a plurality of display units, which are non-web page controls, and the content types of the plurality of display units include at least two types. For example, as shown in fig. 5C, the page 3 includes 3 display units, which are respectively a non-web page control 1 to a non-web page control 3, wherein the content type of the non-web page control 1 is text, the content type of the non-web page control 2 is a picture, and the content type of the non-web page control 3 is video.

Optionally, in yet another example, the page includes a plurality of display units, which are all web page elements, and the content types of the plurality of display units include at least two types. For example, as shown in fig. 5D, the page 4 includes a web page control, and the web page control includes 3 web page elements, that is, the page 4 includes 3 display units, that is, the web page elements 1 to 3, respectively. The content type of the webpage element 1 is text, the content type of the webpage element 2 is picture, and the content type of the webpage element 3 is video.

Optionally, in yet another example, the page includes a plurality of display units, the plurality of display units includes a non-web page control and or a web page element, and the content types of the plurality of display units include at least two. Illustratively, as shown in FIG. 5E, page 5 includes a web page control and a non-web page control 1, the web page control including 2 web page elements, i.e., page 5 includes 3 display units, web page element 1, web page element 2, and non-web page control 1, respectively. The content type of the webpage element 1 is text, the content type of the webpage element 2 is picture, and the content type of the non-webpage control 1 is video.

Optionally, in yet another example, as shown in fig. 5F, page 6 includes non-web page control 1 and non-web page control 2, and page 7 is located at an upper layer of page 6, including non-web page control 3. The areas where the non-web page control 3 and the non-web page control 2 are located are provided with overlapping areas, and the non-web page control 3 is located on the upper layer of the non-web page control 2. The user sees that non-web page control 3 obscures a portion of non-web page control 2.

Optionally, in yet another example, as shown in fig. 5G, page 8 includes controls 1-7, all of which are non-web page controls. The content types of the controls 4 to 7 are pictures, and the areas where the controls 4 to 7 are located are adjacent, or other display units are not arranged between the areas where the controls 4 to 7 are located.

Optionally, in yet another example, the page has a content refresh area, specifically a sliding display area, therein. As shown in the left side of fig. 5H, the page 9 has a sliding display area 61, and in this case, the sliding display area 61 includes controls 1 to 3, which are all non-web page controls. The user can perform a pull-down operation on the slide control 62, thereby refreshing the content displayed in the slide display region 61. As shown on the right side of fig. 5H, after refreshing the content in the sliding display area 61, including the controls 3 to 5, are all non-web page controls. Page 9 also includes control 5, which is a non-web page control.

Next, an implementation of setting a refresh mode of the ink screen in the related art will be described.

Optionally, in one implementation, the electronic device opens a software interface for setting a refresh mode of the ink screen at an operating system layer for an application program located at a higher layer. Correspondingly, under different display scenes and display contents, the application program at a high layer can call a software interface provided by the system side to set the refreshing mode of the ink screen, and the set refreshing mode of the ink screen is transferred to the system side.

Fig. 6 is an exemplary software architecture diagram of an electronic device according to an embodiment of the present application. As shown in fig. 6, the software architecture of the electronic device includes, from top to bottom, an application layer, an interface layer, a framework layer, a local service layer, and a kernel layer. Wherein the application layer, the framework layer, the local service layer and the kernel layer may be referred to as related descriptions of fig. 3, the framework layer and the local service layer are simplified to a framework layer & local service layer for simplifying the structure, and a layout subsystem, a drawing subsystem and a display composition subsystem are not shown. As shown in fig. 6, the interface layer includes a software development kit (software development kit, SDK), which is an interface that the operating system opens to the APP, for the APP to set the refresh mode of the ink screen. Take APP1 as an example for illustration. Suppose that the content that APP1 needs to display includes control 11, control 12, control 13, and control 14. Then, APP1 will call the SDK to set refresh modes for the controls 11 to 14, respectively, and transfer the refresh modes of the controls 11 to 14 to the framework layer & local service layer, thereby setting the refresh modes to the control chip of the ink screen.

In this implementation manner, the operating system of the electronic device may provide an interface for setting a refresh mode to an upper application program, and the upper application program actively invokes the interface according to the content to be displayed, so as to set an appropriate refresh mode for the control to be displayed. Because of the variety of application programs, each application program needs to adapt to the interface in the development process, and the development requirement of the application program is high. Moreover, the content to be displayed by the application program is complex and changeable, and an interface provided by a system side is required to be called for each control, so that the workload of an application program developer is large and the difficulty is high. And, the application program sets a refresh mode for the controls, one for each control. When multiple types of content are included in the control, for example, when the web page control includes multiple types of web page elements, a unified refresh mode is set for the control, which results in poor display effect of some types of content.

Fig. 7A is a schematic diagram illustrating a refresh mode set using the software architecture shown in fig. 6. As shown on the left side of fig. 7A, assume that the browser-like application needs to display page 4 shown in fig. 5D, page 4 including web page controls, specifically including three types of content, text, pictures, and video. After the browser application program calls the interface provided by the operating system, the refresh mode of the whole webpage control is set to be GL16, as shown on the right side in FIG. 7A, and the display effect is shown in FIG. 7B. As can be seen, the same refresh mode GL16 is set, so that the text and the picture in the page 4 are displayed normally, but the video has problems of stuck, discontinuous picture, and the like, and the display effect is poor.

Alternatively, in another implementation, the refresh mode of the ink screen may be set by the user. The method for setting the refresh mode by the user is not limited in this embodiment, for example, by performing an operation on a related interface displayed on the electronic device, by voice setting, and the like.

Fig. 8 is an interface diagram of setting a refresh mode of an electronic device according to an embodiment of the present application. As shown in fig. 8, the electronic device displays a setup interface 80 for the refresh mode of the ink screen. The interface 80 includes a plurality of refresh modes therein, such as normal refresh, fast refresh, and very fast refresh. Optionally, the refresh mode included in the interface 80 has a correspondence relationship with the refresh mode shown in table 1. Each refresh mode corresponds to a selection control, e.g., a normal refresh corresponds to selection control 81. Optionally, each refresh mode further has a prompt message for guiding the user to select. For example, the prompt information of normal refreshing is "good in display effect", the prompt information of quick refreshing is "slight ghost, suitable for quick image-text browsing", and the prompt information of quick refreshing is "severe ghost, suitable for quick sliding browsing". Suppose that the user clicks the select control 81 to select the normal refresh mode. Accordingly, the electronic device sets the refresh mode of the ink screen to the normal refresh mode in response to the user clicking the selection control 81.

In the implementation manner, the electronic device sets the refresh mode of the ink screen according to the refresh mode set by the user, the refresh mode is required to be manually switched by the user according to different display scenes, the operation is frequent, and the use experience of the user is poor. For example, the user currently views a picture, and may set the refresh mode to fast refresh. When the user reads the novel, the user is required to manually operate to switch the refresh mode from the quick refresh to the normal refresh. Also, when a plurality of types of contents are included in a page, such as the pages shown in fig. 5C to 5H, different types of display units will be set to a uniform refresh mode, which will result in poor display effects of some types of contents.

Illustratively, FIG. 9 is a schematic diagram of setting a refresh mode in the manner shown in FIG. 8. As shown on the left side of fig. 9, assume that the shopping class application needs to display page 3 shown in fig. 5C, and that page 3 includes 3 non-web page controls of three types, text, picture, and video, respectively. The refresh mode currently set by the user is the extreme speed refresh, corresponding to the A2 refresh mode in table 1, and the refresh mode is shown on the right side in fig. 9. However, A2 has a high refresh rate, resulting in poor display of the text in page 3.

The embodiment of the application also provides a method for determining the refreshing mode of the ink screen, which is characterized in that the refreshing mode of the ink screen is directly set for the display unit in the page to be displayed of the application program in the operating system layer of the electronic equipment, and compared with the mode of setting the refreshing mode by calling the interface provided by the system side through the APP, the workload and development difficulty of an application program developer are reduced. In addition, the page to be displayed of the application program can comprise display units with various content types, the electronic equipment can respectively set the refresh modes according to the content types of the display units, different areas or different display units can be provided with different refresh modes, the accuracy, the suitability and the rationality of setting the refresh modes are improved, the ink screen presents different display effects for the display units with different content types, and the watching experience of a user is improved.

Next, with respect to the display scenes shown in fig. 5A to 5H, a refresh mode set by this implementation will be exemplarily described.

Alternatively, in one example, see fig. 10A. Left side in fig. 10A referring to fig. 5A, a refresh mode is set as shown on the right side in fig. 10A. The electronic device can set the refresh mode, for example, the GLR16, according to the content type (text) of the non-web page control 1, thereby improving the accuracy of setting the refresh mode.

Alternatively, in another example, see fig. 10B. Left side in fig. 10B referring to fig. 5B, a refresh mode is set as shown on the right side in fig. 10B. The electronic device can set the refresh mode, for example, the GLR16, according to the content types (text) of the non-web page controls 1 to 2, thereby improving the accuracy of setting the refresh mode.

Alternatively, in yet another example, see fig. 10C. Left side in fig. 10C referring to fig. 5C, a refresh mode is set as shown on the right side in fig. 10C. The electronic device can set the refresh mode of the non-webpage control 1 (text) as GLR16, set the refresh mode of the non-webpage control 2 (picture) as GL16, set the refresh mode of the non-webpage control 3 (video) as A2, and set the refresh modes for different non-webpage controls respectively, so that the display effect of different non-webpage controls is improved.

Alternatively, in yet another example, see fig. 10D. Left side in fig. 10D referring to fig. 5D, a refresh mode is set as shown on the right side in fig. 10D. The electronic device can set the refresh mode of the webpage element 1 (text) as GLR16, the refresh mode of the webpage element 2 (picture) as GL16, the refresh mode of the webpage element 3 (video) as A2, and the refresh modes are respectively set for different webpage elements, so that the display effect of different webpage elements is improved. The display effect is shown in fig. 11. As can be seen, compared to the display effect of fig. 7B, in this example, since the refresh mode of the web page element 3 (video) is A2, the refresh frequency of A2 is higher, so that the video in the page 4 is displayed normally, and the display effect is improved.

Alternatively, in yet another example, see fig. 10E. Left side in fig. 10E referring to fig. 5E, a refresh mode is set as shown on the right side in fig. 10E. The electronic device can set the refresh mode of the webpage element 1 (text) as GLR16, the refresh mode of the webpage element 2 (picture) as GL16, the refresh mode of the non-webpage control 1 (video) as A2, and the refresh modes are respectively set for different webpage elements or non-webpage controls, so that the display effect of different display contents is improved.

Alternatively, in yet another example, see fig. 10F. Left side in fig. 10F referring to fig. 5F, a refresh mode is set as shown on the right side in fig. 10F. The area where the non-web page control 3 in the page 7 is located and the area where the non-web page control 2 in the page 6 is located have overlapping areas, and the non-overlapping areas are shown by a dashed box in fig. 10F, where the non-web page control 3 is located at an upper layer of the non-web page control 2. The electronic device can set the refresh mode of the non-web page control 1 (text) as GLR16, the refresh mode of the non-overlapping area in the non-web page control 2 (text) as GLR16, the refresh mode of the non-web page control 3 (video) as A2, and the refresh modes are respectively set for different non-web page controls, so that the display effect of different display contents is improved.

Alternatively, in yet another example, see fig. 10G. Left side in fig. 10G referring to fig. 5G, a refresh mode is set as shown on the right side in fig. 10G. The areas where the controls 4 to 7 are located are adjacent, the content types of the controls 4 to 7 are the same, and are all pictures, and the refresh mode can be set in the merging area, and the merging area is shown by a dotted line box in fig. 10G. The electronic equipment can set the refresh modes of the control 1 (text) and the control 3 (text) to be GLR16, the refresh mode of the control 2 (video) to be A2 and the refresh mode of the merging area to be GL16, so that the efficiency of setting the refresh mode is improved, the refresh modes are respectively set for different controls, and the display effect of different display contents is improved.

Alternatively, in yet another example, see fig. 10H. Left side in fig. 10H is referred to left side in fig. 5H, and the refresh mode is set as shown on right side in fig. 10H. Wherein the page 9 includes a sliding display area 61 therein. The electronic device can set the refresh mode corresponding to the sliding display area 61 to be DU, and the refresh mode of the control 5 (picture) to be GL16, so that the efficiency of setting the refresh mode is improved, and the display effect of different display contents is improved.

Next, a software architecture of the electronic device in this implementation will be described.

Optionally, in an implementation, fig. 12 is a further software architecture diagram of an electronic device provided in an embodiment of the present application. As shown in fig. 12, the software architecture of the electronic device includes, from top to bottom, an application layer, a framework layer, a local service layer, and a kernel layer. The application layer, the framework layer, the local service layer, and the kernel layer may refer to the relevant descriptions in fig. 3, and are not described herein.

The frame layer further includes a first mode decision module 121, configured to determine a refresh mode corresponding to a display area of a display unit in a single page to be displayed. Optionally, the display unit may be a first display unit, a second display unit, or a third display unit in the embodiments of the present application. Wherein the first mode decision module 121 may include: a type identification module 1211, an event identification module 1212, a merge module 1213, a configuration module 1214, and a determination module 1215.

The type identifying module 1211 is used for determining the content type and the display area of the display unit in the page to be displayed in the layout stage.

The event identification module 1212 is configured to obtain event information, where the event information includes an effective duration of a user operation and a content refresh area corresponding to the user operation in a page to be displayed, and the user operation is configured to trigger content in the content refresh area to refresh and display in the effective duration.

And the merging module 1213 is configured to perform region merging on the regions occupied by at least two display units that are adjacent to each other and have the same content type in the page to be displayed. The adjacent positions mean that no other display unit exists between the areas occupied by at least two display units.

A configuration module 1214, configured to set a refresh mode of the display unit according to a preset refresh mode. The preset refresh mode may be a preset refresh mode corresponding to different granularity.

A determining module 1215, configured to determine a refresh mode corresponding to the display area of the display unit according to the content type of the display unit. Optionally, the refresh mode corresponding to the display area of the display unit may be determined by combining with the conditions such as the content refresh area of the dynamic refresh display in the page to be displayed or a preset refresh mode.

The local service layer may further include a second mode decision module 122, a dithering algorithm module 124 and a sending module 123.

The second mode decision module 122 is configured to determine refresh modes corresponding to display areas of display units in different pages to be displayed in a composite display scene where a plurality of pages to be displayed exist. Optionally, the plurality of pages to be displayed may include a plurality of pages to be displayed of one application program and/or pages to be displayed respectively corresponding to the plurality of application programs.

The dithering algorithm module 124 is configured to determine whether the dithering algorithm is required for the display area of the display unit. If necessary, a dithering algorithm is used for the display area of the display unit to further improve the display effect.

The sending and displaying module 123 is configured to set the refresh mode corresponding to the display area of the display unit determined by the first mode decision module 121 or the second mode decision module 122 to the control chip of the ink screen.

In this implementation manner, the electronic device may determine the content type of the display unit in the page to be displayed in the layout process of the page to be displayed of the application program, so as to set a refresh mode corresponding to the display area of the display unit. In general, the data display needs to go through a layout process, a drawing process and a diagram layer composition process, and the content type of the display unit is acquired in the layout stage, so that the calculation amount is small, and the efficiency of determining the refresh mode is improved. In addition, the electronic equipment sets the refreshing mode aiming at the display unit, so that the accuracy, the suitability and the rationality of setting the refreshing mode are improved, different display effects are presented by the ink screen aiming at the display units with different content types, and the watching experience of a user is improved.

Optionally, in another implementation, fig. 13 is a further software architecture diagram of an electronic device provided in an embodiment of the present application. As shown in fig. 13, the software architecture of the electronic device includes, from top to bottom, an application layer, a framework layer, a local service layer, and a kernel layer. The application layer, the framework layer, the local service layer, and the kernel layer may refer to the relevant descriptions in fig. 3, and are not described herein.

The local service layer further includes an analysis module 131, a dithering algorithm module 124, and a sending module 123.

And an analysis module 131, configured to acquire the composite display data, and determine the content type and the display area of the display unit according to the composite display data.

The dithering algorithm module 124 and the sending module 123 may be described with reference to fig. 12, and will not be described herein.

It can be seen that in this implementation, the composite display data is generated after the page to be displayed of the at least one application program is processed by the layout flow, the drawing flow, and the diagram layer composition flow. The electronic device obtains the content type of the display unit by analyzing the synthesized display data, so that a refresh mode corresponding to the display area of the display unit can be set. Because the electronic equipment determines the refresh mode at the system side, compared with the mode of determining the refresh mode by the APP, the workload and difficulty of an APP developer are reduced. In addition, the electronic equipment sets the refreshing mode aiming at the display unit, so that the accuracy, the suitability and the rationality of setting the refreshing mode are improved, different display effects are presented by the ink screen aiming at the display units with different content types, and the watching experience of a user is improved.

The technical scheme of the present application is described in detail below through specific examples. The following embodiments may be combined with each other and may not be described in detail in some embodiments for the same or similar concepts or processes.

The embodiments of the present application may be combined with each other, and the same or similar concepts or processes may not be described in detail in some embodiments. The terms "first," "second," "third," "fourth," and the like in embodiments of the present application, if any, are used for distinguishing between similar objects and not necessarily for describing a particular sequential or chronological order.

In some descriptions of the present application, the refresh mode in which the display unit is set and the refresh mode in which the display area of the display unit is set have the same meaning. In the embodiment of the application, determining the refresh mode of the ink screen refers to determining the refresh mode used when the ink screen displays the display area of the display unit in the page to be displayed of the application program.

Fig. 14 is a flowchart of a method for determining a refresh mode of an ink screen according to an embodiment of the present application. The method for determining the refresh mode of the ink screen provided by the embodiment can be applied to electronic equipment with the ink screen. As shown in fig. 14, the method for determining a refresh mode of an ink screen provided in this embodiment may include:

S1401, determining a content type and a display area of a first display unit in a page to be displayed of an application program. The first display unit includes any one of the following: non-web page controls or web page elements in web page controls.

The number of display units included in the page to be displayed is not limited. Alternatively, the number of display units in the page to be displayed may be 1, for example, page 1 shown in fig. 5A. Alternatively, the number of display units in the page to be displayed may be 2 or more, for example, the pages shown in fig. 5B to 5E and fig. 5G to 5H.

The first display unit may be any unit in the page to be displayed. For example. Assume that 10 display units are included in the page to be displayed of APP 1. Alternatively, the first display unit may be any one of 10 display units. Alternatively, the first display unit may be any multiple of 10 display units, where any multiple includes two or more. Alternatively, the first display unit may be any one or any plurality of 10 display units visible to the user, where the visibility to the user means that at least a portion of a display area of the display unit is not blocked, and the user can see the display area.

Alternatively, the content type may include, but is not limited to, any of the following: text, pictures or video.

The display area of the first display unit is used for representing the position of the first display unit in the page to be displayed. For ease of handling, the display area may be of a regular shape, e.g., rectangular, square, circular, etc. Of course, the display area may be irregularly shaped. When the display units are different and the display scenes are different, the shapes of the display areas may be different.

Alternatively, the display area may be represented by coordinates of edge points. For example, if the display area is rectangular, it can be represented by coordinates of 4 vertices of the rectangle. For another example, when the display area is circular, the display area can be represented by coordinates of the center of a circle and a radius.

S1402, setting a refresh mode corresponding to a display area of the first display unit according to a content type of the first display unit.

The content type and the refresh mode have a preset corresponding relationship, and the embodiment does not limit the corresponding relationship. For example, text corresponds to GLR16 mode, pictures correspond to GL16 mode, and video corresponds to A2 mode.

Alternatively, in one implementation, the first display unit may be each display unit in the page to be displayed. The implementation may set a refresh mode for each display unit in the page to be displayed.

Optionally, in another implementation manner, the first display unit may be a display unit of a preset content type, and when determining that the content type of the first display unit is the preset content type, determining a refresh mode corresponding to the display area of the first display unit according to the preset content type. The implementation may set a refresh mode for a display unit of a particular content type. For example, the page to be displayed of APP1 includes 10 display units, where the content type of 3 display units is text, and the preset content type is text. Then, the refresh mode of the display areas of the 3 display units may be set according to the text type.

Therefore, according to the method for determining the refresh mode of the ink screen, the electronic device can directly set the refresh mode of the ink screen for the display unit in the page to be displayed of the application program at the operating system level, and compared with the mode that the refresh mode is set by the interface provided by the APP calling system side in the related technology, the workload and difficulty of an APP developer are reduced. In addition, the electronic equipment can set the refreshing mode aiming at the display unit, so that the accuracy, the suitability and the rationality of setting the refreshing mode are improved, different display effects are presented by the ink screen aiming at the display units with different content types, and the watching experience of a user is improved.

Optionally, the page to be displayed may further include a third display unit, and the method for determining the refresh mode of the ink screen provided in this embodiment further includes:

and setting a preset refresh mode corresponding to the third identification information of the third display unit as a refresh mode corresponding to the display area of the third display unit.

For convenience of explanation, the identification information of the third display unit is referred to as third identification information, and the identification information of the display unit may uniquely distinguish between different display units, for example, names, identification sequences, and the like. The third display unit is preset with a preset refresh mode.

In this implementation, a refresh mode may be set for a specific display unit to enhance the display effect. One display scenario may be: among the plurality of refresh modes, the display effect is the best when the third display unit is set to the first refresh mode, and then the third display unit may correspond to the first refresh mode. And if the third display unit exists in the page to be displayed, setting the refresh mode corresponding to the display area of the third display unit as the first refresh mode.

Optionally, the page to be displayed may further include a fourth display unit, where content types of the first display unit and the fourth display unit are different, and the method for determining the refresh mode of the ink screen provided in this embodiment further includes:

And setting a refresh mode corresponding to the display area of the fourth display unit according to the content type of the fourth display unit.

In this implementation, if the page to be displayed includes at least two content types of display units, for example, a first display unit and a fourth display unit, a refresh mode corresponding to a display area of the first display unit is set according to the content type of the first display unit, and a refresh mode corresponding to a display area of the fourth display unit is set according to the content type of the fourth display unit. Because the refresh modes corresponding to the display areas of different display units are respectively set according to different content types, the accuracy, the suitability and the rationality of setting the refresh modes are improved.

Alternatively, if the page to be displayed includes a display unit of one content type, for example, at least one first display unit has the same content type, see page 2 shown in fig. 5B, or page 1 shown in fig. 5A, then the display area of the whole page to be displayed may be set to the same refresh mode, and it is not necessary to set a refresh mode for each first display unit separately, so that the processing efficiency is improved.

Optionally, the method for determining a refresh mode of an ink screen provided in this embodiment may further include:

And determining whether to use a dithering algorithm for the display area of the first display unit according to the refresh mode corresponding to the display area of the first display unit.

If the dithering algorithm is determined to be used, processing the display area of the first display unit according to the dithering algorithm to improve the display effect. If it is determined that the dithering algorithm is not used, dithering of the display area of the first display unit is not required.

Optionally, there is a preset correspondence between the refresh mode and whether a dithering algorithm needs to be used. Typically, the number of gray levels in the refresh mode is small, and when the display color is small, for example, smaller than a preset value, a dithering algorithm may be used. For example, the DU mode and the A2 mode may incorporate a dithering algorithm.

Based on the embodiment shown in fig. 14, another embodiment of the present application provides an implementation of a method for determining a refresh mode of an ink screen, which is applicable to the software architecture shown in fig. 12.

In this embodiment, in S1401, determining the content type and the display area of the first display unit in the page to be displayed of the application program may include:

and determining the content type and the display area of the first display unit when the layout processing is carried out on the page to be displayed.

Therefore, the method for determining the refresh mode of the ink screen provided by the embodiment can determine the content type and the display area of the first display unit in the layout stage, so that the refresh mode corresponding to the display area of the first display unit is determined, the data processing amount is greatly reduced, and the processing efficiency is improved.

Optionally, in an implementation manner, the page to be displayed includes a non-web page control, the first display unit is the non-web page control, and determining the content type and the display area of the first display unit may include:

at least one non-web page control used when laying out a page to be displayed is identified, the at least one non-web page control including a first display unit.

The content type and the display area of the first display unit are determined.

The implementation can determine the content type and the display area of the non-web page control. The number of the at least one non-web page control included in the page to be displayed is not limited in the embodiment. For example, the pages shown in fig. 5A to 5C and fig. 5E to 5F. Optionally, the page to be displayed may further include a web page control. The first display unit may be any non-web page control in the page to be displayed.

Optionally, in another implementation, the page to be displayed includes a web page control, the first display unit is a web page element, and determining the content type and the display area of the first display unit may include:

at least one webpage element in a webpage control included in a webpage to be displayed is acquired in a browser kernel, and the at least one webpage element includes a first display unit.

And determining the content type and the display area of the first display unit according to the document objectification model corresponding to the first display unit.

The implementation can determine the content type and the display area of the webpage element in the webpage control. The number of web page controls included in the page to be displayed and the number of at least one web page element included in each web page control are not limited in this embodiment. For example, the pages shown in fig. 5D to 5E. Optionally, the page to be displayed may further include a non-web page control. The first display unit may be any web page element in the page to be displayed.

Optionally, the page to be displayed may further include a second display unit, where the content types of the first display unit and the second display unit are the same, and no other content type display unit is located between the display area of the first display unit and the display area of the second display area. In S1402, setting a refresh mode corresponding to a display area of the first display unit according to a content type of the first display unit may include:

And setting a refresh mode corresponding to the target area according to the content type of the first display unit. The target area comprises a display area of the first display unit, a display area of the second display unit and a display area between the first display unit and the second display unit.

For example. As shown in fig. 5G, assume that the page to be displayed is page 8. The first display unit is a control 4 in the page 8, the second display unit comprises a control 5-a control 7 in the page 8, and the content types are pictures. And no display units of other content types exist between the display areas corresponding to the controls 4 to 7 respectively. Then, as shown on the right side in fig. 10G, the target area is shown by a dotted line, and the refresh mode corresponding to the target area may be uniformly set according to the picture content type. That is, the refresh mode is set for the target area for 1 time, and the display areas of the controls 4 to 7 do not need to be set independently, so that 4 times of redundant processing are avoided, and the processing efficiency is improved.

Optionally, before setting the refresh mode corresponding to the target area according to the content type of the first display unit, the method may further include:

and combining the display area of the first display unit and the display area of the second display unit to form a target area.

For example, see fig. 10G. As shown on the left side in fig. 10G, the display areas corresponding to the controls 4 to 7 in the page 8 may be combined to form a target area, such as a dashed box shown on the right side in fig. 10G. And setting a refresh mode corresponding to the target area shown by the dotted line box according to the picture content type. And as only 1 refreshing mode is required to be set, the processing efficiency is improved.

event information is acquired. The event information comprises a refreshing time period corresponding to user operation and a content refreshing area corresponding to the user operation in the page to be displayed, wherein the user operation is used for triggering the content in the content refreshing area to refresh and display in the refreshing time period. The content refresh area includes a display area of the first display unit.

Correspondingly, if the current moment is in the refresh period, determining a refresh mode corresponding to the display area of the first display unit according to a refresh display mode.

The present embodiment is not limited to the operation of the user, for example, a click operation, a slide operation, a pinch zoom operation of two fingers, or the like. The user action is used to trigger the content in the content refresh area to refresh the display during the refresh period. Optionally, the refresh period may include a start-effective time point and an end-effective time point.

For example. As shown in fig. 5H, the user operation may be a pull-down operation of the slide control 62 by the user, the content refresh area may be the slide display area 61, and the user operation is used to trigger the content in the slide display area 61 to be displayed in a slide down manner during the refresh period. And if the current moment is in the refreshing period, the sliding display triggered by the user is still effective. In order to improve the display effect, for a scene in which a content refresh dynamic display exists, the refresh mode corresponding to the slide display area 61 should be set based on the slide display manner. Compared with the method for setting the refreshing area according to the content types of the controls 1 to 3 in the sliding display area 61, the method has the advantages that the setting is more accurate and reasonable, and the display effect is improved.

Optionally, the manner of refreshing the display includes, but is not limited to, any of the following: sliding display, scrolling display, page up display, zoom-out display, or zoom-in display.

Optionally, determining that the content refresh area includes the display area of the first display unit may include:

it is determined that the display area of the first display unit is located within the content refresh area.

Optionally, determining, according to the manner of refreshing display, a refresh mode corresponding to the display area of the first display unit may include:

And determining a refresh mode corresponding to the display area of the first display unit according to the content type of the first display unit and the refresh display mode.

In the implementation manner, for the scene with the content refreshing dynamic display, the refreshing mode corresponding to the content refreshing area is determined, the setting is performed based on the refreshing display mode, the content type of the first display unit in the content refreshing area is considered, the accuracy and the rationality of setting the refreshing mode are further improved, and the display effect is improved. For example, a different refresh mode may be set for the slide display text and the slide display picture in the content refresh area.

Optionally, a fifth display unit may be further included in the page to be displayed. Optionally, the content type of the fifth display unit cannot be determined. For example, the content type of the fifth display unit is not text, picture or video, and may be marked as other types. The method for determining the refresh mode of the ink screen provided in this embodiment may further include:

and acquiring a configuration file, wherein the configuration file comprises the corresponding relation between the identification information and the refresh mode under different granularity.

And setting a refresh mode corresponding to the display area of the fifth display unit according to the corresponding relation between the identification information and the refresh mode under different granularity.

For convenience of explanation, the identification information of the fifth display unit is referred to as fifth identification information, and the identification information of the display unit may uniquely distinguish between different display units, for example, names, identification sequences, and the like.

The implementation provides a complementary solution for setting the refresh mode of the display unit, especially in a scenario where the content type of the display unit is not determined. Because the corresponding relation between the identification information and the refresh modes under different granularities is preset in the configuration file, the refresh mode corresponding to the display area of the fifth display unit can be directly set according to the configuration file.

When the granularity is different, the identification information is different.

Alternatively, the granularity may include, but is not limited to, at least one of the following: application granularity, window granularity, or control granularity.

The granularity of the application program refers to that each display unit in each page included in the application program can adopt a preset refresh mode corresponding to the application program. Under the granularity of the application program, the configuration file comprises the corresponding relation between the identification information of the application program and the refreshing mode, and the identification information of the application program can uniquely distinguish different application programs. And setting a preset refresh mode corresponding to the application program to which the fifth display unit belongs as a refresh mode corresponding to the display area of the fifth display unit under the granularity of the application program. For example, APP1 includes page 1 and page 2, page 1 includes controls 1-3, and page 2 includes controls 4-10. The refresh mode 1 is preset in the identification information of the APP 1. The fifth display unit is control 5 in page 2. Then, the refresh mode 1 corresponding to the application APP1 to which the control 5 belongs may be set as the refresh mode corresponding to the display area of the control 5.

The window granularity refers to that each display unit in each page in the window can adopt a preset refresh mode corresponding to the window. Under the granularity of the windows, the configuration file comprises the corresponding relation between the identification information of the windows and the preset refreshing mode, and the identification information of the windows can uniquely distinguish different windows. Under the granularity of the window, the refresh mode corresponding to the window to which the fifth display unit belongs may be set as the refresh mode corresponding to the display area of the fifth display unit. For example, window 1 includes page 1 and page 2, page 1 includes controls 1-3, and page 2 includes controls 4-10. The identification information of the window 1 is preset with a refresh mode 2. The fifth display element is control 3 in page 1. Then, the refresh mode 2 corresponding to the window 1 to which the control 3 belongs may be set as the refresh mode corresponding to the display area of the control 3.

The granularity of the control means that a certain display unit can adopt a preset refreshing mode corresponding to the display unit. Under control granularity, the configuration file comprises the corresponding relation between the identification information of the display unit and a preset refreshing mode, and the identification information of the display unit can uniquely distinguish different display units. And setting the refresh mode corresponding to the fifth display unit as the refresh mode corresponding to the display area of the fifth display unit under the granularity of the control. For example, as shown in fig. 5H, the fifth display unit is a control 5 in the page 9, and the refresh mode 3 is preset for the identification information of the control 5. Then, the refresh mode 3 corresponding to the control 5 may be set to the refresh mode corresponding to the display area of the control 5.

Optionally, in an implementation manner, setting a refresh mode corresponding to a display area of the fifth display unit according to a correspondence between the identification information and the refresh mode under different granularity may include: and setting a refresh mode corresponding to the display area of the fifth display unit according to the order of granularity level from small to large.

For example. The order of the granularity grade from small to large is as follows: control granularity, window granularity, and application granularity. Suppose APP1 includes window 1 and window 2. Window 1 includes page 1 and page 2, and window 2 includes page 3. Page 1 includes controls 1-3, page 2 includes controls 4-10, and page 3 includes control 11. The identification information of APP1 corresponds to refresh mode 1. The identification information of window 1 corresponds to refresh mode 2. The identification information of control 2 corresponds to refresh mode 3.

In one example, the fifth display unit is control 2 included in page 1 of window 1 in APP 1. According to the order of the granularity level from small to large, the identification information of the control 2 corresponds to the refreshing mode 3 under the minimum granularity (control granularity) can be found. Therefore, the refresh mode corresponding to the display area of control 2 is set to refresh mode 3.

In another example, the fifth display unit is control 1 included in page 1 of window 1 in APP 1. And according to the order of granularity level from small to large, no refresh mode corresponding to the identification information of the control 1 is found under the granularity of the control. The search continues at window granularity. And under the granularity of the window, setting the refresh mode corresponding to the display area of the control 1 as the refresh mode 2 when the window 1 of the page 1 to which the control 1 belongs corresponds to the refresh mode 2.

In yet another example, the fifth display unit is control 11 included in page 3 of window 2 in APP 1. According to the order of granularity level from small to large, no refresh mode corresponding to the identification information of the control 11 is found under the granularity of the control. The search continues at window granularity. And under the granularity of the window, if the refresh mode corresponding to the identification information of the window 2 to which the control 11 belongs is not found, the search under the granularity of the application program is continued. Under the granularity of the application program, the application program APP1 of the window 2 of the page 3 to which the control 11 belongs corresponds to the refresh mode 1, and the refresh mode corresponding to the display area of the control 11 is set to be the refresh mode 1.

It can be seen that the refresh mode corresponding to the display area of the fifth display unit is set in order of granularity level from small to large, the smaller the granularity level is, the higher the accuracy of the set refresh mode is, and the accuracy of setting the refresh mode is improved.

Alternatively, in another implementation, the refresh mode corresponding to the display area of the fifth display unit may be set according to a preset granularity. The preset granularity is not limited in this embodiment. The preset granularity may be, for example, a control granularity, a window granularity, or an application granularity. The implementation is easy to implement.

Alternatively, the configuration file may be updated periodically or conditionally triggered. For example, when it is determined that the display effect of the display unit in the refresh mode 1 is better, the configuration file may be updated, where the identification information of the display unit and the refresh mode 1 are corresponding.

Optionally, the electronic device may receive a configuration file sent by the cloud server.

Optionally, in the method for determining a refresh mode of an ink screen provided in this embodiment, if there are multiple pages to be displayed, where the multiple pages to be displayed include multiple pages to be displayed of an application program and/or multiple pages to be displayed corresponding to the multiple application programs, in S1402, setting, according to a content type of a first display unit, a refresh mode corresponding to a display area of the first display unit may include:

and acquiring page coverage relations among the plurality of pages to be displayed.

When the first display unit is positioned in the first page to be displayed of the highest layer, setting a refresh mode corresponding to a display area of the first display unit in the first page to be displayed according to the content type of the first display unit in the first page to be displayed.

When the first display unit is positioned in the second page to be displayed below the highest layer, determining a non-overlapping area which is not overlapped with the target page to be displayed in the display area of the first display unit in the second page to be displayed, and setting a refresh mode corresponding to the non-overlapping area according to the content type of the first display unit in the second page to be displayed. The target page to be displayed comprises the sum of the areas of all the pages to be displayed which are positioned above the second page to be displayed.

For example.

See fig. 10F. Suppose APP1 includes page 6 and page 7, i.e., the plurality of pages to be displayed includes a plurality of pages to be displayed of the same APP. Wherein page 7 is located at the upper layer of page 6. For non-web page controls 3 in page 7, the refresh mode may be set to A2 according to the content type (video) of the non-web page control 3. For non-web page control 1 in page 6, which is not obscured by web page 7, refresh mode may be set to GLR16 according to the content type (text) of non-web page control 1. For the non-web page control 2 in the page 6, which is blocked by the web page 7, there are an overlapping area and a non-overlapping area, and the non-overlapping area is shown as a dotted line box on the right side in fig. 10F, and the refresh mode of the non-overlapping area shown as the dotted line box is set as GLR16 according to the content type (text) of the non-web page control 2.

It can be seen that, by the page coverage relationship among the plurality of pages to be displayed, the first page to be displayed at the highest layer and the second page to be displayed at the lower layer can be determined. For the display units in the first page to be displayed, the display units are visible to the user, and the refresh mode can be set directly according to the content type of the display units. For the display unit in the second page to be displayed, part or all of the display area of the display unit may be blocked, and the non-blocked part is visible to the user, and the refresh mode may be set according to the content type of the display unit. The set refreshing mode is more accurate and reasonable, and the display effect is improved.

Next, a method of determining a refresh mode of an ink screen provided by the present embodiment will be described by way of example. Fig. 15 is a schematic diagram of a page to be displayed according to an embodiment of the present application, and fig. 16 is a schematic diagram of a refresh mode corresponding to each area in fig. 15. However, fig. 15 and 16 are not limited thereto.

As shown in fig. 15, a plurality of non-web page controls are included in the page 151 to be displayed. The content type of the control corresponding to the area indicated by the solid line box is video, and is marked as control 152. The content type of the control corresponding to the area indicated by the dotted line box is text, and is marked as control 153, and the controls 153 are multiple. The user may perform a drop down operation on the slider control 154 such that the area to the left of the slider control 154 is displayed in a sliding manner.

The method for determining the refresh mode of the ink screen provided in the embodiment may include:

1. in performing layout processing on the page 151 to be displayed, identifying the used controls includes: control 154, control 152, and plurality of controls 153, respectively obtain the content type and display area of each control. Wherein the content type of control 152 is video, the content type of control 153 is text, and the content type of control 154 is not determined.

2. Event information is acquired, including a content refresh zone 164, as shown in fig. 16. The content in the content refresh area 164 is displayed with sliding.

3. The multiple controls 153 are area-merged to obtain a merge area 162 and a merge area 163, as shown in fig. 16.

4. Determining that a refresh mode corresponding to a display area 161 of the control 152 is an A2 mode according to the content type (video) of the control 152; determining that the refresh mode corresponding to the merge area 162 and the merge area 163 is the GLR16 mode according to the content type (text) of the control 153; determining that the refresh mode corresponding to the content refresh zone 164 is DU mode according to the sliding display mode and the content type (text) of the control 153;

5. the display area 161 and the content refresh area 164 are determined to use a dithering algorithm according to a correspondence relationship between the refresh mode and whether the dithering algorithm is used.

Therefore, by the method for determining the refresh mode of the ink screen, the electronic device can set different refresh modes for different areas in the page, the set refresh modes are more accurate and reasonable, and the display effect is improved. In addition, the method for determining the refresh mode of the ink screen is realized on the system side, so that the workload and difficulty of an APP developer are reduced.

Based on the embodiment shown in fig. 14, another embodiment of the present application provides an implementation of a method for determining a refresh mode of an ink screen, which is applicable to the software architecture shown in fig. 13.

after layout processing, drawing processing, and layer composition processing are performed on a page to be displayed, composite display data is acquired.

The content type and the display area of the first display unit are determined from the composite display data.

Alternatively, the recognition classification of image data may be performed on the synthesized display data using an optical character recognition (optical character recognition, OCR) or the like, and different content types (e.g., text, picture, video) may be divided by regions, thereby obtaining content types and display regions of different display units.

Therefore, in the method for determining the refresh mode of the ink screen provided in this embodiment, after the page to be displayed is processed by the layout flow, the drawing flow and the diagram layer composition flow, the composite display data is generated. The electronic device obtains the content type of the display unit by analyzing the synthesized display data, so that a refresh mode corresponding to the display area of the display unit can be set. Because the electronic equipment determines the refresh mode at the system side, compared with the mode of determining the refresh mode by the APP, the workload and difficulty of an APP developer are reduced. In addition, the electronic equipment sets the refreshing mode aiming at the display unit, so that the accuracy, the suitability and the rationality of setting the refreshing mode are improved, different display effects are presented by the ink screen aiming at the display units with different content types, and the watching experience of a user is improved.

It will be appreciated that the electronic device, in order to achieve the above-described functions, includes corresponding hardware and/or software modules that perform the respective functions. The steps of an algorithm for each example described in connection with the embodiments disclosed herein may be embodied in hardware or a combination of hardware and computer software. Whether a function is implemented as hardware or computer software driven hardware depends upon the particular application and design constraints imposed on the solution. Those skilled in the art may implement the described functionality using different approaches for each particular application in conjunction with the embodiments, but such implementation is not to be considered as outside the scope of this application.

The embodiment of the application may divide the functional modules of the electronic device according to the above method example, for example, each functional module may be divided corresponding to each function, or two or more functions may be integrated into one module. It should be noted that, in the embodiment of the present application, the division of the modules is schematic, which is merely a logic function division, and other division manners may be implemented in actual implementation. It should be noted that, in the embodiment of the present application, the names of the modules are schematic, and the names of the modules are not limited in actual implementation.

Fig. 17 is a schematic structural diagram of an apparatus for determining a refresh mode of an ink screen according to an embodiment of the present application. The device for determining the refresh mode of the ink screen provided by the embodiment is used for executing the method for determining the refresh mode of the ink screen provided by the embodiment of the application, and the technical principle and the technical effect are similar.

As shown in fig. 17, the apparatus for determining a refresh mode of an ink screen provided in this embodiment may include:

a determining module 1701, configured to determine a content type and a display area of a first display unit in a page to be displayed of the application program; the first display unit is a non-web page control or a web page element in the web page control;

A setting module 1702, configured to set a refresh mode corresponding to a display area of the first display unit according to a content type of the first display unit; the refreshing mode is used for displaying a display area of the first display unit in the page to be displayed on the ink screen.

Optionally, the determining module 1701 is configured to:

and determining the content type and the display area of the first display unit when the page to be displayed is subjected to layout processing.

Optionally, the page to be displayed includes a non-web page control, the first display unit is a non-web page control, and the determining module 1701 is configured to:

identifying at least one non-web page control used when the page to be displayed is laid out, wherein the at least one non-web page control comprises the first display unit;

and determining the content type and the display area of the identified first display unit.

Optionally, the page to be displayed includes a web page control, the first display unit is a web page element, and the determining module 1701 is configured to:

acquiring at least one webpage element in a webpage control included in the webpage to be displayed in a browser kernel, wherein the at least one webpage element comprises the first display unit;

Optionally, the setting module 1702 is further configured to:

acquiring event information; the event information comprises a content refreshing area and a refreshing period corresponding to user operation in the page to be displayed, wherein the user operation is used for triggering the content in the content refreshing area to be refreshed and displayed in the refreshing period, and the content refreshing area comprises a display area of the first display unit;

and if the current moment is in the refresh period, determining a refresh mode corresponding to the display area of the first display unit according to the refresh display mode.

Optionally, the method for refreshing the display includes any one of the following: sliding display, scrolling display, page turning display, zoom-out display, or zoom-in display.

Optionally, the page to be displayed further includes a second display unit, the content types of the first display unit and the second display unit are the same, and no other content type display unit exists between the display area of the first display unit and the display area of the second display area;

The setting module 1702 is configured to:

setting a refresh mode corresponding to a target area according to the content type of the first display unit; the target area includes a display area of the first display unit, a display area of the second display unit, and a display area between the first display unit and the second display unit.

Optionally, the page to be displayed further includes a fifth display unit, and the setting module 1702 is further configured to:

acquiring a configuration file;

if the configuration file comprises the corresponding relation between the window of the page to be displayed, to which the fifth display unit belongs, and the refresh mode, corresponding to the window, of the fifth display unit is set as the refresh mode, corresponding to the display area of the fifth display unit;

or if the configuration file includes the correspondence between the application program to which the fifth display unit belongs and the refresh mode, setting the refresh mode corresponding to the application program to which the fifth display unit belongs as the refresh mode corresponding to the display area of the fifth display unit.

Optionally, the number of pages to be displayed is multiple, where the multiple pages to be displayed belong to one or more application programs, and the setting module 1702 is configured to:

Acquiring page coverage relations among the plurality of pages to be displayed;

when the first display unit is a display unit in a first page to be displayed at the highest layer, setting a refresh mode corresponding to a display area of the first display unit in the first page to be displayed according to a content type of the first display unit in the first page to be displayed;

or when the first display unit is a display unit in a second to-be-displayed page positioned under the highest layer, determining a non-overlapping area which is not overlapped with a target to-be-displayed page in a display area of the first display unit in the second to-be-displayed page, and setting a refresh mode corresponding to the non-overlapping area according to the content type of the first display unit in the second to-be-displayed page; the target page to be displayed comprises the sum of the areas of all the pages to be displayed above the second page to be displayed.

Optionally, the determining module 1701 is configured to:

after carrying out layout processing, drawing processing and layer composition processing on the page to be displayed, obtaining composite display data;

and determining the content type and the display area of the first display unit according to the synthesized display data.

Optionally, the page to be displayed further includes a third display unit, and the setting module 1702 is further configured to:

and setting a preset refresh mode of a third display unit as a refresh mode corresponding to a display area of the third display unit.

Optionally, the page to be displayed further includes a fourth display unit, the content types of the first display unit and the fourth display unit are different, and the setting module 1702 is further configured to:

and setting a refresh mode corresponding to a display area of the fourth display unit according to the content type of the fourth display unit.

Optionally, the setting module 1702 is further configured to:

and determining whether a dithering algorithm is used for the display area of the first display unit according to the refresh mode corresponding to the display area of the first display unit.

Optionally, the content type includes any one of the following: text, pictures or video.

Referring to fig. 18, a structure of an electronic device provided in an embodiment of the present application is shown, where the electronic device has an ink screen. The electronic device further includes: a processor 1801, a receiver 1802, a transmitter 1803, a memory 1804, and a bus 1805. The processor 1801 includes one or more processing cores, and the processor 1801 executes software programs and modules to perform various functional applications and information processing. The receiver 1802 and the transmitter 1803 may be implemented as a communication component, which may be a baseband chip. The memory 1804 is coupled to the processor 1801 via a bus 1805. The memory 1804 may be used for storing at least one program instruction, and the processor 1801 is used for executing at least one program instruction to implement the technical solutions of the foregoing embodiments. The implementation principle and technical effects are similar to those of the related embodiments of the method, and are not repeated here.

When the electronic device is started, the processor can read the software program in the memory, interpret and execute the instructions of the software program, and process the data of the software program. When data is required to be transmitted through the antenna, the processor carries out baseband processing on the data to be transmitted and then outputs a baseband signal to a control circuit in the control circuit, and the control circuit carries out radio frequency processing on the baseband signal and then transmits the radio frequency signal outwards in the form of electromagnetic waves through the antenna. When data is transmitted to the electronic equipment, the control circuit receives a radio frequency signal through the antenna, converts the radio frequency signal into a baseband signal, and outputs the baseband signal to the processor, and the processor converts the baseband signal into data and processes the data.

Those skilled in the art will appreciate that fig. 18 shows only one memory and processor for ease of illustration. In an actual electronic device, there may be multiple processors and memories. The memory may also be referred to as a storage medium or a storage electronic device, etc., and embodiments of the present application are not limited in this regard.

As an alternative implementation, the processor may include a baseband processor, which is mainly used to process the communication data, and a central processor, which is mainly used to execute a software program and process the data of the software program. It will be appreciated by those skilled in the art that the baseband processor and the central processing unit may be integrated into one processor or may be separate processors interconnected by bus technology or the like. Those skilled in the art will appreciate that an electronic device may include multiple baseband processors to accommodate different network formats, and that an electronic device may include multiple central processors to enhance its processing capabilities, with various components of the electronic device being connectable via various buses. The baseband processor may also be referred to as a baseband processing circuit or baseband processing chip. The central processing unit may also be expressed as a central processing circuit or a central processing chip. The function of processing the communication protocol and the communication data may be built in the processor, or may be stored in a memory in the form of a software program, which is executed by the processor to realize the baseband processing function. The memory may be integrated within the processor or separate from the processor. The memory includes a Cache memory that can hold frequently accessed data/instructions.

In the embodiments of the present application, the processor may be a general purpose processor, a digital signal processor, an application specific integrated circuit, a field programmable gate array or other programmable logic device, a discrete gate or transistor logic device, or a discrete hardware component, and may implement or execute the methods, steps, and logic blocks disclosed in the embodiments of the present application. The general purpose processor may be a microprocessor or any conventional processor or the like. The steps of a method disclosed in connection with the embodiments of the present application may be embodied directly in a hardware processor for execution, or in a combination of hardware and software modules in the processor for execution.

In the embodiment of the present application, the memory may be a nonvolatile memory, such as a hard disk (HDD) or a solid state drive (SS), or may be a volatile memory (volatile memory), for example, a random-access memory (RAM). The memory is any other medium that can be used to carry or store desired program code in the form of instructions or data structures and that can be accessed by a computer, and is not limited thereto.

The memory in the embodiments of the present application may also be circuitry or any other device capable of implementing a memory function for storing program instructions and/or data. The methods provided in the embodiments of the present application may be implemented in whole or in part by software, hardware, firmware, or any combination thereof. When implemented in software, may be implemented in whole or in part in the form of a computer program product. The computer program product includes one or more computer instructions. When loaded and executed on a computer, produces a flow or function in accordance with embodiments of the present application, in whole or in part. The computer may be a general purpose computer, a special purpose computer, a computer network, a network device, a user device, or other programmable apparatus. The computer instructions may be stored in a computer-readable storage medium or transmitted from one computer-readable storage medium to another computer-readable storage medium, e.g., from one website, computer, server, or data center, by wired (e.g., coaxial cable, fiber optic, digital subscriber line (digital subscriber line, DSL), or wireless (e.g., infrared, wireless, microwave, etc.) means, the computer-readable storage medium may be any available medium that can be accessed by a computer or a data storage device such as a server, data center, etc., that contains an integration of one or more available media, the available media may be magnetic media (e.g., floppy disk, hard disk, tape), optical media (e.g., digital video disc (digital video disc, DWD), or semiconductor media (e.g., SSD), etc.

The embodiments of the present application provide a computer program product, when the computer program product runs on an electronic device, to enable the electronic device to execute the technical solution in the embodiment of the method, and the implementation principle and technical effects are similar to those of the related embodiments, which are not repeated herein.

An embodiment of the present application provides a computer readable storage medium, on which program instructions are stored, which when executed by an electronic device, cause the electronic device to execute the technical solution of the foregoing embodiment. The principle and technical effects of the present invention are similar to those of the above-described related embodiments, and will not be described in detail herein.

In summary, the above embodiments are only for illustrating the technical solution of the present application, and are not limited thereto; although the present application has been described in detail with reference to the foregoing embodiments, it should be understood by those of ordinary skill in the art that: the technical scheme described in the foregoing embodiments can be modified or some technical features thereof can be replaced by equivalents; such modifications and substitutions do not depart from the spirit of the corresponding technical solutions from the scope of the technical solutions of the embodiments of the present application.

Claims

1. A method of determining a refresh mode of an ink screen, comprising:

Determining the content type and the display area of a first display unit in a page to be displayed of an application program; the first display unit is a non-web page control or a web page element in the web page control;

setting a refresh mode corresponding to a display area of the first display unit according to the content type of the first display unit; the refreshing mode is used for displaying a display area of the first display unit in the page to be displayed on the ink screen.

2. The method of claim 1, wherein determining the content type and the display area of the first display unit in the page to be displayed of the application program comprises:

3. The method of claim 2, wherein the page to be displayed includes a non-web page control, the first display unit is a non-web page control, and the determining the content type and the display area of the first display unit includes:

4. The method of claim 2, wherein the page to be displayed includes a web page control, the first display unit is a web page element, and the determining the content type and the display area of the first display unit includes:

5. The method according to any one of claims 1-4, further comprising:

6. The method of claim 5, wherein the manner of refreshing the display comprises any one of: sliding display, scrolling display, page turning display, zoom-out display, or zoom-in display.

7. The method according to any one of claims 1 to 4, wherein the page to be displayed further comprises a second display unit, the content types of the first display unit and the second display unit are the same, and no other content type display unit is arranged between the display area of the first display unit and the display area of the second display area;

the setting the refresh mode corresponding to the display area of the first display unit according to the content type of the first display unit includes:

8. The method according to any one of claims 1-4, wherein a fifth display unit is further included in the page to be displayed, the method further comprising:

Acquiring a configuration file;

9. The method according to any one of claims 1-8, wherein the number of pages to be displayed is a plurality, the plurality of pages to be displayed belong to one or more application programs, and the setting the refresh mode corresponding to the display area of the first display unit according to the content type of the first display unit includes:

acquiring page coverage relations among the plurality of pages to be displayed;

when the first display unit is a display unit in a first page to be displayed at the highest layer, setting a refresh mode corresponding to a display area of the first display unit in the first page to be displayed according to the content type of the first display unit in the first page to be displayed;

10. The method of claim 1, wherein determining the content type and the display area of the first display unit in the page to be displayed of the application program comprises:

11. The method according to any one of claims 1-10, wherein the page to be displayed further comprises a third display unit, and the method further comprises:

12. The method according to any one of claims 1-11, further comprising a fourth display unit in the page to be displayed, wherein the content types of the first display unit and the fourth display unit are different, and the method further comprises:

13. The method according to any one of claims 1-11, further comprising:

14. The method according to any one of claims 1-11, wherein the content type comprises any one of the following: text, pictures or video.

15. An electronic device comprising a processor configured to couple to a memory and to read instructions in the memory and to cause the electronic device to perform the method of any of claims 1-14 in accordance with the instructions.

16. A computer readable storage medium storing computer instructions which, when run on an electronic device, cause the electronic device to perform the method of any one of claims 1-14.

17. A computer program product comprising instructions which, when run on an electronic device, cause the electronic device to perform the method of any of claims 1-14.